Company: DoubleVerify

Role: Senior Data Engineer II (P4) - Social Integrations

Type: Full Time

Reports To: Team Lead, Social Integration

Location: New York, NY

Who we are

DoubleVerify is the leading independent provider of marketing measurement software, data, & analytics that authenticates the quality & effectiveness of digital media for the world's largest brands & media platforms. DV provides media transparency & accountability to deliver the highest level of impression quality for maximum advertising performance. Since 2008, DV has helped hundreds of Fortune 500 companies gain the most from their media spending by delivering best-in-class solutions across the digital ecosystem, helping to build a better industry. Learn more at www.doubleverify.com.

The Role

As a Senior Data Engineer II in Social Integrations, you own new initiatives, & design & build world-class data systems to ingest & analyze billions of records per day from the worlds biggest social platforms, like Facebook, Youtube, Snap, & more. You build high-volume, high-availability, low-latency APIs to support live traffic metrics collection. You develop systems that analyze & categorize social content to power tools that allow advertisers to understand & control where their ads run.  You use state-of-the-art technologies, frameworks, & strategies to address complex challenges with Big-Data processing & analytics to achieve the above objectives.

What youll do

• Write solid code with a focus on high performance for services supporting high-throughput & low-latency
• Architect, design, & build big-data-processing platforms, handling tens of TBs/day, serve thousands of clients & support advanced analytic workloads
• Provide meaningful & relevant feedback to junior developers & stay up-to-date with technology changes
• Explore the technological landscape for new ways of producing, processing, & analyzing data, in order to gain insights on our users & product features
• Design, develop, & test data-driven products, features, & APIs that scale
• Continuously improve the quality of deliverables & SDLC processes
• Operate production environments, investigate issues, assess their impact, & come up with feasible solutions
• Understand business needs & work with product owners to establish priorities 
• Translate between business / product requirements & technical details
• Work in multi-functional agile teams with end-to-end responsibility for product development & delivery

Who you are

• 5+ years of programming experience in coding, object-oriented design, and/or functional programming including Python, Scala, or related language
• Lead by example - design, develop & deliver quality solutions
• Love what you do & are passionate about crafting clean code 
• Deep understanding of distributed system technologies, standards, & protocols, & have 2+ years of experience working in distributed systems like Airflow, BigQuery, Spark Streaming, Kafka ecosystem ( Kafka Connect, Kafka Streams, or Kinesis), & building data pipelines at scale
• Hands-on experience building low-latency, high-throughput APIs, & comfortable using external APIs from platforms
• Expertise in relational database concepts, data modeling & crafting complex SQL queries
• Cares about agile software processes, data-driven development, software reliability, & responsible experimentation
• Genuine desire to automate decision-making, processes, & workflows
• Experience working with process orchestration tools such as Luigi/Airflow
• Experience with DevOps domain - working with build servers, docker, & containers clusters (kubernetes)
• Experience mentoring & growing a diverse team of talented data engineers
• B.S./M.S. in Computer Science or a related field
• Excellent communication skills & a team player
• Experience with the following technologies is a plus:
• Columnar data stores
• Cloud environment, Google Cloud Platform 
• Ad-serving technologies & standards