Posted 6 months ago

Data Engineer

Foster City, CARemoteFull-time

AI Summary

Data Engineer designs, builds, and maintains data pipelines and infrastructure to transform autonomous-vehicle data at scale, enabling analytics and data-driven decision making across Zoox.

About this role

The Data team leverages data from our autonomous vehicles and operations to determine autonomy and service readiness. We provide the foundation for strategic decision-making at Zoox. You will develop and implement the next generation of our data pipeline to ensure visibility into our business as we scale toward the launch of an autonomous mobility service. You will define the system and build the pipeline to enable Zoox to develop and scale with a data-first culture.

You will join a diverse, experienced team with rapidly growing scope and responsibility while also having access to one of the most unique data sets in the autonomous vehicle industry. Hence, we are seeking all skill levels to grow with the team.

In this role, you will:

Design, build, and maintain the infrastructure that transforms autonomous vehicle data at scale to support analytics throughout the company

Define and execute on how data from perception, prediction, planning and other parts of the autonomous stack is consumed to generate valuable insights by data scientists, engineers, and business users

Establish robust data integrity monitoring so that company-wide metrics are based on accurate data

Partner with engineering and product teams to define data consumption patterns and establish best practices

Qualifications

BS/MS degree in a technical field

Experience designing and building complex data modeling at scale

Advanced Structure Query Language (SQL) and data warehousing experience

Experience operating a workflow manager such as Airflow

Experience with large scale streaming platforms (e.g. Kafka, Kinesis), processing frameworks (e.g. Spark, Hadoop) and storage engines (e.g. HDFS, HBase)

Bonus Qualifications

Exceptional Python or Scala skills

Basic fluency in C++

Familiarity with or exposure to experimentation platforms

A strong DataOps mindset and opinions on next-generation warehousing tools

Skills

AirflowC++Data Integrity MonitoringData ModelingData WarehousingHadoopHBaseHDFSKafkaKinesisProcessing FrameworksPythonScalaSparkSQLStreaming PlatformsWorkflow Management

Data Engineer

About this role

In this role, you will:

Qualifications

Bonus Qualifications

Skills

Explore related jobs

More jobs at Zoox

Similar Airflow jobs

Browse these categories