Windfall is seeking a Sr. Data Engineer to join our data team. As a Sr. Data Engineer on our data team, you will be building out the core data asset that everything else at Windfall is built on top of. Communication and collaboration are at the heart of Windfall, and you will work closely with our product, data science, and other engineering teams. You will personally design and build the pipelines for massive datasets, taking them all the way from inception to exploration to production and customer use.

We’re on a mission to change how organizations perceive and use people data. And we hold true to our core values of: (1) Be an excellent communicator; (2) Operate with transparency; (3) Provide leverage, not optimization; (4) Win When Our Customers Win; and (5) Act with integrity and trust.

Responsibilities:

Construct data pipelines to ingest and merge billions of individual entities into Windfall’s core data asset

Work closely with our data science team to run ML models on top of billions of data points

Build supporting data services and applications to orchestrate and monitor our data systems

Some technology you will use:

Cloud platform - GCP

Programming languages - Java, Python, and Kotlin

Data warehouse & databases - BigQuery, Postgres, Scylla/Cassandra

Distributed processing frameworks - Dataflow (Apache Beam) and Apache Spark

Orchestration - Airflow

Requirements:

4-8 years of professional data engineering experience

Significant experience working with Apache Beam/Spark/Flink or MapReduce

Strong Object-oriented programming ability in a JVM language

Expert knowledge of distributed data processing

Familiarity with different datastores, their differences, and appropriate usages

Experience at a sub-200 person company

You communicate as well as you code

You can simplify complex problems into simple solutions

You balance a strong sense of ownership and responsibility in your work with collaboration and team alignment

You are comfortable making trade-offs between quality, complexity, and speed-of-delivery

Preferred Qualifications:

Proven experience taking a large project from ideation to production

Experience leading greenfield projects

Working knowledge of cloud-native data engineering infrastructure

Data Engineer

About this role

Responsibilities:

Some technology you will use:

Requirements:

Preferred Qualifications:

Explore related jobs

More jobs at Windfall

Jobs in San Francisco

Browse these categories