Jobless Developer
Windfall logo
Windfall

Open since Jun 2026

Data EngineerWindfall · San Francisco

Data Engineer

San FranciscoHybridFull-time

AI Summary

Builds and owns the core data asset by designing and constructing large-scale data pipelines from inception to production, collaborating with data science and engineering teams to support ML models and customer-facing data services.

About this role

Windfall is seeking a Sr. Data Engineer to join our data team. As a Sr. Data Engineer on our data team, you will be building out the core data asset that everything else at Windfall is built on top of. Communication and collaboration are at the heart of Windfall, and you will work closely with our product, data science, and other engineering teams. You will personally design and build the pipelines for massive datasets, taking them all the way from inception to exploration to production and customer use.
We’re on a mission to change how organizations perceive and use people data. And we hold true to our core values of: (1) Be an excellent communicator; (2) Operate with transparency; (3) Provide leverage, not optimization; (4) Win When Our Customers Win; and (5) Act with integrity and trust.

Responsibilities:

  • Construct data pipelines to ingest and merge billions of individual entities into Windfall’s core data asset
  • Work closely with our data science team to run ML models on top of billions of data points
  • Build supporting data services and applications to orchestrate and monitor our data systems

    • Some technology you will use:

  • Cloud platform - GCP
  • Programming languages - Java, Python, and Kotlin
  • Data warehouse & databases - BigQuery, Postgres, Scylla/Cassandra
  • Distributed processing frameworks - Dataflow (Apache Beam) and Apache Spark
  • Orchestration - Airflow

    • Requirements:

  • 4-8 years of professional data engineering experience
  • Significant experience working with Apache Beam/Spark/Flink or MapReduce
  • Strong Object-oriented programming ability in a JVM language
  • Expert knowledge of distributed data processing
  • Familiarity with different datastores, their differences, and appropriate usages
  • Experience at a sub-200 person company
  • You communicate as well as you code
  • You can simplify complex problems into simple solutions
  • You balance a strong sense of ownership and responsibility in your work with collaboration and team alignment
  • You are comfortable making trade-offs between quality, complexity, and speed-of-delivery

    • Preferred Qualifications:

  • Proven experience taking a large project from ideation to production
  • Experience leading greenfield projects
  • Working knowledge of cloud-native data engineering infrastructure

    • Skills

    Apache AirflowApache BeamApache SparkBigQueryCassandraData Pipeline DesignDistributed Data ProcessingGCPGreenfield Project DevelopmentJavaKotlinObject-oriented ProgrammingPostgreSQLPythonScylla

    Explore related jobs

    More jobs at Windfall

    Similar Apache Airflow jobs

    Jobs in San Francisco

    Browse these categories

    GCP JobsJava JobsPostgreSQL JobsPython JobsJobs in San Francisco

    Market data for data engineer roles

    All reports →