Jobless Developer
Quantcast logo
Quantcast

Posted 2 months ago

Open

Software Engineer (Big Data)

San FranciscoHybridFull-time

AI Summary

Software Engineer for Quantcast's Big Data Services team focusing on building, maintaining, and optimizing large-scale data processing systems to support analytics and modeling workflows.

About this role

At Quantcast, we don't just build advertising technology, we revolutionize how it works. Our AI-powered Demand Side Platform (DSP) connects the world's most ambitious marketers with their ideal audiences across the open internet, delivering results that actually move the needle. Since 2006, we've been the industry's trailblazer, launching the first AI-powered measurement platform for publishers and the first AI-driven DSP. Our AI doesn't just optimize—it delivers the measurable outcomes that matter most to our clients, giving them the competitive edge they need in a crowded marketplace. Ready to join the team that's defining the future of digital advertising?

We are seeking a Software Engineer to join our Big Data Services team. This role focuses on building, maintaining, and optimizing large-scale data processing systems while supporting the needs of our data science and engineering teams.
You will work closely with engineers, data scientists, and researchers to ensure a reliable, scalable, and efficient data infrastructure that powers advanced analytics and modeling workflows.
The primary focus of the team is driving and developing systems and services that enable Quantcast to scale its distributed storage and compute platform. The ideal candidate has a passion for large-scale distributed systems (e.g., HDFS and Spark).

What you'll do:

  • Contribute to the development and optimization of large-scale data workflows using technologies such as Apache Spark or similar frameworks

  • Develop and operate our large scale data processing systems, making them more elastic and fault tolerant, solving distributed data and compute challenges

  • Assist in deploying and maintaining production systems, including CI/CD workflows

  • Provide technical input into roadmaps for the team

  • Write clean, maintainable, and well-tested code

    • Who you are:

  • Recent graduate (0-1 years) with a Bachelor's Degree in computer science or equivalent experience

  • You must be work-authorized in the United States without the need for current or future employer sponsorship. We are not currently able to engage candidates on OPT.

  • Familiarity with data processing frameworks such as Apache Spark, Hadoop, or similar.

  • Familiarity with containerization tools (e.g., Docker and Kubernetes)

  • Experience with workflow orchestration tools (e.g., Airflow) is a plus

  • Proficient in Java and/or Python programming languages

  • Linux system administration/automation is a plus

  • Strong problem-solving and debugging skills

  • Organized and detail-oriented

    • What you'll learn in this role:

    • Hands-on experience with large-scale distributed systems in production

    • Exposure to real-world data science and modeling workflows

    • Best practices in building scalable and reliable data infrastructure

    • Collaboration across engineering and modeling teams

    Skills

    AirflowApache SparkCI/CDContainerizationData Processing FrameworksData WorkflowsDistributed SystemsDockerHadoopJavaKubernetesLinuxProduction SystemsPythonScalaWorkflow Orchestration

    Explore related jobs

    More jobs at Quantcast

    Similar Airflow jobs

    Jobs in San Francisco

    Browse these categories

    Airflow JobsCI/CD JobsContainerization JobsDistributed Systems JobsDocker Jobs