Jobless Developer
Zencore logo
Zencore

Posted 47 months ago

Open

Senior Data Engineer

LATAMRemoteFull-time

AI Summary

Senior Data Engineer designs and optimizes large-scale data pipelines in Google Cloud, focusing on ETL/ELT, data warehousing, and streaming with Spark, Beam/Dataflow, or Flink. Acts as a trusted advisor to customers during data and application modernization.

About this role

Zencore is a fast-growing company founded by former Google Cloud leaders, architects, and engineers. We are seeking candidates with significant experience in Google Cloud to join our team. Our engagements aim to eliminate obstacles, reduce risk, and accelerate timelines for customers transitioning to Google and seeking assistance with data and application modernization. We embed within customer teams to provide strategic guidance, facilitate technology decisions, and execute projects in a collaborative, co-development style.

What you will do...

As a member of our Data Engineering team, you will be working with fast-paced innovative companies, leveraging Cloud as the key driver of their transformation. They will look at you as their trusted advisor, someone they can rely on and who will be there to help them along their journey on Google Cloud. You will be expected to cover a large spectrum of technology topics like ETL/ELT, Data Warehousing, Distributed Data Processing, and Streaming Data systems.

Responsibilities:

Design, build, and optimize large-scale distributed data pipelines using Apache Beam / Google Cloud Dataflow, Apache Spark, or Apache Flink.
Develop ETL/ELT workflows on GCP integrating multiple structured and unstructured data sources.
Address schema, type conversion, and performance optimization challenges when migrating data warehouses to BigQuery.
Implement observability, monitoring, logging, and error-handling within pipelines.
Collaborate with Data Analysts to integrate validation rules, QA checks, and automated testing into the pipeline lifecycle.
Support large-scale data migrations and performance tuning for high-volume workloads.

Who we need...

  • 4+ years working as a Data Engineer in modern cloud environments.
  • 2+ years hands-on experience in GCP (BigQuery, Dataflow, Dataform, Composer, Dataproc, Pub/Sub).
  • Strong experience with distributed data processing frameworks (experience in at least one is required)
  • Apache Beam / Google Cloud Dataflow
  • Apache Spark
  • Apache Flink
    • Proficiency in:
  • Python (pipeline development)
  • SQL (Oracle + BigQuery dialects ideal)
  • Apache Airflow (orchestration)
  • Experience with big data workloads, batch/streaming pipelines, and large-scale data migrations.
  • Experience with data warehousing (BigQuery, Snowflake, Databricks a plus).
  • Familiarity with CI/CD, MLOps, or data quality frameworks is an advantage.

    • Why work here...

  • We are professionals you can Trust. Our people have the extensive experience to get the job done
  • We share unbiased opinions and are comfortable with the hard truths. You are the subject matter experts for our customers.
  • We are the Missing Link. You will connect our customers to Google and move quickly when others can’t
  • We remove uncertainty and risk by clearly outlining the process of cloud migration for our customers
  • We accelerate timelines and do not dwell on a challenge. You’ll move faster and expose “unknown unknowns” for our customers
  • We show empathy. Our customers believe in us because we can relate to their complexities.

    • How to succeed...

  • First rule at Zencore - Be Kind
  • Own the process - own your customer’s success by proactive practices
  • Work hard to reach the destination, but make sure to enjoy the journey
  • Champion a consistent collaborative culture
  • Be receptive to Feedback
  • Challenge the Status Quo

    • Skills

    AirflowApache Beam / Google Cloud DataflowApache FlinkApache SparkCI/CD FamiliarityComposerData MigrationsDataprocData Quality Frameworks FamiliarityData Validation & QAData WarehousingDistributed Data ProcessingETL/ELTGCP DataformGoogle Cloud Platform (BigQuery, Dataflow, Dataform, Composer, Dataproc, Pub/Sub)MLOps FamiliarityObservability / Monitoring / LoggingPub/SubPythonSQL DialectsSQL (Oracle + BigQuery Dialects Ideal)Streaming Data Systems

    Explore related jobs

    More jobs at Zencore

    Similar Airflow jobs

    Browse these categories

    Remote JobsAirflow JobsData Warehousing JobsETL/ELT JobsPython Jobs