Senior Data Engineer
LATAMRemoteFull-time
AI Summary
A senior data engineer designs, builds, and optimizes large-scale data pipelines for cloud migration projects, serving as a trusted advisor to accelerate customers' transitions to Google Cloud.
About this role
Zencore is a fast-growing company founded by former Google Cloud leaders, architects, and engineers. We are seeking candidates with significant experience in Google Cloud to join our team. Our engagements aim to eliminate obstacles, reduce risk, and accelerate timelines for customers transitioning to Google and seeking assistance with data and application modernization. We embed within customer teams to provide strategic guidance, facilitate technology decisions, and execute projects in a collaborative, co-development style.
What you will do...
As a member of our Data Engineering team, you will be working with fast-paced innovative companies, leveraging Cloud as the key driver of their transformation. They will look at you as their trusted advisor, someone they can rely on and who will be there to help them along their journey on Google Cloud. You will be expected to cover a large spectrum of technology topics like ETL/ELT, Data Warehousing, Distributed Data Processing, and Streaming Data systems.
Responsibilities:
Design, build, and optimize large-scale distributed data pipelines using Apache Beam / Google Cloud Dataflow, Apache Spark, or Apache Flink.
Develop ETL/ELT workflows on GCP integrating multiple structured and unstructured data sources.
Address schema, type conversion, and performance optimization challenges when migrating data warehouses to BigQuery.
Implement observability, monitoring, logging, and error-handling within pipelines.
Collaborate with Data Analysts to integrate validation rules, QA checks, and automated testing into the pipeline lifecycle.
Support large-scale data migrations and performance tuning for high-volume workloads.
Who we need...
Proficiency in:
Why work here...
How to succeed...
Skills
Apache AirflowApache BeamApache FlinkApache SparkGoogle Cloud BigQueryGoogle Cloud ComposerGoogle Cloud DataflowGoogle Cloud DataprocGoogle Cloud Pub/SubOraclePythonSQL
Explore related jobs
More jobs at Zencore
Similar Apache Airflow jobs
- Data Engineer LATAM (Python/PySpark/AWS Glue/Amazon Athena/SQL/Apache Airflow)Wizdaa · Remote job
- Software Engineer 3 - Linux/Bash/Python/Apache Airflow/SQL/Jupyter Notebook/NumPy/JSONCaptivation Software · Annapolis Junction, Moldova
- LSenior Data Engineer BrazilLinkedIn Job Wrapping · Avenida das Nações Unidas, 12901
