
Posted 2 days ago
Databricks Data Engineering Manager (AWS/AZURE)Ccube · Mississauga
Databricks Data Engineering Manager (AWS/AZURE)
MississaugaOn-siteFull-time
AI Summary
Leads and manages data engineering teams to design and deliver scalable Databricks-based lakehouse and data platforms on AWS and/or Azure, including ETL/ELT pipelines, governance, and team mentorship.
About this role
We are looking for a Senior Databricks Manager to design and lead scalable, secure, and high-performance cloud data platforms across AWS and/or Azure." Mississauga, ON (Hybrid – 3 Days Onsite Per Week) .
Job Title: Databricks Data Engineering Manager – (AWS/Azure)Location: Mississauga, ON (Hybrid – 3 Days Onsite Per Week)
Employment Type: Full-Time/CTH
Key Responsibilities
- Lead and manage Data Engineering teams responsible for building enterprise-scale data platforms using Databricks on AWS and/or Azure.
- Drive end-to-end delivery of modern data engineering solutions, including Data Lakes, Lakehouses and Data Warehouses.
- Define and implement scalable data engineering strategies, architecture standards and best practices.
- Lead the design and implementation of Medallion Architecture (Bronze, Silver and Gold layers).
- Oversee the development of robust ETL/ELT pipelines, batch processing and real-time streaming solutions.
- Ensure data platform scalability, reliability, performance optimization and cost efficiency.
- Drive engineering excellence through code reviews, CI/CD automation, DevOps practices and reusable frameworks.
- Establish data governance, data quality, security and compliance standards across data platforms.
- Collaborate with Enterprise Architects, Product Owners, Business Stakeholders and cross-functional teams.
- Manage project execution, resource allocation, delivery timelines, risks and technical dependencies.
- Mentor and develop Data Engineers, Senior Engineers and Technical Leads.
- Drive cloud data modernization initiatives and continuous improvement across engineering processes.
- 10+ years of experience in Data Engineering, with at least 2–4 years in a Data Engineering Manager / Technical Lead / Engineering Lead role.
- Strong hands-on experience with Databricks and Apache Spark.
- Expertise in AWS and/or Azure cloud data platforms.
- Strong understanding of Data Lakes, Lakehouses, Data Warehousing and Medallion Architecture.
- Experience designing and implementing scalable ETL/ELT pipelines and data integration frameworks.
- Strong proficiency in SQL and Python/PySpark.
- Experience with Kafka, Airflow, dbt or equivalent orchestration and streaming technologies.
- Experience with structured, semi-structured and unstructured data.
- Strong understanding of Data Governance, Security, CI/CD, DevOps and data quality frameworks.
- Proven experience managing engineering teams, technical delivery and stakeholder expectations.
- Excellent leadership, communication, problem-solving and people management skills.
· PMP, PMI-ACP, CSM or SAFe certifications.
- AWS/Azure cloud certifications.
- Databricks certifications.
- Snowflake experience.
- Experience with Data Mesh and enterprise data architecture.
- Exposure to MLOps, AI/ML data platforms and GenAI data engineering.
- Experience managing distributed engineering teams and Agile delivery models.
Skills
AirflowApache SparkAWSAzureCI/CDDatabricksData GovernanceData LakesData QualityData WarehousingDbtKafkaLakehouseMedallion ArchitecturePySparkPythonSnowflakeSQL
Explore related jobs
More jobs at Ccube
Similar AWS jobs
- J
Airflow Platform EngineerJade Global Software Pvt LTD · Hyderabad, Telangana - S
Airflow Python DeveloperSutherland · Hyderabad, TS - C
Category Manager - AirflowCFO Trane U.S. Inc.-CFO · Davidson, North Carolina - B
Airflow Operator 3rd ShiftBurke Aerospace · Farmington, Connecticut - C
Sr. Mechanical Engineer - AirflowCFO Trane U.S. Inc.-CFO · Clarksville, Tennessee - E
Solutions Engineer(Python/Airflow)Edb · Remote - United States
Browse these categories
Market data for data engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.