Azure Data Engineer

Must Have: Certification: Required – Microsoft Certified: Azure Data Engineer Associate (or higher), Azure Data Factory,

Job Summary:

We are seeking a highly skilled Data Engineer with strong expertise in ** Azure Data Factory **, ** Azure Databricks **, ** Oracle **, and ** PostgreSQL **. The ideal candidate will design and implement robust data pipelines, optimize data flows, and contribute to our cloud data platform initiatives using the Microsoft Azure ecosystem.

Key Responsibilities:

• Design, build, and maintain scalable data pipelines using Azure Data Factory and ** Databricks (Spark-based)**.
• Ingest, transform, and orchestrate data from various sources including Oracle and ** PostgreSQL** databases.
• Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and deliver clean, reliable data.
• Optimize performance of data workflows, especially within Azure environments.
• Implement data quality checks, lineage tracking, and monitoring processes.
• Follow and contribute to data governance, security, and compliance policies.
• Participate in code reviews, documentation, and continuous improvement initiatives.

Required Skills & Experience:

• Strong hands-on experience with Azure Data Factory and ** Azure Databricks** (PySpark/Scala preferred).
• Solid working knowledge of Oracle and ** PostgreSQL** databases, including writing efficient SQL queries.
• Proficient in building ETL/ELT workflows and data orchestration on Azure.
• Experience with Azure storage solutions (Blob Storage, ADLS Gen2).
• Strong understanding of data modeling, warehousing concepts, and performance optimization.
• Familiarity with CI/CD pipelines in Azure DevOps is a plus.
• Excellent problem-solving skills and ability to work independently or in a team.