
Posted 1 day ago
Senior Data EngineerCloud Kaptan · Kolkata
Senior Data Engineer
KolkataOn-siteFull-time
AI Summary
Architects, builds and maintains cloud data warehouses and ETL/ELT pipelines on Databricks, Azure Data Factory and AWS Glue, builds dashboards for stakeholders, and leads and mentors the Analytics team.
About this role
Senior Data Engineer
We are seeking a highly skilled and self-motivated Senior Data Engineer with strong experience in Databricks, Azure Data Factory, AWS Glue and BI visualisation to build and maintain modern cloud data platforms and lead our Analytics team. You will work closely with clients and cross-functional teams to turn data into insights that drive business decisions.
Key Responsibilities
- Architect, build and maintain data warehouses and our next-gen cloud data platform.
- Design and implement scalable data models and ETL/ELT pipelines using Databricks, Azure Data Factory and AWS Glue.
- Conduct deep data analysis and build insightful dashboards and visualisations for internal and client stakeholders.
- Lead and mentor the Analytics team, setting standards for data modelling, code quality and delivery.
- Ensure data quality, governance and compliance across the data lifecycle.
- Own source version control, CI/CD and release/change management for data products.
- Automate data sourcing, visualisation and analytics products to reduce manual effort.
- Work with cross-functional teams and clients to turn business problems into data-driven solutions.
Must-Have Qualifications
- Bachelor's/Master’s degree in Computer Science, IT, Data Science or related field.
- 5+ years of industry experience in data engineering, cloud services or BI and analytics, including team leadership or mentoring.
- Strong hands-on experience with Databricks (Spark/PySpark), Azure Data Factory and AWS Glue.
- Strong SQL and Python skills.
- Experience with at least one Data Warehousing/Analytics tool (Azure Synapse Analytics, SQL Database, Snowflake, AWS Redshift, RDS).
- Experience with at least one Visualisation tool (Tableau, Power BI, QuickSight, Sisense).
- At least one cloud data certification (Databricks Data Engineer, Microsoft Fabric DP-700, AWS Data Engineer, Snowflake SnowPro).
- Experience with Git, CI/CD and release/change management.
- Excellent communication and collaboration skills, including client-facing work.
Nice-to-Have Skills
- Experience with dbt or Airflow.
- Data governance and privacy compliance in financial services.
- Fintech or lending domain experience, or Salesforce data integration.
- Experience with Delta Lake, Unity Catalog or lakehouse architecture.
Skills
AirflowAWS GlueAWS RedshiftAzure Data FactoryAzure Synapse AnalyticsCI/CDDatabricksData WarehousingDbtDelta LakeGitPower BIPySparkPythonQuickSightSnowflakeSQLTableau
Explore related jobs
More jobs at Cloud Kaptan
Similar AWS Glue jobs
- J
Airflow Platform EngineerJade Global Software Pvt LTD · Hyderabad, Telangana - S
Airflow Python DeveloperSutherland · Hyderabad, TS - B
Airflow Operator 3rd ShiftBurke Aerospace · Farmington, Connecticut - E
Solutions Engineer(Python/Airflow)Edb · Remote - United States - H
Laser Deburring Technician-AirflowHanwha Aerospace USA · East Windsor, CT - O
Data Engineer (Python, Airflow, Snowflake)OPTIVEUM sp. z o.o. · Gdańsk, Poland
Jobs in Kolkata
- G(new) Business Development - KolkataGroupon · Kolkata, India
- E
Tech SupportEasebuzz Pvt Ltd · Kolkata, West Bengal - S
Digital Marketing SpecialistSentient Geeks · Kolkata, WB - S
Dot Net DeveloperSentient Geeks · Kolkata, WB - S
AI/ML EngineerSentient Geeks · Kolkata, WB - S
Internship ProgrammeSentient Geeks · Kolkata, WB
Browse these categories
Market data for data engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.