Jobless Developer
TechBlocks. In logo

Posted 1 month ago

Sr AI Data EngineerTechBlocks. In · Gurugram

Sr AI Data Engineer

GurugramOn-siteFull-time

AI Summary

Designs and builds production-grade data ingestion and transformation pipelines on Databricks and Microsoft Fabric, integrating enterprise ERP, planning and HR systems, and develops LLM/AI agents and MCP servers in Python for governed data access.

About this role

Required Skills & Experience
    • 7+ years of experience in Data Engineering.
    • Minimum 3 years of hands-on experience with Databricks.
    • Strong hands-on experience with:
    • PySpark
    • Delta Lake
    • Databricks Workflows
    • Unity Catalog
    • Strong SQL development and optimization skills.
    • Strong experience in dimensional data modelling and star schemas.
    • Hands-on experience with Slowly Changing Dimensions (SCD).
    • Experience building production-grade data ingestion and transformation pipelines.
    • Experience integrating multiple enterprise source systems, preferably ERP, planning and HR systems.
    • Hands-on experience integrating Databricks with Microsoft Fabric.
    • Good understanding of:
    • Microsoft OneLake
    • Fabric Lakehouses
    • OneLake shortcuts
    • Proven hands-on experience building LLM/AI agents using Python.
    • Proven hands-on experience building MCP servers using Python in a real-world project.
    • Understanding of secure and governed access for AI agents and tools.
    • Strong understanding of data quality, reconciliation, lineage and data governance.
    • Ability to work with business and technical stakeholders to translate requirements into data solutions.

Strongly Preferred Skills
    • Experience in Finance, FP&A or financial data engineering.
    • Strong understanding of:
    • GL structures
    • Budgets
    • Forecasts
    • Estimates
    • Allocations
    • Cost centres
    • Financial planning scenarios
    • Experience with TBM (Technology Business Management) classification or similar financial classification frameworks.
    • Experience building AI-powered data engineering or ingestion solutions.
    • Experience with agentic workflows for data mapping, classification and anomaly detection.
    • Experience with additional LLM frameworks such as LangChain, LangGraph or similar.
    • Experience with enterprise AI governance and secure AI/data access.
    • Experience with Databricks data governance and lineage.
    • Experience implementing automated data reconciliation and financial controls.
    • Experience working with Microsoft Fabric-based enterprise analytics environments.

Skills

DatabricksDatabricks WorkflowsData GovernanceData LineageData ReconciliationDelta LakeDimensional ModellingFabric LakehouseLangChainLangGraphLLM AgentsMCP ServersMicrosoft FabricOneLakePySparkPythonSlowly Changing DimensionsSQLStar SchemaUnity Catalog

Explore related jobs

Browse these categories

Market data for data engineer roles

All reports →