
Open since Sep 2026
Data Engineer
AI Summary
Designs, builds, and maintains scalable data pipelines and real-time ingestion systems using Databricks, PySpark, Delta Lake, and Kafka to power digital twin platforms and AI/ML workloads.
About this role
About Gradera
Gradera defines a new category of enterprise transformation called Software-Orchestrated Services™ - where software orchestrates human expertise, digital workers, and enterprise systems to deliver governed outcomes at scale. As an AI Native Services firm, we help enterprises redesign how work gets done across operations, product, engineering, customer experience, data, and enterprise workflows to move beyond fragmented AI pilots and disconnected automation toward measurable business outcomes
Overview
We are seeking skilled Data Engineers to join our Data & Digital Twin Foundation team. You will design, build, and maintain data pipelines that power digital twin platforms, real-time operational systems, and AI/ML workloads. Working closely with data architects, simulation engineers, and ML teams, you will transform raw operational data into high-quality, governed datasets that drive intelligent decision-making.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using Databricks, PySpark, and Delta Lake
Build real-time and batch data ingestion pipelines from diverse operational systems using high-performance Kafka data pipelines.
Implement data transformations that serve digital twin platforms and operational analytics
Integrate Kafka event streams with Databricks for real-time operational state updates
Implement data quality checks using Delta Live Tables expectations
Ensure data governance compliance through Unity Catalog (lineage, access control, metadata)
Optimize pipeline performance, reliability, and cost efficiency
Write clean, well-documented, and testable code following engineering best practices
Collaborate with ML engineers to deliver feature-engineered datasets
Participate in code reviews, knowledge sharing, and continuous improvement initiatives
Support production data systems through monitoring, troubleshooting, and incident resolution.
Build business data warehouse solutions using Terradata for business intelligence.
Our core data platform stack includes:
Data Platform & Lakehouse
Databricks as the single point of truth for all data
Realtime Data Pipelines implemented using Kafka for data ingestion.
Databricks SQL for analytical queries
Unity Catalog for metadata management and governance
Terradata for data warehouse and business intelligence.
Stream & Event ProcessingApache Kafka for real-time event ingestion
Structured Streaming for continuous data processing
Delta Live Tables for declarative, quality-enforced pipelines
Data QualityDelta Live Tables expectations for data validation
Data profiling and anomaly detection
Preferred Qualifications
7+ years of hands-on data engineering experience
Track record of building and maintaining production-grade data pipelines
Experience with Delta Live Tables for declarative pipeline development
Experience working in agile, cross-functional teams
Familiarity with time-series data patterns and operational data modelling
Highly Desirable
Experience building data pipelines for digital twin or simulation platforms
Familiarity with operational state modeling for real-time systems
Exposure to physics-informed or time-series ML feature engineering
Experience working with distributed, multidisciplinary teams
Exposure to industrial domains such as Manufacturing, Logistics, or Transportation is a plus
Skills
Explore related jobs
More jobs at Gradera Inc.
Similar Databricks jobs
- D
Databricks AdministratorDelan Associates, Inc · United States, United States - O
Databricks SpecialistOne51 · Sydney, New South Wales - T
Databricks ArchitectTiger Analytics Inc. · United States - B
Databricks AdministratorBHG Financial · Remote - U
Databricks ArchitectUnison Group · Sydney, New South Wales - T
Databricks AdminTiger Analytics Inc. · Dallas, Texas
Jobs in Hyderabad
- D
Team Lead - Projects - Biosimilars/ BiologicsDr Reddy's Laboratories Limited · Hyderabad, India - D
Team member - Drug Substance (Cell Banking)Dr Reddy's Laboratories Limited · Hyderabad, India - I
Software EngineerInfor · Hyderabad - I
Quality Assurance Analyst (Syteline, ERP, Manual Testing)Infor · Hyderabad
Browse these categories
Market data for data engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.