
Posted 18 days ago
Data EngineerScry Analytics India Pvt · Delhi
Data Engineer
DelhiOn-siteFull-time
AI Summary
Designs, builds and maintains scalable ETL/ELT pipelines and backend data services, integrating APIs and databases and supporting AI/ML and agentic workflows from POC to production. Works directly with customers to translate requirements into technical solutions.
About this role
SCRY AI is an innovative AI-driven technology company focused on building intelligent, scalable, and high-performance solutions. We work with modern technologies across Software Engineering, AI/ML, and Data to solve real-world business problems and deliver impactful digital products.
Role Overview
We are looking for a skilled Data Engineer with 2-3 years of experience in building scalable data pipelines, backend services, and data processing systems. The ideal candidate should have strong hands-on experience in Python, SQL, ETL/ELT, API development, and database technologies, with exposure to AI/ML applications, Agentic AI, and cloud or on-premises deployments.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines for processing structured and unstructured data.
- Build data ingestion and transformation workflows using Python, SQL, and relevant data engineering frameworks.
- Extract, clean, validate, normalize, and transform data from APIs, databases, files, and other sources.
- Design and optimize database schemas, data models, SQL queries, joins, indexes, and aggregations.
- Work with relational databases such as PostgreSQL/MySQL and NoSQL databases where required.
- Develop batch and incremental data processing pipelines with appropriate error handling and recovery mechanisms.
- Implement data quality checks, validation rules, deduplication, and reconciliation to ensure data accuracy and consistency.
- Integrate data pipelines and AI applications with SQL/NoSQL databases, APIs, enterprise systems, and customer-specific data sources.
- Develop Agentic AI and workflow automation solutions using frameworks such as LangChain/LlamaIndex, including tool calling and external system integrations.
- Build and optimize backend services and APIs to support data processing, AI/ML workflows, and enterprise integrations.
- Work directly with customers and stakeholders to understand requirements, troubleshoot issues, demonstrate solutions, and translate business needs into technical implementations.
- Take AI/ML solutions from POC to production, focusing on scalability, reliability, latency, monitoring, and maintainability.
- Deploy and troubleshoot data and AI applications using Docker across cloud, on-premises, and customer environments.
- Implement logging, monitoring, alerting, and performance optimization for data pipelines and production applications.
- Follow engineering best practices using Git, CI/CD, automated testing, and documentation, collaborating with Data Scientists, ML Engineers, Backend Engineers, and business teams.
Key Qualifications
- 2-3 years of experience in Data Engineering, Backend Engineering, ETL development, or a related role.
- Strong proficiency in Python and SQL, including complex queries, joins, CTEs, window functions, and query optimization.
- Hands-on experience building ETL/ELT pipelines, data ingestion workflows, and transformation processes.
- Experience with relational databases, preferably PostgreSQL/MySQL, and database design principles.
- Understanding of data warehousing, dimensional modeling, indexing, partitioning, and incremental data processing.
- Experience integrating REST APIs, databases, CSV/Excel files, JSON, and other data sources.
- Strong experience with FastAPI/Flask, microservices, Docker, and backend architecture; Kubernetes is a plus.
- Experience with AWS/Azure/GCP and cloud or on-premises deployments.
- Knowledge of CI/CD, automated testing, Git, logging, monitoring, production debugging, and AI/ML inference optimization.
- Exposure to LLMs, Agentic AI, tool calling, workflow automation, and frameworks such as LangChain/LlamaIndex.
- Strong problem-solving, communication, customer-facing, and collaboration skills, with the ability to work independently in fast-paced environments.
Good to Have
- Experience with Apache Spark/PySpark, Kafka, or similar distributed data processing and messaging technologies.
- Exposure to cloud data platforms and warehouses such as BigQuery, Redshift, or Azure Data Factory.
- Experience preparing datasets for AI/ML, GenAI, RAG applications, vector databases, or analytics pipelines
Skills
Apache SparkAWSAzureCI/CDDockerETL/ELTFastAPIFlaskGCPGitKafkaKubernetesLangChainLlamaIndexMySQLNoSQLPostgreSQLPythonREST APISQL
Explore related jobs
More jobs at Scry Analytics India Pvt Ltd
Similar ETL/ELT jobs
- B
Apache Spark DeveloperBright Vision Technologies · Edison / Middlesex County, New Jersey - E
Apache Spark Java DeveloperElite Workforce Inc. · Brooklyn Park, MN - T
Desarrollador Java – Apache SparkTalycap Global · Bogotá, Colombia - E
JAVA and Scala/ Apache Spark developer.EROS Technologies Inc. · New York, NY - N
Senior Machine Learning Engineer, Accelerated Apache SparkNVIDIA USA · US, CA - D
Sr. Designated Support Engineer, Apache Spark™Databricks · Sao Paulo, Brazil
Jobs in Delhi
- WFemale Sales & Store AssistantWrapchic · New Delhi Tughlakabad Extension, Delhi
- UCustomer Experience SpecialistUrbanClap · New Delhi, Delhi
- P
Tour Executive (Domestic/Outbound)Packngo · New Delhi, Delhi - GAssistant Manager/ Manager Search Engine MarketingGroupon · New Delhi, Delhi
- F
Sales RepresentativeFarMart · Delhi, Delhi - F
CPG - Sales OfficerFarMart · Delhi, Delhi
Browse these categories
Market data for data engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.