
Posted 1 month ago
Junior Data EngineerConveGenius · Shimla
Junior Data Engineer
ShimlaOn-siteFull-time
AI Summary
Designs, builds and maintains scalable ETL/ELT data pipelines and architectures on AWS, supporting reliable data movement, transformation and analytics for reporting and dashboards.
About this role
Role Overview
We are looking for a Junior Data Engineer to join our Data Platform team. You will design and maintain scalable data pipelines and architectures using AWS services, enabling reliable data movement, transformation, and analytics at scale. You will collaborate with analytics, product, and engineering teams to support reporting, dashboards, and insights for millions of students and schools.
Key Responsibilities
- Design, build, and maintain ETL/ELT pipelines for large-scale data ingestion, transformation, and loading.
- Develop and optimize Spark and PySpark jobs for batch and real-time data processing.
- Work with AWS services (S3, Glue, Lambda, Redshift, Athena, EMR) to manage the data ecosystem.
- Support the design and implementation of Data Lake and Data Warehouse architectures.
- Implement data validation, partitioning, and schema management for efficient query performance.
- Collaborate with data analysts and BI teams to ensure data availability and consistency.
- Maintain data lineage, metadata, data quality, and governance.
- Implement monitoring and alerting for data pipelines.
- Use Git and CI/CD tools to manage code and automate deployment of data workflows.
Qualifications
- Education: Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field.
- Experience: 3–5 years of hands-on experience in data engineering, pipeline development, or cloud-based data systems.
- Core Skills: Strong knowledge of SQL and Python/PySpark.
- Cloud & Data Stack: Practical experience with AWS (S3, Glue, Lambda, Redshift, Athena, EMR, Step Functions).
- Architecture: Solid understanding of Data Lake architecture, ETL/ELT frameworks, and data warehousing concepts.
- Frameworks: Familiarity with Delta Lake, Spark SQL, or other big data frameworks, along with data modeling and performance tuning.
Nice to Have
- Exposure to GCP (BigQuery, Dataflow) or Azure (Data Factory, Synapse, Databricks).
- Experience with Databricks, PostgreSQL, MySQL, NoSQL, or Airflow.
- Understanding of DevOps practices, CI/CD pipelines, and infrastructure automation.
- Prior experience in an EdTech or public data ecosystem.
Skills
AWS AthenaAWS EMRAWS GlueAWS LambdaAWS RedshiftAWS S3AWS Step FunctionsCI/CDData Lake ArchitectureDelta LakeETL/ELTGitPySparkPythonSpark SQLSQL
Explore related jobs
More jobs at ConveGenius
Similar ETL/ELT jobs
- F
Senior Data Analyst (12 Month FTC)Funding Circle · London - B
Principal Data Engineer- R01558808Brillio · Bangalore, Karnataka - M
AWS Data Engineer (Senior) (Freelancer)Mactores · Mumbai, Marshall Islands - M
AWS Data Engineer (Senior)Mactores · Seattle, Washington - U
AWS Data EngineerUrbanSoft SA PTY · Johannesburg, South Africa - J
Data Engineer ChileJoin ready · Remote job
Browse these categories
Market data for data engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.