
Posted 1 month ago
Data Engineer II
AI Summary
Designs, develops, and maintains scalable cloud-based data pipelines on AWS to support analytics, reporting, and business intelligence for enterprise stakeholders.
About this role
Role Overview:
As a Data Engineer II, you will design, develop, and support scalable cloud-based data pipelines that enable analytics, reporting, and business intelligence across the organization. Working within AWS-native technologies, you will integrate enterprise applications into centralized data platforms while ensuring data quality, reliability, and performance. You will collaborate with business stakeholders and technical teams to translate reporting requirements into scalable data solutions that support informed business decisions.
Key Responsibilities
-
Design, develop, and maintain cloud-based data pipelines supporting enterprise reporting and analytics.
-
Build and optimize ETL/ELT processes using AWS-native data services and modern data engineering practices.
-
Integrate enterprise source systems, including Salesforce, NetSuite, and other business applications, into centralized data platforms.
-
Develop and maintain scalable data models supporting reporting and business intelligence initiatives.
-
Monitor pipeline performance, troubleshoot data issues, and implement improvements to ensure data accuracy and reliability.
-
Partner with business stakeholders to understand reporting requirements and translate them into technical solutions.
-
Support data governance initiatives by maintaining data quality, metadata, and documentation.
-
Contribute to automation, continuous integration, and infrastructure-as-code practices to improve development efficiency.
-
Participate in code reviews and promote engineering best practices across the team.
Qualifications
-
Bachelor's degree in Computer Science, Information Systems, Engineering, or related field, or equivalent experience.
-
2-4 years of experience in data engineering or cloud data platform development.
-
Experience developing data pipelines using AWS services such as S3, Glue, Redshift, AppFlow, and Step Functions.
-
Experience working with SQL, Python, and PySpark.
-
Understanding of dimensional modeling, data warehousing concepts, and modern data lake technologies.
-
Experience integrating enterprise applications such as Salesforce, NetSuite, or similar SaaS platforms.
-
Familiarity with Git, CI/CD pipelines, and Infrastructure as Code (Terraform preferred).
-
Practical experience with applying AI/ML techniques to data engineering problems, such as automated data quality checks, anomaly detection, or intelligent pipeline monitoring
-
Strong analytical and problem-solving skills.
-
Excellent collaboration and communication skills.
Behavioral Competencies
Ensures Accountability
Manages Complexity
Communicates Effectively
Balances Stakeholders
Collaborates Effectively
Skills
Explore related jobs
More jobs at PDI Technologies
Jobs in Chennai
Intern - Project CoordinatorFlatirons Solutions · Chennai, India
Interns - Technical AuthorFlatirons Solutions · Chennai, India
Technical AuthorFlatirons Solutions · Chennai, India- Manager, Firmware EngineeringLFE - Logitech Far East Ltd.,-Taiwan · Chennai, India
Distributed Technical Advisor, Infrastructure ServicesEnsono · Bengaluru, India- ETrade Compliance Spec IIIEn Biorad · Chennai, India
Browse these categories
Market data for data engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.