
Posted 24 days ago
Data Engineer
AI Summary
Designs, develops, tests and implements Python and PySpark data transformation features and standalone scripts within an existing data engineering framework, translating business logic into reliable data solutions.
About this role
We are unable to sponsor or take over sponsorship of an employment visa at this time.
Data Engineer
Job Overview
We are seeking a Data Engineer with strong hands-on coding experience in Python and PySpark, along with a solid understanding of Object-Oriented Programming. The ideal candidate will be responsible for designing, developing, testing, and implementing new features within an existing data engineering framework.
This role requires someone who is comfortable working with complex data transformations, translating business requirements into technical solutions, and developing standalone PySpark scripts based on defined business logic. The successful candidate will work closely with the team to deliver reliable, maintainable, and effective data solutions.
Responsibilities
Design, develop, and implement new features within an existing framework using Python and PySpark.
Develop efficient and effective PySpark scripts to perform data transformations based on defined business logic.
Apply strong Object-Oriented Programming concepts to solve complex problems and develop robust, reusable solutions.
Work closely with team members to understand requirements and develop solutions aligned with business objectives.
Translate business requirements into technical solutions and data transformation processes.
Test, debug, and troubleshoot code to ensure it produces accurate and reliable results.
Identify and resolve complex software and data-related issues.
Develop standalone scripts and applications to support data processing requirements.
Follow coding best practices and contribute to the enhancement of the existing framework.
Document programming tasks, processes, and procedures to support future troubleshooting and maintenance.
Communicate effectively with team members regarding requirements, technical challenges, and solutions.
Work independently with minimal supervision while contributing effectively to the overall team.
Qualifications
Strong hands-on experience with Python.
Strong hands-on experience with PySpark and data transformations.
Solid understanding of Object-Oriented Programming concepts.
Experience developing standalone scripts based on defined business logic.
Strong problem-solving and troubleshooting skills.
Ability to understand complex requirements and translate them into effective technical solutions.
Experience working with data engineering frameworks and large-scale data processing.
Excellent written and verbal communication skills.
Ability to work independently with minimal supervision.
AWS experience is preferred but not required.
Preferred Skills
AWS / Cloud technologies
Large-scale data processing
Data transformation and ETL
Software development best practices
Framework development and enhancement
Automated testing and debugging
Data engineering tools and technologies
Kaleidoscope, an Infosys Company, is an equal opportunity employer, and all qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, spouse of protected veteran, or disability.
Skills
Explore related jobs
More jobs at Infosys Nova Holdings
Similar Data Transformation jobs
- S
Automation TestingSQUIRCLE IT CONSULTING SERVICES PVT. LTD · Bengaluru, KA - S
Automation TestingSonsoft Inc · Weehawken, NJ - T
Automation testingTestingxperts · San Mateo, CA - S
Automated Test EngineerSteampunk · McLean, VA - S
Automation Test Engineersteampunk · McLean, VA - S
Automation Test EngineerSQUIRCLE IT CONSULTING SERVICES PVT. LTD · Bengaluru, KA
Jobs in Charlotte
- K
Experienced Civil EIT - Land DevelopmentKimley-Horn · Charlotte, North Carolina - RMaintenance TechnicianRPM Living · Charlotte, NC
- NLicensed Practical Nurse - FamilyNovanthealth · Charlotte, North Carolina
- CDocument Scanning AssociateConduent · Charlotte, NC
- NCNA I - Certified Nursing Aide - 5F Cardiac TelemetryNovanthealth · Charlotte, North Carolina
- CSummer 2027 Mechanical Engineering InternCareers Haskell · Charlotte, North Carolina
Browse these categories
Market data for data engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.