Posted 3 months ago
Xperts: Senior Java Engineer (Data Engineering)
AI Summary
Senior Java Engineer (Data Engineering) at InspiredXpert, responsible for designing and delivering large-scale data migration and transformation solutions, building scalable batch and streaming pipelines, and providing technical leadership in a hybrid Cape Town role.
About this role
Role: Senior Java Engineer (Data Engineering)
Location: Cape Town, Western Cape (Hybrid)
Engagement: Permanent / Full Time
Role Overview
Senior Data Engineer required to deliver large-scale data migration and transformation solutions across enterprise platforms.
Blend of hands-on engineering and technical leadership, working on distributed systems at scale.
Key Responsibilities
- Design and deliver data migration and transformation solutions
- Build scalable batch and streaming pipelines
- Implement data validation, lineage, and testing frameworks
- Ensure monitoring, observability, and performance
- Lead technical design and support delivery
- Mentor engineers and drive best practices
- Collaborate with cross-functional stakeholders
Required Experience
- 8+ years in data or software engineering
- Strong Java expertise (Scala/Python beneficial)
- Experience building large-scale ETL/data pipelines
- Knowledge of distributed systems and cloud (AWS, GCP, Azure)
- Experience with Kubernetes / containerised environments
- Solid understanding of data architecture, security, compliance
Desirable
- Apache Spark / PySpark
- Hadoop ecosystem (HDFS, MapReduce)
- Streaming platforms (Kafka, Kinesis)
- Modern data formats (Parquet, Avro, Iceberg)
- Observability tools (Prometheus, Grafana)
Key Skills
Java | Data Engineering | ETL Pipelines | Spark | Distributed Systems | Cloud | Kubernetes | Data Migration
About InspiredXpert
InspiredXpert is a specialist IT Talent Solutions company providing high-quality contract or perm talent across software development, cloud, AI, cybersecurity, and data-driven roles. We connect skilled professionals with innovative companies, offering exciting opportunities to work on impactful projects across the globe.
Skills
Explore related jobs
More jobs at Inspired Testing
- Xpert: SAP S/4HANA Test ManagerEngland, United Kingdom
- Xpert: SAP S/4HANA Data Migration SpecialistUnited Kingdom, United Kingdom
- Xpert: Salesforce Test Lead (UK based) (contract outside IR35) (Current BPSS clearance is required)Remote, United Kingdom
- Xpert: Test Lead | Snr Test Analyst (iManage) London hybrid (Independent Contract outside IR35)London, United Kingdom
- Xpert: Senior Java/Scala EngineerCape Town, South Africa
- Xpert: Senior Oracle Fusion Test Analyst (Contract)JHB, South Africa
Similar Apache Spark jobs
- Software Engineer 2 (Hybrid) - Linux/Bash/Apache Airflow/Apache Spark/Docker/Podman/Git/AWSCaptivation Software · Annapolis Junction, MD - Hybrid
- Senior Data Engineer – Apache Spark | Kafka | Flink | Trino | Iceberg | Big Data | Streaming | Data Platform 8–12 YearsCisco Systems, Inc. · Bangalore, India
Software Engineer, Spark PlatformDoorDash USA · San Francisco, CA
Browse these categories
Market data for data engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.