Posted 1 month ago
Senior Data Engineer
AI Summary
Designs and operates production-grade data pipelines on GCP, including Kafka event streams, BigQuery transformations, and Airflow workflows, while owning data quality, observability, and SLA adherence for IG's analytics and AI initiatives.
About this role
Job Title
Senior Data EngineerJob Description
Compensation details will be shared by the recruiter during the first interview.
So, who are we?
IG Group is a FTSE 100 fintechoperatingacross five continents, serving over 1.3m customers and handling billions of dollars in transactions – built on scale, trust, and proof.Wedidn'tpivot to innovation;it'showwe'vealwaysoperated. What that means for the people who work here is real: genuinely complex problems to solve, the technology and resources to tackle them properly, and the kind of scopethat'srare in established businesses. The bar is high – bring a curious and forward-thinking mindset andwe'llgive you the platform to define what comes next. Join us at IG – the future gets built here.
Your team
IG’s Data function is a central capability serving both central and divisional business lines across the entire IG estate. The Data Engineering teamis responsible forthe platforms that underpin analytics, reporting, compliance, and client-facing data products, and that will increasingly power AI and machine-learning use cases across the firm.
The current data landscape reflects IG’s growth: a combination of GCP-native capabilities,onpremisessystems, and a legacy AWS data platform. The strategic direction — endorsed by the CDO and Executive — is clear:consolidateonto GCP, raise the bar on data quality, and enable self-service access to trusted data for teams across the business.
Your role in the Team’s Success
As a Senior Data Engineer, you will design, build, andoperatethe data pipelines and platform capabilities that power IG’s analytics, compliance, and AI ambitions. Working within a squad led by the Data Engineering Team Lead, you will be a key technical contributor to IG’s GCP consolidation programme — tackling complex ingestion, transformation, and reliability challenges with a high standard of craft. You will also play a meaningful role in raising the bar for the wider team: mentoring junior engineers, championing data quality, and helping to define how the squad builds andoperatesat scale.
Whatyou’lldo
Design and build robust batch and real-time data pipelines on GCP, including Kafka-based event streams,BigQuerytransformations, and Airflow-orchestrated workflows, as part of the GCP consolidation and Medallion architecture build-out
Own data quality within your delivery area: define and implement data contracts, quality checks, and observability instrumentation so that pipeline health is visible and SLAs are met
Develop andmaintainin-house connectors and third-party native integrations that form part of IG’s ingestion estate, ensuring resilience, monitoring, and long-term maintainability
Contribute to engineering standards and best practices across the squad — including code review,dbtmodelling patterns, CI/CD pipeline hygiene, and change control for shared datasets
Support feature engineering and model data pipelines for Data Science, and help lay the foundations for AI-ready data — including lineage, reproducibility, and freshness guarantees for ML workloads
Whatyou’llneed for this role
Proven hands-on experience building and operating production-grade data pipelines on GCP — includingBigQuery, Cloud Composer/Airflow, GCS, and Cloud Run — with strong SQL and Python skills
Solid experience with Apache Kafka or equivalent streaming technologies, including designing event-driven ingestion patterns and troubleshooting real-time data flows under operational conditions
Familiarity with modern transformation tooling, particularlydbt, and an appreciation of Medallion (Bronze/Silver/Gold) architecture patterns and how they support self-service analytics
A quality-first mindset: experience implementing data contracts, lineage tracking, observability tooling, and pipeline SLO monitoring in a production environment
Comfortable working in a regulated financial services environment, with an understanding of data governance requirements (lineage, access control, audit trails) and the discipline tooperatewithin change control processes
Key Qualification Requirements:
How we work
We try to take a thoughtful approach to our ways of working as a company.We follow a hybrid working model with 3 days inthe office – which we think balances the need to collaborate effectively and connect with each other. When it comes to how we deliver, there are 5 things we want everyone to do to drive high performance, betterlearningand career satisfaction:
Lead and Inspire:Drives trust, alignment, and enthusiasm
Think Big:Focus on the problems that most impact commercial outcomes
Champion the client:Understand and prioritise client's needs
Deliver at pace:Push for fast, sustainable growth;
Raise the bar:Take ownership, be accountable and share feedback
We believe that diversity is vital to success, it fuels creativity, drivesinnovationand sets us up for global success.We’recommitted to building teams with a variety of perspectives and skills to help us realise our vision and strategy,that’swhy we encourage applications from people with diverse backgrounds and experiences to join us on this journey. Learn more about our D&I approachhere.
The Perks
Your growth fuels our success! Thrive with tailored development programs, mentoring opportunities with leaders, and clear career progression. Expand your network through committees,sportsand social clubs. Enjoy extra time off for volunteering and community work.
Learn more about the Perkshere!
Join us for this exciting journey.Apply now!
Number of openings
1Skills
Explore related jobs
More jobs at IG Index Limited
- Senior Platform EngineerBangalore, India
- Customer Experience Associate (Italian)Kraków - Poland
- Data Solutions ArchitectBangalore, India
- Assistant Portfolio ManagerCity of London - United Kingdom
- Enhanced Due Diligence SpecialistCity of London - United Kingdom
- Senior Manager, KYC Risk & AssuranceCity of London - United Kingdom
Similar Airflow jobs
Jobs in Kraków
- [RPG] Scrum MasterSoftware Mind · Kraków, Lesser Poland Voivodeship
- [BPC] Scrum Master / Agile CoachSoftware Mind · Kraków, Lesser Poland Voivodeship
- Senior Data Developer (m/f/d)Inpost · Kraków, Województwo małopolskie
- SPRZEDAWCA / SPRZEDAWCZYNI JYSK KRAKÓW RUCZAJ 1/4 ETAT(1375 PLN)Jysk · Kraków, Województwo małopolskie
- (Senior) Data Analyst (m/f/n)Inpost · Kraków, Województwo małopolskie
Koordynator ds. Zaopatrzenia i LogistykiuPacjenta.pl · Kraków, małopolska
Browse these categories
Market data for data engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.