Jobless Developer
IG Index Limited logo

Posted 1 month ago

Open

Senior Data Engineer

KrakówHybridFull-time

AI Summary

Designs and operates production-grade data pipelines on GCP, including Kafka event streams, BigQuery transformations, and Airflow workflows, while owning data quality, observability, and SLA adherence for IG's analytics and AI initiatives.

About this role

Job Title

Senior Data Engineer

Job Description

Compensation details will be shared by the recruiter during the first interview.


So, who are we?
IG Group is a FTSE 100 fintechoperatingacross five continents, serving over 1.3m customers and handling billions of dollars in transactions – built on scale, trust, and proof.Wedidn'tpivot to innovation;it'showwe'vealwaysoperated. What that means for the people who work here is real: genuinely complex problems to solve, the technology and resources to tackle them properly, and the kind of scopethat'srare in established businesses. The bar is high – bring a curious and forward-thinking mindset andwe'llgive you the platform to define what comes next. Join us at IG – the future gets built here.

Your team

IG’s Data function is a central capability serving both central and divisional business lines across the entire IG estate. The Data Engineering teamis responsible forthe platforms that underpin analytics, reporting, compliance, and client-facing data products, and that will increasingly power AI and machine-learning use cases across the firm.

The current data landscape reflects IG’s growth: a combination of GCP-native capabilities,onpremisessystems, and a legacy AWS data platform. The strategic direction — endorsed by the CDO and Executive — is clear:consolidateonto GCP, raise the bar on data quality, and enable self-service access to trusted data for teams across the business.


Your role in the Team’s Success

As a Senior Data Engineer, you will design, build, andoperatethe data pipelines and platform capabilities that power IG’s analytics, compliance, and AI ambitions. Working within a squad led by the Data Engineering Team Lead, you will be a key technical contributor to IG’s GCP consolidation programme — tackling complex ingestion, transformation, and reliability challenges with a high standard of craft. You will also play a meaningful role in raising the bar for the wider team: mentoring junior engineers, championing data quality, and helping to define how the squad builds andoperatesat scale.

Whatyou’lldo

  • Design and build robust batch and real-time data pipelines on GCP, including Kafka-based event streams,BigQuerytransformations, and Airflow-orchestrated workflows, as part of the GCP consolidation and Medallion architecture build-out

  • Own data quality within your delivery area: define and implement data contracts, quality checks, and observability instrumentation so that pipeline health is visible and SLAs are met

  • Develop andmaintainin-house connectors and third-party native integrations that form part of IG’s ingestion estate, ensuring resilience, monitoring, and long-term maintainability

  • Contribute to engineering standards and best practices across the squad — including code review,dbtmodelling patterns, CI/CD pipeline hygiene, and change control for shared datasets

  • Support feature engineering and model data pipelines for Data Science, and help lay the foundations for AI-ready data — including lineage, reproducibility, and freshness guarantees for ML workloads

Whatyou’llneed for this role

  • Proven hands-on experience building and operating production-grade data pipelines on GCP — includingBigQuery, Cloud Composer/Airflow, GCS, and Cloud Run — with strong SQL and Python skills

  • Solid experience with Apache Kafka or equivalent streaming technologies, including designing event-driven ingestion patterns and troubleshooting real-time data flows under operational conditions

  • Familiarity with modern transformation tooling, particularlydbt, and an appreciation of Medallion (Bronze/Silver/Gold) architecture patterns and how they support self-service analytics

  • A quality-first mindset: experience implementing data contracts, lineage tracking, observability tooling, and pipeline SLO monitoring in a production environment

  • Comfortable working in a regulated financial services environment, with an understanding of data governance requirements (lineage, access control, audit trails) and the discipline tooperatewithin change control processes

Key Qualification Requirements:

How we work

We try to take a thoughtful approach to our ways of working as a company.We follow a hybrid working model with 3 days inthe office – which we think balances the need to collaborate effectively and connect with each other. When it comes to how we deliver, there are 5 things we want everyone to do to drive high performance, betterlearningand career satisfaction:

  • Lead and Inspire:Drives trust, alignment, and enthusiasm

  • Think Big:Focus on the problems that most impact commercial outcomes

  • Champion the client:Understand and prioritise client's needs

  • Deliver at pace:Push for fast, sustainable growth;

  • Raise the bar:Take ownership, be accountable and share feedback

We believe that diversity is vital to success, it fuels creativity, drivesinnovationand sets us up for global success.We’recommitted to building teams with a variety of perspectives and skills to help us realise our vision and strategy,that’swhy we encourage applications from people with diverse backgrounds and experiences to join us on this journey. Learn more about our D&I approachhere.

The Perks

Your growth fuels our success! Thrive with tailored development programs, mentoring opportunities with leaders, and clear career progression. Expand your network through committees,sportsand social clubs. Enjoy extra time off for volunteering and community work.


Learn more about the Perkshere!

Join us for this exciting journey.Apply now!

Number of openings

1

Skills

AirflowApache KafkaBigQueryChange ControlCI/CDCloud ComposerCloud RunData ContractsData LineageDbtGCPGCSMedallion ArchitectureObservability ToolingPythonSQL

Explore related jobs

Browse these categories

Market data for data engineer roles

All reports →