Software Engineer (Data Platforms)
AI Summary
A Data Engineer building production data pipelines, designing scalable data models and schemas, and developing data quality, lineage, and orchestration systems for grid operators.
About this role
About the role
Pay Range: £75k-£200k (salary + equity), based in London, UK.
We are hiring a Data Engineer to join Squid as one of our first engineers.
You will work closely with the founders and early engineering team to build the data foundations of our platform for grid operators. The role combines data engineering, software engineering, infrastructure and applied AI.
You will work with large, complex and often inconsistent technical datasets, building reliable systems to ingest, transform, validate, connect and serve them. This is a high-ownership role based in our central London office, with the opportunity to shape our data architecture, engineering practices and product from an early stage.
What you'll do
- Build production data pipelines for ingesting, transforming, validating and serving complex datasets.
- Design scalable data models, schemas and storage systems for structured, semi-structured and geospatial data.
- Build pipeline orchestration using directed acyclic graphs, or DAGs, to manage dependencies, retries, scheduling and observability.
- Develop systems for data quality testing, lineage, versioning, reconciliation and change detection.
- Create tools for combining datasets from different systems while preserving provenance and auditability.
- Build APIs and services that make processed data available to products, customers and AI systems.
- Develop workflows for batch processing, event-driven processing and long-running computational jobs.
- Create monitoring and alerting for pipeline failures, unexpected data changes and quality regressions.
- Work directly with customers and domain experts to understand source systems and data problems.
- Use modern AI development tools to accelerate data mapping, validation and pipeline development.
Qualifications
You do not need to meet every requirement. We are looking for strong data engineers who enjoy making difficult, messy datasets reliable and usable.
You may be a strong fit if you have:
- Professional experience building and maintaining production data pipelines.
- Strong Python and SQL skills, with experience working with Postgres or similar databases.
- Experience designing data models, schemas and transformation layers for complex datasets.
- Experience with directed acyclic graph-based orchestration tools such as Airflow, Dagster, Prefect or similar systems.
- Familiarity with data warehouses, object storage, queues, APIs and cloud infrastructure.
- Experience with data quality testing, lineage, observability, versioning or change-data capture.
- The ability to work with incomplete, inconsistent or poorly documented source data.
- Strong software engineering fundamentals, including testing, code review and maintainable system design.
- An interest in applied AI, data evaluation and building reliable data foundations for AI systems.
- High ownership, clear communication and a willingness to work directly with technical customers.
Experience with geospatial data, graph data, time-series data, scientific computing, energy data or other complex engineering datasets would be valuable, but is not required.
About Squid
AI and data centres are booming, electrification is accelerating, and trillions in generation, storage, and connection projects are queued - but the real bottleneck is the grid.
Grid planning and operations are becoming a national-scale systems problem: complex network models, messy legacy data, strict governance, overloaded teams, and high-stakes decisions that affect real infrastructure.
Squid is building the agentic modelling platform for power grids: a versioned, auditable source of truth where network models, data, changes, assumptions, and decisions can be tracked - and where humans and AI agents can safely work together.
We unify legacy planning models, operational data, and grid workflows into software that helps teams run checks, compare models, explain changes, validate assumptions, and move faster without losing engineering rigour.
Based in London, Squid is backed by premier investors like Y Combinator and partners with industry leaders including National Grid and Northern Powergrid. 🦑
Skills
Explore related jobs
More jobs at Squid
Similar Airflow jobs
Jobs in London
- HUrban Outfitters Merchandising Admin Assistant (12 Month FTC) - Future OpportunitiesHomeoffice Eu Urbn · London, United Kingdom
- PHygienist Laurel Dental CarePepperpointe · London, KY
- OPrincipal| Leadership Advisory | LondonOdgersberndtson · London, United Kingdom
- OPrincipal| Leadership Advisory | LondonOdgersinterim · London, United Kingdom
- MAssociate, Commercial Real Estate Debt (London)Marathonfund · London, United Kingdom
- MVice President, Commercial Real Estate Debt (London)Marathonfund · London, United Kingdom
Browse these categories
Market data for software engineer roles
All reports →- Role reportSoftware engineer jobs, Sep 2026: new listings down 9.7%New software engineer listings fell 9.7% to 1,506 this week, the first weekly drop in a month. Prioritize applications while 1,506 fresh roles remain open.
- Salary reportSoftware engineer salary 2026: median midpoint is $190,587The median published range midpoint for US software engineer roles is $190,587, with the middle half from $166,000 to $222,000.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.