
Posted 5 days ago
Data Engineer (Tech Lead/Staff)
AI Summary
Tech Lead/Staff Data Engineer at Octopus Electric Vehicles designing, owning, and optimizing the data platform and pipelines to enable analytics and automation across the business.
About this role
At Octopus Electric Vehicles we鈥檝e built a data platform that provides data services to all areas of our business. The aim of the platform is to enable self-service of data analytics to data hungry internal users as well as automation of all our data workflows - from simple ETL jobs to ML training and prediction.
The data team at OEV is growing at speed. We have invested time and resources on establishing a core data platform, and are now leveraging technology to automate processes and reporting, so we can focus on improving how our data platform works as a system - from improving data latency and reliability, to thinking about making our data ready for productionised data science applications.
We are looking for a data engineer who has operated at Staff/Tech Lead level that is equally passionate about using technology to grow the business and decarbonise the UK鈥檚 fleet.
This is a fantastic opportunity to work on data problems that genuinely move us closer to Net Zero with a company that is passionate about building great technology to change the way customers travel sustainably.
What you'll do
Own and optimise our platform architecture (improve reliability, scalability, maintainability, etc)
Build new data sources and data pipelines that deliver key data and insights to the business (this will include integration with third party systems and ingestion through APIs)
Scope and deliver new data engineering projects in collaboration with business stakeholders
Develop and deploy ML infrastructure to help build out our ever-growing AI requirements and use cases
Collaborate closely with our dev teams to build seamless integrations between our back-end databases and our data platform
What you'll have
You don鈥檛 need experience with electric vehicles (we can teach you that!), but having worked in similar environments might be a bonus.
First and foremost, a passion for decarbonisation
Ability to work with ambiguity and own problems end-to-end
A passion for writing high quality code and building lean processes
Experience with distributed data processing
Experience with monitoring, testing, and data quality
Experience building robust pipelines from diverse sources e.g. parquet, SQL & no-SQL databases, API endpoints
It would be helpful to have experience/expertise/knowledge in the following:
Python
AWS
Kubernetes
Spark & distributed computing
dbt
Terraform
Data Warehousing (we use Databricks but experience with other platforms is fine)
MLOps implementation (desirable but not required)
Airflow (or other orchestration tooling)
Governance
Why else you'll love it here
Things to note
馃 We use AI to help us assess applications fairly and objectively. We鈥檙e totally fine with you using AI as a tool to help prepare too. That said, when we get to the interview and assessment stage, we鈥檙e really interested in hearing your unique perspective and real-world stories. That鈥檚 the stuff we can鈥檛 get from a bot or a prompt!
Skills
Explore related jobs
More jobs at Octopus Energy Group
Freelancer Learning & Development Content Creation (m/w/d) E-Learning-Autor*in 馃悪Remote (Germany)
Client Success ExecutiveLondon (GB)
Software Engineer (Backend, Python)London (GB)
Platform Engineer IIRemote (USA)
T茅cnico/a Precheck Proyectos Fotovoltaicos (Valencia)Valencia (ES)
T茅cnico/a de SAT (Servicio de Asistencia T茅cnica) - FotovoltaicaSantiago de Compostela (ES)
Similar Airflow jobs
Jobs in London
- Receptionist - Cecconi's Mayfair, Central LondonSoho House & Co. 路 5A Burlington Gardens, London W1S 3EP
Receptionist - Cecconi's Mayfair, Central LondonSoho House via Caterer.com 路 London- Chef de Partie - Cecconi's Mayfair, Central LondonSoho House & Co. 路 5A Burlington Gardens, London W1S 3EP
Demi Chef de PartieThe Queen's Club 路 London, London
German Speaking Sr. Client Success Manager - EnterpriseAddepar 路 London, UK- Meat CutterFarm Boy Inc. 路 London, ON