
Posted 2 months ago
Data Engineer
AI Summary
Data engineer who will own and optimize the data platform, build pipelines and ML infrastructure, and collaborate with dev teams to enable scalable data analytics and AI work.
About this role
At Octopus Electric Vehicles we鈥檝e built a data platform that provides data services to all areas of our business. The aim of the platform is to enable self-service of data analytics to data hungry internal users as well as automation of all our data workflows - from simple ETL jobs to ML training and prediction.
The data team at OEV is growing at speed. We have invested time and resources on establishing a core data platform, and are now leveraging technology to automate processes and reporting, so we can focus on improving how our data platform works as a system - from improving data latency and reliability, to thinking about making our data ready for productionised data science applications.
We are looking for an experienced data engineer that is equally passionate about using technology to grow the business and decarbonise the UK鈥檚 fleet.
This is a fantastic opportunity to work on data problems that genuinely move us closer to Net Zero with a company that is passionate about building great technology to change the way customers travel sustainably.
What you'll do
Own and optimise our platform architecture (improve reliability, scalability, maintainability, etc)
Build new data sources and data pipelines that deliver key data and insights to the business (this will include integration with third party systems and ingestion through APIs)
Scope and deliver new data engineering projects in collaboration with business stakeholders
Develop and deploy ML infrastructure to help build out our ever-growing AI requirements and use cases
Collaborate closely with our dev teams to build seamless integrations between our back-end databases and our data platform
Shape the direction of our growing team and coach team members on best practices
What you'll have
You don鈥檛 need experience with electric vehicles (we can teach you that!), but having worked in similar environments might be a bonus.
First and foremost, a passion for decarbonisation
Ability to work with ambiguity and own problems end-to-end
A passion for writing high quality code and building lean processes
Experience with distributed data processing
Experience with monitoring, testing, and data quality
Experience building robust pipelines from diverse sources e.g. parquet, SQL & no-SQL databases, API endpoints
It would be helpful to have experience/expertise/knowledge in the following:
Python
AWS
Kubernetes
Spark & distributed computing
dbt
Terraform
Data Warehousing (we use Databricks but experience with other platforms is fine)
MLOps implementation (desirable but not required)
Airflow (or other orchestration tooling)
Governance
Why else you'll love it here
Things to note
馃 We use AI to help us assess applications fairly and objectively. We鈥檙e totally fine with you using AI as a tool to help prepare too. That said, when we get to the interview and assessment stage, we鈥檙e really interested in hearing your unique perspective and real-world stories. That鈥檚 the stuff we can鈥檛 get from a bot or a prompt!
Skills
Explore related jobs
More jobs at Octopus Energy Group
Similar Airflow jobs
Jobs in London
Product Lead - AcquiringWise 路 London, United Kingdom- Retail CleanerEntain (Smartrecruiters) 路 London, England
- Holiday Club Activity LeaderJunior Adventures Group 路 Vauxhall, London
Junior Affiliate Marketing ManagerOLIVER Agency 路 London, United Kingdom- Pre Sales ArchitectVersion 1 路 London, England
- Organic Performance Senior ExecutiveOmnicom Media UK 路 London