Jobless Developer
Kpler logo
Kpler

Posted 4 months ago

Open

Senior Data Engineer

AthensRemoteFull-time

AI Summary

Senior Data Engineer at Kpler contributes to building and maintaining data pipelines, APIs, and real-time data delivery for the European power market, collaborating with staff engineers and data scientists.

About this role

At Kpler, we are dedicated to helping our clients navigate complex markets with ease. By simplifying global trade information and providing valuable insights, we empower organisations to make informed decisions in commodities, energy, and maritime sectors.

Since our founding in 2014, we have focused on delivering top-tier intelligence through user-friendly platforms. Our team of over 700 experts from 35+ countries works tirelessly to transform intricate data into actionable strategies, ensuring our clients stay ahead in a dynamic market landscape. Join us to leverage cutting-edge innovation for impactful results and experience unparalleled support on your journey to success.


The Power team is responsible for a product covering the whole product related to the European power market. This includes a large datasets of data to retrieve, normalize and distribute to our users, and also offer different proprietary datasets such as real time availability computation or market forecasts on different time horizons, from intra day to long term.

Your mission is to:

  • Be instrumental in the enhancement of multiple pipelines in place to retrieve data from external providers.
  • Collaborate with the Staff Engineer in designing robust architecture, to build a responsive product, able to retrieve and deliver real time data.
  • Participate in expanding the coverage of the data retrieved to new markets or geographies.
  • Enrich the product and participate in the development of new features.
  • Build and improve monitoring and alerting tools and dashboards.
  • Ensure good performance of our API which distributes the data to end users.
  • Work together with Data Scientists and market experts with strong experience in this domain.
  • Help build the Roadmap, in collaboration with the Product team.
  • Provide support and technical guidance to less experienced Engineers within the team.

  • This could be a match if you have/are:

  • BSc/MSc in computer science, computer engineering or equivalent.
  • Circa 6+ years' of experience as a data focused Software Engineer.
  • Significant experience working with Python (FastAPI is a plus).
  • Working experience with Postgresql or similar data stores.
  • Proficiency in building and consuming RESTful APIs.
  • Experienced working with Git, code reviews, and Agile methodologies.
  • Deep understanding of performance optimization and caching strategies.
  • Great communication, ability to work asynchronously with team members in other countries.
  • Have experience with AWS (or another cloud provider), using Terraform.
  • Experience with containerization (Docker) and orchestration (Kubernetes)
  • Curious to learn about the domain.
  • Strong command of written and spoken English.

  • Desirable experience
  • Knowledge on hexagonal architecture and medallion architecture
  • Used monitoring solutions (Datadog, Grafana, etc...)
  • Skills

    Agile MethodologiesAWSCaching StrategiesCode ReviewsDataDogDockerFastAPIGitGrafanaKubernetesPerformance OptimizationPostgreSQLPythonRESTful APIsTerraform

    Explore related jobs

    Browse these categories