AI Summary

Designs, develops, and maintains real-time, stateful Flink data streaming pipelines; owns operational maturity and cloud infrastructure for Kpler’s data platform.

About this role

At Kpler, we are dedicated to helping our clients navigate complex markets with ease. By simplifying global trade information and providing valuable insights, we empower organisations to make informed decisions in commodities, energy, and maritime sectors.

Since our founding in 2014, we have focused on delivering top-tier intelligence through user-friendly platforms. Our team of over 850 experts from 69 countries works tirelessly to transform intricate data into actionable strategies, ensuring our clients stay ahead in a dynamic market landscape. Join us to leverage cutting-edge innovation for impactful results and experience unparalleled support on your journey to success.

Your Future Position

As a data streaming engineer in a data platform tribe, you will create, evolve and maintain complex stateful Flink pipelines. You will be responsible for raising the bar on the operational maturity of our streaming pipelines and support the continued adoption of streaming technologies within Kpler.

Your mission is to

Design, develop and maintain real-time data pipelines.

Take ownership over the operational excellence of stateful streaming pipelines.

Own complex cloud-based infrastructure (You build it, you run it.)

Manage data products with a diverse set of stakeholders.

Support and mentor other engineers.

Understand a complex domain with many cross-team dependencies.

Own features from end to end.

You could be a match if you have

BSc/MSc in computer science, computer engineering or equivalent

8+ years of experience in DevOps and Data/Software engineering

Experience with Kafka and Flink.

Strong experience with Java

Understanding of distributed systems and architectural trade-offs.

Extensive experience working in a cloud environment (AWS, GCP, Azure)

Strong command of written and spoken English.

Desirable:

Exposure infrastructure as code (Terraform, Pulumi)

Experience with Python

Skills

AWSAzureDistributed SystemsFlinkGCPJavaKafkaPulumiPythonTerraform

Senior Engineer - Geo Events

About this role

Your mission is to

You could be a match if you have

Skills

Explore related jobs

More jobs at Kpler

Similar AWS jobs

Browse these categories