
Posted 6 days ago
Senior Data Engineer
AI Summary
Designs and builds the Enterprise Data Catalog application on Databricks, integrating front-end and back-end components with Unity Catalog APIs and implementing secure authentication and authorisation. Also sets engineering standards and shares best practices.
About this role
Avenga is an international engineering firm helping businesses operate with AI at the core. With 6,000+ experts worldwide, we combine engineering expertise with AI-native thinking to turn ambitious ideas into real-world impact across industries, technologies, and markets.
At the core of the role
We are looking for a Senior Data Engineer with Databricks to join our team. Our client is one of the largest state-owned energy companies and a leading producer and supplier of electricity and heat in Europe.
As a Senior Data Engineer, you will take part in setting standards, establishing guidelines, and sharing best practices in order to ensure continuous learning and development.
Core skills you’ll bring
5+ years of experience as a Data Engineer
Proficiency in Databricks Apps development experience using React, Node.js, Python, Streamlit or similar technologies
Experience integrating with Unity Catalog APIs and metadata services
Proven experience implementing OAuth, Microsoft Entra ID, SSO, RBAC and group-based authorisation
Experience designing enterprise-scale web applications supporting large user groups
Strong knowledge of Databricks SQL, Serverless SQL, Jobs, Lakehouse architecture and governance
Familiarity with integrating external systems through REST APIs
Experience with CI/CD, Git, and Azure DevOps or GitHub Actions
English – Upper-intermediate or higher
Nice-to-have
Experience with MCP / JSON-RPC integration patterns
Familiarity with Databricks Genie and Genie Ontology
Knowledge of Unity Gateway or comparable governed data-access patterns
The impact you'll create
Design and develop the Enterprise Data Catalog application, including front-end and back-end components
Integrate the application with Unity Catalog APIs, Databricks services, metadata sources and external systems
Implement secure authentication, SSO, role-based and group-based authorisation, and user-context data access
Design high-performing metadata search, caching and indexing for a large user base
Implement CI/CD, automated testing, audit logging, monitoring and application observability
Support deployment, security and architecture reviews, troubleshooting and performance optimisation
Produce maintainable code, configuration and technical documentation, and provide knowledge transfer
People are at the core of Avenga. We provide equal opportunities regardless of race, ethnicity, gender identity, sexual orientation, disability, age, religion, or any other characteristic. We are committed to a respectful environment where everyone can be themselves, share their ideas, and feel that they belong.
Skills
Explore related jobs
More jobs at Avenga
Similar Databricks jobs
- D
Azure DevOps SMEDDP Specialty Elect Mat US LLC · Remote - S
Azure DevOps EngineerSopra Steria · Nieuwegein, UT - K
Azure DevOps Leadkrg technology inc · Dearborn, MI - MArchitecte Azure DevOpsMagellan · Toulouse, Occitanie
- A
Azure DevOps EngineerArrow Electronics, Inc. · Ahmedabad, India - S
Azure DevOps EngineerStartekk Inc · Dallas, TX
Browse these categories
Market data for data engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.