Posted 4 days ago
Senior Data Engineer
AI Summary
Design and build scalable cloud-native data platforms, migrate legacy systems to the cloud, and lead R&D on agentic AI architectures and LLM-ready data pipelines as a senior technical contributor.
About this role
We are looking for a Senior Data Engineer to join our Data Engineering Team and take ownership of high-impact, greenfield data initiatives. You will work on building modern cloud-native data platforms, migrating on-premises legacy systems to the cloud, and laying the architectural foundation for AI-ready data infrastructure.
In this role, you will collaborate closely with Machine Learning, Data Science, and Product teams, serving as a key technical contributor and thought leader. You will also drive R&D efforts around agentic AI architectures, event-driven systems, and LLM-ready data pipelines – turning architectural concepts into production-grade solutions.
- Design and build scalable cloud-native data platforms from greenfield to production
- Design and implement near-real-time ingestion pipelines using event-driven patterns
- Define and enforce data platform standards including Data Lake and Lakehouse principles, medallion architecture, and data contracts
- Refactor, optimize, and modernize Spark and PySpark scripts for performance and maintainability
- Introduce best practices for code quality, testing, and CI/CD across data pipelines
- Drive adoption of AI tooling and agentic workflows within the Data Engineering team
- Ensure data quality, observability, scalability, and reliability across all platforms and pipelines
- Design and deliver self-service tooling and microservices that simplify platform usage
- Collaborate with cross-functional stakeholders including Product, Machine Learning, and Data Science teams
- Contribute to architecture decisions and technical R&D initiatives
- 5+ years of professional experience in Data Engineering
- Strong Python and SQL development skills
- Hands-on experience with Apache Spark and PySpark including query optimization and performance tuning
- Experience working with Databricks or Snowflake
- Practical experience with at least one major cloud provider such as Azure, AWS, or GCP
- Experience with stream processing technologies including Kafka or Spark Structured Streaming
- Strong understanding of ETL/ELT patterns, data modelling, and data warehousing concepts
- Experience with orchestration tools such as Apache Airflow or Azure Data Factory
- Knowledge of Infrastructure as Code tools including Terraform
- Understanding of production-grade systems including observability, scalability, reliability, and performance
- Ability to independently lead technical initiatives from concept to delivery
- Strong communication and collaboration skills
- Upper-Intermediate or higher English level
WILL BE A PLUS
- Familiarity with RAG pipeline design and LLM integration patterns
- Knowledge of data governance frameworks and tools such as Unity Catalog or Apache Atlas
- Experience with dbt for data transformation and modelling
- Familiarity with MLflow, Feature Stores, or ML platform integrations
PERSONAL PROFILE
- Proactive and self-driven mindset
- Strong analytical and architectural thinking
- Ability to work independently and take ownership of technical decisions
- Passion for innovation and modern engineering practices
- Knowledge-sharing and team-oriented approach
- Strong problem-solving skills
Skills
Explore related jobs
More jobs at Sigma Software
- SProject CoordinatorWarsaw, Masovian Voivodeship
- SData GeneralistBrasília, DF
- SSenior Embedded Software Developer (Networking, Security)Lviv, Lviv Oblast
- SStrong Junior Project ManagerLviv, Lviv Oblast
- SSenior Data Engineer (Databricks Migration)Bucharest, Bucharest
- SProject Manager (Embedded Systems)Kyiv, Kyiv city
Similar Apache Airflow jobs
- CSoftware Engineer 2 (Hybrid) - Linux/Bash/Apache Airflow/Apache Spark/Docker/Podman/Git/AWSCaptivation Software · Annapolis Junction, MD - Hybrid
- UPrincipal Data Engineer (AWS, Databricks, Ai, ML Flow, Data Architecture, Apache Airflow)US: Mastercard Technologies, LLC · Pune, India
- PData Engineer with AirflowPoland and Central-Eastern Europe · Bulgaria
Jobs in Warsaw
- SBeauty Advisor (Inside Sales) Sally Beauty 10646SBH · Warsaw, IN
- TAnalityk Urzadzen Elektronicznych - Teardown AnalystTechInsights · Warsaw, Poland
- S
VP of Finance / Head of FinanceSowelo Consulting sp. z o.o · Warsaw, Poland - Q
CNA/QMA/MA/Combat Medic Part Time Nights (1 shift a week)Quality Correctional Care · Warsaw, Indiana - T
CNC Machinist II - 2nd or 3rd ShiftTecomet · Warsaw, IN - T
CNC Machinist I - 2nd & 3rd Shift - WarsawTecomet · Warsaw, IN
Browse these categories
Market data for data engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.