
Posted 1 month ago
Data Service Engineer
AI Summary
Supports the day-to-day reliability of enterprise data services by monitoring data pipelines, investigating production failures, resolving data-quality and integration issues, coordinating incident follow-up, and ensuring trusted data is available to reporting, analytics, and downstream business processes.
About this role
The Data Service Engineer supports the day-to-day reliability of enterprise data services. The role monitors data pipelines, investigates production failures, resolves data-quality and integration issues, coordinates incident follow-up, and helps ensure that trusted data is available to reporting, analytics, and downstream business processes.
Key Responsibilities
1. Data Pipeline Operations
· Monitor scheduled and event-driven ETL/ELT pipelines across Azure Data Factory, Databricks, Airflow, and related platforms.
· Investigate failed jobs, delayed data, missing records, schema changes, and dependency issues.
· Rerun or recover pipelines using approved operational procedures and confirm successful completion.
· Support production releases, cutovers, and post-deployment monitoring.
2. Incident and Problem Management
· Respond to data-service incidents and operational requests within agreed service levels.
· Perform root-cause analysis and document the issue, impact, resolution, and preventive action.
· Create, update, and follow operational tickets through closure.
· Coordinate with source-system owners, data engineers, infrastructure teams, and report owners when cross-team support is required.
3. Data Quality and Reliability
· Validate data completeness, accuracy, freshness, and reconciliation results.
· Maintain monitoring, alerting, and operational checks for critical pipelines and datasets.
· Identify recurring failure patterns and recommend permanent fixes or automation.
· Escalate material data risks with clear impact and status communication.
4. Stakeholder and Service Support
· Support users of reports, dashboards, and downstream data products.
· Provide concise updates on incidents, blockers, ownership, and expected next actions.
· Participate in daily operational reviews and handovers.
· Maintain runbooks, troubleshooting guides, support knowledge, and service documentation.
5. Continuous Improvement
· Automate repetitive operational tasks and recovery steps where appropriate.
· Contribute to observability, cost, performance, and reliability improvements.
· Support standardization of deployment, support, and data-quality practices.
· Share lessons learned and help improve team operational readiness.
Required Qualifications
· Bachelor’s degree in Computer Science, Information Technology, Data Engineering, or a related discipline, or equivalent practical experience.
· 2–5 years of experience in data engineering, data operations, application support, or production support.
· Hands-on experience supporting production data pipelines or data platforms.
· Strong SQL skills and working knowledge of Python or another scripting language.
· Experience with one or more orchestration or processing technologies such as Azure Data Factory, Databricks, Apache Spark, or Airflow.
· Understanding of data warehousing, ETL/ELT, file and database integration, job dependencies, and data-quality controls.
· Ability to troubleshoot methodically, communicate clearly, and work across technical and business teams.
Requirements
Preferred qualifications:
· Experience with Azure or AWS data services.
· Experience with Linux, shell scripting, Git, and CI/CD practices.
· Familiarity with monitoring platforms such as Azure Monitor, CloudWatch, Grafana, or equivalent tools.
· Experience with Jira or an IT service-management platform.
· Retail, e-commerce, finance, supply-chain, or enterprise analytics experience.
· Knowledge of access controls, secrets management, and secure production-support practices.
Key competencies:
· Production ownership and service mindset
· Structured troubleshooting and root-cause analysis
· Attention to data quality and operational detail
· Clear incident communication and stakeholder coordination
· Prioritization under pressure
· Continuous improvement and automation mindset
Skills
Explore related jobs
More jobs at CP Axtra
Similar Apache Airflow jobs
- F
Senior DevOps Engineer - Apache Airflow PlatformFidelity Workplace Investing LLC · Merrimack, New Hampshire - S
Data Engineer ETL / Apache Airflow - ConsultingScalian · Neuilly-sur-Seine, IDF - C
Software Engineer 2 (Hybrid) - Linux/Bash/Apache Airflow/Apache Spark/Docker/Podman/Git/AWSCaptivation Software · Annapolis Junction, MD - Hybrid - C
Software Engineer 3 - Linux/Bash/Python/Apache Airflow/SQL/Jupyter Notebook/NumPy/JSONCaptivation Software · Annapolis Junction, Maryland - S
Airflow Python DeveloperSutherland · Hyderabad, TS - L
#111 - Data EngineerLifted, an Upwork Company™ · Hyderabad, TS
Jobs in Bangkok
- E
Agent-TransconExpeditors · Sathorn, Bangkok - E
Agent-Ocean ExportExpeditors · Bangkok, Bangkok - E
Agent-Air Export Customer ServiceExpeditors · Bangkok, Bangkok - E
Agent -Centralized TruckingExpeditors · Sathorn, Bangkok - E
Agent -Ocean ImportExpeditors · Sathorn, Bangkok - A
E-commerce Operations Specialist (KAM Support)aCommerce · Bangkok, Thailand
Browse these categories
Market data for this role
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.