Hyphen Connect Limited
Posted 1 month ago
Synthetic Data Engineer (AI Data/Training)
BostonOn-site
AI Summary
Synthetic Data Engineer focused on designing domain-specific synthetic data generation pipelines, automated quality scoring, and data pipelines for SFT and DPO training loops.
About this role
We are seeking a talented and innovative Synthetic Data Engineer. In this role, you will design and implement domain-specific synthetic data generation pipelines, ensuring high-quality data management for training loops. Your expertise will drive the success of data processing and model training within the organization.
Responsibilities:
- Design domain-specific synthetic data generation (SDG) pipelines via self-instruct and constitutional prompting.
- Implement automated quality scoring and de-duplication systems.
- Manage data pipelines that feed directly into SFT and DPO training loops.
Qualifications:
- Proven experience building large-scale data pipelines (Airflow, Spark, Ray).
- Deep knowledge of prompt engineering for data generation.
- Familiarity with dataset distillation and bias mitigation.
Skills
AirflowApache SparkBias MitigationConstitutional PromptingData PipelinesData Quality ScoringDataset DistillationDeduplicationPrompt EngineeringRaySDG (synthetic Data Generation)Self-instructTraining Loop Data Management
Explore related jobs
More jobs at Hyphen Connect Limited
- Sales Operations ManagerRemote - Hangzhou, China
- Compliance Officer/ Money Laundering Reporting Officer (CO/MLRO)Hong Kong
- DeFi Product Owner (Bilingual: English & Mandarin)Remote - Global
- Senior 2D Game Artist (Characters & Animation) - Taiwan/ Hong KongAPAC
- Social Media Content Creator (Instagram Reels | AI-Driven)APAC
- Founding Engineer/ Tech Lead (Stablecoin Cross-border Payments Infrastructure)APAC
Similar Airflow jobs
Jobs in Boston
- GSenior Social Media StrategistGupta Media · Boston, United States
- CFabrication Shop Associate, HVAC DuctCannistraro · Boston- Seaport District, United States
- CFabrication Shop Associate, Fire ProtectionCannistraro · Boston- Seaport District, United States
- ZSenior Medical Director, Pharmacovigilance (PV)Zevra Therapeutics, Inc. · Boston, Morocco
- People Operations Program ManagerTive Inc · Boston, Morocco
Business Development RepresentativeZappi · Boston, Morocco