Posted 3 months ago
Synthetic Data Engineer (AI Data/Training)
Oregon, USAOn-siteFull-time
AI Summary
Designs and implements domain-specific synthetic data generation pipelines and automated quality systems to produce high-quality training data for SFT and DPO model training loops.
About this role
We are seeking a talented and innovative Synthetic Data Engineer. In this role, you will design and implement domain-specific synthetic data generation pipelines, ensuring high-quality data management for training loops. Your expertise will drive the success of data processing and model training within the organization.
Responsibilities:
- Design domain-specific synthetic data generation (SDG) pipelines via self-instruct and constitutional prompting.
- Implement automated quality scoring and de-duplication systems.
- Manage data pipelines that feed directly into SFT and DPO training loops.
Qualifications:
- Proven experience building large-scale data pipelines (Airflow, Spark, Ray).
- Deep knowledge of prompt engineering for data generation.
- Familiarity with dataset distillation and bias mitigation.
Skills
AirflowBias MitigationData PipelinesDataset DistillationDe-duplicationPrompt EngineeringQuality ScoringRaySparkSynthetic Data Generation
Explore related jobs
More jobs at Hyphen Connect Limited
- General Counsel (Crypto & Commercial Litigation) - Hong Kong OnsiteAPAC
- Content Operations Specialist (US stock contract) - Crypto ExchangeGlobal
- VIP BD Manager/ Director - Global RemoteGlobal
- Web3 Frontend Developer (UX)APAC
- Sales Operations ManagerRemote - Hangzhou, China
- Compliance Officer/ Money Laundering Reporting Officer (CO/MLRO)Hong Kong