[Intern] Big Data Development Engineer Intern
AI Summary
Bybit is hiring a Big Data Development Engineer Intern to research AI-driven data governance approaches, build automated model review and metric semantic layers, and deliver an end-to-end MVP for data quality and lineage automation on a real data domain.
About this role
About Us
-
Research & Benchmarking — Survey industry and open-source approaches in AI + data governance (metadata & lineage platforms, semantic layers, data quality frameworks, NL2SQL / NL2Metric); produce a best-practice proposal adapted to our tech stack.
-
Data Model Governance — Build AI-assisted model review capabilities: naming convention and layering (ODS/DWD/DWS/ADS) validation, duplicate and redundant model detection, lineage-based identification of unused / low-value / high-cost assets, and automated refactoring recommendations.
-
Metric Semantic Automation — Automatically extract and standardize metric definitions from SQL, lineage, and documentation; detect definition conflicts and redundant builds of the same metric across different reports; maintain a machine-readable semantic layer to support natural language metric queries.
-
Data Quality Automation — Auto-generate quality rules based on data profiling and lineage (replacing hand-written rules); perform anomaly detection on data volume, distribution, timeliness, and schema drift; conduct root cause analysis along lineage; implement automated alert grading and remediation recommendations (or auto-remediation).
-
MVP Delivery — Run at least one end-to-end implementation across the three areas: problem definition → solution design → prototype → deployment on a real data domain → quantified results (coverage, precision/recall of issue detection, manual effort saved) → iteration.
-
Documentation & Communication — Produce solution designs, evaluation methodologies, and results; present findings to platform and data stakeholders; deliver a reusable framework rather than one-off scripts.
-
Undergraduate or graduate student in Computer Science, Data Science, Statistics, or a related field.
-
Solid proficiency in SQL and Python. Understanding of data warehouse fundamentals — dimensional modeling, layered architecture, metadata, and lineage. Experience with Spark / Flink / Hive / StarRocks is a plus.
-
Hands-on experience with LLM application development: prompt engineering, RAG, Agent / tool-calling frameworks (e.g., LangChain, LlamaIndex, MCP), with the ability to evaluate whether an LLM system is actually effective.
-
Structured thinking: able to distill a vague governance pain point into a well-defined problem with quantifiable success criteria, and honestly articulate what the MVP validated and what it did not.
-
Self-driven and comfortable with ambiguity — this is an exploratory project with no predetermined answers.
-
Bonus: experience with DataHub / OpenMetadata / Atlas, dbt, Great Expectations / Deequ, or any metrics / semantic layer tooling.
-
Able to read technical materials in English; clear written communication skills.
-
Minimum 3-month internship commitment, 5 days per week on-site.
-
Fluent in Mandarin is required; fluent English is a plus.
Why Join Us
At Bybit, we are committed to fostering a supportive and enriching work environment.
Our benefits include:
- Study Growth Fund: We support your professional development and continuous learning.
- Internal Events: Participate in regular team-building activities, workshops, and events designed to promote collaboration and innovation.
- Global Collaboration: Be part of a diverse, international team, working alongside colleagues from around the world.
- Career Advancement: Access opportunities for growth and advancement within a rapidly expanding global company.
- Internal Mobility: Grow with us- Your long-term development is important to us. We offer internal job opportunities to help build your career path.
Skills
Explore related jobs
More jobs at bybit
Backend Development EngineerKuala Lumpur, Malaysia
Senior AML Specialist, Name Screening & Travel RuleKuala Lumpur, Malaysia
Senior AML Specialist, InvestigationsKuala Lumpur, Malaysia
Lead AML Product SpecialistAbu Dhabi, UAE
AML Expert, Process ExcellenceVilnius, Lithuania
Senior AML Specialist, Transaction MonitoringKuala Lumpur, Malaysia
Similar Anomaly Detection jobs
Jobs in Hong Kong
VFX and AI artistidNerd Studio Ltd. · Lai Chi Kok, Kowloon- Business Development Manager, DRFreshfields Rechtsanwälte Steuerberater PartG mbB · Hong Kong
- Manulife - Analyst Intern (6-months), Private Equity Asia, January 2027 IntakeCompany 19 - John Hancock Life Insurance Company (U.S.A.) · Hong Kong
- Associate/ Vice President, Global Client Sales Department, Global Markets Division for AsiaMUFG Bank, Ltd. · Hong Kong - Airside
- Vice President, Regulatory ComplianceUnited Overseas Bank (Malaysia) Bhd · Hong Kong (City Area)
- Associate, Structured Trade, Global Transaction Banking, Asia PacificF8F Santander Bank N.A. · Hong Kong
Browse these categories
Market data for this role
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.