Posted 4 months ago

Data Engineer - Mid

Bolling, AFB, DCRemoteFull-time

AI Summary

Designs, develops, and maintains scalable data pipelines and infrastructure to support enterprise AI/ML operations; builds ETL/ELT pipelines, data models, and quality monitoring for chatbot training and analytics.

About this role

Spear AI is a growing defense contracting company dedicated to delivering cutting-edge solutions that support our nation's security. As we expand, we're building a culture where innovation meets mission-critical work. We operate with a flat organizational structure that empowers every team member to make an impact, collaborate directly with leadership, and contribute to projects that matter. Whether you're joining our Hardware, Software, or Services division, you'll work alongside talented professionals who are committed to excellence and advancing the capabilities that keep our nation safe and secure.

Designs, develops, and maintains scalable data pipelines and infrastructure to support enterprise AI/ML operations. Works with structured and unstructured data sources to ensure reliable data flow for chatbot training and operational analytics. Opportunity to work on real-world projects that directly impact warfighter capabilities and mission success.

Key Responsibilities

Develop and maintain ETL/ELT pipelines for processing large-scale datasets

Design data models and schemas optimized for AI/ML workloads

Implement data quality monitoring and validation frameworks

Collaborate with AI engineers to understand data requirements and optimize data delivery

Troubleshoot data pipeline issues and implement performance improvements

Maintain documentation for data flows, transformations, and pipeline architectures

Support data governance initiatives and ensure compliance with data handling policies

Qualifications

5+ years of experience in data engineering or related field

Active TS/SCI clearance with ability to obtain CI Polygraph

Proficiency in Python, SQL, and data processing frameworks (Apache Spark, Kafka, etc.)

Experience with cloud platforms (AWS preferred, Azure, GCP) and containerization technologies

Knowledge of data warehousing concepts and modern data stack tools

Understanding of version control systems and CI/CD practices

AWS experience highly preferred but not required

Military experience strongly preferred

What We Offer

Unlimited PTO – Take the time you need to recharge and maintain work-life balance

Dedicated Sick Time – Your health and wellbeing come first

Comprehensive Health & Benefits – Medical, dental, and vision coverage to keep you and your family protected

11 Paid Holidays – Enjoy time off throughout the year to celebrate and spend with loved ones

Professional Development – Educational opportunities and resources to help you grow your skills and advance your career

Collaborative Environment – Work directly with leadership in our flat organizational structure where your ideas and contributions matter

Mission-Driven Work – Contribute to projects that directly support national security and make a real-world impact

Growth Opportunities – Join us during an exciting expansion phase where you can help shape our future

Additional Benefit Opportunties when you choose Spear AI

401(k) with company match

Onsite / Remote / Flexible work arrangements or hybrid options (position dependent)

Relocation assistance (position dependent)

Referral bonuses

Performance bonuses

Life insurance and disability coverage

Technology home office setup stipend

Professional certification reimbursement

Skills

Apache SparkAWSAzureCI/CDData WarehousingDbtDockerGCPGitKafkaKubernetesPythonSnowflakeSQL

Explore related jobs

More jobs at Spear Ai

Similar Apache Spark jobs

Browse these categories

Remote Jobs Remote Jobs With No Experience Required AWS Jobs Azure Jobs CI/CD Jobs

Market data for data engineer roles

All reports →