Posted today
Data Engineer, Senior
AI Summary
Develops and maintains Databricks, Python, Spark and SQL data pipelines and Qlik Sense reporting for defense and intelligence mission users. Also manages data access, troubleshoots production issues, and documents workflows.
About this role
All applicants must currently reside in the United States
Overview
BigBear.ai is seeking a Lead Data Engineer to develop and maintain data pipelines, reporting datasets, and analytics applications that support defense and intelligence operations. You’ll use Databricks, Python, Spark, and SQL to prepare data for analysis and reporting. You’ll work with engineers, analysts, and mission stakeholders to resolve data issues and deliver reliable information for operational planning and senior-leader decisions.
What you will do
- Develop, maintain, and troubleshoot data pipelines and transformations in Databricks using Python, PySpark, and SQL.
- Clean and validate source data, investigate discrepancies, and deliver datasets for operational reporting and analytics.
- Build and maintain Qlik Sense applications, dashboards, and SQL reports for mission users.
- Manage user access and permissions across data and analytics platforms in accordance with security and data governance requirements.
- Support database upgrades, system migrations, and production troubleshooting in coordination with engineering and operations teams.
- Document data workflows, reporting logic, and support procedures so other team members can maintain them.
- Work with mission stakeholders to translate operational reporting needs into data products and application improvements.
What you need to have
- Active TS/SCI clearance with the ability to maintain it.
- Bachelor’s degree in Information Systems, Information Technology, Computer Science, Engineering, or a related field.
- Five +years of combined experience supporting data or information systems through data engineering, analytics, database administration, or technical systems support.
- Hands-on experience using Databricks, Python, Spark or PySpark, and SQL to transform, validate, or analyze data.
- Experience maintaining data pipelines and developing reports, dashboards, or analytics applications.
- Experience troubleshooting production data or application issues and administering user access in a secure environment.
- Ability to work on-site Full time in Norfolk, Virginia.
What we'd like you to have
- Experience supporting the Joint Staff, Combatant Commands, or other Department of Defense or intelligence organizations.
- Familiarity with Global Force Management data, systems, or workflows.
- Experience developing and supporting Qlik Sense applications.
- Experience supporting database upgrades, system migrations, or DoD security hardening.
- AWS Certified Cloud Practitioner certification or experience with AWS data services.
- Familiarity with API-based data integration.
Pay transparency
Please note the targeted compensation range is provided as an estimate, and any actual compensation offer may vary depending on the needs of the company, or an applicant's skillset, competencies, experience, education, certifications, location, or other factors. The estimated range does not include the value of any benefits offered.
About BigBear.ai
BigBear.ai is a leading provider of AI-powered decision intelligence solutions for national security, supply chain management, and digital identity. Customers and partners rely on Bigbear.ai’s predictive analytics capabilities in highly complex, distributed, mission-based operating environments. Headquartered in McLean, Virginia, BigBear.ai is a public company traded on the NYSE under the symbol BBAI. For more information, visit https://bigbear.ai/ and follow BigBear.ai on LinkedIn: @BigBear.ai and X: @BigBearai.
BigBear.ai is an Equal opportunity employer all protected groups, including protected veterans and individuals with disabilities.
Skills
Explore related jobs
More jobs at BigBear.ai
Similar Databricks jobs
- S
Access ManagementSonoma Consulting Inc. · Cranston, RI - S
Access ManagementSQUIRCLE IT CONSULTING SERVICES PVT. LTD · Bengaluru, KA - I
Access ManagerIndra Group UK & Ireland · Redhill, England - A
Access ManagerAbraxas Youth and Family Services · Quakertown, PA - S
IBM Access ManagementSonsoft Inc · Carrollton, TX - S
Identity & Access ManagementSonsoft Inc · Cranston, RI
Jobs in Norfolk
- T
Palliative Care RN: Registered NurseThe US Oncology Network · Norfolk, Virginia - M
Tailor (Part-Time; Flexible Schedule)MES Service Company · Norfolk, Virginia - LLicensed Practical Nurse (LPN) FT EVENINGSLtcrevolution · Norfolk, Virginia
- LLicensed Practical Nurse (LPN) FT DAYSLtcrevolution · Norfolk, Virginia
- S
Site SupervisorStonbury Limited · Norfolk-Norwich, United Kingdom - S
Site Operative - East DeliveryStonbury Limited · Norfolk-Norwich, United Kingdom
Browse these categories
Market data for data engineer roles
All reports →- SeriesRole reportsOne role family at a time: how many openings, what changed this week, who is hiring, what it pays.
- SeriesSalary reportsWhat employers publish in job postings, by level and workplace. Not self-reported pay.
- Market overviewState of tech hiring, September 2026: up 4.8%Tech hiring rose 4.8% month over month in September 2026, with 411,122 new listings. Customer support and account executive roles led the growth.