ETL Engineer SME

Be Challenged and Make a Difference

In a world of technology, people make the difference. We believe if we invest in great people, then great things will happen. At AnaVation, we provide unmatched value to our customers and employees through innovative solutions and an engaging culture.

Description of Task to be Performed:

AnaVation is seeking a highly skilled Senior-level ETL Engineer to join our team deliver engineering tasks to advanced analytic applications across classified environments. You will develop sophisticated data pipelines and ETL processes for desktop and web-based analytic software, facilitate the bulk analysis of relational information, and enable applications that deliver data from diverse data sources. This position offers hybrid flexibility, but candidates must be local to the DMV area. Onsite requirements are subject to change based on customer needs.

Key Responsibilities

• Design and implement complex data pipelines and ETL processes to support cyber investigative capabilities across multi-classification domains
• Architect and develop ETL workflows for highly sensitive data in classified environments
• Support IC Data Services requirements by integrating various intelligence data sources and systems
• Develop and maintain data analytics solutions for desktop and web-based visual analytic applications
• Establish applications that produce manageable, actionable intelligence from streams of structured and semi-structured data
• Design strategies for enterprise database systems and set standards for operations, programming, and security
• Construct and optimize large relational databases across multi-enclave environments (Unclassified, Secret, and Top Secret)
• Tune performance of large-scale data workflows, ensuring cost efficiency, low latency, and high availability
• Design and manage Elasticsearch/Opensearch clusters for fast search, indexing, and retrieval of large-scale datasets
• Integrate new systems with existing warehouse structures and refine system performance and functionality
• Implement CI/CD pipelines for data systems, automate monitoring/alerting, and enforce infrastructure-as-code practices
• Provide technical leadership and mentorship to other team members
• Participate in Program Increments (PIs) and Agile Release Train (ART) activities

Minimum Qualifications:

Bachelor's degree in Computer Science, Data Science, Engineering, or related field

Minimum of 10 years of experience in data engineering or related field

Active Top Secret (TS) clearance with eligibility for Sensitive Compartmented Information (SCI)

US Citizenship is required.

Experience with Agile methodologies

Understanding of data warehousing and business intelligence concept

Data analysis, query, aggregation, and visualization techniques

ETL processes and data transformation

SQL and database technologies (MySQL, PostgreSQL, Microsoft SQL)

Software development fundamentals

Data management and big data technologies

Version control systems (Git)

Advanced proficiency with:

Python for data processing, automation and ETL workflow orchestration

Elasticsearch or Opensearch (design, scaling, query optimization, cluster management)

Data pipeline technologies (Apache Nifi, Cribl)

Cross-domain ETL solutions for secure data transfer between classification levels

Cloud platforms (AWS GovCloud, SC2S, C2S)

Work Environment

Primary location: Chantilly, VA

May require occasional travel for Program Increment planning sessions

Must be a U.S. citizen and able to pass a background check and polygraph examination

May require flexible scheduling to support critical operations

Containerization and orchestration technologies (Docker, Kubernetes)

GraphQL: schema design, API development, and query optimization

DevSecOps practices and tools in classified environments

Experience with RabbitMQ and Redis

Knowledge of IC specific data formats, schemas and transfer protocols

Prior work integrating intelligence data across multiple enclaves

Cloud certification