Software Engineer
HerndonOn-siteFull-time
AI Summary
Software Engineer responsible for building and managing data pipelines, with cloud and data processing expertise, security clearance requirement, and experience with Python, AWS, Spark, SQL, and Linux.
About this role
馃敀 Clearance & Citizenship Requirements
This position requires U.S. Citizenship and an active TS/SCI security clearance with Full Scope Polygraph. Candidates who do not currently hold these credentials will not be considered.
REQUIRED SKILLS
Demonstrated experience building and managing data pipelines.
Demonstrated experience with python.
Demonstrated experience with cloud computing using AWS services.
Demonstrated experience processing data using Apache Spark.
Demonstrated experience with an RDBMS (Relational Database Management System) (Postgres, Oracle, MySQL) and writing SQL queries.
Demonstrated experience with Linux and shell scripting.
Demonstrated experience analyzing data in different file formats like csv, xml, json, avro, parquet, etc.
Demonstrated experience writing and validating unit tests.
DESIRED SKILLS
Demonstrated experience in NiFi, Apache AirFlow, or an equivalent solution or tool for orchestrating data pipelines.
Demonstrated experience with java or scala.
Demonstrated experience administering an EMR/Spark cluster.
Demonstrated experience conducting performance tuning of a spark job.
Demonstrated experience supporting Hive, Iceberg, or another technology providing SQL access to data.
Demonstrated experience developing cloud-based security solutions.
Demonstrated experience following a configuration management process to review and deploy code as patt of releases.
Skills
Apache SparkAvroAWSCSVJSONLinuxMySQLOracleParquetPostgreSQLPythonShell ScriptingSQLUnit TestingXML
