Job Description:
We are looking for a Data Engineer for one of our clients in Mclean, VA
Responsibilities:
- Develop new tools, code & services for data engineering activities
- Execute data movement of structured & unstructured data using approved methods
- Perform data ingestion activities for local or enterprise storage
- View and analyze data in source format
- Develop code for data exploration formatting
- Collaborate with Data Scientists & partners to determine optimal data formats and transformations
- Create tools for one-time & ongoing data formatting/transformations
- Implement ETL code following best practices/standards
- Develop ETL Code, Transition Plans
- Create comprehensive documentation including ETL mappings, Code usage guides, Code location & access instructions, Facilitate Code Reviews
- Provide consulting services for: Data transport, Data ingestion, Data conditioning, Data access, Data management
Clearance: - TS/SCI Full Scope Polygraph
Mandatory Skills:
- Extract, Transform, and Load (ETL) tools and processes
- Python
- AWS
- SQL
- APIs
- Linux
- Geospatial tools/data experience
Desired Skills:
- Docker
- Jenkins
- Hadoop/Spark
- Kibana
- Kafka
- NiFi
- ElasticSearch