Data Engineer at Core4ce in Arlington, Virginia

Job Description:

Core4ce

Data Engineer
644-383

Core4ce is seeking a Senior Data Engineer for a position within our R&D organization. This individual will play a significant role in developing highly optimized mission-ready data conditioning and delivery systems in support of mission analytics.

The ideal candidate supports critical mission objectives in near real-time – designing, engineering, and maintaining systems that accept data feeds (file and streaming) from a wide variety of sources. Because raw content itself is of nominal use to the mission, candidates are entrusted by the mission to build processes that extract, transform, and load data into downstream applications. This process is directed by mission requirements, but we are also interested in our data engineers contributing novel ideas to our data flows that support the customer mission. This role will also develop dashboards and automated alerting mechanisms to monitor data feeds. Mission success depends on flagging data flow failures and restoring data to mission users and systems, with maximum urgency and minimal delay.

Responsibilities

Candidate will design and develop new software products or make significant enhancements to existing software. The ideal candidate is a hands-on data engineer with experience using AWS infrastructure, Apache NiFi, and data pipeline development. Candidate must have expertise in a modern service-oriented architecture and must be familiar with working on an Agile team environment. The successful candidate will be one who embraces a culture of learning, growth, and risk.

Requirements

• Ability to obtain a U.S. Security Clearance
• 3+ years developing, testing, and maintaining data pipelines with Apache NiFi and proficiency with data orchestration frameworks
• 5+ year experience developing data ETL processes.
• 3+ year experience with Docker and/or Kubernetes, or managed service equivalents (e.g., ECS, EKS)
• Able to deploy and maintain data engineering pipelines
• 3+ years’ experience programming in Bash, Python, and/or Java.
• 3+ years’ experience working with a variety of AWS data services such as Lambda, Translate, EC2, S3, Glue, and OpenSearch
• 3+ years of experience with common CI/CD toolkits including Git / Github
• 3+ years’ experience working with and implementing APIs
• Working level familiarity with ELK stack . Able to develop dashboard visualizations in kibana from data in elasticsearch and logstash.
• 3+ years' experience developing high-quality prototypes for stakeholder demonstrations.
• Ability to work remotely on a distributed team
• Experience working in a team following an agile delivery process like Scrum or Kanban

All qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, disability, veteran status, age, marital status, pregnancy, genetic information, or other legally protected status.

Arlington, Virginia, United States

Full-Time/Regular

PI258852652

Apply Now