This position is primarily remote. With that said, candidates must reside in Maryland, Washington, DC, Virginia, or West Virginia to consider working onsite in Reston, VA up to once per month for "moments that matter."
Responsibilities
Our client is looking for a Lead Ab Initio Data Engineer to join a team that is working on a MongoDB buildout project for a very, very important business use case. While this will be the initial focus, once the project is complete, the Lead Ab Initio Data Engineer will be moved to new projects, as there is plenty of work budgeted for throughout the remainder of the year into 2025.
General responsibilities include:
Work with Business Analysts and Product team to gather data requirements.
Transform the data to create a consumable data layer for various application uses.
Support data pipeline with bug fixes, and additional enhancements.
Document Technical design, Operational Runbook, etc.
Required Skills & Experience
8+ years of experience in data engineering and implementing scalable and fine-tuned ETL solutions for optimal performance.
5+ years of ETL design and development experience using Ab Initio.
Experience using the Ab Initio Continuous>Flows product.
Experience leading at least one data integration project.
Data Integration project experience on the Cloudera platform.
Exposure to Amazon Web Services (AWS) services and systems (RedShift, Kafka, Glue, etc.).
Working knowledge of HDFS, Hive, Impala and other related Hadoop technologies.
Sound understanding of SQL and ability to write well performing SQL queries.
Good knowledge of OLTP and OLAP data models and other data warehouse fundamentals.
Rigor in high code quality, automated testing, and other engineering best practices, ability to write reusable code components.
Ability to unit test the code thoroughly and to troubleshoot issues in production environments.
Working experience with Unix/Linux shell scripting.
Ability to work independently and support other junior developers as needed.
Knowledge of Agile Development practices.
Preferred Skills & Experience
Java development experience.
Experience in the healthcare/health insurance industry.