The Data Engineer will analyze, design, develop, performance tuning, test their code as well as others code and support initiatives to build an enterprise integration framework while providing inputs for improving standards for data mapping, integration, and data traceability across the NAPA business functions.
Qualifications:
Five or more years' experience in software engineering.
Five or more years' experience in large scale RDBMS environments or Google BigQuery
Two or more years of Exadata experience OR Google BigQuery
Four or more years' experience with Informatica PowerCenter or IICS
One or more years experience in Erwin
Experience in code automation (e.g. pattern based integration)
Experience in advanced SQL and PL/SQL techniques
Experience in building re-usable Utility packages
Experience with testing the code
Focus on continuous improvement
Experience in Unix shell and Python scripting
Integration design & data modeling skills in Data lake and Data Warehousing environments
Experience with Streaming technologies is a plus( STRIIM, Kafka, etc)
Experience with other Informatica tools is plus - e.g., Metadata manager, Analyst, DVO, Data Quality
Exposure to both on-prem and cloud Integration solutions
Familiarity with non-relational DB technologies is a plus
Experience with automated testing
Experience with both batch and real-time patterns for integration s
Ability to build and analyze complex integration workflows from heterogeneous data sources
Experienced in large Enterprise Data Warehouse & Integration projects.
Strong background in full lifecycle development using multiple platforms or languages.
Ability to interact at a technical and non-technical level with Infrastructure, Network, Development, BA and QA teams.
Development experience in high transaction/high availability systems.
Experience with analyzing and recommending solutions for Production issues short-term and long term.
RESPONSIBILITIES:
The ETL Engineer performs design, development and implementation of integration processes for both the Enterprise Data lake, Data Warehouse and Applications
Analyzes requirements and existing resources to create efficient database and integration designs that meet company IT standards.
Works with project and business analyst leads to develop and clarify in-depth technical requirements.
Participates in all phases of the integration development lifecycle, including unit testing, quality assurance(QA) and ongoing support.