The Data Engineer will play a crucial role in consuming and processing data files being moved from SAP into IBM Sterling. This position requires expertise in data integration, transformation, and management to ensure a seamless transition and optimal performance of our new system. The engineer will assist in the migration of data from SAP and the client's internal Order Management System (OMS) to IBM Sterling, ensuring data integrity and accuracy. They will also manage file staging, recording, and data validation processes, importing validated data into Snowflake for transformation and modeling.
REQUIRED SKILLS AND EXPERIENCE
- Experience using databricks for data processing and transformation.
- Experience using snowflake for data storage and management.
- Experience with IBM Sterling or Cognos for data integration and reporting.
- Proficiency in XML and JSON for data interchange transformation.
Proficiency using python for scripting and automating workflows.