Our client is seeking a Cloud Engineer to join their hybrid team in Hopkins, Minnesota! They are looking for a candidate who has an interest in back end development, devOps, ETL, and cloud engineering. They are specifically looking for a candidate who has experience with GCP and/or AWS. The selected candidate should have experience with ETL using the service catalogue offerings of either AWS or GCP.
Duties:
Connect with downstream app owners, explaining to them the overall migration plan to Azure Synapse
Assist in functional and performance testing of the new environment before releasing the Synapse environment to customers
Build documentation and workflows for application sign-off for each of the environments
Enter stories for each application area in Jira and updating accordingly during the project to completion. Attend daily scrum
Work with the downstream app owners on getting appropriate drivers installed on their systems in all environments
Work with the downstream app owners to configure the endpoint to the new Synapse environment when it becomes available
Work with the downstream app owners to test and change all their programs to account for the new environment and sign off upon completion
Log any issues as cases with the Microsoft vendor and work on the issue until resolution
Desired Skills/Experience:
5+ years of experience as a Data Analyst with Azure Synapse and SQL coding experience
Experience in the onboarding to Azure Synapse with an understanding of dedicated, serverless, and spark pools, and the different features and functionality of Synapse and role-based permissions
Knowledge of Azure Active Directory, Azure Data Lake storage and Azure Data Factory
Experience in migration projects from on-prem data to Azure Synapse
Experience with minimally two ETL tools such as SSIS, Informatica and DataStage
Hadoop/Hive experience with a good knowledge in working with Delta and Parquet tables