Senior Cloud Data Engineer - Selective Insurance seeks Senior Cloud Data Engineer to work with Enterprise Data Lake team to devise/design system requirements/develop processes for solving business problems.
Duties: create low level architecture/tech. designs, develop ETL w/IICS/PySpark/Azure Data Factory pipelines, implement data integrations/provisioning in MS Azure Cloud environment from on-premise/Cloud data sources, design appropriate system structures, verify stability/portability/security/scalability of system structures.
Requires: B.S. Computer Science/EE/similar + 5 years experience with requirements gathering, designing databrick workflows, transforming data for parquet/hive, developing ETL dataflow processes. Experience with IICS/Azure SQL Data/Azure Data Lake/Azure DevOps/PySpark/Databricks.