Senior Data Engineer
at Pronix Inc
in
Charlotte,
North Carolina
Posted in Other about 2 hours ago.
Type: full-time
Job Description:
Job Title: AWS Data Engineer Location: Charlotte, NCDuration: 12 MonthsResponsibilitie
- Experience - 10+Yrs of Overall IT Experien
- ceDesign, develop, and optimize data pipelines and workflows using Databrick
- s.Implement and manage Unity Catalog to ensure data governance, security, and complianc
- e.Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solution
- s.AWS (Glue, Athena, EMR Cluster, Redshift, Lambda, S
- 3)Monitor and troubleshoot data processing jobs to ensure reliability and performanc
- e.Develop and maintain documentation for data engineering processes and best practice
- s.Stay up-to-date with the latest developments in Databricks and Unity Catalog to continuously improve our data infrastructur
e.Requirement
- s:Bachelor's degree in Computer Science, Engineering, or a related fiel
- d.Proven experience as a Databricks Engineer or similar rol
- e.Hands-on experience with Unity Catalog and its implementatio
- ETL Tolls
- n.Strong proficiency in SQL, Python, and Spar
- k.AWS (Glue, Athena, EMR Cluster, Redshift, Lambda, S
3)