This automotive/retail company is seeking a Senior Data Engineer to implement, architect, and manage scalable data infrastructure. In this role, you will work with cross-functional teams and support machine learning and advanced analytics projects. You will also work in a collaborative team environment.
Role Responsibilities:
Design and implement scalable data pipelines for diverse data using Apache Spark, Hadoop, and Kafka.
Utilize cloud environments (AWS, Azure) and services for efficient data handling and processing.
Develop and optimize data models and storage solutions to support operational and analytical applications.
Automate data workflows using ETL tools to ensure timely availability of data for analytics.
Collaborate closely with data scientists, providing necessary infrastructure and tools for complex analytical models.
Skills:
8+ years of data engineering experience
Designs and operates large scale data pipelines
Develops ETL workflows
Platform services experience with Databricks, AWS native, or Dataiku
Experience with big data technologies - Spark, Hadoop, or Kafka
Cloud environment experience - AWS or Azure
Bonus - knowledge of ML model deployment and management practices
Strong communication with technical and nontechnical stakeholders
BENEFITS:
$120,000 - $160,000 Base Salary + Bonus + Benefits
HOW TO APPLY Please register your interest by sending your Resume to Emma Spagnola via the Apply link on this page or at emmaspagnola@harnham.com.