We are seeking an experienced Data Engineer to support our dynamic pricing team by building and optimizing data pipelines for machine learning models. You'll collaborate with data scientists, analysts, and developers to enhance pricing strategies while ensuring seamless data integration and model deployment. Strong communication skills and client interaction are key for this role.
Must-Haves:
Proficiency in Python
Experience with Azure Databricks
Cloud platform experience (Azure preferred)
Excellent client-facing and communication skills
Responsibilities:
Develop and maintain scalable data pipelines for dynamic pricing models.
Collaborate with teams to prepare data for model training, validation, and deployment.
Implement and optimize ETL processes to ensure data accuracy and reliability.
Work closely with stakeholders to gather requirements and deliver effective data solutions.
Monitor and troubleshoot data workflows, ensuring continuous data integration.
Ensure data governance and compliance with privacy and security standards.
Qualifications:
Bachelor's or Master's in Computer Science, Engineering, or related field.
4+ years of experience in data engineering, with a focus on data pipelines and big data technologies.
Experience with relational databases (PostgreSQL, MySQL, or SQL Server).
Strong problem-solving skills and ability to work in a fast-paced environment.