Eligibility: Must live in Los Angeles to be considered
Overview
We are seeking a highly skilled Data Engineer to join our team. You'll work closely with data scientists, analysts, and developers to build robust, secure data models and pipelines that enhance our user data privacy, verification, and authentication processes.
Must Haves:
Azure Databricks
Python
Adobe CDP or Other CRM
Key Qualifications
Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field
4+ years of experience in data engineering, data warehousing, and big data technologies.
Proficiency in SQL and experience with relational databases (PostgreSQL, MySQL, SQL Server)
Experience with cloud platforms (Azure preferred, AWS, or GCP accepted)
Knowledge of big data technologies (e.g., Spark, Hadoop, Databricks)
Familiarity with Customer Data Platforms (CDPs); Adobe CDP experience is a plus
Strong problem-solving abilities and collaborative skills, with adaptability to a fast-paced environment
Responsibilities
Develop and maintain scalable data pipelines supporting identity verification and authentication
Collaborate with data scientists to prepare data for model training, validation, and deployment
Implement and optimize ETL processes for accuracy and reliability
Monitor and troubleshoot workflows, ensuring continuous data integration
Integrate data engineering solutions with the broader product architecture
Ensure compliance with data governance, privacy, and security regulations
Translate stakeholder data requirements into technical specifications
Document processes and contribute to best practices