We are on the lookout for a Senior Data Engineer for a direct client.
This is a long-term contract role, at least 12 months.
This is based in Santa Monica, CA and would require some onsite time, but there is an opportunity for the hiring manager to allow remote work on a case by case basis.
3 - 5 years experience in Quality validating ETL pipelines and Data Warehouses
Expert SQL knowledge and experience working with relational databases as well as a working familiarity with a variety of databases.
Good experience in data analytics, data engineering, data modeling, data warehousing, and big data platform
Strong programming (Scala/Java) or scripting skills (Python)
Experience with but not limited to JUnit/TestNG/BDD or similar tools
Experience in a range of common big data tools & technologies such as Airflow, Hive, Snowflake, Databricks, Spark etc.
Experience in working with large datasets (Terabytes or more)
Test and validate ETL logic and Data Pipelines
Own the quality of every release into production with a data-driven approach
Create, deliver and continuously improve our quality processes for delivering operational
data to address all types of subscriber and commerce operations to our stakeholders.
Partner with Data Analysts, Product and Engineering teams to deeply understand the underlying transactional systems behavior and business use cases.
Translate reporting and operational technical specifications, including calculations, custom groups, parameters, filtering criteria and/or aggregations into test requirements.
Build automated and reusable tests for data stores to improve quality and development velocity
Diagnose issues, report defects, and propose regression tests to catch recurring bugs
Mentor fellow Test Engineers on the team to ramp up on automation concepts and contribute towards expanding test coverage