SUMMARY: The Cloud Data Engineer role develops and maintains robust and scalable integrations and data pipelines. This role will be part of a collaborative remote team working closely with other engineers, analysts, architects, and business stakeholders to develop reliable and modular data flows and integrations on an agile cycle that automate core business needs at scale and empower online education for students across the United States.
ESSENTIAL FUNCTIONS: Reasonable accommodations may be made to enable individuals with disabilities to perform the essential duties.
Develop modular data integrations following an event-based architecture, partnering with data analysts and architects to understand and meet development requirements for each use-case.
Partner with other engineers and technical leads for collaboration, support, and alignment throughout design/development and to solve development blockers if they arise.
Develop robust unit testing on developed code and drive integration, end-to-end, and performance testing to ensure each data integration is reliable, scalable, and meets business needs before deployment.
Drive developed integrations through a CI/CD process to validate, test, and deploy reliable solutions for production use.
Communicate and demo developed data integration solutions and progress with stakeholders in bi-weekly sprint reviews to drive transparency and collaboration between teams.
Maintain deployed data integrations, monitoring for any issues and resolving as they arise.
This position has no formal supervisory responsibilities.
MINIMUM REQUIRED QUALIFICATIONS:
Bachelor's degree in Computer Science, Information Technology, or equivalent training;
Three (3) years of relevant professional experience working with, building, and/or managing AWS cloud services including AWS Lambda, Step Functions, DMS, Kinesis, S3, RDS, Glue, EC2, CloudWatch, CloudFormation or equivalent Azure/GCP services;
Proficiency in Python development;
Proficiency in using SQL and APIs to automate interactions with various data stores and systems;
Familiarity with pub/sub event-based architecture and ETL data pipeline patterns;
Demonstrated experience with software development best practices including developing robust unit, integration, functional, and performance tests>;
Demonstrated experience following enterprise-grade DevOps practices including release management, CI/CD pipelines;
Demonstrated success in working with a highly collaborative and agile remote development team;
Excellent verbal and written communication skills;
Proficiency in the Microsoft Office Suite (Excel, Word, PowerPoint and SharePoint);
Ability to travel up to 10% of the time;
Ability to clear required background check;
Certificates and Licenses: None required.
DESIRED QUALIFICATIONS:
Experience in education and/or educational technology industries;
Experience developing pub/sub event-based architectures, data streaming, data integration, and batch data pipelines;
Experience working with various data storage types including relational databases, object storage, graph databases, data warehouses;
Experience with Snowflake or equivalent data warehousing and services;