Location: Austin, TX (Preferred), or Remote (CDT Time Zone)
Our Fortune 2 IT client is the largest online retailer and technology provider in the US, which is now focusing on revolutionizing the grocery shopping experience. We are seeking a talented and motivated Data Engineer to join our team, working on a high-priority/visibility product. In this role, you will play a pivotal part in optimizing and consolidating existing pipelines and contributing to the enhancement of our systems and processes.
Requirements:
7+ years of experience with design, implementation and management of data processing systems dealing with large data sets.
Proficiency in Python
Hands-on experience and advanced knowledge of SQL.
Knowledge of data management fundamentals and data storage principles.
Knowledge of distributed systems as it pertains to data storage and cloud computing
Experience working with Open-Source Big Data tools (Hadoop, Spark, Hive, Presto and etc.)
Preferred Qualifications:
Experience in working and delivering end-to-end projects independently.
Relevant experience in one of the following areas: Data engineering, database engineering, business intelligence, or business analytics.
Experience working with AWS Big Data Technologies (AWS Glue, EMR, Athena, Ec2, Redshift and S3 etc.)
Experience working with Oracle, PostgreSQL, SQL Server or MySQL.
Experience working with visualization tools such as Tableau and Power BI.
Proven success in communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and data engineering strategy
Experience providing technical leadership and mentoring other engineers for best practices on data engineering
Knowledge of software coding practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
Education
Bachelor's degree or higher in a quantitative/technical field (e.g. Computer Science, Statistics, Engineering)