Remote role - consultant can live anywhere in the US
Citizenship does NOT matter but communication does matter and must be excellent.
About the Role:
We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will have 5+ years of experience in data engineering with a strong focus on AWS technologies. This role involves designing, developing, and maintaining scalable data pipelines and processing systems. The candidate should be adept at managing and optimizing data architectures and be passionate about data-driven solutions. Knowledge of machine learning is a plus.
Key Responsibilities:
Design and implement scalable data pipelines using AWS services such as Glue, Redshift, S3, Lambda, EMR, Athena
Develop and maintain ELT processes to transform and integrate data from various sources.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
Optimize and tune performance of data pipelines and queries.
Ensure data quality and integrity through robust testing and validation processes.
Implement data security and compliance best practices.
Monitor and troubleshoot data pipeline issues and ensure timely resolution.
Stay updated with the latest developments in AWS data engineering technologies and best practices.
Required Skills and Qualifications:
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
5+ years of experience in data engineering with a focus on AWS technologies.
Expertise in AWS services such as Glue, Redshift, S3, Lambda, EMR, Athena,
Strong programming skills in Python, Pandas, SQL
Experience with database systems such as AWS RDS, Postgres and SAP HANA.
Knowledge of data modeling, ETL processes, and data warehousing concepts.
Familiarity with CI/CD pipelines and version control systems (e.g., Git).
Experience writing infrastructure as code using Terraform.
Familiarity with Glue Notebooks, Sagemaker Notebooks, Textract, Rekognition, Bedrock, and any GenAI/LLM tools
Strong problem-solving skills and attention to detail.