We are seeking an experienced Lead Data Engineer with a strong background in data engineering, Python, SQL, and AWS to join our team. This role will be responsible for designing, building, and maintaining scalable data pipelines, data models, and performing data analysis to support evolving needs. The ideal candidate will have deep technical expertise, leadership skills, and a passion for working in a dynamic environment.
Key Responsibilities:
Design, build, and maintain scalable and efficient data pipelines.
Perform data modeling, analysis, and ensure data integrity.
Collaborate with cross-functional teams to gather requirements and design data solutions.
Work with cloud services to build integrated production applications (AWS - EC2, ECS, API Gateway, Lambda).
Implement CI/CD pipelines and take on DevOps responsibilities to deploy and support software in production.
Evaluate, install, and configure database management systems and data platforms.
Assist in database design, capacity planning, and performance tuning.
Document and communicate database design, standards, and guidelines.
Technical Stack:
Languages: Python, SQL
Data Tools: Data Bricks, AirFlow
Cloud Services: AWS (EC2, ECS, API Gateway, Lambda, EMR)
DevOps Tools: CI/CD, Git, Jenkins
Qualifications:
Bachelor's Degree (preferred) or equivalent experience.
Minimum 8 years of relevant work experience in data engineering, building data pipelines, and data modeling.
Proven experience with cloud services (AWS) and building integrated applications in production.
Expertise in Python programming and extensive experience with SQL.
Hands-on experience with Data Bricks and AirFlow.
Familiarity with implementing CI/CD pipelines and supporting software in production.
About Brickred Systems:
Brickred Systems is a global leader in next-generation technology, consulting, and business process service companies. We enable clients to navigate their digital transformation. Brickred Systems delivers a range of consulting services to our clients across multiple industries around the world. Our practices employ highly skilled and experienced individuals with a client-centric passion for innovation and delivery excellence.
With ISO 27001 and ISO 9001 certification and over a decade of experience in managing the systems and workings of global enterprises, we harness the power of cognitive computing hyper-automation, robotics, cloud, analytics, and emerging technologies to help our clients adapt to the digital world and make them successful. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.