Big Data Engineer at The Judge Group Inc. in Malvern, Pennsylvania

Job Description:

Location: Malvern, PA

Description: Our large, financial services client located in Malvern, PA is looking for a Big Data Engineer (1+ Year Contract/Hybrid).


This job will have the following responsibilities:

• Writes ETL processes, designs database systems, and develops tools for real-time and offline analytic processing.


• Troubleshoots software and processes for data consistency and integrity. Integrates complex and large scale data from a variety of sources for business partners to generate insight and make decisions.


• Leads all phases of solution development. Explains technical considerations at related meetings, including those with internal clients and less experienced team members.


• Tests and implements new software releases through regression testing. Identifies issues and engages with vendors to resolve and elevate software into production.

Qualifications & Requirements:

• 
  MANDATORY- Python, CI/CD pipeline (Bitbucket, Bamboo, GitHub), AWS Services-S3, Glue, Athena, EMR Cluster, Redshift, Pandas, Spark, Lambda, CloudFormation, IAM, Service Catalog, SQL, ETL Processes
• 
  GOOD TO HAVE- Collibra, Dremio, Tableau, Data Modeling

Contact: dcalingo@judge.com


This job and many more are available through The Judge Group. Find us on the web at www.judge.com Apply Now