Hadoop Developer (pyspark)
at Tata Consultancy Services
in
Pittsburgh,
Pennsylvania
Posted in Other about 5 hours ago.
Type: full-time
Job Description:
Role : Hadoop Data Engineer
Location : Pittsburgh,PA
Pay range -120k
experience 7+years
Job Description
Deep understanding of Hadoop ecosystem technologies.
2. Strong Proficient in PySpark for data processing and analytics.
3. In-depth knowledge of Hive for data warehousing and querying.
4. Experienced with Livy for interactive job submission.
5. Proficiency in shell scripting for automation and orchestration.
6. Hands-on experience with AWS SageMaker for machine learning model development and deployment.
7. Excellent communication and interpersonal skills, with the ability to collaborate with cross functional team.
8. Strong Problem-solving skills.
9. Ability to work independently and effectively prioritize tasks in a fast-paced environment.