Hadoop Engineer at Devfi in Scottsdale, Arizona

Posted in Other about 13 hours ago.

Type: full-time





Job Description:

Hadoop Engineer with CloudEra

Project Duration
  • Contract, 6-12 Months

****Day1 onsite at Scottsdale, AZ

Skills required:
  • Experience : 6-9 Years
  • Must have Primary skills required are Cloudera (Hadoop), Spark + Scala or Spark + Java and SQL
  • The resources should also have a good understanding of Hive, Aerospike.
  • The resources should have strong analytical skills

Scope of work:
  1. Persistent resources will be taking the KT from the current team members on the developed framework.
  2. The team will need to work on the following aspects:
  3. Documentation of lineage as per the existing template.
  4. Understanding the DQ rules from the data science team.
  5. Onboarding of new incremental datasets along with configuration of the DQ rules etc.
  6. Perform data validation checks.
  7. Copying of production data into test environments - to be confirmed.
  8. Report on the DQ issues


Thanks,

Raju Ch

216-343-3435
More jobs in Scottsdale, Arizona

Other
about 4 hours ago

Federal Express Corporation
Other
about 4 hours ago

Federal Express Corporation
Other
about 7 hours ago

Baker Tilly Advisory Group, LP
More jobs in Other

Other
less than a minute ago

Guardian Protection Products
Other
less than a minute ago

Guardian Protection Products
Other
less than a minute ago

Guardian Protection Products