Job Title: Cloudera Big Data Administrator / Senior Administrator (Hybrid)
Location: Reston, VA (Hybrid)
Hiring for 2 Position: 1 - Cloudera Big Data Administrator (Contract to Hire) and 1 - Senior Cloudera Administrator (Contract)
Job Summary:
We are seeking experienced Cloudera Big Data Administrators and Senior Administrators to manage, monitor, and enhance Big Data environments in the cloud. This is an administrator role (not a developer role) focused on building Cloudera clusters, setting up critical services, ensuring high availability, and optimizing performance using Cloudera CDP Public Cloud v7.2.17 or higher. Candidates should have deep technical expertise, a proactive approach to troubleshooting, and the ability to collaborate across teams to drive optimal outcomes.
Responsibilities:
Build and configure Cloudera clusters using CDP Public Cloud v7.2.17 or higher.
Set up and administer critical services, including NiFi, SOLR, HBase, Kafka, Knox, Hue, Hive, and IMPALA.
Implement high availability for services such as Hue, Hive, HBase REST, SOLR, and IMPALA on BDPaaS platforms.
Write and maintain shell scripts for health checks and automated responses to warnings or failures.
Monitor and manage service health using Cloudera Manager and address performance or operational issues proactively.
Access and manage databases, metastore tables, and write Hive/Impala queries via HUE.
Collaborate with application development, security, and platform support teams to identify and implement configuration changes for optimal service performance.
Assist with incremental updates, upgrades, cluster migrations, and new deployments.
Support testing, governance, data quality, training, and documentation efforts.
Skills & Requirements:
Core Requirements:
Cloudera CDP Public Cloud v7.2.17 or higher.
Apache Kafka Administration: Strong skills in troubleshooting, broker management, Streams API, stream processing, and Kafka integration with IBM MQ.
Apache NiFi Administration: Expertise in flow management, registry server management, and controller services. Integration with Kafka, HBase, and SOLR is essential.
HBase Administration: Experience with database management and troubleshooting.
SOLR Administration: Expertise in shard management, high availability, logging levels, collection management, and query optimization.
Additional Skills:
Proficient in AWS services (EC2, S3, EBS, EFS).
Experience with job workflow management using Hue.
Ability to implement security policies across Hadoop clusters using Ranger.
Troubleshoot issues related to Kerberos, TLS/SSL, and other workloads.
Scripting expertise with Shell and/or Python for automation.
Experience with streaming technologies such as Kafka, Spark, and Kudu.
Familiarity with YARN for resource allocation and job scheduling.
Preferred Qualifications:
Proven experience in debugging and resolving database integrity, performance, and connectivity issues.
Hands-on experience with Cloudera Manager tools for upgrades and configurations.
AWS or Cloudera certifications are a plus.
Work Arrangement:
This is a hybrid position requiring some on-site presence at our Reston, VA office.