Dexian is seeking a Hadoop Developer for an opportunity with a client located in Kennesaw, GA.
Responsibilities:
Utilize multiple architectural components in design and development of client requirements
Maintain, improve, clean and manipulate data for the operational and/or analytics data systems
Constantly looking for better ways of solving technical problems and designing the solution without being afraid of challenging the status quo
Document and communicate required information for deployment, maintenance, support, and business functionality
Adhere to team delivery/release process and cadence pertaining to code deployment and release They must have a proven ability to drive business results with their data-based insights The right candidate will have a passion for discovering solutions hidden in large data sets and working with stakeholders to improve business outcomes
Design, develop, and maintain data processing pipelines using Cloudera technologies such as Apache Hadoop, Apache Spark, Apache Hive, and Python
Collaborate with data engineers and data scientists to understand data requirements and translate them into technical specifications
Develop and maintain data ingestion frameworks for efficiently extracting, transforming, and loading data from various sources into the Cloudera platform
Optimize and tune data processing jobs to ensure high performance and scalability
Implement data governance and security policies to ensure data integrity and compliance
Monitor and troubleshoot data processing jobs to identify and resolve issues in a timely manner
Perform unit testing and debugging of data solutions to ensure high quality and reliability
Document technical specifications, data flows, and data architecture diagrams
Stay updated with the latest advancements and best practices in Cloudera technologies and big data analytics
Requirements:
Experience with Agile Methodologies
Add experience with Python scripting for data engineering to qualifications
Ability to pick new products quickly to understand their data
Strong problem solving skills with an emphasis on product development
Experience working with and creating data architectures
Excellent written and verbal communication skills for coordinating across teams
A drive to learn and master new technologies and techniques
Experience working with AutoSys
5-7 years of experience with distributed data/computing tools: Hadoop, Hive, MySQL, etc
Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian's platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals.
Dexian's brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit https://dexian.com/ to learn more.
Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.