Innova Solutions has a client that is immediately hiring for a Data Engineer
Position type: Full-time, Contract Duration: 12 Months possible extension Location: Oakbrook Terrace Illinois Hybrid
As a Data Engineer, you will:
Description
A mid-level Data Engineer is responsible for designing, building, and maintaining the data infrastructure and pipelines that enable efficient data processing, storage, and analysis within a hybrid computing environment.
This role bridges the gap between data collection and data consumption across both high-performance computing (HPC) servers and Azure cloud platforms, ensuring that data is accessible, reliable, and optimized for analytics, machine learning, and business intelligence purposes.
Responsibilities
Design, develop, and implement scalable data pipelines using modern ETL/ELT frameworks and tools in hybrid environments
Create and maintain data architectures that span high-performance computing servers and Azure cloud services
Build robust data integration solutions to connect various data sources across on-premises and cloud systems
Configure and optimize databases and data stores in both UNIX/Linux environments and cloud platforms
Implement MLOps practices to support the machine learning lifecycle from development to production
Design and implement modern data flow architectures that support both batch and real-time processing needs
Apply performance tuning techniques for high-volume data processing in HPC environments
Collaborate with data scientists, ML engineers, and business stakeholders to understand data requirements
Develop and maintain documentation for data infrastructure, pipelines, and workflows
Implement data quality monitoring and validation across hybrid environments
Mentor junior data engineers on best practices for hybrid cloud/on-premises architectures
Skills
3-5 years of experience in data engineering or related field
Strong UNIX/Linux administration skills and command-line proficiency
Experience with high-performance computing environments and workload management
Proficiency in SQL and experience with major database systems (PostgreSQL, SQL Server, Oracle, MySQL)
Hands-on experience with Azure cloud data services (Azure Data Factory, Synapse Analytics, Azure SQL)
Knowledge of modern data flow architectures (Lambda, Kappa, Delta) and implementation patterns
Experience with ML flow frameworks and ML lifecycle management tools
Programming skills in Python and shell scripting for automation and data processing
Familiarity with containerization (Docker) and orchestration (Kubernetes)
Experience with data processing frameworks (Spark, Databricks, Azure Batch)
Understanding of networking concepts for data movement between on-premises and cloud
Preferred Skills
Experience with real-time data processing and streaming technologies (Kafka, Event Hubs)
Knowledge of infrastructure-as-code tools (Terraform, ARM templates)
Experience with distributed file systems (HDFS, Lustre) and object storage
Familiarity with graph databases and specialized analytics datastores
Understanding of data governance, security, and compliance requirements across hybrid environments
Experience with optimization techniques for large-scale data transfers between systems
Knowledge of GPU acceleration for data processing pipelines
Background in implementing CI/CD for data solutions
Education
Bachelor's degree in Computer Science, Information Systems, or related technical field
Relevant certifications in Azure, data technologies, or HPC administration
Qualified candidates should APPLY NOW for immediate consideration! Please hit APPLY to provide the required information, and we will be back in touch as soon as possible. We are currently interviewing to fill this and other similar positions. If this role is not a fit for you, we do offer a referral bonus program for referrals that we successfully place with our clients, subject to program guidelines. ASK ME HOW. Thank you!
Pay Range: $70.00 - $75.00 per hour Pay range offered to a successful candidate will be based on several factors, including the candidate's education, work experience, work location, specific job duties, certifications, etc.
Benefits: Innova Solutions offers benefits( based on eligibility) that include the following: Medical & pharmacy coverage, Dental/vision insurance, 401(k), Health saving account (HSA) and Flexible spending account (FSA), Life Insurance, Pet Insurance, Short term and Long term Disability, Accident & Critical illness coverage, Pre-paid legal & ID theft protection, Sick time, and other types of paid leaves (as required by law), Employee Assistance Program (EAP).
ABOUT INNOVA SOLUTIONS: Founded in 1998 and headquartered in Atlanta, Georgia, Innova Solutions employs approximately 50,000 professionals worldwide and reports an annual revenue approaching $3 Billion. Through our global delivery centers across North America, Asia, and Europe, we deliver strategic technology and business transformation solutions to our clients, enabling them to operate as leaders within their fields.
Recent Recognitions:
Named One of America's Best Employers for New Grads by Forbes (2024
Named One of the Best Companies to Work for by U.S. News & World Report (Private Companies List, 2024-2025)
One of the Largest IT Staffing Firms in the US - Ranked #3 by Staffing Industry Analysts (SIA, 2024)
One of the Largest Staffing Firms in the US - Ranked #13 by Staffing Industry Analysts (SIA, 2024; includes Innova Solutions, Volt, & HireGenics)
Named One of the Top Ten Private Companies in Atlanta by the Atlanta Business Chronicle (2023)
One of the Largest Certified Minority Business Enterprises (MBEs) in the United States (NMSDC, 2024)
AWS Advanced Tier Services Partner with 100+ certifications
Website: https://www.innovasolutions.com/
Innova Solutions is an Equal Opportunity Employer and prohibits any kind of unlawful discrimination and harassment. Innova Solutions is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment on the basis of race, color, religion or belief, national origin, citizenship, social or ethnic origin, sex, age, physical or mental disability, veteran status, marital status, domestic partner status, sexual orientation, or any other status protected by the statutes, rules, and regulations in the locations where it operates. If you are an individual with a disability and need a reasonable accommodation to assist with your job search or application for employment, please contact us at hr@innovasolutions.com or (770) 493-5588. Please indicate the specifics of the assistance needed. Innova Solutions encourages all interested and qualified candidates to apply for employment opportunities. Innova Solutions (HireGenics/Volt) does not discriminate against applicants based on citizenship status, immigration status, or national origin, in accordance with 8 U.S.C. § 1324b. The company will consider for employment qualified applicants with arrest and conviction records in a manner that complies with the San Francisco Fair Chance Ordinance, the Los Angeles Fair Chance Initiative for Hiring Ordinance, and other applicable laws.