Dunn Solutions a Kaar Tech Company is a digital transformation consultancy, that works with companies to change the way they work with their employees, vendors, and customers. We are currently looking for a Databricks Architect/Lead to add to our dynamic team!
This person will work directly with our client and technical team to ensure best practices in enterprise Databricks deployments and development. This role requires a blend of technical prowess, cloud platform familiarity, and big data expertise.
Key skills include:
Strong analytical and problem-solving skills to address complex challenges.
Excellent communication skills to explain technical concepts to non-technical stakeholders.
Ability to document designs, processes, and guidelines effectively.
Teamwork skills to work with and lead data engineers, data scientists, business analysts, and other stakeholders.
Experience with Agile methodologies and collaborative development environments.
Capability to manage and deliver data projects within timelines and budgets.
Proficiency in tools like JIRA, Spira, MS Project, or other project management software.
Key technical skills include:
Proficiency in data engineering (ETL and ELT)
Understanding of data warehousing, data lake and delta lake.
Proficiency in managing and optimizing Spark clusters, job scheduling, and performance tuning as well as cost optimization
Ability to configure and manage Databricks workspaces, users, security settings, and integrations.
Proficiency with AWS and/or Azure: storage, compute, networking, and security.
Strong scripting skills in Python or Scala, and SQL.
Experience with Databricks Unity Catalog to support data governance.
Experience with monitoring tools to track cluster performance and resource usage.
Knowledge of data protection, access control, encryption, and compliance standards.
Ability to diagnose and resolve cluster issues and performance bottlenecks.
Certifications: Databricks Certified Professional Data Engineer,
**LOCAL APPLICANTS ONLY** (Chicago, IL or Minneapolis, MN area)
For more information about Dunn Solutions Group, please visit our website at www.dunnsolutions.com
This is a hybrid Full-Time permanent position with benefits (medical, dental, 401(k), long-term disability, paid vacation, PTO, and holiday pay). Applicant must be a U.S. Citizen or currently able to legally work in the U.S. on a Full-Time basis. Dunn Solutions Group is an equal opportunity employer.