Platform Design and Architecture: Lead the design and architecture of our Azure cloud platform, ensuring alignment with business goals, scalability, reliability, and security requirements.
Azure Administration: Oversee Azure administration tasks, including managing subscriptions, creating and configuring clusters, monitoring performance, and troubleshooting network issues.
Platform Optimization: Continuously optimize the Azure platform for performance, cost-effectiveness, and efficiency. Identify opportunities for automation and implement best practices to streamline processes.
Collaboration with Databricks Administration: Work closely with Databricks administrators to integrate and optimize Databricks services within the Azure environment. Leverage Databricks expertise to enhance data processing, analytics, and machine learning capabilities.
Security and Compliance: Ensure that the Azure platform adheres to security standards and regulatory requirements. Implement robust security measures and regularly assess and mitigate potential risks.
Documentation and Training: Develop comprehensive documentation for the Azure platform architecture, configurations, and procedures. Provide training and guidance to Azure and Databricks administrators as needed.
Technical Leadership: Serve as a technical leader within the organization, staying current with industry trends, emerging technologies, and best practices related to Azure and cloud computing.
Requirements
10+ years of experience in Azure administration, with a strong focus on platform design and architecture. (Experience level may be flexible based on demonstrated skills and accomplishments)
Expertise in Azure services and technologies, with a deep understanding of networking, security, and infrastructure components.
Proven experience with Databricks administration and integration within Azure environments.
Strong analytical and problem-solving skills, with the ability to troubleshoot complex issues and propose effective solutions.
Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
Certifications such as Microsoft Certified: Azure Solutions Architect Expert or similar are highly desirable.
Bachelor's degree in Computer Science, Information Technology, or related field is preferred.
Preferred Qualifications
Rest API knowledge.
Knowledge of migration projects to build a Unified Data Platform.
Knowledge of DBT.
Experience with DevSecOps, including Docker and Kubernetes.
Knowledge of programming and scripting languages such as JavaScript, PowerShell, Bash, etc.
Experience with data ingestion technologies such as Azure Data Factory, SSIS, Pentaho, Alteryx.
Experience with visualization tools such as Tableau, Power BI.
Demonstrated knowledge of relevant industry trends and standards.