Open Systems Technologies Corporation is looking for a Databricks Administrator to join our team of experts to assist with building state of the art data platforms for the Department of Defense's premier data analytics platform.
Responsibilities:
Manage and Administer Databricks Environment: Oversee the Databricks environment, including clusters, workspaces, jobs, and notebooks, to ensure optimal performance, reliability, and scalability.
Configure and Optimize Databricks Clusters: Adjust and optimize Databricks clusters and resources based on workload requirements and best practices.
Workspace Management: Create and manage workspaces and permissions.
Identity Management: Understand and craft all applicable AWS IAM roles and policies necessary for program use cases.
Monitor Account Usage Logs: Inspect Databricks logs for auditing and cost reporting.
Ensure Security: Understand and execute DoD security best practices across the Databricks platform.
Collaborate with Teams: Work closely with Advana teams to ensure smooth operation and physical design of databases, clusters, jobs, and workspaces.
Support: Provide support to data engineers, data scientists, and analysts, enabling them to leverage the full potential of Databricks for analytics and machine learning.
Manage Multiple Environments - maintain and support configuration management across unclasssified and classified environments
Required Skills:
Clearance: TS/SCI w Poly
Minimum 2+ years of hands-on administration experience, from setting up the Databricks environment to successfully administering it (AWS preferred)
Experience as the Databricks account owner, managing workspaces, AWS accounts, audit logs, and high-level usage monitoring
Experience as Databricks workspace admin, managing workspace users and groups including single sign-on, provisioning, access control, and workspace storage.
Experience managing S3 access across a large user base
Experience managing cluster and jobs configuration options
Experience with Databricks security and privacy setup
Experience troubleshooting end user and platform-level issues
Experience delivering client presentations and demos
Experience optimizing usage for performance and cost preferred
Ability to multitask and reprioritize tasking on the fly according to the needs of a growing platform and its stakeholders
Strong coding skills in SQL and Python (PySpark) with experience optimizing code
Documented experience with AWS, EC2, S3, and/or RDS
BA or BS degree
Preferred Skills:
Experience with Qlik dashboarding and development functions
Experience with facilitating BI tool training
Experience in using DoD Data Management to manipulate and integrate databases with SQL, SAS, or other languages
Knowledge of Big Data systems, including Hadoop, HDFS, Hive, or Cloudera
Able to discern stakeholder needs, effectively communicate development plans, and track progress milestones
Excellent organizational and time management skills to handle multiple tasks simultaneously
Excellent critical thinking skills to assess numbers, trends, and data to reach new conclusions based on findings
Excellent quantitative skills, including statistical analysis, process design, and data management
BENEFITS
OST has been operating since 1996 and has various contracts with Government agencies. We offer a comprehensive benefits package that includes 3 weeks paid time off, 11 Federal Holidays, medical/dental coverage, STD, LTD, Life Insurance, AD&D, 401k with up to 4% match, and end-of-year profit sharing.