DATABRICKS ADMINISTRATOR WITH SECURITY CLEARANCE
Open Systems Technologies Corporation
Alexandria VA 22301 US
Open Systems Technologies Corporation is looking for a Databricks Administrator to join our team of experts to assist with building state of the art data platforms for the Department of Defense's premier data analytics platform. Responsibilities: * Manage and Administer Databricks Environment: Oversee the Databricks environment, including clusters, workspaces, jobs, and notebooks, to ensure optimal performance, reliability, and scalability.
* Configure and Optimize Databricks Clusters: Adjust and optimize Databricks clusters and resources based on workload requirements and best practices.
* Workspace Management: Create and manage workspaces and permissions.
* Identity Management: Understand and craft all applicable AWS IAM roles and policies necessary for program use cases.
* Monitor Account Usage Logs: Inspect Databricks logs for auditing and cost reporting.
* Ensure Security: Understand and execute DoD security best practices across the Databricks platform.
* Collaborate with Teams: Work closely with Advana teams to ensure smooth operation and physical design of databases, clusters, jobs, and workspaces.
* Support: Provide support to data engineers, data scientists, and analysts, enabling them to leverage the full potential of Databricks for analytics and machine learning.
* Manage Multiple Environments - maintain and support configuration management across unclasssified and classified environments
Required Skills: * Clearance: TS/SCI w Poly
* Minimum 2+ years of hands-on administration experience, from setting up the Databricks environment to successfully administering it (AWS preferred)
* Experience as the Databricks account owner, managing workspaces, AWS accounts, audit logs, and high-level usage monitoring
* Experience as Databricks workspace admin, managing workspace users and groups including single sign-on, provisioning, access control, and workspace storage.
* Experience managing S3 access across a large user base
* Experience managing cluster and jobs configuration options
* Experience with Databricks security and privacy setup
* Experience troubleshooting end user and platform-level issues
* Experience delivering client presentations and demos
* Experience optimizing usage for performance and cost preferred
* Ability to multitask and reprioritize tasking on the fly according to the needs of a growing platform and its stakeholders
* Strong coding skills in SQL and Python (PySpark) with experience optimizing code
* Documented experience with AWS, EC2, S3, and/or RDS
* BA or BS degree Preferred Skills: * Experience with Qlik dashboarding and development functions
* Experience with facilitating BI tool training
* Experience in using DoD Data Management to manipulate and integrate databases with SQL, SAS, or other languages
* Knowledge of Big Data systems, including Hadoop, HDFS, Hive, or Cloudera
* Able to discern stakeholder needs, effectively communicate development plans, and track progress milestones
* Excellent organizational and time management skills to handle multiple tasks simultaneously
* Excellent critical thinking skills to assess numbers, trends, and data to reach new conclusions based on findings
* Excellent quantitative skills, including statistical analysis, process design, and data management BENEFITS OST has been operating since 1996 and has various contracts with Government agencies. We offer a comprehensive benefits package that includes 3 weeks paid time off, 11 Federal Holidays, medical/dental coverage, STD, LTD, Life Insurance, AD&D, 401k with up to 4% match, and end-of-year profit sharing.
* Configure and Optimize Databricks Clusters: Adjust and optimize Databricks clusters and resources based on workload requirements and best practices.
* Workspace Management: Create and manage workspaces and permissions.
* Identity Management: Understand and craft all applicable AWS IAM roles and policies necessary for program use cases.
* Monitor Account Usage Logs: Inspect Databricks logs for auditing and cost reporting.
* Ensure Security: Understand and execute DoD security best practices across the Databricks platform.
* Collaborate with Teams: Work closely with Advana teams to ensure smooth operation and physical design of databases, clusters, jobs, and workspaces.
* Support: Provide support to data engineers, data scientists, and analysts, enabling them to leverage the full potential of Databricks for analytics and machine learning.
* Manage Multiple Environments - maintain and support configuration management across unclasssified and classified environments
Required Skills: * Clearance: TS/SCI w Poly
* Minimum 2+ years of hands-on administration experience, from setting up the Databricks environment to successfully administering it (AWS preferred)
* Experience as the Databricks account owner, managing workspaces, AWS accounts, audit logs, and high-level usage monitoring
* Experience as Databricks workspace admin, managing workspace users and groups including single sign-on, provisioning, access control, and workspace storage.
* Experience managing S3 access across a large user base
* Experience managing cluster and jobs configuration options
* Experience with Databricks security and privacy setup
* Experience troubleshooting end user and platform-level issues
* Experience delivering client presentations and demos
* Experience optimizing usage for performance and cost preferred
* Ability to multitask and reprioritize tasking on the fly according to the needs of a growing platform and its stakeholders
* Strong coding skills in SQL and Python (PySpark) with experience optimizing code
* Documented experience with AWS, EC2, S3, and/or RDS
* BA or BS degree Preferred Skills: * Experience with Qlik dashboarding and development functions
* Experience with facilitating BI tool training
* Experience in using DoD Data Management to manipulate and integrate databases with SQL, SAS, or other languages
* Knowledge of Big Data systems, including Hadoop, HDFS, Hive, or Cloudera
* Able to discern stakeholder needs, effectively communicate development plans, and track progress milestones
* Excellent organizational and time management skills to handle multiple tasks simultaneously
* Excellent critical thinking skills to assess numbers, trends, and data to reach new conclusions based on findings
* Excellent quantitative skills, including statistical analysis, process design, and data management BENEFITS OST has been operating since 1996 and has various contracts with Government agencies. We offer a comprehensive benefits package that includes 3 weeks paid time off, 11 Federal Holidays, medical/dental coverage, STD, LTD, Life Insurance, AD&D, 401k with up to 4% match, and end-of-year profit sharing.