Databricks Platform Engineer

Summary

Contech Systems Inc. is seeking a Databricks Platform Engineer to design, implement, and maintain its enterprise Databricks environment. The role focuses on scalable data processing, platform performance optimization, security, compliance, cloud integrations, automation, and technical support in collaboration with architecture and data teams.

Responsibilities

• Deploy, configure, and manage Databricks workspaces, clusters, and jobs
• Monitor platform performance and optimize resource utilization
• Implement best practices for cost management and scalability
• Knowledge of Unity Catalog Implementation
• Configure identity and access management (IAM) for Databricks
• Ensure compliance with organizational security standards and data governance policies
• Manage secrets, tokens, and secure data access
• Integrate Databricks with cloud storage, data lakes, and enterprise systems
• Automate cluster provisioning, job scheduling, and CI/CD pipelines
• Develop reusable scripts and templates for infrastructure as code (IaC)
• Partner with Data Architecture, Enterprise Architecture, and Enterprise Infrastructure
• Partner with data engineers, analysts, and data scientists to enable efficient workflows
• Provide technical support and troubleshooting for Databricks-related issues
• Document platform architecture, processes, and operational guidelines

Skills

• Bachelor's degree in Computer Science, Information Systems, or related field (or equivalent experience)
• 3+ years of experience in cloud-based data platforms (AWS, Azure, or GCP)
• Hands-on experience with Databricks administration and development
• Strong knowledge of Spark, Python, and SQL
• Familiarity with CI/CD, Terraform, or other IaC tools
• Understanding of data security, networking, and identity management in cloud environments
• Experience with AWS Databricks
• Knowledge of Delta Lake, MLflow, GitHub, and advanced Databricks features
• Exposure to data governance frameworks and compliance standards
• Certifications in Databricks, AWS

Qualifications

Must Haves

• Bachelor's degree in Computer Science, Information Systems, or related field (or equivalent experience)
• 3+ years of experience in cloud-based data platforms (AWS, Azure, or GCP)
• Hands-on experience with Databricks administration and development
• Strong knowledge of Spark, Python, and SQL
• Familiarity with CI/CD, Terraform, or other IaC tools
• Understanding of data security, networking, and identity management in cloud environments

Nice to Haves

• Experience with AWS Databricks
• Knowledge of Delta Lake, MLflow, GitHub, and advanced Databricks features
• Exposure to data governance frameworks and compliance standards
• Certifications in Databricks, AWS

Benefits

• Remote and onsite work model