CyberProof logo
CyberProof
Posted 52 days agoVerified live 2d ago

Data Platform Engineer Merger & Migration

Brief overview

Remote
$72k–$108k/yrStated range
2+ yrsMinimum
DatabricksAWSPythonSQLAWS LambdaAWS IAMTerraformData ValidationGit/CI/CD

About the company

CyberProof logo
CyberProofcyberproof.com

CyberProof is a security services company that intelligently manages your incident detection and response requirements.

Job description

Summary

UST is a mission-driven technology company that helps clients create transformative experiences and human-centered solutions. The Lead I - Data Engineering role focuses on migrating data assets and updating pipelines across unified AWS and Databricks environments, while also provisioning workspaces, mapping permissions, and validating migrations.

Responsibilities

  • Hands-on Migration: Execute the moving of data assets, schemas, tables, and notebooks from the source tenant to the target environment
  • Pipeline Updates: Update and test data pipelines, changing storage paths, API endpoints, and connection strings to match the new unified architecture
  • Workspace Setup: Use Terraform and platform APIs to spin up new, unified workspaces, clusters, and warehouses according to the new company standards
  • Permissions Mapping: Recreate and map user groups, access permissions, and roles from the old systems into the new centralized governance model
  • Monitoring & Validation: Run data validation tests and monitor migration logs to ensure zero data loss or downtime during cutovers

Skills

  • UST is searching for a Data Platform Engineer Merger & Migration with solid hands-on experience using AWS (S3, IAM, EC2, Lambda) in a multi-account setup
  • 2-4 years of experience working in Data Engineering, Platform Operations, or Cloud Operations
  • Strong troubleshooting skills and the ability to work collaboratively to solve migration roadblocks
  • Practical administration experience with Databricks (clusters, notebooks, jobs) OR Snowflake (warehouses, roles, storage integration)
  • Automation Tools: Comfortable using Terraform for provisioning infrastructure and Git/CI/CD for deployment pipelines
  • Core Coding: Proficient in Python and SQL for writing tests, scripting automation tasks, and verifying data structures

Qualifications

Must Haves

  • UST is searching for a Data Platform Engineer Merger & Migration with solid hands-on experience using AWS (S3, IAM, EC2, Lambda) in a multi-account setup
  • 2-4 years of experience working in Data Engineering, Platform Operations, or Cloud Operations
  • Strong troubleshooting skills and the ability to work collaboratively to solve migration roadblocks
  • Practical administration experience with Databricks (clusters, notebooks, jobs) OR Snowflake (warehouses, roles, storage integration)
  • Automation Tools: Comfortable using Terraform for provisioning infrastructure and Git/CI/CD for deployment pipelines
  • Core Coding: Proficient in Python and SQL for writing tests, scripting automation tasks, and verifying data structures

Benefits

  • Full-time, regular employees accrue a minimum of 10 days of paid vacation per year.
  • Full-time, regular employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
  • Full-time, regular employees receive 10 paid holidays.
  • Full-time, regular employees are eligible for paid bereavement leave and jury duty.
  • Full-time, regular employees are eligible to participate in the Company’s 401(k) Retirement Plan with employer matching.
  • Full-time, regular employees and their dependents residing in the US are eligible for medical, dental, and vision insurance.
  • Full-time, regular employees receive Company-paid basic life insurance, accidental death and disability insurance, and short- and long-term disability benefits for employees only.
  • Full-time, regular employees may purchase additional voluntary short-term disability benefits.
  • Full-time, regular employees may participate in a Health Savings Account (HSA).
  • Full-time, regular employees may participate in a Flexible Spending Account (FSA) for healthcare, dependent child care, and/or commuting expenses as allowable under IRS guidelines.
  • Part-time employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
  • Part-time employees are eligible to participate in the Company’s 401(k) Retirement Plan with employer matching.
  • Full-time temporary employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
  • Full-time temporary employees are eligible to participate in the Company’s 401(k) program with employer matching.
  • Full-time temporary employees and their dependents residing in the US are eligible for medical, dental, and vision insurance.
  • Part-time temporary employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
  • All US employees who work in a state or locality with more generous paid sick leave benefits than specified here will receive the benefit of those sick leave laws.

More jobs like this