ProMach logo
ProMach
Posted 38 days agoVerified live 15h ago

Data Engineer

Brief overview

Remote
UndergradOr in progress
3+ yrsMinimum
DatabricksApache SparkDelta LakeSQLPythonCloud Platforms AzureCloud Platforms AWSCloud PlatformsCloud Platforms GCPData ModelingETL/ELTData WarehousingCI/CD Pipelines

About the company

ProMach is a family of best-in-class packaging and processing solution brands serving manufacturers of all sizes and geographies in the food, beverage, pharmaceutical, personal care, and household and industrial goods industries.

Job description

Summary

ProMach is a packaging performance and automation company seeking a Data Engineer to design, build, and maintain data flows between corporate IT systems and its data lake. The role focuses on data pipelines, ETL/ELT, cloud integration, data quality, data modeling, CI/CD automation, and collaboration with analysts and stakeholders to deliver actionable insights.

Responsibilities

  • Design, build, and maintain scalable data pipelines using Databricks, Apache Spark, and Delta Lake
  • Develop and manage robust ETL/ELT workflows for data extraction, transformation, and loading from diverse source systems
  • Monitor and resolve any issues with scheduled jobs that move data
  • Contribute to designing and implementing data models and architecture for data lakes and data warehouses
  • Provide guidance on architecture and platforms that facilitate reporting and analytics needs
  • Integrate data solutions with cloud platforms (Azure, AWS, or GCP) and related services
  • Implement data quality checks, monitoring, and data governance best practices to ensure consistency, accuracy, and reliability
  • Implement and maintain CI/CD pipelines to automate deployment and streamline workflows
  • Work closely with business analysts and stakeholders to define data requirements and deliver actionable insights

Skills

  • Proven experience in data engineering and cloud-based development
  • 3-5 Years' experience in a similar role
  • Expertise in Databricks and the broader Databricks ecosystem (Databricks SQL, Delta Lake, Databricks Runtime)
  • Proficiency in SQL, Python, and Apache Spark
  • Experience with cloud platforms such as Azure, AWS, or GCP
  • Strong understanding of data modeling, ETL/ELT, and data warehousing concepts
  • Experience with CI/CD tools and practices
  • Excellent problem-solving, analytical, and communication skills
  • Eager to learn new skills and step in to deliver where needed
  • Bachelor's Degree in Information Systems, Computer Science, or related field, or equivalent work experience
  • Experience with ERP systems (SAP, Infor) and Salesforce CRM
  • Familiarity with BI tools such as Tableau
  • Manufacturing industry experience
  • Motivated, committed and energetic self-starter dedicated to providing high quality and responsive IT service

Qualifications

Must Haves

  • Proven experience in data engineering and cloud-based development
  • 3-5 Years' experience in a similar role
  • Expertise in Databricks and the broader Databricks ecosystem (Databricks SQL, Delta Lake, Databricks Runtime)
  • Proficiency in SQL, Python, and Apache Spark
  • Experience with cloud platforms such as Azure, AWS, or GCP
  • Strong understanding of data modeling, ETL/ELT, and data warehousing concepts
  • Experience with CI/CD tools and practices
  • Excellent problem-solving, analytical, and communication skills
  • Eager to learn new skills and step in to deliver where needed
  • Bachelor's Degree in Information Systems, Computer Science, or related field, or equivalent work experience

Nice to Haves

  • Experience with ERP systems (SAP, Infor) and Salesforce CRM
  • Familiarity with BI tools such as Tableau
  • Manufacturing industry experience
  • Motivated, committed and energetic self-starter dedicated to providing high quality and responsive IT service

Benefits

  • Remote work arrangement
  • Growth opportunities
  • Comprehensive medical/dental programs
  • Life insurance
  • Generous paid time off program
  • Retirement savings plan with a company match
  • Benefits eligibility on the first day of employment

More jobs like this