Summary
ProMach is a packaging performance and automation company seeking a Data Engineer to design, build, and maintain data flows between corporate IT systems and its data lake. The role focuses on data pipelines, ETL/ELT, cloud integration, data quality, data modeling, CI/CD automation, and collaboration with analysts and stakeholders to deliver actionable insights.
Responsibilities
- Design, build, and maintain scalable data pipelines using Databricks, Apache Spark, and Delta Lake
- Develop and manage robust ETL/ELT workflows for data extraction, transformation, and loading from diverse source systems
- Monitor and resolve any issues with scheduled jobs that move data
- Contribute to designing and implementing data models and architecture for data lakes and data warehouses
- Provide guidance on architecture and platforms that facilitate reporting and analytics needs
- Integrate data solutions with cloud platforms (Azure, AWS, or GCP) and related services
- Implement data quality checks, monitoring, and data governance best practices to ensure consistency, accuracy, and reliability
- Implement and maintain CI/CD pipelines to automate deployment and streamline workflows
- Work closely with business analysts and stakeholders to define data requirements and deliver actionable insights
Skills
- Proven experience in data engineering and cloud-based development
- 3-5 Years' experience in a similar role
- Expertise in Databricks and the broader Databricks ecosystem (Databricks SQL, Delta Lake, Databricks Runtime)
- Proficiency in SQL, Python, and Apache Spark
- Experience with cloud platforms such as Azure, AWS, or GCP
- Strong understanding of data modeling, ETL/ELT, and data warehousing concepts
- Experience with CI/CD tools and practices
- Excellent problem-solving, analytical, and communication skills
- Eager to learn new skills and step in to deliver where needed
- Bachelor's Degree in Information Systems, Computer Science, or related field, or equivalent work experience
- Experience with ERP systems (SAP, Infor) and Salesforce CRM
- Familiarity with BI tools such as Tableau
- Manufacturing industry experience
- Motivated, committed and energetic self-starter dedicated to providing high quality and responsive IT service
Qualifications
Must Haves
- Proven experience in data engineering and cloud-based development
- 3-5 Years' experience in a similar role
- Expertise in Databricks and the broader Databricks ecosystem (Databricks SQL, Delta Lake, Databricks Runtime)
- Proficiency in SQL, Python, and Apache Spark
- Experience with cloud platforms such as Azure, AWS, or GCP
- Strong understanding of data modeling, ETL/ELT, and data warehousing concepts
- Experience with CI/CD tools and practices
- Excellent problem-solving, analytical, and communication skills
- Eager to learn new skills and step in to deliver where needed
- Bachelor's Degree in Information Systems, Computer Science, or related field, or equivalent work experience
Nice to Haves
- Experience with ERP systems (SAP, Infor) and Salesforce CRM
- Familiarity with BI tools such as Tableau
- Manufacturing industry experience
- Motivated, committed and energetic self-starter dedicated to providing high quality and responsive IT service
Benefits
- Remote work arrangement
- Growth opportunities
- Comprehensive medical/dental programs
- Life insurance
- Generous paid time off program
- Retirement savings plan with a company match
- Benefits eligibility on the first day of employment