AWS Data Engineer (Associate)

Summary

Mactores is the agent-native AWS modernization firm that focuses on delivering production systems and retiring legacy systems. The AWS Data Engineer (Associate) role involves building data products and services by writing efficient code, collaborating with various teams, and ensuring timely project delivery.

Responsibilities

• Write efficient PySpark and Amazon Glue code that ships to production
• Write SQL in Amazon Athena and Amazon Redshift
• Pick up new technologies and techniques and put them to work on real business problems
• Work across engineering and business teams to build data products and services people actually use
• Deliver projects with the team and land customer updates on time

Skills

• 1 to 3 years of experience in Apache Spark, PySpark, and Amazon Glue
• 2+ years of experience writing ETL jobs using PySpark and SparkSQL
• 2+ years of experience with SQL queries and stored procedures
• Deep understanding of the Dataframe API and the transformation functions supported by Spark 2.7+
• Prior experience in working on AWS EMR, Apache Airflow
• Certifications AWS Certified Big Data – Specialty OR Cloudera Certified Big Data Engineer OR Hortonworks Certified Big Data Engineer
• Understanding of DataOps Engineering

Qualifications

Must Haves

• 1 to 3 years of experience in Apache Spark, PySpark, and Amazon Glue
• 2+ years of experience writing ETL jobs using PySpark and SparkSQL
• 2+ years of experience with SQL queries and stored procedures
• Deep understanding of the Dataframe API and the transformation functions supported by Spark 2.7+

Nice to Haves

• Prior experience in working on AWS EMR, Apache Airflow
• Certifications AWS Certified Big Data – Specialty OR Cloudera Certified Big Data Engineer OR Hortonworks Certified Big Data Engineer
• Understanding of DataOps Engineering