Data Engineer II -AWS Data Platform (Redshift, Glue, and Airflow)

Summary

VERSANT Media is an industry-changing media and entertainment business that operates across various markets. They are seeking a Data Engineer II to design and develop data pipelines and support data warehousing environments, focusing on database architecture and ETL processes.

Responsibilities

• The candidate will design and develop data pipelines, data marts, and schemas to support our data warehousing environments and analytical requirements
• Database architecture and design of data warehouses & data marts to support presentation layers elastic cubes, reporting and analytics
• Hands on experience with tsql or psql development, query tuning, table development, stored procedures, functions
• Hands on experience with creating indexes to enhance performance of workloads
• Hands on experience with development of ETL/ELT processes, share responsibilities for monitoring the data warehouse and data marts
• Hands on development and support of data pipelines in Airflow, AWS Glue, Azure Data factory, Python, Golang
• Hands on experience with cloud environments Azure, AWS, GCP
• Troubleshoot and resolve data issues in production system
• Communicate with business users and project managers to resolve business problems and create solutions
• Use of technical experience to suggest better solutions to new and existing problems
• Involvement with other IT departments providing systems communication processes
• Meet with various IT groups (other departments and computer operations' staff) to address issues/concerns. This includes other business unit IT groups, as well as the technical operations group (Server Group and other Infrastructure groups)
• Identify software solutions needed for new projects
• Weekly reporting to management on project status and issues
• On call production support

Skills

• 5 years of data warehousing / OLAP experience
• 5 years multidimensional database architecture and design experience
• 5+ years of SQL Experience
• 3+ years of Python Experience
• 2+ years of Redshift Experience
• 2+ years of NoSQL Experience
• Team and vendor partner management
• Clear understanding of principles and techniques of Web development
• Experience with AWS Glue and Airflow
• Experience with API
• Dimensional database architecture experience
• Formal systems life cycle methodology experience
• Cloud Data Warehouse operations experience
• Tableau, SSRS, big data and Realtime BI experience
• Experience with data streaming

Qualifications

Must Haves

• 5 years of data warehousing / OLAP experience
• 5 years multidimensional database architecture and design experience
• 5+ years of SQL Experience
• 3+ years of Python Experience
• 2+ years of Redshift Experience
• 2+ years of NoSQL Experience
• Team and vendor partner management
• Clear understanding of principles and techniques of Web development
• Experience with AWS Glue and Airflow
• Experience with API
• Dimensional database architecture experience
• Formal systems life cycle methodology experience

Nice to Haves

• Cloud Data Warehouse operations experience
• Tableau, SSRS, big data and Realtime BI experience
• Experience with data streaming

Benefits

• Health insurance
• Retirement plans
• Paid time off