Data Engineer

Summary

Perpay Inc. is a certified B Corp and Philadelphia's most impactful growth-stage startup, focused on improving the financial stability of everyday Americans. The Data Engineer will be responsible for managing data pipelines and infrastructure, partnering with various teams to ensure data accessibility and reliability.

Responsibilities

• Own the warehouse, the orchestration layer, and the pipelines that move data from operational systems to stakeholders
• Partner directly with Engineering, Risk, Commerce, Accounting, and Compliance
• Write code that someone else has to maintain and document the parts that need documentation
• Participate in architecture discussions for upcoming work and contribute opinions on platform direction
• Ship your first commit to production within your first week, which could be a bug fix or small improvement
• Get fluent in Airflow setup, Redshift conventions, and governance tooling in DataHub within your first month
• Complete your first end-to-end pipeline or pipeline change in collaboration with a downstream team
• Become the technical lead on your first meaningful project within your first three months
• Help hire and onboard new data engineers on the data team within your first year

Skills

• At least two years of production data engineering experience in a comparable environment
• Experience with AWS
• Familiarity with Redshift and Spectrum for the warehouse
• Experience with Glue and Fivetran for ingestion
• Knowledge of Airflow for orchestration
• Experience with ECS/ECR for services
• Familiarity with DMS for replication
• Experience with DataHub for cataloging and lineage
• Knowledge of Terraform
• Proficiency in Python
• Proficiency in SQL
• Experience with Spark when the size of the problem demands it

Qualifications

Must Haves

• At least two years of production data engineering experience in a comparable environment
• Experience with AWS
• Familiarity with Redshift and Spectrum for the warehouse
• Experience with Glue and Fivetran for ingestion
• Knowledge of Airflow for orchestration
• Experience with ECS/ECR for services
• Familiarity with DMS for replication
• Experience with DataHub for cataloging and lineage
• Knowledge of Terraform
• Proficiency in Python
• Proficiency in SQL
• Experience with Spark when the size of the problem demands it

Benefits

• Meaningful compensation and equity
• Premium medical benefits (fully paid base plan, and very reasonable premium for the buy-up option)
• 4% employer 401k match
• Unlimited PTO policy
• Remote weeks around major holidays + extra holiday on weekends like MDW and LDW
• High quality catered lunch by local chefs, 4 days / week
• Gym subsidy
• Paid cell phone + plan
• Student loan repayment program
• Relocation assistance
• Generous team member discounts