Summary
WINTrio LLC is seeking an experienced Data Engineer (ETL Developer) to design, build, and optimize AWS native data pipelines for a federal data management program. This role will ingest and transform 30+ high priority datasets into an enterprise data platform built around a Medallion architecture.
Responsibilities
- Design, build, test, and deploy ETL pipelines for priority datasets using AWS native services or approved third party tools hosted on AWS
- Develop supporting data models, schemas, validation frameworks, and database structures, and enhance data models to support expanded analytics and reporting
- Implement scalable data validation and quality checks, including error handling and lineage capture
- Produce complete technical documentation, including ERDs, data dictionaries, and pipeline specifications
- Collaborate with agency stakeholders to prioritize datasets, define sequencing, and identify phased deployment options
- Support thorough testing across development, staging, and production environments
- Support optional surge development capacity when activated, including accelerating backlog ingestion and parallel development tracks
- Meet performance standards including a 97%+ monthly pipeline success rate, SLA windows of 15 to 45 minutes (2 to 4 hours for large regulatory datasets), curated layer data freshness within 4 to 24 hours, and a 98%+ data validation pass rate
Skills
- 3 to 7+ years designing and maintaining AWS based data pipelines, including Glue, Lambda, Step Functions, and S3
- Experience building serverless, event driven ETL/ELT workflows and Medallion/Lakehouse designs
- Proficiency in Python, SQL, PySpark, Pandas, or similar data processing frameworks
- Experience with data validation tools (such as Great Expectations), data catalogs (AWS Glue, Lake Formation), CI/CD, and infrastructure as code (Terraform)
- Experience designing relational schemas, star/snowflake models, indexes, and partition strategies
- Experience working in a federal or regulated environment with stakeholders, CORs, and structured deliverables
- Must be eligible for a Moderate Risk (MBI) background investigation
- AWS Certified Data Engineer Associate
- AWS Certified Developer Associate
Qualifications
Must Haves
- 3 to 7+ years designing and maintaining AWS based data pipelines, including Glue, Lambda, Step Functions, and S3
- Experience building serverless, event driven ETL/ELT workflows and Medallion/Lakehouse designs
- Proficiency in Python, SQL, PySpark, Pandas, or similar data processing frameworks
- Experience with data validation tools (such as Great Expectations), data catalogs (AWS Glue, Lake Formation), CI/CD, and infrastructure as code (Terraform)
- Experience designing relational schemas, star/snowflake models, indexes, and partition strategies
- Experience working in a federal or regulated environment with stakeholders, CORs, and structured deliverables
- Must be eligible for a Moderate Risk (MBI) background investigation
Nice to Haves
- AWS Certified Data Engineer Associate
- AWS Certified Developer Associate
Benefits
- Healthcare (Medical, Dental, and Vision)
- Flexible Spending Account (FSA) and Health Savings Account (HSA)
- 401(k) and Retirement Savings Plan
- Annual Bonus and Profit Sharing Opportunities
- Paid Time Off (PTO) and Vacation
- Employee Assistance Program (EAP)
- Life, Personal, and Voluntary Disability Insurance