Software Engineer in Test

Summary

Roadie, a UPS company, is a leading logistics and delivery platform providing scalable delivery solutions across the United States. The Software Engineer in Test will advance data science testing and automation capabilities by building test infrastructure, troubleshooting automation, validating data products and models, and championing quality throughout the software development lifecycle.

Responsibilities

• Build robust test infrastructure that powers automated regression testing for data science microservices
• Troubleshoot and resolve automation issues across multiple environments
• Improve the performance, reliability, and stability of automated test suites
• Develop and execute comprehensive test strategies and high-impact test cases
• Review product requirements to ensure alignment with established design and quality guidelines
• Partner with software engineers and fellow test engineers to conduct end-to-end system testing and post-deployment validation
• Identify, isolate, and clearly document product defects, then verify fixes through resolution
• Champion quality at every stage of the software development lifecycle

Skills

• 3+ years experience in a developer, SDET or QA automation role
• 3+ years coding experience in Python preferred; coding/scripting in other languages such as Ruby, Bash or Javascript, a plus!
• Experience with testing APIs and DBs
• Experience in testing frameworks - Pytest preferred
• Experience with monitoring tools like grafana, NewRelic or similar
• Experience in CI/CD tools such as CircleCI, github action or similar
• Be able to write and analyze SQL queries
• Experience with cloud solutions such as AWS
• Experience with tools such as github, JIRA, postman
• Demonstrated background of writing clean, stable, maintainable code
• Strong understanding of testing methodologies and automated testing approaches
• Excellent troubleshooting and communication skills
• Thrives in fast-paced environment, with ability to operate within short release-cycles
• Familiarity with performance testing and related tools
• Familiarity with Data Science concepts
• Experience with testing ML models
• Experience with Kafka, groundcover, Sentry, MLFlow
• Understanding of the full application development lifecycle

Qualifications

Must Haves

• 3+ years experience in a developer, SDET or QA automation role
• 3+ years coding experience in Python preferred; coding/scripting in other languages such as Ruby, Bash or Javascript, a plus!
• Experience with testing APIs and DBs
• Experience in testing frameworks - Pytest preferred
• Experience with monitoring tools like grafana, NewRelic or similar
• Experience in CI/CD tools such as CircleCI, github action or similar
• Be able to write and analyze SQL queries
• Experience with cloud solutions such as AWS
• Experience with tools such as github, JIRA, postman
• Demonstrated background of writing clean, stable, maintainable code
• Strong understanding of testing methodologies and automated testing approaches
• Excellent troubleshooting and communication skills
• Thrives in fast-paced environment, with ability to operate within short release-cycles

Nice to Haves

• Familiarity with performance testing and related tools
• Familiarity with Data Science concepts
• Experience with testing ML models
• Experience with Kafka, groundcover, Sentry, MLFlow
• Understanding of the full application development lifecycle

Benefits

• 100% company-paid health insurance for yourself
• 401(k) with company match
• Tuition & student loan repayment assistance- yes, we’ll contribute directly to your student loans!
• Remote-first environment
• Unlimited PTO
• Inclusive family leave policy that supports all new parents
• Paid Wellness Days in addition to Company holidays
• Monthly WFH stipend
• Paid sabbatical leave- tenured Roadies are given extra time to unplug, rest, and explore
• The technology you need to get the job done