Software Development Engineer in Test

Summary

Ease Health is seeking a highly technical, product-minded Software Development Engineer in Test to own testing for its AI-native behavioral health platform at scale. The role focuses on building automated testing frameworks, evaluating non-deterministic AI systems and autonomous agents, embedding automation into CI/CD, and improving testability, compliance, and product quality.

Responsibilities

• Design and maintain scalable automated testing frameworks across the entire stack
• Develop testing strategies for non-deterministic AI systems, LLM outputs, and autonomous agents in clinical workflows
• Embed automation into CI/CD pipelines so we can ship quickly with confidence
• Partner with product and engineering on testability while features are being built
• Identify edge cases, race conditions, and compliance gaps in billing and scheduling systems
• Help define our testing philosophy and influence product direction

Skills

• Strong engineering fundamentals and a quality-first mindset
• Ability to learn behavioral health workflows quickly
• An automation bias and the initiative to build tools the whole team uses
• Comfort with ambiguity in an emerging area of testing
• An ownership mentality for defining testing philosophy at a startup
• No CS degree required
• No minimum years of experience
• No brand-name résumé needed
• Interest or experience in AI/LLM evaluation and testing autonomous agents

Qualifications

Must Haves

• Strong engineering fundamentals and a quality-first mindset
• Ability to learn behavioral health workflows quickly
• An automation bias and the initiative to build tools the whole team uses
• Comfort with ambiguity in an emerging area of testing
• An ownership mentality for defining testing philosophy at a startup
• No CS degree required
• No minimum years of experience
• No brand-name résumé needed

Nice to Haves

• Interest or experience in AI/LLM evaluation and testing autonomous agents