QA Automation Engineer II - IntelliScript (Remote)

Summary

Milliman IntelliScript develops data-driven SaaS products for insurance clients. The QA Automation Engineer II will design and execute manual and automated testing for web applications and APIs, validate workflows and data, document defects, and collaborate with Agile development teams to improve software quality and automation coverage.

Responsibilities

• Design, document, maintain, and execute test cases for new features, enhancements, integrations, and regression coverage
• Perform functional, exploratory, integration, smoke, regression, and end-to-end testing across web-based user interfaces and APIs
• Validate user workflows, business rules, field behavior, navigation, error handling, usability, and cross-browser behavior
• Test REST APIs using tools such as Postman, including requests, responses, status codes, payloads, authentication, validation rules, and negative scenarios
• Use SQL and available logs or diagnostic information to validate data and investigate issues across application layers
• Review requirements, user stories, acceptance criteria, and technical designs to identify gaps, edge cases, dependencies, and quality risks before development is complete
• Create clear, reproducible defect reports that include expected and actual results, supporting evidence, business impact, and appropriate severity
• Collaborate with developers to troubleshoot issues, verify fixes, and determine appropriate regression coverage
• Maintain test cases, execution results, and traceability in Zephyr or a comparable test management tool
• Participate actively in Agile ceremonies, including refinement, sprint planning, daily stand-ups, demonstrations, and retrospectives
• Provide concise input on release readiness, unresolved risks, and recommended follow-up testing
• Identify stable, repetitive test scenarios that are strong candidates for automation
• Execute and review automated test suites where applicable, troubleshoot basic failures, and partner with automation-focused engineers to improve coverage
• Contribute to UI or API automation over time based on experience, interest, and team priorities

Skills

• 2+ years of software quality assurance or software testing experience
• Strong hands-on experience manually testing web-based applications
• Experience testing APIs with Postman or a similar tool
• Ability to create effective test cases, test scenarios, and exploratory test charters from requirements and acceptance criteria
• Experience with functional, integration, regression, negative, and end-to-end testing techniques
• Experience documenting and managing defects in Jira or a similar tracking tool
• Working knowledge of SQL for test data setup, backend validation, or defect investigation
• Experience using generative AI tools to support software testing activities-such as test case development, exploratory testing, test data creation, defect investigation, or test automation-with appropriate review and validation of AI-generated outputs
• Experience working within an Agile or Scrum delivery team
• Strong analytical, troubleshooting, communication, and collaboration skills
• Ability to learn unfamiliar business workflows and technical systems with appropriate guidance
• Individual(s) must be legally authorized to work in the United States without the need for immigration support or sponsorship from Milliman now or in the future
• Experience with Zephyr, TestRail, or another test management platform
• Exposure to UI or API test automation through professional experience, training, or personal projects
• Familiarity with automation tools or frameworks such as Playwright, RestSharp, Reqnroll, Selenium, or comparable technologies
• Basic programming or scripting experience in C#, JavaScript, TypeScript, Java, Python, or a similar language
• Experience executing automated tests through a CI/CD pipeline and reviewing results
• Experience using generative AI tools to support test design, test data creation, defect analysis, or automation, with appropriate human review
• Experience testing software-as-a-service (SaaS) or other complex business applications

Qualifications

Must Haves

• 2+ years of software quality assurance or software testing experience
• Strong hands-on experience manually testing web-based applications
• Experience testing APIs with Postman or a similar tool
• Ability to create effective test cases, test scenarios, and exploratory test charters from requirements and acceptance criteria
• Experience with functional, integration, regression, negative, and end-to-end testing techniques
• Experience documenting and managing defects in Jira or a similar tracking tool
• Working knowledge of SQL for test data setup, backend validation, or defect investigation
• Experience using generative AI tools to support software testing activities-such as test case development, exploratory testing, test data creation, defect investigation, or test automation-with appropriate review and validation of AI-generated outputs
• Experience working within an Agile or Scrum delivery team
• Strong analytical, troubleshooting, communication, and collaboration skills
• Ability to learn unfamiliar business workflows and technical systems with appropriate guidance
• Individual(s) must be legally authorized to work in the United States without the need for immigration support or sponsorship from Milliman now or in the future

Nice to Haves

• Experience with Zephyr, TestRail, or another test management platform
• Exposure to UI or API test automation through professional experience, training, or personal projects
• Familiarity with automation tools or frameworks such as Playwright, RestSharp, Reqnroll, Selenium, or comparable technologies
• Basic programming or scripting experience in C#, JavaScript, TypeScript, Java, Python, or a similar language
• Experience executing automated tests through a CI/CD pipeline and reviewing results
• Experience using generative AI tools to support test design, test data creation, defect analysis, or automation, with appropriate human review
• Experience testing software-as-a-service (SaaS) or other complex business applications

Benefits

• The position is open to remote work.
• Milliman invests in skills training and career development and gives all employees access to a variety of learning and mentoring opportunities.
• Medical, Dental and Vision - Coverage for employees, dependents, and domestic partners.
• Employee Assistance Program (EAP) - Confidential support for personal and work-related challenges.
• 401(k) Plan - Includes a company matching program and profit-sharing contributions.
• Discretionary Bonus Program - Recognizing employee contributions.
• Flexible Spending Accounts (FSA) - Pre-tax savings for dependent care, transportation, and eligible medical expenses.
• Paid Time Off (PTO) - Begins accruing on the first day of work. Full-time employees accrue 15 days per year, and employees working less than full-time accrue PTO on a prorated basis.
• Holidays - A minimum of 10 paid holidays per year.
• Family Building Benefits - Includes adoption and fertility assistance.
• Paid Parental Leave - Up to 11 weeks of paid leave for employees who meet eligibility criteria.
• Life Insurance & AD&D - 100% of premiums covered by Milliman.
• Short-Term and Long-Term Disability - Fully paid by Milliman.