QA Automation Engineer

Summary

Reputation is an AI-powered platform that helps companies measure, manage, and scale their real-time reputation performance. The QA Automation Engineer II will develop and maintain automated tests for web applications, APIs, integrations, and SaaS platform components while contributing to AI-assisted testing initiatives. The role also focuses on improving automation frameworks, validating customer journeys, integrating tests into CI/CD pipelines, and enhancing software quality and release confidence.

Responsibilities

• Develop and maintain automated tests for web applications, APIs, integrations, and other platform components
• Contribute to AI-assisted testing initiatives that improve test creation, execution, and maintenance
• Build automated customer journey tests that validate critical user workflows
• Enhance existing automation frameworks to improve reliability, maintainability, and test coverage
• Participate in regression, functional, integration, and end-to-end testing efforts
• Integrate automated tests into CI/CD pipelines
• Assist with testing AI-powered product capabilities, including validating application behavior and outputs
• Analyze automation results, troubleshoot failures, and collaborate with engineers to resolve defects
• Identify improvements to automation practices and testing efficiency
• Stay current on emerging automation and AI testing technologies and apply relevant best practices to your work

Skills

• 4-7 years of experience in software quality assurance, automation testing, or quality engineering
• Experience developing and maintaining automated test suites and automation frameworks
• Strong software development background with proficiency in one or more of: + Python + Java + JavaScript/TypeScript + Go
• Proven experience with automation technologies such as: + Playwright + Selenium + Cypress + PyTest
• Working knowledge of: + Software architecture + Distributed systems + Microservices + Cloud-native applications + Agile development methodologies + CI/CD practices
• Experience testing APIs, integrations, and large-scale SaaS platforms
• Familiarity with cloud environments including AWS, GCP, or Azure
• Exposure to Generative AI tools (such as ChatGPT, GitHub Copilot, Claude, or similar) and an interest in applying AI to software testing
• Robot Framework (preferred)
• Exposure to Large Language Models (LLMs) and AI-assisted development tools
• Basic understanding of prompt engineering and an interest in AI-enabled testing
• Familiarity with: + OpenAI + Anthropic + LangChain + LangGraph + CrewAI + AutoGen + MCP (Model Context Protocol)
• Experience working with agentic AI frameworks or AI-assisted development tools
• Knowledge of AI model evaluation and testing methodologies
• Experience with RAG architectures and vector databases
• Understanding of MLOps and AI platform operations
• Experience developing synthetic user simulation or digital customer journey testing systems

Qualifications

Must Haves

• 4-7 years of experience in software quality assurance, automation testing, or quality engineering
• Experience developing and maintaining automated test suites and automation frameworks
• Strong software development background with proficiency in one or more of: + Python + Java + JavaScript/TypeScript + Go
• Proven experience with automation technologies such as: + Playwright + Selenium + Cypress + PyTest
• Working knowledge of: + Software architecture + Distributed systems + Microservices + Cloud-native applications + Agile development methodologies + CI/CD practices
• Experience testing APIs, integrations, and large-scale SaaS platforms
• Familiarity with cloud environments including AWS, GCP, or Azure
• Exposure to Generative AI tools (such as ChatGPT, GitHub Copilot, Claude, or similar) and an interest in applying AI to software testing

Nice to Haves

• Robot Framework (preferred)
• Exposure to Large Language Models (LLMs) and AI-assisted development tools
• Basic understanding of prompt engineering and an interest in AI-enabled testing
• Familiarity with: + OpenAI + Anthropic + LangChain + LangGraph + CrewAI + AutoGen + MCP (Model Context Protocol)
• Experience working with agentic AI frameworks or AI-assisted development tools
• Knowledge of AI model evaluation and testing methodologies
• Experience with RAG architectures and vector databases
• Understanding of MLOps and AI platform operations
• Experience developing synthetic user simulation or digital customer journey testing systems

Benefits

• Flexible PTO for salary paid employees
• Hourly employees accrue PTO based on tenure and receive 5 sick days annually; sick days are available day 1. PTO accrues on a per paycheck basis.
• 10 company-paid holidays plus 4 Extended Company Holidays, which are additional paid days off for the company.
• Multiple medical and dental plan options
• 100% company-paid vision coverage
• 401k available through Fidelity
• Paid Parental Leave for all eligible employees as of day 1 of employment
• Employer-paid short- and long-term disability and life insurance
• Critical Illness, Accident & Hospital Indemnity insurance
• Employee Assistance Program (EAP)
• PerkSpot employee discount program
• Wellhub (Gym Pass) access to virtual wellbeing apps, coaching, and gym memberships
• Carrot Fertility support for fertility, family planning, maternity, parenting, and hormonal health
• Omada virtual prevention and physical therapy program
• Ladder supplemental life insurance
• SoFi financial wellbeing platform with 1:1 advice
• Fetch pet insurance discount program
• Spring Health for Guardian virtual mental health support
• XP Health for Guardian virtual eyewear platform
• Rate.com mortgage services discount program