AI Tester / AI QA Analyst

Summary

MCI is a tech-enabled business services company delivering customer experience, business process outsourcing, and cloud technology solutions. The AI Tester / AI QA Analyst will ensure the quality, reliability, and effectiveness of AI-powered products, machine learning models, and Generative AI applications by validating functionality, identifying defects, analyzing performance, and supporting compliance and continuous improvement.

Responsibilities

• Ensure AI systems perform as expected across multiple use cases
• Design and execute AI testing strategies and test cases
• Validate model outputs against expected outcomes
• Assess system reliability, consistency, and performance
• Identify defects, anomalies, and areas for improvement
• Support the delivery of high-quality AI solutions
• Conduct functional, regression, and user acceptance testing
• Verify compliance with business and regulatory requirements
• Maintain testing documentation and evidence
• Support release readiness assessments
• Provide insights into AI system effectiveness
• Analyze testing results and identify trends
• Develop reports and recommendations
• Track quality metrics and performance indicators
• Support root cause analysis activities
• Work closely with technical and business teams
• Collaborate with AI engineers and product managers
• Participate in requirements and solution reviews
• Provide feedback throughout the development lifecycle
• Support continuous quality improvement initiatives
• Help advance AI testing practices across the organization
• Evaluate new AI testing methodologies and tools
• Recommend enhancements to quality frameworks
• Stay informed about AI and Generative AI developments
• Contribute to best practices and standards

Skills

• * Bachelor's Degree in Information Technology, Computer Science, Quality Assurance, Engineering, or a related field
• * Minimum 3 years of software testing, QA, or technology-related experience
• * Experience creating and executing test plans and test cases
• * Strong analytical and troubleshooting skills
• * Experience documenting defects and test outcomes
• * Understanding of software development lifecycle methodologies
• * Familiarity with AI, machine learning, or Generative AI concepts
• * Strong attention to detail
• * Ability to analyze large volumes of information and identify patterns
• * Strong written and verbal communication skills
• * Experience working within Agile environments
• * Ability to collaborate effectively with technical teams
• * Must be authorized to work in the country where the job is based
• * Experience testing AI or machine learning solutions
• * Knowledge of chatbot testing and conversational AI evaluation
• * Experience with QA automation tools
• * Familiarity with prompt engineering concepts
• * Understanding of AI governance and compliance requirements
• * Experience within SaaS, technology, or BPO environments
• * Certifications in software testing or quality assurance
• * Exposure to AI evaluation frameworks

Qualifications

Must Haves

• * Bachelor's Degree in Information Technology, Computer Science, Quality Assurance, Engineering, or a related field
• * Minimum 3 years of software testing, QA, or technology-related experience
• * Experience creating and executing test plans and test cases
• * Strong analytical and troubleshooting skills
• * Experience documenting defects and test outcomes
• * Understanding of software development lifecycle methodologies
• * Familiarity with AI, machine learning, or Generative AI concepts
• * Strong attention to detail
• * Ability to analyze large volumes of information and identify patterns
• * Strong written and verbal communication skills
• * Experience working within Agile environments
• * Ability to collaborate effectively with technical teams
• * Must be authorized to work in the country where the job is based

Nice to Haves

• * Experience testing AI or machine learning solutions
• * Knowledge of chatbot testing and conversational AI evaluation
• * Experience with QA automation tools
• * Familiarity with prompt engineering concepts
• * Understanding of AI governance and compliance requirements
• * Experience within SaaS, technology, or BPO environments
• * Certifications in software testing or quality assurance
• * Exposure to AI evaluation frameworks

Benefits

• Continuous learning and development opportunities
• Reasonable accommodations when requested by a qualified applicant or employee with a disability unless such accommodations would cause undue hardship