QA / Test Automation Engineer

Summary

CACI is seeking a Mid-Level QA / Test Automation Engineer to support an agile software modernization program for Java-based applications hosted in Amazon Web Services. The role plans, executes, documents, and automates testing across applications, APIs, databases, integrations, and AWS environments while supporting defect resolution, CI/CD quality gates, and release readiness.

Responsibilities

• Review user stories, acceptance criteria, Java application designs, API specifications, data mappings, and AWS environment documentation to identify test conditions and expected results
• Create, execute, and maintain manual test cases for functional, system, regression, smoke, integration, API, database, data validation, and user acceptance testing
• Develop, enhance, and maintain automated test scripts, reusable components, test data, locators, and regression suites using appropriate automated testing tools
• Use automated testing tools to test web user interfaces, REST or SOAP APIs, databases, and end-to-end business processes, as applicable
• Execute automated tests across AWS-hosted test environments; analyze results, logs, screenshots, and execution evidence; troubleshoot failures; and maintain tests as the Java applications evolve
• Test Java-based application components and their interactions with AWS services, APIs, databases, authentication services, data exchanges, legacy systems, workflows, reports, and downstream systems
• Validate application behavior across AWS environments and use available application, cloud, and pipeline logs to support defect isolation and root-cause analysis
• Prepare and manage test data, capture test evidence, maintain requirements traceability, and document testing outcomes
• Log defects with clear reproduction steps, expected and actual results, severity, AWS environment details, and supporting evidence; participate in defect triage and verify fixes
• Collaborate with Java developers, Product Owners, Scrum Masters, AWS and DevSecOps engineers, integration and data teams, security specialists, vendors, and business stakeholders throughout the sprint and release lifecycle
• Support automated test execution in CI/CD pipelines, scheduled regression runs, and release validation; investigate failures and improve test reliability with senior QA and DevSecOps staff
• Contribute to test estimates, sprint planning, test coverage reviews, release-readiness assessments, quality metrics, and continuous improvement of AWS and automated testing practices

Skills

• Must be able to obtain and maintain a Federal Public Trust; candidates must receive approved adjudication before onboarding
• Bachelor's degree required
• Four (4) years of experience in software quality assurance, application testing, system testing, or a related technical role
• Hands-on experience testing Java-based web applications, services, APIs, integrations, and data flows
• Hands-on experience developing, maintaining, executing, and troubleshooting automated tests using one or more automated testing tools or frameworks
• Experience creating reusable automated test components, managing test data and locators, applying validations, and interpreting automated test results
• Experience testing applications deployed in AWS environments and working with cloud-hosted application components, APIs, databases, logs, and multiple test environments
• Hands-on experience creating and executing functional, system, regression, integration, API, smoke, database, data validation, and user acceptance tests
• Experience with defect tracking, test management, requirements traceability, test evidence, test data preparation, and defect retesting
• Working knowledge of the software development lifecycle, agile delivery, DevSecOps concepts, version control, AWS-based CI/CD pipelines, and release management
• Ability to interpret Java application behavior, user stories, acceptance criteria, business rules, API contracts, data mappings, and technical design documentation
• Ability to troubleshoot test failures, analyze automated test execution results and application or AWS logs, isolate defects, and clearly communicate findings and quality risks
• Strong documentation, analytical, collaboration, and communication skills
• Ability to manage assigned testing responsibilities with moderate supervision in a fast-paced environment with competing priorities and release timelines
• Percentage of Travel Required: Up to 10%
• Minimum Clearance Required to Start: Public Trust
• Candidates with an active Public Trust or suitability determination are preferred
• Experience supporting Java application or platform modernization in an enterprise or government environment
• Experience using Subject7 for web, REST or SOAP API, database, reusable-component, data-driven, scheduled, parallel, or CI/CD-integrated test automation
• Familiarity with common AWS services used by Java applications, such as Amazon EC2, Amazon S3, Amazon RDS, AWS Lambda, Amazon CloudWatch, or related services
• Ability to read basic Java, SQL, JSON, XML, and application logs to support testing and defect investigation
• Experience with Jira, Confluence, Git, Jenkins, AWS CodePipeline, Azure DevOps, or comparable delivery and test-management tools
• Exposure to Section 508 accessibility requirements and automated or manual accessibility testing practices
• Familiarity with containerized Java applications, security testing, performance testing, or AWS observability tools
• ISTQB, Subject7, AWS, agile, testing, automation, cloud, or security certification

Qualifications

Must Haves

• Must be able to obtain and maintain a Federal Public Trust; candidates must receive approved adjudication before onboarding
• Bachelor's degree required
• Four (4) years of experience in software quality assurance, application testing, system testing, or a related technical role
• Hands-on experience testing Java-based web applications, services, APIs, integrations, and data flows
• Hands-on experience developing, maintaining, executing, and troubleshooting automated tests using one or more automated testing tools or frameworks
• Experience creating reusable automated test components, managing test data and locators, applying validations, and interpreting automated test results
• Experience testing applications deployed in AWS environments and working with cloud-hosted application components, APIs, databases, logs, and multiple test environments
• Hands-on experience creating and executing functional, system, regression, integration, API, smoke, database, data validation, and user acceptance tests
• Experience with defect tracking, test management, requirements traceability, test evidence, test data preparation, and defect retesting
• Working knowledge of the software development lifecycle, agile delivery, DevSecOps concepts, version control, AWS-based CI/CD pipelines, and release management
• Ability to interpret Java application behavior, user stories, acceptance criteria, business rules, API contracts, data mappings, and technical design documentation
• Ability to troubleshoot test failures, analyze automated test execution results and application or AWS logs, isolate defects, and clearly communicate findings and quality risks
• Strong documentation, analytical, collaboration, and communication skills
• Ability to manage assigned testing responsibilities with moderate supervision in a fast-paced environment with competing priorities and release timelines
• Percentage of Travel Required: Up to 10%
• Minimum Clearance Required to Start: Public Trust

Nice to Haves

• Candidates with an active Public Trust or suitability determination are preferred
• Experience supporting Java application or platform modernization in an enterprise or government environment
• Experience using Subject7 for web, REST or SOAP API, database, reusable-component, data-driven, scheduled, parallel, or CI/CD-integrated test automation
• Familiarity with common AWS services used by Java applications, such as Amazon EC2, Amazon S3, Amazon RDS, AWS Lambda, Amazon CloudWatch, or related services
• Ability to read basic Java, SQL, JSON, XML, and application logs to support testing and defect investigation
• Experience with Jira, Confluence, Git, Jenkins, AWS CodePipeline, Azure DevOps, or comparable delivery and test-management tools
• Exposure to Section 508 accessibility requirements and automated or manual accessibility testing practices
• Familiarity with containerized Java applications, security testing, performance testing, or AWS observability tools
• ISTQB, Subject7, AWS, agile, testing, automation, cloud, or security certification

Benefits

• A unique flexible time off benefit
• Access to robust learning resources
• Healthcare benefits
• Wellness benefits
• Financial benefits
• Retirement benefits
• Family support benefits
• Continuing education benefits
• Time off benefits