Architect

AI Test Engineer (QA)

Role Summary

The AI Test Engineer ensures quality, reliability, safety, and correctness of AI enabled systems across the SDLC.

Key Responsibilities

Design and execute test strategies for GenAI and Agentic AI apps
Validate LLM outputs for:
Accuracy
Bias
Hallucinations
Safety
Test prompt versions and AI behavior changes
Automate functional and non functional tests
Test AI integrations, APIs, and workflows
Perform regression testing for AI model/version changes
Collaborate with developers on quality gates

Required Skills

Application testing (manual + automation)
Test automation frameworks (Selenium, Playwright)
API testing
CI/CD quality gates

AI Specific Skills

Testing LLM outputs and prompt behavior
Understanding of model variability and non determinism
Test data management for AI
Knowledge of responsible AI testing concepts

Experience

5–8 years in software testing
Hands on GenAI / AI testing experience required