Senior AI QA Test Analyst

Key Responsibilities:

• Design and implement automated testing frameworks for AI and machine learning systems.
• Develop and maintain automated test suites for generative AI models, including language and multimodal systems.
• Create testing strategies to validate AI-generated content for quality, coherence, safety, and bias.
• Implement automated validation for prompt engineering, fine-tuning workflows, and model versioning.
• Develop tools and scripts to generate diverse datasets and simulate real-world AI scenarios.
• Perform data validation, model performance testing, and AI explainability assessments.
• Conduct performance testing for AI models and distributed systems.
• Analyze test outcomes and produce detailed reports on model behavior, risks, and improvement areas.
• Collaborate with AI researchers, data scientists, and engineering teams to address testing challenges.
• Continuously enhance automation methodologies aligned with evolving AI technologies.