Medical/Public Health Consultant

Validation of QA Pairs for AI Assistant

• Verify accuracy and relevance of information in QA pairs against documents
• Update or create QA pairs to ensure document content is accurately represented
• Highlight text in documents corresponding to updates made

Qualitative Evaluation of AI Assistant

• Create evaluation datasets with varied input text
• Conduct programmatic testing of the AI Assistant
• Provide detailed feedback on AI responses, referencing source data

Programmatic Support for Evaluation Datasets

• Develop question-answer pairs requiring both field-level and domain knowledge
• Ensure datasets comprehensively cover the intended content