Connect with experts and redefine what’s possible at work – join us at the Microsoft 365 Community Conference May 6-8. Learn more >
Most RecentMost ViewedMost LikesEvaluating a RAG chat app: Can your app say "I don't know"? A RAG chat app should provide great answers if a question is answered by its knowledge base, but it should know how to say "I don't know" for all other questions. Let's explore how we can evaluate its ability to say "I don't know". Evaluating a RAG chat app: Approach, SDKs, and Tools If you're building a RAG chat app, you must run evaluations to ensure high quality answers. Here's how you can do it with GPT-4 and simple command-line tools.
