Try “How do I create a LangChain chain?” or “What is a retriever?”
Offline evaluation
Retrieval quality
Measured against a labeled LangSmith documentation question set.
Loading snapshot…
Recall curve
Hit rate by cutoff
Dataset slices
Performance by difficulty
Evaluation cases
Question-level results
A hit means the labeled source URL appears in the top-k results. MRR and nDCG reward relevant sources that rank closer to #1. This snapshot evaluates retrieval and the configured reranker; answer generation is excluded.