NDCG and MRR calculator

Tool ·

Did the reranker help? Paste the relevance labels of each query’s candidates in the order they were returned, once before reranking and once after, and read off NDCG@k, MRR and Hit@1. It runs in your browser: nothing you type is sent anywhere. The evaluation guide explains how to build the labels.

Your rankings

Results

Average ranking quality before and after reranking
MetricBeforeAfterChange

Per query

NDCG and reciprocal rank for each query
QueryNDCG beforeNDCG afterRank of first relevant

How to enter the labels

Each line is one query. Write one number per candidate, in ranked order, separated by spaces or commas: 0 for not relevant, 1 for relevant, and 2 or 3 if you grade relevance. “Before” is the order your retriever returned; “after” is the same candidates in the order the reranker put them. The two lines for a query must hold the same labels, just in a different order.

What the numbers mean

Queries with no relevant candidate at all are left out of the averages, because no reranker can fix them; if there are many, the problem is retrieval, not reranking. Only the candidates you list are scored, so this measures reordering, not recall. With 30 queries a small difference can be noise: treat gains of a point or two as a tie and look at the per-query table before trusting them.

Need candidates to label?

The live demo shows how a cross-encoder reorders a shortlist — a quick way to see which ranking is better before you label a real set.

Open the live demo →

Keep reading