Learning to Rank — When Machine Learning Takes Over Relevance
BM25 ranks by a fixed formula, but real search engines have hundreds of relevance signals — freshness, popularity, personalization, link quality, and dozens of text features — and no human can hand-tune how to weigh them all. Learning to rank hands that job to machine learning: train a model on examples of good and bad rankings, and let it discover the optimal combination of signals. This post is where search ranking becomes a machine-learning problem, and the bridge to the neural retrieval behind modern AI.
Real engines have hundreds of relevance signals no human can hand-weight — so learning to rank trains a model on good/bad rankings. Pointwise/pairwise/listwise framings, gradient-boosted rankers, and the bridge to neural ranking, embedding retrieval, and the rerankers behind modern RAG.