trec_eval ☆
« Back to VersTracker
Description:
Evaluation software used in the Text Retrieval Conference
Type: Formula  |  Tracked Since: Dec 28, 2025
Links: Homepage  |  formulae.brew.sh
Category: Developer tools
Tags: information-retrieval evaluation benchmarking search research
Install: brew install trec_eval
About:
TrecEval is the standard evaluation tool for information retrieval systems, developed for the Text Retrieval Conference (TREC). It calculates a wide range of performance metrics, such as precision and recall, by comparing system-generated rankings against human-judged relevance data. This tool is essential for benchmarking search algorithms and ensuring rigorous evaluation in research and production environments.
Key Features:
  • Computes standard IR metrics (Precision, Recall, MAP, NDCG)
  • Handles multi-level relevance judgments
  • Generates trec_eval output for detailed analysis
  • Supports multi-query evaluation
Use Cases:
  • Benchmarking search engine ranking algorithms
  • Academic research in information retrieval
  • Validating ML models for search relevance
Alternatives:
  • pytrec_eval – Python binding for trec_eval; faster for batch evaluation in Python pipelines
  • ranx – Modern Rust-based library with optimized metrics and Python bindings
Version History
Detected Version Rev Change Commit
Sep 12, 2024 4:12am 0 VERSION_BUMP 8e2d40ec
Feb 8, 2023 2:24pm 0 VERSION_BUMP f0d05781
Nov 25, 2022 1:17am 0 VERSION_BUMP 90000920
« Back to VersTracker  |  Browse Packages  |  About