Vectara, "Hallucination Leaderboard" (https://github.com/vectara/hallucination-leaderboard)

web

GitHub·github.com/vectara/hallucination-leaderboard

Credibility Rating

3/5

Good(3)

Good quality. Reputable source with community review or editorial standards, but less rigorous than peer-reviewed venues.

Rating inherited from publication venue: GitHub

Relevant to AI safety discussions around reliability and trustworthiness of LLMs; hallucination is a key failure mode affecting safe deployment in high-stakes contexts.

Metadata

Importance: 62/100tool pagetool

Summary

A public leaderboard that benchmarks large language models on their tendency to hallucinate or introduce factual inconsistencies when summarizing documents. It provides a standardized evaluation framework comparing models on 'groundedness' — how faithfully they summarize source material without fabricating information. The leaderboard is regularly updated as new models are released.

Key Points

•Evaluates LLMs on hallucination rate using a summarization task, measuring how often models introduce facts not present in the source document.
•Uses a dataset of news articles to test whether model outputs are faithful to source content, providing a consistent cross-model benchmark.
•Ranks major commercial and open-source models (e.g., GPT-4, Claude, Llama) by hallucination frequency, enabling direct comparison.
•Highlights that even top-tier models hallucinate at non-trivial rates, underscoring reliability concerns for real-world deployment.
•Serves as a practical tool for practitioners selecting models where factual accuracy and trustworthiness are critical requirements.

Cited by 1 page

Page	Type	Quality
Large Language Models	Capability	60.0

Cached Content Preview

HTTP 200Fetched Mar 20, 202634 KB

[Skip to content](https://github.com/vectara/hallucination-leaderboard#start-of-content)

You signed in with another tab or window. [Reload](https://github.com/vectara/hallucination-leaderboard) to refresh your session.You signed out in another tab or window. [Reload](https://github.com/vectara/hallucination-leaderboard) to refresh your session.You switched accounts on another tab or window. [Reload](https://github.com/vectara/hallucination-leaderboard) to refresh your session.Dismiss alert

{{ message }}

[vectara](https://github.com/vectara)/ **[hallucination-leaderboard](https://github.com/vectara/hallucination-leaderboard)** Public

- [Notifications](https://github.com/login?return_to=%2Fvectara%2Fhallucination-leaderboard) You must be signed in to change notification settings
- [Fork\\
98](https://github.com/login?return_to=%2Fvectara%2Fhallucination-leaderboard)
- [Star\\
3.1k](https://github.com/login?return_to=%2Fvectara%2Fhallucination-leaderboard)


main

[**58** Branches](https://github.com/vectara/hallucination-leaderboard/branches) [**0** Tags](https://github.com/vectara/hallucination-leaderboard/tags)

[Go to Branches page](https://github.com/vectara/hallucination-leaderboard/branches)[Go to Tags page](https://github.com/vectara/hallucination-leaderboard/tags)

Go to file

Code

Open more actions menu

## Folders and files

| Name | Name | Last commit message | Last commit date |
| --- | --- | --- | --- |
| ## Latest commit<br>[![ofermend](https://avatars.githubusercontent.com/u/1823547?v=4&size=40)](https://github.com/ofermend)[ofermend](https://github.com/vectara/hallucination-leaderboard/commits?author=ofermend)<br>[Merge pull request](https://github.com/vectara/hallucination-leaderboard/commit/2e0985929addf7fd52451854fd899161edea0aa4) [#180](https://github.com/vectara/hallucination-leaderboard/pull/180) [from vectara/lb-update-3-10-2026](https://github.com/vectara/hallucination-leaderboard/commit/2e0985929addf7fd52451854fd899161edea0aa4)<br>Open commit details<br>last weekMar 10, 2026<br>[2e09859](https://github.com/vectara/hallucination-leaderboard/commit/2e0985929addf7fd52451854fd899161edea0aa4) · last weekMar 10, 2026<br>## History<br>[439 Commits](https://github.com/vectara/hallucination-leaderboard/commits/main/) <br>Open commit details<br>[View commit history for this file.](https://github.com/vectara/hallucination-leaderboard/commits/main/) 439 Commits |
| [img](https://github.com/vectara/hallucination-leaderboard/tree/main/img "img") | [img](https://github.com/vectara/hallucination-leaderboard/tree/main/img "img") | [Add files via upload](https://github.com/vectara/hallucination-leaderboard/commit/09d654017ede934c9293a30cb20db3018eb56a01 "Add files via upload") | 2 weeks agoMar 5, 2026 |
| [CITATION.cff](https://github.com/vectara/hallucination-leaderboard/blob/main/CITATION.cff "CITATION.cff") | [CITATION.cff](https://github.com/vectara/hallucination-leaderboard/blob/main/CITATION.cff "CITATION.cff") | [added Miaoran to

... (truncated, 34 KB total)

Resource ID: b44f883dc65dd0e9 | Stable ID: OWJmYTEwNj