Software health reportschema 0.34.0 · metrics 2.10.0 · 2026-09-11 15:32 UTC

embeddings-benchmark / mteb

MTEB: State-of-the-art evaluation of embeddings across languages and modalities

Python · Jupyter NotebookApache-2.0★ 3,419 stars⑂ 694 forkssince Apr 2022View on GitHub ↗

KindCommand-line toolLibraryhow this is determined

#benchmark #clustering #information-retrieval #sentence-transformers #sts #text-embedding #retrieval #neural-search #semantic-search #sbert #text-classification #bitext-mining #reranking #multilingual-nlp #mteb #low-resource-nlp #multimodal #embeddings #evaluation

embeddings-benchmark/mteb holds a health index of 96 out of 100, placing it in the Exceptional band. It scores highest on Vitality (96/100) and lowest on Security (62/100). It was last updated today. 4 contributors account for most of its recent work.

overall / 100

Exceptional

Software health index

Metrics are grouped into weighted categories on one standardized 1–100 scale. Overall starts as their weighted mean, calibrated against the distribution of the public record so bands carry percentile meaning; when public evidence triggers the High-Risk Jurisdiction Policy, the rating is adjusted and receives an At Risk ceiling of 34.

Exceptional93-100The record's top tier (≈ top 5%); essentially all checked criteria met

Excellent80-92Strong across the board; minor gaps

Good65-79Healthy; gaps are limited and manageable

Moderate50-64Acceptable with notable gaps; review recommended

Weak35-49Material weaknesses across several areas

At Risk20-34Significant weaknesses; adoption warrants caution

Critical1-19Severe problems (abandoned, single-maintainer, no hygiene)

Score profile

Each axis is a category. The shape matters more than the average — a healthy subject fills the whole shape, while a spike-and-crater profile means strength in one dimension is masking risk in another.

The weighted overall 83 is calibrated to 96 on the published index scale (record calibration 2026-08-02).

Ownership

Massive Text Embedding BenchmarkOrganization

240 followers11 public repossince Apr 2022

This repository is backed by an organization — shared, accountable stewardship that can outlive any single maintainer.

Package ecosystems

Registry	Package	Version	Downloads / mo	Versions	Last publish	Tags
PyPI	mteb	2.20.11	-	797	3 days ago	deep-learning text-embeddings embeddings multimodal benchmark retrieval information-retrieval

Metrics by category

Vitality

Is the project alive — is code being written and are releases shipping?

96Exceptional · 21% of overall

Development activity

100Exceptional

How it's scored

36/36	Push recency — last push 0 days ago
36/36	Commit cadence — 52/52 weeks with commits
18/18	Commit volume — 1,354 commits in the last year
10/10	OpenSSF Scorecard: Maintained — 30 commit(s) and 14 issue activity found in the last 90 days -- score normalized to 10

Inputs used

commits_last_year	1,354
human_commit_share	1
days_since_last_push	0
active_weeks_last_year	52

Release discipline

90Excellent

How it's scored

27/27	Ships releases — 100 releases published
36/36	Release recency — latest release 1 days ago
27/27	Release cadence — a release every ~1.4 days
0/10	OpenSSF Scorecard: Signed-Releases — Project has not signed or included provenance with any releases.

Inputs used

releases_count	100
latest_release_tag	2.20.12
releases_from_tags	no
days_since_latest_release	1
mean_days_between_releases	1.4

Community & Adoption

Does the project have users, downloads, attention, and a welcoming setup for contributors?

83Excellent · 17% of overall

Popularity & adoption

88Excellent

How it's scored

57.3/60	Stars — 3,419 stars
23.7/25	Forks — 694 forks
6.8/15	Watchers — 18 watchers

Inputs used

forks	694
stars	3,419
watchers	18
growth_state	unverified
growth_factor_pct	100
growth_unverified_reason	no_history

Community health

77Good

How it's scored

22.5/22.5	README
22.5/22.5	License — recognized license (Apache-2.0)
18/18	CONTRIBUTING guide
0/13.5	Code of conduct
0/7.2	Issue template
6.3/6.3	PR template

Inputs used

has_readme	yes
has_license	yes
readme_badges	2
has_contributing	yes
has_issue_template	no
has_code_of_conduct	no
readme_badge_services	shields.io
has_pull_request_template	yes

Sustainability & Governance

Will the project survive its people — bus factor, responsiveness, who backs it, and package upkeep?

82Excellent · 23% of overall

Maintainer resilience (bus factor)

85Excellent

How it's scored

43.2/54	Bus factor — 4 contributor(s) cover half of all commits
18.4/22.5	Commit distribution — top contributor authored 18% of commits
13.5/13.5	Contributor breadth — 99 contributors
10/10	OpenSSF Scorecard: Contributors — project has 35 contributing companies or organizations

Inputs used

bus_factor	4
contributors_sampled	99
top_contributor_share	0.181

Issue & PR responsiveness

82Excellent

How it's scored

36/42	Issue resolution — 86% of issues closed
26.3/30	PR acceptance — 2,918/3,324 decided PRs merged
8.1/13	Newcomer PR acceptance — 5/8 first-time contributors' PRs merged in 30d
12/15	OpenSSF Scorecard: Code-Review — Found 23/28 approved changesets -- score normalized to 8

Inputs used

merged_prs	2,918
open_issues	275
closed_issues	1,666
prs_merged_7d	35
prs_decided_7d	55
prs_merged_30d	38
prs_decided_30d	58
issue_closed_ratio	0.858
closed_unmerged_prs	406
first_time_authors_30d	4
first_time_prs_merged_30d	5
first_time_prs_decided_30d	8

Ownership & stewardship

64Moderate

How it's scored

30/30	Ownership backing — organization-owned
0/20	Verified domain
17.1/25	Owner reach — 240 followers of embeddings-benchmark
16.7/25	Track record — 11 public repos, account ~4 yr old

Inputs used

followers	240
owner_type	Organization
is_verified	no
owner_login	embeddings-benchmark
public_repos	11
account_age_days	1,620

Package maintenance

100Exceptional

How it's scored

25/25	Published & resolvable — 1 package(s) on pypi
35/35	Publish recency — latest publish 3 days ago
20/20	Version history — 797 published versions
20/20	Not deprecated — active, not deprecated or yanked

Inputs used

packages	mteb
ecosystems	pypi
any_deprecated	no
min_days_since_publish	3

Engineering Quality

Are baseline engineering and documentation practices in place?

92Excellent · 19% of overall

Engineering practices

94Exceptional

How it's scored

24/24	CI workflows — 15 workflow(s)
24/24	Tests present
16/16	Linter config — pyproject.toml ([tool.ruff])
9.6/9.6	Pre-commit hooks
0/6.4	.editorconfig
20/20	OpenSSF Scorecard: CI-Tests — 26 out of 26 merged PRs checked by a CI test -- score normalized to 10

Inputs used

has_ci	yes
has_tests	yes
has_editorconfig	no
has_linter_config	yes
has_precommit_config	yes

Documentation

90Excellent

How it's scored

30/30	README
25/25	Documentation directory
15/15	Documentation / homepage site — https://docs.mteb.org
10/10	Repository description
10/10	Topics — 19 topics
0/10	Wiki

Inputs used

topics	benchmark, clustering, information-retrieval, sentence-transformers, sts, text-embedding, retrieval, neural-search, semantic-search, sbert, text-classification, bitext-mining, reranking, multilingual-nlp, mteb, low-resource-nlp, multimodal, embeddings, evaluation
has_wiki	no
homepage	https://docs.mteb.org
docs_site	https://docs.mteb.org
has_readme	yes
has_docs_dir	yes
has_description	yes

Security

Are visible security and supply-chain practices strong, without unresolved high-risk jurisdiction exposure?

62Moderate · 16% of overall

Security posture

52Moderate

How it's scored

7.5/7.5	Binary-Artifacts — no binaries found in the repo
0/7.5	Branch-Protection — no data
2.5/2.5	CI-Tests — 26 out of 26 merged PRs checked by a CI test -- score normalized to 10
0/2.5	CII-Best-Practices — no effort to earn an OpenSSF best practices badge detected
6/7.5	Code-Review — Found 23/28 approved changesets -- score normalized to 8
2.5/2.5	Contributors — project has 35 contributing companies or organizations
10/10	Dangerous-Workflow — no dangerous workflow patterns detected
0/7.5	Dependency-Update-Tool — no update tool detected
0/5	Fuzzing — project is not fuzzed
2.5/2.5	License — license file detected
7.5/7.5	Maintained — 30 commit(s) and 14 issue activity found in the last 90 days -- score normalized to 10
5/5	Packaging — packaging workflow detected
0/5	Pinned-Dependencies — dependency not pinned by hash detected -- score normalized to 0
0/5	SAST — SAST tool is not run on all commits -- score normalized to 0
0/5	Security-Policy — security policy file not detected
0/7.5	Signed-Releases — Project has not signed or included provenance with any releases.
0/7.5	Token-Permissions — detected GitHub workflow tokens with excessive permissions
7.5/7.5	Vulnerabilities — 0 existing vulnerabilities detected

Inputs used

source	openssf_scorecard
checks_evaluated	17
scorecard_version	v5.5.0
checks_inconclusive	1
scorecard_aggregate	5.2

Excluded from scoring (no data or not applicable): Branch-Protection. Remaining weights renormalized.

Dependency advisories

100Exceptional

How it's scored

35/35	Direct dependencies free of known advisories — no direct dependency carries a known advisory
25/25	Indirect dependencies free of known advisories — no indirect dependency carries a known advisory
0/40	No advisories left outstanding — no advisory carries a publication date

Inputs used

source	osv
advisories	0
affected_packages	0
assessed_packages	86
unassessed_packages	0
affected_by_severity	none
direct_affected_packages	0

Excluded from scoring (no data or not applicable): No advisories left outstanding. Remaining weights renormalized. Matched the pypi:mteb@2.20.11 runtime dependency closure — what installing the published package pulls in — 86 packages. Reachability is not analyzed.

AI Readiness

How well is the repo equipped to be developed and maintained with AI coding agents? Carries a deliberately small weight (4%): agent tooling is a real maintenance signal, but a repository with none can still reach 100/100.

72Good · 4% of overall

Agent context & guidance

40Weak

How it's scored

0/45	Agent instructions — no CLAUDE.md / AGENTS.md / editor rules
0/15	Machine-readable docs (llms.txt)
40/40	Legible commit history — 89 of 100 human commits state their intent (structured subject or explanatory body)

Inputs used

has_llms_txt	no
llms_txt_url	—
legible_history_share	0.89
agent_instruction_files	—
agent_instruction_max_bytes	—

Verify loop (build / test / typecheck)

82Excellent

How it's scored

18/18	One-command bootstrap — Makefile
22/22	Automated tests
11/11	Lint / format config — pyproject.toml ([tool.ruff])
11/11	Static type checking — mteb/py.typed
10/10	Reproducible environment — Dockerfile, lockfile
10/10	Demonstrated agent practice — 18 of the last 100 commits agent-authored or agent-credited
0/8	Automated maintenance — no automated dependency updates observed
0/10	OpenSSF Scorecard: Pinned-Dependencies — dependency not pinned by hash detected -- score normalized to 0

Inputs used

has_nix	no
has_tests	yes
lockfiles	uv.lock
has_dockerfile	yes
typed_language	no
bootstrap_files	Makefile
has_devcontainer	no
has_linter_config	yes
typecheck_configs	mteb/py.typed
agent_commit_share	0.18
toolchain_manifests	—
dependency_bot_commit_share	0

Code legibility for models

82Excellent

How it's scored

27/45	Type-checkable code — Python with type-check config (mteb/py.typed)
54.8/55	Manageable file sizes — 8/1,935 source files over 60KB

Inputs used

primary_language	Python
largest_source_bytes	305,351
source_files_sampled	1,935
oversized_source_files	8

Machine-readable interfaces

100Exceptional

How it's scored

0/40	API schema (OpenAPI/GraphQL/proto) — not applicable to this kind of software
0/20	MCP server — not applicable to this kind of software
40/40	Runnable examples — notebooks

Inputs used

example_dirs	notebooks
has_mcp_signal	no
api_schema_files	—
interfaces_expected_of	—

Excluded from scoring (no data or not applicable): API schema (OpenAPI/GraphQL/proto), MCP server. Remaining weights renormalized.

Key facts

3,419GitHub stars

99contributors

1,354commits, last 12 months

0days since last push

100releases

4bus factor

275open issues

PyPIpackage ecosystems

Data collection warnings

Star history unavailable: GitHub GraphQL error: Resource not accessible by personal access token
First-time contributor figures cover 12 of 27 authors (cap 12)
pypi download statistics for 'mteb' unavailable this scan (stats endpoint failed after retries); adoption may be under-evidenced

More detail

Star and fork history 0 ★ / 694 ⇿

0Stars

694Forks

100Releases

When each star and fork was added, collected from GitHub and bucketed by day. Cumulative growth sits directly above the daily additions it is made of, so the two read against each other: steady organic accretion looks nothing like an abrupt, short-lived burst. Where that difference is measurable, it is reported as growth authenticity.

Major 0Minor 8Patch 92

Each point covers 4 days.

OpenSSF Scorecard 5.2 / 10

5.2aggregate

Independent, tool-agnostic security assessment from the open-source OpenSSF Scorecard. Each check rewards a security practice, not a specific vendor's tool. Checks Scorecard could not determine are marked n/a and excluded from the security score (never counted as zero).Scorecard v5.5.0 · 2026-09-11 15:31 UTC

10	Binary-Artifacts	no binaries found in the repo
n/a	Branch-Protection	internal error: error during branchesHandler.setup: internal error: some github tokens can't read classic branch protection rules: https://github.com/ossf/scorecard-action/blob/main/docs/authentication/fine-grained-auth-token.md
10	CI-Tests	26 out of 26 merged PRs checked by a CI test -- score normalized to 10
0	CII-Best-Practices	no effort to earn an OpenSSF best practices badge detected
8	Code-Review	Found 23/28 approved changesets -- score normalized to 8
10	Contributors	project has 35 contributing companies or organizations
10	Dangerous-Workflow	no dangerous workflow patterns detected
0	Dependency-Update-Tool	no update tool detected
0	Fuzzing	project is not fuzzed
10	License	license file detected
10	Maintained	30 commit(s) and 14 issue activity found in the last 90 days -- score normalized to 10
10	Packaging	packaging workflow detected
0	Pinned-Dependencies	dependency not pinned by hash detected -- score normalized to 0
0	SAST	SAST tool is not run on all commits -- score normalized to 0
0	Security-Policy	security policy file not detected
0	Signed-Releases	Project has not signed or included provenance with any releases.
0	Token-Permissions	detected GitHub workflow tokens with excessive permissions
10	Vulnerabilities	0 existing vulnerabilities detected

Direct dependencies 14

Registry	Package	Version constraint	Manifest
PyPI	datasets	`>=2.19.0`	pyproject.toml
PyPI	numpy	`>=1.23.0,<3.0.0`	pyproject.toml
PyPI	requests	`>=2.26.0`	pyproject.toml
PyPI	scikit-learn	`>=1.4.0`	pyproject.toml
PyPI	scipy	`>=1.14.0`	pyproject.toml
PyPI	sentence_transformers	`>=3.0.0`	pyproject.toml
PyPI	transformers	`>=4.40.0,<6.0.0`	pyproject.toml
PyPI	typing-extensions	`>=4.5.0`	pyproject.toml
PyPI	torch	`>=2.0.0`	pyproject.toml
PyPI	tqdm	`>1.0.0`	pyproject.toml
PyPI	rich	`>=13.0.0`	pyproject.toml
PyPI	pytrec-eval-terrier	`>=0.5.6`	pyproject.toml
PyPI	pydantic	`>=2.11.0`	pyproject.toml
PyPI	polars	`>=1.0.0`	pyproject.toml

All dependencies 552

Full resolved dependency set from the GitHub dependency graph: 29 direct and 523 indirect (transitive) packages. The transitive closure is complete when the repository commits a lockfile.

Registry	Package	Version	Relation
PyPI	datasets	`5.0.0`	direct
PyPI	numpy	`1.26.4`	direct
PyPI	numpy	`2.2.6`	direct
PyPI	numpy	`2.3.5`	direct
PyPI	numpy	`2.4.6`	direct
PyPI	polars	`1.41.2`	direct
PyPI	pydantic	`2.12.4`	direct
PyPI	pytrec-eval-terrier	`0.5.10`	direct
PyPI	requests	`2.34.2`	direct
PyPI	rich	`15.0.0`	direct
PyPI	scikit-learn	`1.7.2`	direct
PyPI	scikit-learn	`1.9.0`	direct
PyPI	scipy	`1.15.3`	direct
PyPI	scipy	`1.17.1`	direct
PyPI	sentence-transformers	`5.3.0`	direct
PyPI	sentence-transformers	`5.5.1`	direct
PyPI	torch	`2.11.0`	direct
PyPI	torch	`2.8.0`	direct
PyPI	tqdm	`4.68.2`	direct
PyPI	transformers	`4.42.4`	direct
PyPI	transformers	`4.44.2`	direct
PyPI	transformers	`4.47.1`	direct
PyPI	transformers	`4.49.0`	direct
PyPI	transformers	`4.51.0`	direct
PyPI	transformers	`4.52.4`	direct
PyPI	transformers	`4.57.6`	direct
PyPI	transformers	`5.0.0`	direct
PyPI	transformers	`5.14.1`	direct
PyPI	typing-extensions	`4.15.0`	direct
PyPI	accelerate	`1.13.0`	indirect
PyPI	aiofiles	`24.1.0`	indirect
PyPI	aiohappyeyeballs	`2.6.2`	indirect
PyPI	aiohttp	`3.14.1`	indirect
PyPI	aiolimiter	`1.2.1`	indirect
PyPI	aiosignal	`1.4.0`	indirect
PyPI	altair	`6.2.1`	indirect
PyPI	annotated-doc	`0.0.4`	indirect
PyPI	annotated-types	`0.7.0`	indirect
PyPI	anthropic	`0.109.1`	indirect
PyPI	antlr4-python3-runtime	`4.9.3`	indirect
PyPI	anyio	`4.13.0`	indirect
PyPI	apache-tvm-ffi	`0.1.9`	indirect
PyPI	arrow	`1.4.0`	indirect
PyPI	asgiref	`3.11.1`	indirect
PyPI	ast-serialize	`0.5.0`	indirect
PyPI	astor	`0.8.1`	indirect
PyPI	asttokens	`3.0.1`	indirect
PyPI	async-timeout	`5.0.1`	indirect
PyPI	attrs	`26.1.0`	indirect
PyPI	audioop-lts	`0.2.2`	indirect
PyPI	audioread	`3.1.0`	indirect
PyPI	av	`17.1.0`	indirect
PyPI	backports-strenum	`1.3.1`	indirect
PyPI	beartype	`0.22.9`	indirect
PyPI	beautifulsoup4	`4.15.0`	indirect
PyPI	bibtexparser	`1.4.4`	indirect
PyPI	blake3	`1.0.8`	indirect
PyPI	bleach	`6.4.0`	indirect
PyPI	blinker	`1.9.0`	indirect
PyPI	blis	`1.3.3`	indirect
PyPI	bm25s	`0.3.9`	indirect
PyPI	boto3	`1.43.72`	indirect
PyPI	botocore	`1.43.72`	indirect
PyPI	braceexpand	`0.1.7`	indirect
PyPI	brotli	`1.2.0`	indirect
PyPI	cachetools	`7.1.4`	indirect
PyPI	catalogue	`2.0.10`	indirect
PyPI	cbor	`1.0.0`	indirect
PyPI	cbor2	`6.1.2`	indirect
PyPI	certifi	`2026.5.20`	indirect
PyPI	cffi	`2.0.0`	indirect
PyPI	cfgv	`3.5.0`	indirect
PyPI	charset-normalizer	`3.4.7`	indirect
PyPI	click	`8.4.1`	indirect
PyPI	cloudpathlib	`0.24.0`	indirect
PyPI	cloudpickle	`3.1.2`	indirect
PyPI	codecarbon	`2.7.1`	indirect
PyPI	cohere	`5.14.0`	indirect
PyPI	colorama	`0.4.6`	indirect
PyPI	colpali-engine	`0.3.17`	indirect
PyPI	compressed-tensors	`0.15.0.1`	indirect
PyPI	confection	`1.3.3`	indirect
PyPI	contexttimer	`0.3.3`	indirect
PyPI	contourpy	`1.3.2`	indirect
PyPI	contourpy	`1.3.3`	indirect
PyPI	coverage	`7.14.1`	indirect
PyPI	cryptography	`43.0.3`	indirect
PyPI	cuda-bindings	`13.3.1`	indirect
PyPI	cuda-core	`1.0.1`	indirect
PyPI	cuda-pathfinder	`1.5.5`	indirect
PyPI	cuda-python	`13.3.1`	indirect
PyPI	cuda-tile	`1.4.0`	indirect
PyPI	cuda-toolkit	`13.0.2`	indirect
PyPI	cycler	`0.12.1`	indirect
PyPI	cymem	`2.0.13`	indirect
PyPI	decorator	`5.3.1`	indirect
PyPI	decord	`0.6.0`	indirect
PyPI	deepmerge	`2.0`	indirect
PyPI	depyf	`0.20.0`	indirect
PyPI	detect-installer	`0.1.0`	indirect
PyPI	dill	`0.4.1`	indirect
PyPI	diskcache	`5.6.3`	indirect
PyPI	distlib	`0.4.2`	indirect
PyPI	distro	`1.9.0`	indirect
PyPI	dnspython	`2.8.0`	indirect
PyPI	docstring-parser	`0.18.0`	indirect
PyPI	easydict	`1.13`	indirect
PyPI	einops	`0.8.2`	indirect
PyPI	email-validator	`2.3.0`	indirect
PyPI	evaluate	`0.4.6`	indirect
PyPI	exceptiongroup	`1.3.1`	indirect
PyPI	execnet	`2.1.2`	indirect
PyPI	executing	`2.2.1`	indirect
PyPI	fairscale	`0.4.4`	indirect
PyPI	faiss-cpu	`1.14.2`	indirect
PyPI	fast-plaid	`1.4.6.2110`	indirect
PyPI	fastapi	`0.136.3`	indirect
PyPI	fastapi-cli	`0.0.24`	indirect
PyPI	fastapi-cloud-cli	`0.19.0`	indirect
PyPI	fastar	`0.11.0`	indirect
PyPI	fastavro	`1.12.2`	indirect
PyPI	fastjsonschema	`2.21.2`	indirect
PyPI	fastkmeans	`0.5.0`	indirect
PyPI	fastsafetensors	`0.3.2`	indirect
PyPI	ffmpeg-python	`0.2.0`	indirect
PyPI	ffmpy	`1.0.0`	indirect
PyPI	filelock	`3.29.1`	indirect
PyPI	flagembedding	`1.3.4`	indirect
PyPI	flash-attn	`2.8.3`	indirect
PyPI	flashinfer-cubin	`0.6.11.post2`	indirect
PyPI	flashinfer-python	`0.6.11.post2`	indirect
PyPI	fonttools	`4.63.0`	indirect
PyPI	frozenlist	`1.8.0`	indirect
PyPI	fsspec	`2026.4.0`	indirect
PyPI	ftfy	`6.3.1`	indirect
PyPI	future	`1.0.0`	indirect
PyPI	gguf	`0.19.0`	indirect
PyPI	ghp-import	`2.1.0`	indirect
PyPI	gitdb	`4.0.12`	indirect
PyPI	gitpython	`3.1.50`	indirect
PyPI	google-api-core	`2.25.2`	indirect
PyPI	google-auth	`2.53.0`	indirect
PyPI	google-cloud-aiplatform	`1.71.1`	indirect
PyPI	google-cloud-bigquery	`3.41.0`	indirect
PyPI	google-cloud-core	`2.6.0`	indirect
PyPI	google-cloud-resource-manager	`1.17.0`	indirect
PyPI	google-cloud-storage	`2.19.0`	indirect
PyPI	google-crc32c	`1.8.0`	indirect
PyPI	google-genai	`2.8.0`	indirect
PyPI	google-resumable-media	`2.10.0`	indirect
PyPI	googleapis-common-protos	`1.75.0`	indirect
PyPI	gradio	`6.0.1`	indirect
PyPI	gradio-client	`2.0.0`	indirect
PyPI	greenlet	`3.5.1`	indirect
PyPI	griffelib	`2.0.2`	indirect
PyPI	gritlm	`1.0.2`	indirect
PyPI	groovy	`0.1.2`	indirect
PyPI	grpc-google-iam-v1	`0.14.4`	indirect
PyPI	grpcio	`1.81.0`	indirect
PyPI	grpcio-status	`1.71.2`	indirect
PyPI	h11	`0.16.0`	indirect
PyPI	h2	`4.3.0`	indirect
PyPI	hf-transfer	`0.1.9`	indirect
PyPI	hf-xet	`1.5.1`	indirect
PyPI	hpack	`4.1.0`	indirect
PyPI	httpcore	`1.0.9`	indirect
PyPI	httptools	`0.8.0`	indirect
PyPI	httpx	`0.28.1`	indirect
PyPI	httpx-sse	`0.4.0`	indirect
PyPI	huggingface-hub	`0.36.2`	indirect
PyPI	huggingface-hub	`1.18.0`	indirect
PyPI	humming-kernels	`0.1.2`	indirect
PyPI	hyperframe	`6.1.0`	indirect
PyPI	hyperpyyaml	`1.2.3`	indirect
PyPI	identify	`2.6.19`	indirect
PyPI	idna	`3.18`	indirect
PyPI	ijson	`3.5.0`	indirect
PyPI	imageio	`2.37.3`	indirect
PyPI	iniconfig	`2.3.0`	indirect
PyPI	inscriptis	`2.7.1`	indirect
PyPI	interegular	`0.3.3`	indirect
PyPI	iopath	`0.1.10`	indirect
PyPI	ipython	`8.39.0`	indirect
PyPI	ipython	`9.14.1`	indirect
PyPI	ipython-pygments-lexers	`1.1.1`	indirect
PyPI	ir-datasets	`0.5.11`	indirect
PyPI	iso639	`0.1.4`	indirect
PyPI	itsdangerous	`2.2.0`	indirect
PyPI	jedi	`0.20.0`	indirect
PyPI	jinja2	`3.1.6`	indirect
PyPI	jiter	`0.15.0`	indirect
PyPI	jmespath	`1.1.0`	indirect
PyPI	joblib	`1.5.3`	indirect
PyPI	jsonpatch	`1.33`	indirect
PyPI	jsonpointer	`3.1.1`	indirect
PyPI	jsonschema	`4.26.0`	indirect
PyPI	jsonschema-specifications	`2025.9.1`	indirect
PyPI	jupyter-core	`5.9.1`	indirect
PyPI	jupytext	`1.19.3`	indirect
PyPI	kaggle	`1.7.4.5`	indirect
PyPI	kaggle	`2.2.1`	indirect
PyPI	kagglesdk	`0.1.28`	indirect
PyPI	kiwisolver	`1.5.0`	indirect
PyPI	langchain-core	`1.4.3`	indirect
PyPI	langchain-protocol	`0.0.16`	indirect
PyPI	langchain-text-splitters	`1.1.2`	indirect
PyPI	langsmith	`0.8.11`	indirect
PyPI	lark	`1.2.2`	indirect
PyPI	lazy-loader	`0.5`	indirect
PyPI	librosa	`0.10.2.post1`	indirect
PyPI	librosa	`0.11.0`	indirect
PyPI	librt	`0.11.0`	indirect
PyPI	llguidance	`1.7.6`	indirect
PyPI	llm2vec	`0.2.3`	indirect
PyPI	llvmlite	`0.47.0`	indirect
PyPI	lm-format-enforcer	`0.11.3`	indirect
PyPI	loguru	`0.7.3`	indirect
PyPI	lxml	`6.0.4`	indirect
PyPI	lz4	`4.4.5`	indirect
PyPI	markdown	`3.10.2`	indirect
PyPI	markdown-it-py	`4.2.0`	indirect
PyPI	markupsafe	`3.0.3`	indirect
PyPI	matplotlib	`3.10.9`	indirect
PyPI	matplotlib-inline	`0.2.2`	indirect
PyPI	maturin	`1.13.3`	indirect
PyPI	mcp	`1.27.2`	indirect
PyPI	mdit-py-plugins	`0.6.1`	indirect
PyPI	mdurl	`0.1.2`	indirect
PyPI	mergedeep	`1.3.4`	indirect
PyPI	mistral-common	`1.11.3`	indirect
PyPI	mkdocs	`1.6.1`	indirect
PyPI	mkdocs-autorefs	`1.4.4`	indirect
PyPI	mkdocs-get-deps	`0.2.2`	indirect
PyPI	mkdocstrings	`1.0.4`	indirect
PyPI	mkdocstrings-python	`2.0.4`	indirect
PyPI	ml-dtypes	`0.5.4`	indirect
PyPI	model-hosting-container-standards	`0.1.15`	indirect
PyPI	model2vec	`0.8.2`	indirect
PyPI	mpmath	`1.3.0`	indirect
PyPI	msclap	`1.3.4`	indirect
PyPI	msgpack	`1.1.2`	indirect
PyPI	msgspec	`0.21.1`	indirect
PyPI	mteb	`2.20.0`	indirect
PyPI	multidict	`6.7.1`	indirect
PyPI	multiprocess	`0.70.19`	indirect
PyPI	muq	`0.1.0`	indirect
PyPI	murmurhash	`1.0.15`	indirect
PyPI	mypy	`2.1.0`	indirect
PyPI	mypy-extensions	`1.1.0`	indirect
PyPI	narwhals	`2.22.1`	indirect
PyPI	nbformat	`5.10.4`	indirect
PyPI	networkx	`3.4.2`	indirect
PyPI	networkx	`3.6.1`	indirect
PyPI	ninja	`1.11.1.4`	indirect
PyPI	ninja	`1.13.0`	indirect
PyPI	nnaudio	`0.3.4`	indirect
PyPI	nodeenv	`1.10.0`	indirect
PyPI	numba	`0.65.0`	indirect
PyPI	numkong	`7.7.0`	indirect
PyPI	numpy-typing-compat	`20251206.1.25`	indirect
PyPI	numpy-typing-compat	`20251206.2.3`	indirect
PyPI	numpy-typing-compat	`20251206.2.4`	indirect
PyPI	nvidia-cublas	`13.1.0.3`	indirect
PyPI	nvidia-cublas-cu12	`12.8.4.1`	indirect
PyPI	nvidia-cuda-cccl	`13.3.3.3.1`	indirect
PyPI	nvidia-cuda-crt	`13.3.33`	indirect
PyPI	nvidia-cuda-cupti	`13.0.85`	indirect
PyPI	nvidia-cuda-cupti-cu12	`12.8.90`	indirect
PyPI	nvidia-cuda-nvcc	`13.3.33`	indirect
PyPI	nvidia-cuda-nvrtc	`13.0.88`	indirect
PyPI	nvidia-cuda-nvrtc-cu12	`12.8.93`	indirect
PyPI	nvidia-cuda-runtime	`13.0.96`	indirect
PyPI	nvidia-cuda-runtime-cu12	`12.8.90`	indirect
PyPI	nvidia-cudnn-cu12	`9.10.2.21`	indirect
PyPI	nvidia-cudnn-cu13	`9.19.0.56`	indirect
PyPI	nvidia-cudnn-frontend	`1.18.0`	indirect
PyPI	nvidia-cufft	`12.0.0.61`	indirect
PyPI	nvidia-cufft-cu12	`11.3.3.83`	indirect
PyPI	nvidia-cufile	`1.15.1.6`	indirect
PyPI	nvidia-cufile-cu12	`1.13.1.3`	indirect
PyPI	nvidia-curand	`10.4.0.35`	indirect
PyPI	nvidia-curand-cu12	`10.3.9.90`	indirect
PyPI	nvidia-cusolver	`12.0.4.66`	indirect
PyPI	nvidia-cusolver-cu12	`11.7.3.90`	indirect
PyPI	nvidia-cusparse	`12.6.3.3`	indirect
PyPI	nvidia-cusparse-cu12	`12.5.8.93`	indirect
PyPI	nvidia-cusparselt-cu12	`0.7.1`	indirect
PyPI	nvidia-cusparselt-cu13	`0.8.0`	indirect
PyPI	nvidia-cutlass-dsl	`4.5.2`	indirect
PyPI	nvidia-cutlass-dsl-libs-base	`4.5.2`	indirect
PyPI	nvidia-cutlass-dsl-libs-cu13	`4.5.2`	indirect
PyPI	nvidia-ml-py	`13.610.43`	indirect
PyPI	nvidia-nccl-cu12	`2.27.3`	indirect
PyPI	nvidia-nccl-cu13	`2.28.9`	indirect
PyPI	nvidia-nvjitlink	`13.0.88`	indirect
PyPI	nvidia-nvjitlink-cu12	`12.8.93`	indirect
PyPI	nvidia-nvshmem-cu13	`3.4.5`	indirect
PyPI	nvidia-nvtx	`13.0.85`	indirect
PyPI	nvidia-nvtx-cu12	`12.8.90`	indirect
PyPI	nvidia-nvvm	`13.3.33`	indirect
PyPI	octen	`0.4.0`	indirect
PyPI	omegaconf	`2.3.0`	indirect
PyPI	open-clip-torch	`2.31.0`	indirect
PyPI	openai	`2.41.0`	indirect
PyPI	openai-harmony	`0.0.8`	indirect
PyPI	opencv-python-headless	`4.13.0.92`	indirect
PyPI	opencv-python-headless	`4.5.5.64`	indirect
PyPI	opendatasets	`0.1.22`	indirect
PyPI	opentelemetry-api	`1.42.1`	indirect
PyPI	opentelemetry-exporter-otlp	`1.42.1`	indirect
PyPI	opentelemetry-exporter-otlp-proto-common	`1.42.1`	indirect
PyPI	opentelemetry-exporter-otlp-proto-grpc	`1.42.1`	indirect
PyPI	opentelemetry-exporter-otlp-proto-http	`1.42.1`	indirect
PyPI	opentelemetry-instrumentation	`0.63b1`	indirect
PyPI	opentelemetry-instrumentation-asgi	`0.63b1`	indirect
PyPI	opentelemetry-instrumentation-fastapi	`0.63b1`	indirect
PyPI	opentelemetry-proto	`1.42.1`	indirect
PyPI	opentelemetry-sdk	`1.42.1`	indirect
PyPI	opentelemetry-semantic-conventions	`0.63b1`	indirect
PyPI	opentelemetry-semantic-conventions-ai	`0.5.1`	indirect
PyPI	opentelemetry-util-http	`0.63b1`	indirect
PyPI	optype	`0.17.1`	indirect
PyPI	optype	`0.9.3`	indirect
PyPI	orjson	`3.11.9`	indirect
PyPI	outlines-core	`0.2.14`	indirect
PyPI	packaging	`26.2`	indirect
PyPI	pandas	`2.3.3`	indirect
PyPI	pandas-stubs	`2.3.3.260113`	indirect
PyPI	pandas-stubs	`3.0.3.260530`	indirect
PyPI	parso	`0.8.7`	indirect
PyPI	partial-json-parser	`0.2.1.1.post7`	indirect
PyPI	pathspec	`1.1.1`	indirect
PyPI	peft	`0.17.1`	indirect
PyPI	peft	`0.19.1`	indirect
PyPI	pexpect	`4.9.0`	indirect
PyPI	pillow	`12.2.0`	indirect
PyPI	platformdirs	`4.10.0`	indirect
PyPI	playwright	`1.60.0`	indirect
PyPI	plotly	`5.24.1`	indirect
PyPI	pluggy	`1.6.0`	indirect
PyPI	polars-runtime-32	`1.41.2`	indirect
PyPI	pooch	`1.9.0`	indirect
PyPI	portalocker	`3.2.0`	indirect
PyPI	pre-commit	`4.6.0`	indirect
PyPI	preshed	`3.0.13`	indirect
PyPI	prometheus-client	`0.25.0`	indirect
PyPI	prometheus-fastapi-instrumentator	`7.1.0`	indirect
PyPI	prompt-toolkit	`3.0.52`	indirect
PyPI	propcache	`0.5.2`	indirect
PyPI	proto-plus	`1.28.0`	indirect
PyPI	protobuf	`5.29.6`	indirect
PyPI	ps3-torch	`0.1.3`	indirect
PyPI	psutil	`7.2.2`	indirect
PyPI	ptyprocess	`0.7.0`	indirect
PyPI	pure-eval	`0.2.3`	indirect
PyPI	py-cpuinfo	`9.0.0`	indirect
PyPI	pyarrow	`24.0.0`	indirect
PyPI	pyasn1	`0.6.3`	indirect
PyPI	pyasn1-modules	`0.4.2`	indirect
PyPI	pybase64	`1.4.3`	indirect
PyPI	pycocoevalcap	`1.2`	indirect
PyPI	pycocotools	`2.0.11`	indirect
PyPI	pycountry	`26.2.16`	indirect
PyPI	pycparser	`3.0`	indirect
PyPI	pydantic-core	`2.41.5`	indirect
PyPI	pydantic-extra-types	`2.11.1`	indirect
PyPI	pydantic-settings	`2.14.1`	indirect
PyPI	pydeck	`0.9.2`	indirect
PyPI	pydub	`0.25.1`	indirect
PyPI	pyee	`13.0.1`	indirect
PyPI	pyelftools	`0.33`	indirect
PyPI	pygithub	`2.9.1`	indirect
PyPI	pygments	`2.20.0`	indirect
PyPI	pyjwt	`2.13.0`	indirect
PyPI	pylate	`1.5.1`	indirect
PyPI	pymdown-extensions	`11.0.2`	indirect
PyPI	pymongo	`4.17.0`	indirect
PyPI	pynacl	`1.6.2`	indirect
PyPI	pynvml	`13.0.1`	indirect
PyPI	pyparsing	`3.3.2`	indirect
PyPI	pystemmer	`3.1.0`	indirect
PyPI	pytest	`8.3.5`	indirect
PyPI	pytest-cov	`7.1.0`	indirect
PyPI	pytest-cover	`3.0.0`	indirect
PyPI	pytest-coverage	`0.0`	indirect
PyPI	pytest-rerunfailures	`15.1`	indirect
PyPI	pytest-xdist	`3.6.1`	indirect
PyPI	python-dateutil	`2.9.0.post0`	indirect
PyPI	python-discovery	`1.4.0`	indirect
PyPI	python-dotenv	`1.2.2`	indirect
PyPI	python-json-logger	`4.1.0`	indirect
PyPI	python-magic	`0.4.27`	indirect
PyPI	python-multipart	`0.0.32`	indirect
PyPI	python-slugify	`8.0.4`	indirect
PyPI	pytz	`2026.2`	indirect
PyPI	pywin32	`312`	indirect
PyPI	pyyaml	`6.0.3`	indirect
PyPI	pyyaml-env-tag	`1.1`	indirect
PyPI	pyzmq	`27.1.0`	indirect
PyPI	quack-kernels	`0.5.0`	indirect
PyPI	questionary	`2.1.1`	indirect
PyPI	qwen-omni-utils	`0.0.9`	indirect
PyPI	qwen-vl-utils	`0.0.14`	indirect
PyPI	rapidfuzz	`3.14.5`	indirect
PyPI	referencing	`0.37.0`	indirect
PyPI	regex	`2026.5.9`	indirect
PyPI	requests-toolbelt	`1.0.0`	indirect
PyPI	rich-toolkit	`0.20.1`	indirect
PyPI	rignore	`0.7.6`	indirect
PyPI	rpds-py	`0.30.0`	indirect
PyPI	rpds-py	`2026.5.1`	indirect
PyPI	ruamel-yaml	`0.18.17`	indirect
PyPI	ruamel-yaml-clib	`0.2.15`	indirect
PyPI	ruff	`0.16.0`	indirect
PyPI	s3transfer	`0.19.2`	indirect
PyPI	safehttpx	`0.1.7`	indirect
PyPI	safetensors	`0.8.0`	indirect
PyPI	salesforce-lavis	`1.0.0`	indirect
PyPI	sauerkrautlm-colpali	`0.1.0`	indirect
PyPI	scikit-image	`0.25.2`	indirect
PyPI	scikit-image	`0.26.0`	indirect
PyPI	scipy-stubs	`1.15.3.0`	indirect
PyPI	scipy-stubs	`1.17.1.5`	indirect
PyPI	semantic-version	`2.10.0`	indirect
PyPI	sentencepiece	`0.2.1`	indirect
PyPI	sentry-sdk	`2.62.0`	indirect
PyPI	setproctitle	`1.3.7`	indirect
PyPI	setuptools	`80.10.2`	indirect
PyPI	shapely	`2.1.2`	indirect
PyPI	shellingham	`1.5.4`	indirect
PyPI	six	`1.17.0`	indirect
PyPI	smart-open	`7.6.1`	indirect
PyPI	smmap	`5.0.3`	indirect
PyPI	sniffio	`1.3.1`	indirect
PyPI	soundfile	`0.14.0`	indirect
PyPI	soupsieve	`2.8.4`	indirect
PyPI	soxr	`1.1.0`	indirect
PyPI	spacy	`3.8.14`	indirect
PyPI	spacy-legacy	`3.0.12`	indirect
PyPI	spacy-loggers	`1.0.5`	indirect
PyPI	speechbrain	`1.1.0`	indirect
PyPI	srsly	`2.5.3`	indirect
PyPI	sse-starlette	`3.4.4`	indirect
PyPI	stack-data	`0.6.3`	indirect
PyPI	standard-aifc	`3.13.0`	indirect
PyPI	standard-chunk	`3.13.0`	indirect
PyPI	standard-sunau	`3.13.0`	indirect
PyPI	starlette	`0.52.1`	indirect
PyPI	streamlit	`1.58.0`	indirect
PyPI	supervisor	`4.3.0`	indirect
PyPI	sympy	`1.14.0`	indirect
PyPI	tabulate	`0.10.0`	indirect
PyPI	tenacity	`9.1.4`	indirect
PyPI	tencentcloud-sdk-python-common	`3.1.111`	indirect
PyPI	tencentcloud-sdk-python-lkeap	`3.1.102`	indirect
PyPI	text-unidecode	`1.3`	indirect
PyPI	thinc	`8.3.13`	indirect
PyPI	threadpoolctl	`3.6.0`	indirect
PyPI	tifffile	`2025.5.10`	indirect
PyPI	tifffile	`2026.3.3`	indirect
PyPI	tifffile	`2026.6.1`	indirect
PyPI	tiktoken	`0.13.0`	indirect
PyPI	tilelang	`0.1.9`	indirect
PyPI	timm	`0.4.12`	indirect
PyPI	timm	`1.0.15`	indirect
PyPI	timm	`1.0.27`	indirect
PyPI	tokenizers	`0.19.1`	indirect
PyPI	tokenizers	`0.21.4`	indirect
PyPI	tokenizers	`0.22.2`	indirect
PyPI	tokenspeed-mla	`0.1.2`	indirect
PyPI	tokenspeed-triton	`3.7.10.post20260531`	indirect
PyPI	toml	`0.10.2`	indirect
PyPI	tomli	`2.4.1`	indirect
PyPI	tomlkit	`0.13.3`	indirect
PyPI	torch-c-dlpack-ext	`0.1.5`	indirect
PyPI	torch-vggish-yamnet	`0.2.1`	indirect
PyPI	torchaudio	`2.11.0`	indirect
PyPI	torchcodec	`0.14.0`	indirect
PyPI	torchlibrosa	`0.1.0`	indirect
PyPI	torchvision	`0.23.0`	indirect
PyPI	torchvision	`0.26.0`	indirect
PyPI	traitlets	`5.15.1`	indirect
PyPI	trec-car-tools	`2.6`	indirect
PyPI	triton	`3.4.0`	indirect
PyPI	triton	`3.6.0`	indirect
PyPI	typer	`0.25.1`	indirect
PyPI	typer-slim	`0.24.0`	indirect
PyPI	types-cachetools	`7.0.0.20260518`	indirect
PyPI	types-colorama	`0.4.15.20260508`	indirect
PyPI	types-defusedxml	`0.7.0.20260504`	indirect
PyPI	types-docutils	`0.22.3.20260518`	indirect
PyPI	types-gevent	`26.4.0.20260518`	indirect
PyPI	types-greenlet	`3.5.0.20260518`	indirect
PyPI	types-networkx	`3.6.1.20260518`	indirect
PyPI	types-openpyxl	`3.1.5.20260518`	indirect
PyPI	types-protobuf	`7.34.1.20260518`	indirect
PyPI	types-psutil	`7.2.2.20260518`	indirect
PyPI	types-pygments	`2.20.0.20260518`	indirect
PyPI	types-pysocks	`1.7.1.20260518`	indirect
PyPI	types-python-dateutil	`2.9.0.20260518`	indirect
PyPI	types-pytz	`2026.2.0.20260518`	indirect
PyPI	types-pywin32	`312.0.0.20260609`	indirect
PyPI	types-pyyaml	`6.0.12.20260518`	indirect
PyPI	types-regex	`2026.5.9.20260518`	indirect
PyPI	types-requests	`2.33.0.20260518`	indirect
PyPI	types-setuptools	`82.0.0.20260518`	indirect
PyPI	types-simplejson	`3.20.0.20260518`	indirect
PyPI	types-tabulate	`0.10.0.20260508`	indirect
PyPI	types-tensorflow	`2.18.0.20260610`	indirect
PyPI	types-tqdm	`4.68.0.20260608`	indirect
PyPI	types-xlrd	`2.0.0.20260518`	indirect
PyPI	typing-inspection	`0.4.2`	indirect
PyPI	typos	`1.47.2`	indirect
PyPI	tzdata	`2026.2`	indirect
PyPI	ujson	`5.12.0`	indirect
PyPI	unlzw3	`0.2.3`	indirect
PyPI	urllib3	`2.7.0`	indirect
PyPI	usearch	`2.25.3`	indirect
PyPI	uuid-utils	`0.16.0`	indirect
PyPI	uvicorn	`0.49.0`	indirect
PyPI	uvloop	`0.22.1`	indirect
PyPI	vertexai	`1.71.1`	indirect
PyPI	virtualenv	`21.4.2`	indirect
PyPI	vllm	`0.22.1`	indirect
PyPI	volcengine-python-sdk	`3.0.2`	indirect
PyPI	voyageai	`0.3.2`	indirect
PyPI	voyageai	`0.4.0`	indirect
PyPI	wandb	`0.27.2`	indirect
PyPI	warc3-wet	`0.2.5`	indirect
PyPI	warc3-wet-clueweb09	`0.2.5`	indirect
PyPI	wasabi	`1.1.3`	indirect
PyPI	watchdog	`6.0.0`	indirect
PyPI	watchfiles	`1.2.0`	indirect
PyPI	wav2clip	`0.1.0`	indirect
PyPI	wcwidth	`0.8.1`	indirect
PyPI	weasel	`1.0.0`	indirect
PyPI	webdataset	`1.0.2`	indirect
PyPI	webencodings	`0.5.1`	indirect
PyPI	websockets	`16.0`	indirect
PyPI	wheel	`0.47.0`	indirect
PyPI	win32-setctime	`1.2.0`	indirect
PyPI	wrapt	`2.2.1`	indirect
PyPI	x-clip	`0.14.4`	indirect
PyPI	xformers	`0.0.32.post2`	indirect
PyPI	xformers	`0.0.35`	indirect
PyPI	xgrammar	`0.2.1`	indirect
PyPI	xxhash	`3.7.0`	indirect
PyPI	yarl	`1.24.2`	indirect
PyPI	z3-solver	`4.15.4.0`	indirect
PyPI	zensical	`0.0.57`	indirect
PyPI	zlib-state	`0.1.12`	indirect
PyPI	zstandard	`0.25.0`	indirect

Dependency advisories 0

Installing pypi:mteb@2.20.11 pulls in 86 packages, direct and transitive: 0 carry known advisories, of which 0 are direct dependencies.

No known advisories affect the assessed dependencies.

An advisory means the version recorded in the dependency graph falls inside an advisory’s affected range. Reachability is not analysed, and the graph includes development and test pins — a finding may concern tooling rather than shipped software.

Raw JSON report machine-readable

Feedback

Spotted something off in this report, or have thoughts to share? Wrong measurements, missed tooling, ideas, questions — anything is welcome. Every message is read and gets a response.

Scores are signals, not warranties. They reflect publicly visible practices on GitHub — not a code audit, and not a security guarantee.

Missing data is excluded and weights renormalized, never scored as zero. Methodology is versioned and open: metrics v2.10.0, schema v0.34.0 — full methodology · metrics wiki.

How one result sits in the wider record: aggregate statistics — PyPI.

Software health index

Score profile

Ownership

Package ecosystems

Metrics by category

Key facts

Data collection warnings

More detail

Feedback

Related records