Public record
Software health reportschema 0.34.0 · metrics 2.10.0 · 2026-09-25 07:38 UTC

Toloka / tolokaforge

Universal LLM benchmarking harness for tool use, browser, mobile, coding, and long-horizon evals

PythonCustom license★ 17 stars⑂ 11 forkssince Apr 2026View on GitHub ↗
KindPluginCommand-line toolNetwork serviceMCP serverLibraryhow this is determined

Toloka/tolokaforge holds a health index of 83 out of 100, placing it in the Excellent band. It scores highest on Engineering Quality (88/100) and lowest on Community & Adoption (50/100). It was last updated today. A single contributor accounts for most of its recent work.

83
overall / 100
Excellent

Software health index

Metrics are grouped into weighted categories on one standardized 1–100 scale. Overall starts as their weighted mean, calibrated against the distribution of the public record so bands carry percentile meaning; when public evidence triggers the High-Risk Jurisdiction Policy, the rating is adjusted and receives an At Risk ceiling of 34.

83
Exceptional93-100The record's top tier (≈ top 5%); essentially all checked criteria met
Excellent80-92Strong across the board; minor gaps
Good65-79Healthy; gaps are limited and manageable
Moderate50-64Acceptable with notable gaps; review recommended
Weak35-49Material weaknesses across several areas
At Risk20-34Significant weaknesses; adoption warrants caution
Critical1-19Severe problems (abandoned, single-maintainer, no hygiene)
VitalityCommunity &AdoptionSustainability &GovernanceEngineeringQualitySecurityAI Readiness

Score profile

Each axis is a category. The shape matters more than the average — a healthy subject fills the whole shape, while a spike-and-crater profile means strength in one dimension is masking risk in another.

The weighted overall 70 is calibrated to 83 on the published index scale (record calibration 2026-08-02).

Ownership

TolokaOrganization
97 followers34 public repossince Dec 2020

This repository is backed by an organization — shared, accountable stewardship that can outlive any single maintainer.

Package ecosystems

RegistryPackageVersionDownloads / moVersionsLast publishTags
PyPItolokaforge0.27.37,406700 days agoagentsbenchmarkevaluationllmmcptool-use
PyPItolokaforge-models1.5.01,034617 days agobenchmarkllmmodelstool-use

Metrics by category

Vitality

Is the project alive — is code being written and are releases shipping?

83Excellent · 21% of overall

Development activity

78Good
How it's scored
36/36Push recency — last push 0 days ago
13.8/36Commit cadence — 20/52 weeks with commits
18/18Commit volume — 379 commits in the last year
10/10OpenSSF Scorecard: Maintained — 30 commit(s) and 30 issue activity found in the last 90 days -- score normalized to 10
Inputs used
commits_last_year379
human_commit_share0.67
days_since_last_push0
active_weeks_last_year20

Release discipline

90Excellent
How it's scored
27/27Ships releases — 100 releases published
36/36Release recency — latest release 0 days ago
27/27Release cadence — a release every ~1.1 days
0/10OpenSSF Scorecard: Signed-Releases — Project has not signed or included provenance with any releases.
Inputs used
releases_count100
latest_release_tagv0.27.3
releases_from_tagsno
days_since_latest_release0
mean_days_between_releases1.1

Community & Adoption

Does the project have users, downloads, attention, and a welcoming setup for contributors?

50Moderate · 17% of overall

Popularity & adoption

28At Risk
How it's scored
19.5/60Stars — 17 stars
8.3/25Forks — 11 forks
0/15Watchers — 1 watchers
Inputs used
forks11
stars17
watchers1
growth_stateunverified
growth_factor_pct100
growth_unverified_reasonno_history

Community health

64Moderate
How it's scored
22.5/22.5README
16.9/22.5License — license file present, not a recognized license
18/18CONTRIBUTING guide
0/13.5Code of conduct
0/7.2Issue template
0/6.3PR template
Inputs used
has_readmeyes
has_licenseyes
readme_badges0
has_contributingyes
has_issue_templateno
has_code_of_conductno
readme_badge_services—
has_pull_request_templateno

Ecosystem adoption (downloads)

64Moderate
How it's scored
51.6/80Monthly downloads — 7,406 downloads/month across pypi
0/20Registry dependents — not reported by this ecosystem
Inputs used
packagestolokaforge
dependents—
ecosystemspypi
total_downloads—
monthly_downloads7,406
unverified_packages_excludedtolokaforge-models
Excluded from scoring (no data or not applicable): Registry dependents. Remaining weights renormalized.

Sustainability & Governance

Will the project survive its people — bus factor, responsiveness, who backs it, and package upkeep?

61Moderate · 23% of overall

Maintainer resilience (bus factor)

32At Risk
How it's scored
9/54Bus factor — 1 contributor(s) cover half of all commits
8/22.5Commit distribution — top contributor authored 64% of commits
9.5/13.5Contributor breadth — 7 contributors
6/10OpenSSF Scorecard: Contributors — project has 2 contributing companies or organizations -- score normalized to 6
Inputs used
bus_factor1
contributors_sampled7
top_contributor_share0.645

Issue & PR responsiveness

57Moderate
How it's scored
21.3/42Issue resolution — 51% of issues closed
24.9/30PR acceptance — 556/670 decided PRs merged
0/13Newcomer PR acceptance — no first-time contributor's PR decided in 30d
3/15OpenSSF Scorecard: Code-Review — Found 6/30 approved changesets -- score normalized to 2
Inputs used
merged_prs556
open_issues467
closed_issues483
prs_merged_7d11
prs_decided_7d14
prs_merged_30d49
prs_decided_30d60
issue_closed_ratio0.508
closed_unmerged_prs114
first_time_authors_30d0
first_time_prs_merged_30d0
first_time_prs_decided_30d0
Excluded from scoring (no data or not applicable): Newcomer PR acceptance. Remaining weights renormalized.

Ownership & stewardship

67Good
How it's scored
30/30Ownership backing — organization-owned
0/20Verified domain
14.3/25Owner reach — 97 followers of Toloka
22.8/25Track record — 34 public repos, account ~5 yr old
Inputs used
followers97
owner_typeOrganization
is_verifiedno
owner_loginToloka
public_repos34
account_age_days2,106

Package maintenance

100Exceptional
How it's scored
25/25Published & resolvable — 2 package(s) on pypi
35/35Publish recency — latest publish 0 days ago
20/20Version history — 70 published versions
20/20Not deprecated — active, not deprecated or yanked
Inputs used
packagestolokaforge, tolokaforge-models
ecosystemspypi
any_deprecatedno
min_days_since_publish0

Engineering Quality

Are baseline engineering and documentation practices in place?

88Excellent · 19% of overall

Engineering practices

94Exceptional
How it's scored
24/24CI workflows — 16 workflow(s)
24/24Tests present
16/16Linter config — pyproject.toml ([tool.ruff], [tool.black])
9.6/9.6Pre-commit hooks
0/6.4.editorconfig
20/20OpenSSF Scorecard: CI-Tests — 20 out of 20 merged PRs checked by a CI test -- score normalized to 10
Inputs used
has_ciyes
has_testsyes
has_editorconfigno
has_linter_configyes
has_precommit_configyes

Documentation

80Excellent
How it's scored
30/30README
25/25Documentation directory
15/15Documentation / homepage site — https://github.com/Toloka/tolokaforge/tree/main/docs
10/10Repository description
0/10Topics
0/10Wiki
Inputs used
topics—
has_wikino
homepage—
docs_sitehttps://github.com/Toloka/tolokaforge/tree/main/docs
has_readmeyes
has_docs_diryes
has_descriptionyes

Security

Are visible security and supply-chain practices strong, without unresolved high-risk jurisdiction exposure?

61Moderate · 16% of overall

Security posture

60Moderate
How it's scored
7.5/7.5Binary-Artifacts — no binaries found in the repo
3.8/7.5Branch-Protection — branch protection is not maximal on development and all release branches
2.5/2.5CI-Tests — 20 out of 20 merged PRs checked by a CI test -- score normalized to 10
0/2.5CII-Best-Practices — no effort to earn an OpenSSF best practices badge detected
1.5/7.5Code-Review — Found 6/30 approved changesets -- score normalized to 2
1.5/2.5Contributors — project has 2 contributing companies or organizations -- score normalized to 6
10/10Dangerous-Workflow — no dangerous workflow patterns detected
7.5/7.5Dependency-Update-Tool — update tool detected
0/5Fuzzing — project is not fuzzed
2.2/2.5License — license file detected
7.5/7.5Maintained — 30 commit(s) and 30 issue activity found in the last 90 days -- score normalized to 10
5/5Packaging — packaging workflow detected
0/5Pinned-Dependencies — dependency not pinned by hash detected -- score normalized to 0
5/5SAST — SAST tool is run on all commits
5/5Security-Policy — security policy file detected
0/7.5Signed-Releases — Project has not signed or included provenance with any releases.
0/7.5Token-Permissions — detected GitHub workflow tokens with excessive permissions
3.8/7.5Vulnerabilities — 5 existing vulnerabilities detected
Inputs used
sourceopenssf_scorecard
checks_evaluated18
scorecard_versionv5.5.0
checks_inconclusive0
scorecard_aggregate6

Dependency advisories

65Good
How it's scored
14.8/35Direct dependencies free of known advisories — 1 affected: click 8.1.8 (high 7.2)
0/25Indirect dependencies free of known advisories — transitive set not separable from development and test dependencies in this scope
33.9/40No advisories left outstanding — 1 advisory-carrying package(s) unaddressed past 90 days; oldest published 147 days ago
Inputs used
sourceosv
advisories5
affected_packages3
assessed_packages191
unassessed_packages14
affected_by_severityhigh 2, moderate 1
direct_affected_packages1
Excluded from scoring (no data or not applicable): Indirect dependencies free of known advisories. Remaining weights renormalized. Matched 191 resolved dependencies against OSV. 14 could not be assessed — no resolved version, an unsupported ecosystem, or beyond the reported package list. This repository publishes no package the index resolves, so the repository dependency graph was assessed instead. That graph mixes development and test pins with shipped dependencies, so only the declared runtime dependencies are scored; transitive findings are reported as context and excluded from the score. Reachability is not analyzed.

AI Readiness

How well is the repo equipped to be developed and maintained with AI coding agents? Carries a deliberately small weight (4%): agent tooling is a real maintenance signal, but a repository with none can still reach 100/100.

77Good · 4% of overall

Agent context & guidance

85Excellent
How it's scored
45/45Agent instructions — .cursor/rules/cursor.mdc, AGENTS.md, CLAUDE.md, tests/AGENTS.md, tools/AGENTS.md
0/15Machine-readable docs (llms.txt)
40/40Legible commit history — 67 of 67 human commits state their intent (structured subject or explanatory body)
Inputs used
has_llms_txtno
llms_txt_url—
legible_history_share1
agent_instruction_files.cursor/rules/cursor.mdc, AGENTS.md, CLAUDE.md, tests/AGENTS.md, tools/AGENTS.md
agent_instruction_max_bytes52,166

Verify loop (build / test / typecheck)

71Good
How it's scored
18/18One-command bootstrap — Makefile
22/22Automated tests
11/11Lint / format config — pyproject.toml ([tool.ruff], [tool.black])
0/11Static type checking
10/10Reproducible environment — devcontainer, Dockerfile, lockfile
10/10Demonstrated agent practice — 7 of the last 100 commits agent-authored or agent-credited
0/8Automated maintenance — no automated dependency updates observed
0/10OpenSSF Scorecard: Pinned-Dependencies — dependency not pinned by hash detected -- score normalized to 0
Inputs used
has_nixno
has_testsyes
lockfilesuv.lock
has_dockerfileyes
typed_languageno
bootstrap_filesMakefile
has_devcontaineryes
has_linter_configyes
typecheck_configs—
agent_commit_share0.07
toolchain_manifests—
dependency_bot_commit_share0

Code legibility for models

54Moderate
How it's scored
0/45Type-checkable code — Python without a type-check config
53.7/55Manageable file sizes — 34/1,398 source files over 60KB
Inputs used
primary_languagePython
largest_source_bytes209,424
source_files_sampled1,398
oversized_source_files34

Machine-readable interfaces

100Exceptional
How it's scored
40/40API schema (OpenAPI/GraphQL/proto) — tolokaforge/grader/grader.proto, tolokaforge/runner/runner.proto
20/20MCP server
40/40Runnable examples — examples
Inputs used
example_dirsexamples
has_mcp_signalyes
api_schema_filestolokaforge/grader/grader.proto, tolokaforge/runner/runner.proto
interfaces_expected_ofnetwork-service

Key facts

17GitHub stars
7contributors
379commits, last 12 months
0days since last push
100releases
1bus factor
467open issues
PyPIpackage ecosystems

Data collection warnings

  • Star history unavailable: GitHub GraphQL error: Resource not accessible by personal access token
  • Could not fetch pypi package 'tolokaforge-langfuse' from its registry
  • Could not fetch pypi package 'tolokaforge-coding-harnesses' from its registry
  • deps.dev does not index pypi:tolokaforge@0.27.3; advisories assessed against the repository dependency graph instead

More detail

Star and fork history 0 ★ / 11 ⇿
0Stars
11Forks
80Releases

When each star and fork was added, collected from GitHub and bucketed by day. Cumulative growth sits directly above the daily additions it is made of, so the two read against each other: steady organic accretion looks nothing like an abrupt, short-lived burst. Where that difference is measurable, it is reported as growth authenticity.

0246810121112026-072026-082026-09
Major 0Minor 17Patch 28
OpenSSF Scorecard 6.0 / 10
6.0aggregate

Independent, tool-agnostic security assessment from the open-source OpenSSF Scorecard. Each check rewards a security practice, not a specific vendor's tool. Checks Scorecard could not determine are marked n/a and excluded from the security score (never counted as zero).Scorecard v5.5.0 · 2026-09-25 07:38 UTC

10Binary-Artifactsno binaries found in the repo
5Branch-Protectionbranch protection is not maximal on development and all release branches
10CI-Tests20 out of 20 merged PRs checked by a CI test -- score normalized to 10
0CII-Best-Practicesno effort to earn an OpenSSF best practices badge detected
2Code-ReviewFound 6/30 approved changesets -- score normalized to 2
6Contributorsproject has 2 contributing companies or organizations -- score normalized to 6
10Dangerous-Workflowno dangerous workflow patterns detected
10Dependency-Update-Toolupdate tool detected
0Fuzzingproject is not fuzzed
9Licenselicense file detected
10Maintained30 commit(s) and 30 issue activity found in the last 90 days -- score normalized to 10
10Packagingpackaging workflow detected
0Pinned-Dependenciesdependency not pinned by hash detected -- score normalized to 0
10SASTSAST tool is run on all commits
10Security-Policysecurity policy file detected
0Signed-ReleasesProject has not signed or included provenance with any releases.
0Token-Permissionsdetected GitHub workflow tokens with excessive permissions
5Vulnerabilities5 existing vulnerabilities detected
Direct dependencies 36
RegistryPackageVersion constraintManifest
PyPItolokaforge-models>=1.0.0,<2.0.0pyproject.toml
PyPIjinja2>=3.1.0pyproject.toml
PyPIlitellm>=1.83.14,!=1.92.0,<2.0.0pyproject.toml
PyPIpydantic>=2.0.0pyproject.toml
PyPIpydantic>=2.0.0pyproject.toml
PyPIjsonschema>=4.20.0pyproject.toml
PyPIpackaging>=24.0pyproject.toml
PyPIpyyaml>=6.0.1pyproject.toml
PyPIpython-dotenv>=1.0.0pyproject.toml
PyPIclick>=8.1.0,<8.2pyproject.toml
PyPIjsonpath-ng>=1.6.0pyproject.toml
PyPIhttpx>=0.25.0pyproject.toml
PyPItenacity>=8.2.0pyproject.toml
PyPIjinja2>=3.1.0pyproject.toml
PyPIloguru>=0.7.0pyproject.toml
PyPIdocstring_parser>=0.16pyproject.toml
PyPIdeepdiff>=6.0.0pyproject.toml
PyPItoml>=0.10.0pyproject.toml
PyPIaddict>=2.4.0pyproject.toml
PyPIstarlette>=0.52.1pyproject.toml
PyPItypesense>=2.0.0pyproject.toml
PyPIstructlog>=24.0.0pyproject.toml
PyPIdocker>=7.0.0pyproject.toml
PyPIgrpcio>=1.83.0pyproject.toml
PyPIgrpcio-health-checking>=1.83.0pyproject.toml
PyPIprotobuf>=7.35.1pyproject.toml
PyPItestcontainers>=4.14.2,<5pyproject.toml
PyPImcp>=1.0,<2pyproject.toml
PyPIpyyaml>=6.0.1tolokaforge_coding_harnesses/pyproject.toml
PyPIjinja2>=3.1.0tolokaforge_coding_harnesses/pyproject.toml
PyPIpydantic>=2.0.0tolokaforge_coding_harnesses/pyproject.toml
PyPIpydantic>=2.0.0tolokaforge_langfuse/pyproject.toml
PyPIopentelemetry-sdk>=1.27tolokaforge_langfuse/pyproject.toml
PyPIopentelemetry-exporter-otlp-proto-http>=1.27tolokaforge_langfuse/pyproject.toml
PyPIpyyaml>=6.0.1tolokaforge_langfuse/pyproject.toml
PyPItomli>=2.0tolokaforge_langfuse/pyproject.toml
All dependencies 205

Full resolved dependency set from the GitHub dependency graph: 39 direct and 166 indirect (transitive) packages. The transitive closure is complete when the repository commits a lockfile.

RegistryPackageVersionRelation
PyPIaddict2.4.0direct
PyPIclick—direct
PyPIclick8.1.8direct
PyPIdeepdiff9.1.0direct
PyPIdocker7.2.0direct
PyPIdocstring-parser0.18.0direct
PyPIgrpcio1.83.0direct
PyPIgrpcio-health-checking1.83.0direct
PyPIhttpx—direct
PyPIhttpx0.28.1direct
PyPIjinja2—direct
PyPIjinja23.1.6direct
PyPIjsonpath-ng—direct
PyPIjsonpath-ng1.8.0direct
PyPIjsonschema4.26.0direct
PyPIlitellm1.93.0direct
PyPIloguru0.7.3direct
PyPImcp—direct
PyPImcp1.28.1direct
PyPIopentelemetry-exporter-otlp-proto-http—direct
PyPIopentelemetry-exporter-otlp-proto-http1.44.0direct
PyPIopentelemetry-sdk—direct
PyPIopentelemetry-sdk1.44.0direct
PyPIpackaging26.2direct
PyPIprotobuf7.35.1direct
PyPIpydantic—direct
PyPIpydantic2.13.4direct
PyPIpython-dotenv—direct
PyPIpython-dotenv1.2.2direct
PyPIpyyaml—direct
PyPIpyyaml6.0.3direct
PyPIstarlette1.3.1direct
PyPIstructlog26.1.0direct
PyPItenacity9.1.4direct
PyPItestcontainers4.14.2direct
PyPItolokaforge-models1.5.0direct
PyPItoml0.10.2direct
PyPItomli2.4.1direct
PyPItypesense2.0.0direct
PyPIaiohappyeyeballs2.7.1indirect
PyPIaiohttp3.14.3indirect
PyPIaiosignal1.4.0indirect
PyPIalembic1.18.5indirect
PyPIannotated-doc0.0.4indirect
PyPIannotated-types0.8.0indirect
PyPIanyio4.14.2indirect
PyPIargcomplete3.7.0indirect
PyPIast-serialize0.6.0indirect
PyPIasync-timeout5.0.1indirect
PyPIasyncpg0.31.0indirect
PyPIattrs26.1.0indirect
PyPIautomation0.1.0indirect
PyPIbackports-asyncio-runner1.2.0indirect
PyPIblack26.3.1indirect
PyPIboto31.43.86indirect
PyPIbotocore1.43.86indirect
PyPIbuild1.5.0indirect
PyPIcachebox5.2.3indirect
PyPIcertifi2026.7.22indirect
PyPIcffi2.1.0indirect
PyPIcfgv3.5.0indirect
PyPIcharset-normalizer3.4.9indirect
PyPIclick-repl0.3.0indirect
PyPIcolorama0.4.6indirect
PyPIcommitizen4.16.5indirect
PyPIcoverage7.15.2indirect
PyPIcryptography49.0.0indirect
PyPIdecli0.6.3indirect
PyPIdeprecated1.3.1indirect
PyPIdev-mcp0.1.0indirect
PyPIdistlib0.4.3indirect
PyPIdistro1.9.0indirect
PyPIdnspython2.8.0indirect
PyPIecdsa0.19.2indirect
PyPIemail-validator2.3.0indirect
PyPIet-xmlfile2.0.0indirect
PyPIexceptiongroup1.3.1indirect
PyPIexecnet2.1.2indirect
PyPIfastapi0.139.2indirect
PyPIfastuuid0.14.0indirect
PyPIfilelock3.32.0indirect
PyPIfrozenlist1.8.0indirect
PyPIfsspec2026.6.0indirect
PyPIgoogleapis-common-protos1.75.3indirect
PyPIgreenlet3.5.4indirect
PyPIgrimp3.15indirect
PyPIgrpcio-tools1.83.0indirect
PyPIh110.16.0indirect
PyPIhatchling—indirect
PyPIhatchling1.31.0indirect
PyPIhf-xet1.5.2indirect
PyPIhttpcore1.0.9indirect
PyPIhttpx-sse0.4.3indirect
PyPIhuggingface-hub1.13.0indirect
PyPIhypothesis6.167.1indirect
PyPIidentify2.6.19indirect
PyPIidna3.18indirect
PyPIimport-linter2.13indirect
PyPIimportlib-metadata8.9.0indirect
PyPIiniconfig2.3.0indirect
PyPIjiter0.16.0indirect
PyPIjmespath1.1.0indirect
PyPIjsonschema-specifications2025.9.1indirect
PyPIjudge-kind-ab0.1.0indirect
PyPIlibrt0.13.0indirect
PyPIlxml6.1.1indirect
PyPImako1.3.12indirect
PyPImarkdown-it-py4.2.0indirect
PyPImarkupsafe3.0.3indirect
PyPImdurl0.1.2indirect
PyPImultidict6.7.1indirect
PyPImypy2.3.0indirect
PyPImypy-extensions1.1.0indirect
PyPInodeenv1.10.0indirect
PyPInumpy2.2.6indirect
PyPInumpy2.4.6indirect
PyPInumpy2.5.1indirect
PyPIodata-query0.10.0indirect
PyPIopenai2.48.0indirect
PyPIopenpyxl3.1.5indirect
PyPIopentelemetry-api1.44.0indirect
PyPIopentelemetry-exporter-otlp-proto-common1.44.0indirect
PyPIopentelemetry-proto1.44.0indirect
PyPIopentelemetry-semantic-conventions0.65b0indirect
PyPIorderly-set5.5.0indirect
PyPIpathspec1.1.1indirect
PyPIpillow12.3.0indirect
PyPIplatformdirs4.11.0indirect
PyPIplaywright1.61.0indirect
PyPIpluggy1.6.0indirect
PyPIpre-commit4.6.1indirect
PyPIpricing-updater0.1.0indirect
PyPIprompt-toolkit3.0.51indirect
PyPIpropcache0.5.2indirect
PyPIpsutil7.2.2indirect
PyPIpsycopg3.3.4indirect
PyPIpsycopg-binary3.3.4indirect
PyPIpsycopg2-binary2.9.12indirect
PyPIpyasn10.6.4indirect
PyPIpycparser3.0indirect
PyPIpydantic-core2.46.4indirect
PyPIpydantic-settings2.14.2indirect
PyPIpyee13.0.1indirect
PyPIpygments2.20.0indirect
PyPIpyjwt2.13.0indirect
PyPIpyproject-hooks1.2.0indirect
PyPIpytest9.1.1indirect
PyPIpytest-asyncio1.4.0indirect
PyPIpytest-cov7.1.0indirect
PyPIpytest-docker3.2.5indirect
PyPIpytest-xdist3.8.0indirect
PyPIpython-dateutil2.9.0.post0indirect
PyPIpython-discovery1.5.0indirect
PyPIpython-docx1.2.0indirect
PyPIpython-jose3.5.0indirect
PyPIpython-multipart0.0.32indirect
PyPIpython-pptx1.0.2indirect
PyPIpytokens0.4.1indirect
PyPIpywin32312indirect
PyPIquestionary2.1.1indirect
PyPIrank-bm250.2.2indirect
PyPIreferencing0.37.0indirect
PyPIregex2026.7.19indirect
PyPIrequests2.34.2indirect
PyPIrich—indirect
PyPIrich15.0.0indirect
PyPIrpds-py0.30.0indirect
PyPIrpds-py2026.6.3indirect
PyPIrsa4.9.1indirect
PyPIrubric-calibrator0.1.0indirect
PyPIruff0.14.4indirect
PyPIs3transfer0.19.2indirect
PyPIsetuptools83.0.0indirect
PyPIshellingham1.5.4indirect
PyPIsix1.17.0indirect
PyPIsly0.4indirect
PyPIsniffio1.3.1indirect
PyPIsortedcontainers2.4.0indirect
PyPIsqlalchemy2.0.51indirect
PyPIsse-starlette3.4.6indirect
PyPItermcolor3.3.0indirect
PyPItiktoken0.13.0indirect
PyPItokenizers0.23.1indirect
PyPItolokaforge—indirect
PyPItolokaforge0.26.0indirect
PyPItolokaforge-adapter-terminal-bench0.1.0indirect
PyPItolokaforge-coding-harnesses0.1.0indirect
PyPItolokaforge-langfuse0.1.0indirect
PyPItomlkit0.15.1indirect
PyPItqdm4.69.0indirect
PyPItrove-classifiers2026.6.1.19indirect
PyPItyper—indirect
PyPItyper0.12.5indirect
PyPItyping-extensions4.16.0indirect
PyPItyping-inspection0.4.2indirect
PyPItzdata2026.3indirect
PyPIurllib32.7.0indirect
PyPIuvicorn0.51.0indirect
PyPIvirtualenv21.7.0indirect
PyPIwcwidth0.8.2indirect
PyPIwin32-setctime1.2.0indirect
PyPIwrapt2.2.2indirect
PyPIxlsxwriter3.2.9indirect
PyPIyarl1.24.5indirect
PyPIzipp4.1.0indirect
Dependency advisories 3

This repository publishes no package the index resolves, so its own dependency graph was assessed — 191 packages, which also include development and test pins that never ship: 3 carry known advisories, of which 1 are direct. 14 could not be assessed — no resolved version, an unsupported ecosystem, or beyond the reported package list.

PackageVersionRelationSeverityAdvisoriesFixed in
click8.1.8directhigh18.3.3
ecdsa0.19.2indirecthigh2—
cryptography49.0.0indirectmoderate250.0.0

An advisory means the version recorded in the dependency graph falls inside an advisory’s affected range. Reachability is not analysed, and the graph includes development and test pins — a finding may concern tooling rather than shipped software.

Raw JSON report machine-readable

Feedback

Spotted something off in this report, or have thoughts to share? Wrong measurements, missed tooling, ideas, questions — anything is welcome. Every message is read and gets a response.

The message is kept through sign-in.

Related records

Inspected repositories sharing catalogue tags or ecosystems with Toloka/tolokaforge. Read them side by side →

100deepset-ai/haystackOpen-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.Exceptional98ComposioHQ/composioComposio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.Exceptional98Agenta-AI/agentaAgenta is a workspace where you and your team build agents and automations.Exceptional98strands-agents/toolsA set of tools that gives agents powerful capabilities.Exceptional98googleapis/mcp-toolboxMCP Toolbox for Databases is an open source MCP server for databases.Exceptional97strands-agents/harness-sdkBuild an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.Exceptional

Scores are signals, not warranties. They reflect publicly visible practices on GitHub — not a code audit, and not a security guarantee.

Missing data is excluded and weights renormalized, never scored as zero. Methodology is versioned and open: metrics v2.10.0, schema v0.34.0 — full methodology · metrics wiki.

How one result sits in the wider record: aggregate statistics — PyPI.