Public record
Software health reportschema 0.34.0 · metrics 2.10.0 · 2026-09-17 23:52 UTC

JudgmentLabs / judgeval

The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.

PythonApache-2.0★ 1,063 stars⑂ 99 forkssince Oct 2024View on GitHub ↗
KindCommand-line toolLibraryhow this is determined
#langchain#langgraph#llama-index#llm#llm-evaluation#llm-observability#open-source#openai#prompt-engineering#agent#agentic-ai#agents#grpo#reinforcement-learning#rl

JudgmentLabs/judgeval holds a health index of 91 out of 100, placing it in the Excellent band. It scores highest on Vitality (96/100) and lowest on Security (55/100). It was last updated 1 day ago. 2 contributors account for most of its recent work.

91
overall / 100
Excellent

Software health index

Metrics are grouped into weighted categories on one standardized 1–100 scale. Overall starts as their weighted mean, calibrated against the distribution of the public record so bands carry percentile meaning; when public evidence triggers the High-Risk Jurisdiction Policy, the rating is adjusted and receives an At Risk ceiling of 34.

91
Exceptional93-100The record's top tier (≈ top 5%); essentially all checked criteria met
Excellent80-92Strong across the board; minor gaps
Good65-79Healthy; gaps are limited and manageable
Moderate50-64Acceptable with notable gaps; review recommended
Weak35-49Material weaknesses across several areas
At Risk20-34Significant weaknesses; adoption warrants caution
Critical1-19Severe problems (abandoned, single-maintainer, no hygiene)
VitalityCommunity &AdoptionSustainability &GovernanceEngineeringQualitySecurityAI Readiness

Score profile

Each axis is a category. The shape matters more than the average — a healthy subject fills the whole shape, while a spike-and-crater profile means strength in one dimension is masking risk in another.

The weighted overall 77 is calibrated to 91 on the published index scale (record calibration 2026-08-02).

Ownership

Judgment LabsOrganization
38 followers11 public repossince Oct 2024

This repository is backed by an organization — shared, accountable stewardship that can outlive any single maintainer.

Package ecosystems

RegistryPackageVersionDownloads / moVersionsLast publish
PyPIjudgeval1.3.2233,07514816 days ago

Metrics by category

Vitality

Is the project alive — is code being written and are releases shipping?

96Exceptional · 21% of overall

Development activity

93Exceptional
How it's scored
36/36Push recency — last push 1 days ago
29.1/36Commit cadence — 42/52 weeks with commits
18/18Commit volume — 243 commits in the last year
10/10OpenSSF Scorecard: Maintained — 16 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 10
Inputs used
commits_last_year243
human_commit_share0.98
days_since_last_push1
active_weeks_last_year42

Release discipline

100Exceptional
How it's scored
27/27Ships releases — 100 releases published
36/36Release recency — latest release 16 days ago
27/27Release cadence — a release every ~16.2 days
0/10OpenSSF Scorecard: Signed-Releases — no data
Inputs used
releases_count100
latest_release_tagv1.3.2
releases_from_tagsno
days_since_latest_release16
mean_days_between_releases16.2
Excluded from scoring (no data or not applicable): OpenSSF Scorecard: Signed-Releases. Remaining weights renormalized.

Community & Adoption

Does the project have users, downloads, attention, and a welcoming setup for contributors?

77Good · 17% of overall

Popularity & adoption

70Good
How it's scored
49.1/60Stars — 1,063 stars
16.6/25Forks — 99 forks
4.3/15Watchers — 7 watchers
Inputs used
forks99
stars1,063
watchers7
growth_stateunverified
growth_factor_pct100
growth_unverified_reasonno_history

Community health

77Good
How it's scored
22.5/22.5README
22.5/22.5License — recognized license (Apache-2.0)
18/18CONTRIBUTING guide
0/13.5Code of conduct
0/7.2Issue template
6.3/6.3PR template
Inputs used
has_readmeyes
has_licenseyes
readme_badges3
has_contributingyes
has_issue_templateno
has_code_of_conductno
readme_badge_servicesshields.io
has_pull_request_templateyes

Ecosystem adoption (downloads)

89Excellent
How it's scored
71.6/80Monthly downloads — 233,075 downloads/month across pypi
0/20Registry dependents — not reported by this ecosystem
Inputs used
packagesjudgeval
dependents—
ecosystemspypi
total_downloads—
monthly_downloads233,075
unverified_packages_excluded—
Excluded from scoring (no data or not applicable): Registry dependents. Remaining weights renormalized.

Sustainability & Governance

Will the project survive its people — bus factor, responsiveness, who backs it, and package upkeep?

67Good · 23% of overall

Maintainer resilience (bus factor)

58Moderate
How it's scored
25.2/54Bus factor — 2 contributor(s) cover half of all commits
13.7/22.5Commit distribution — top contributor authored 39% of commits
13.5/13.5Contributor breadth — 24 contributors
6/10OpenSSF Scorecard: Contributors — project has 2 contributing companies or organizations -- score normalized to 6
Inputs used
bus_factor2
contributors_sampled24
top_contributor_share0.39

Issue & PR responsiveness

66Good
How it's scored
32.3/42Issue resolution — 77% of issues closed
24.3/30PR acceptance — 564/696 decided PRs merged
0/13Newcomer PR acceptance — 0/1 first-time contributors' PRs merged in 30d
9/15OpenSSF Scorecard: Code-Review — Found 19/29 approved changesets -- score normalized to 6
Inputs used
merged_prs564
open_issues16
closed_issues53
prs_merged_7d0
prs_decided_7d0
prs_merged_30d2
prs_decided_30d5
issue_closed_ratio0.768
closed_unmerged_prs132
first_time_authors_30d1
first_time_prs_merged_30d0
first_time_prs_decided_30d1

Ownership & stewardship

53Moderate
How it's scored
30/30Ownership backing — organization-owned
0/20Verified domain
11.4/25Owner reach — 38 followers of JudgmentLabs
11.6/25Track record — 11 public repos, account ~1 yr old
Inputs used
followers38
owner_typeOrganization
is_verifiedno
owner_loginJudgmentLabs
public_repos11
account_age_days692

Package maintenance

100Exceptional
How it's scored
25/25Published & resolvable — 1 package(s) on pypi
35/35Publish recency — latest publish 16 days ago
20/20Version history — 148 published versions
20/20Not deprecated — active, not deprecated or yanked
Inputs used
packagesjudgeval
ecosystemspypi
any_deprecatedno
min_days_since_publish16

Engineering Quality

Are baseline engineering and documentation practices in place?

86Excellent · 19% of overall

Engineering practices

94Exceptional
How it's scored
24/24CI workflows — 11 workflow(s)
24/24Tests present
16/16Linter config — pyproject.toml ([tool.ruff])
9.6/9.6Pre-commit hooks
0/6.4.editorconfig
20/20OpenSSF Scorecard: CI-Tests — 21 out of 21 merged PRs checked by a CI test -- score normalized to 10
Inputs used
has_ciyes
has_testsyes
has_editorconfigno
has_linter_configyes
has_precommit_configyes

Documentation

75Good
How it's scored
30/30README
0/25Documentation directory
15/15Documentation / homepage site — https://judgmentlabs.ai/
10/10Repository description
10/10Topics — 15 topics
10/10Wiki
Inputs used
topicslangchain, langgraph, llama-index, llm, llm-evaluation, llm-observability, open-source, openai, prompt-engineering, agent, agentic-ai, agents, grpo, reinforcement-learning, rl
has_wikiyes
homepagehttps://judgmentlabs.ai/
docs_sitehttps://judgmentlabs.ai/
has_readmeyes
has_docs_dirno
has_descriptionyes

Security

Are visible security and supply-chain practices strong, without unresolved high-risk jurisdiction exposure?

55Moderate · 16% of overall

Security posture

44Weak
How it's scored
7.5/7.5Binary-Artifacts — no binaries found in the repo
3.8/7.5Branch-Protection — branch protection is not maximal on development and all release branches
2.5/2.5CI-Tests — 21 out of 21 merged PRs checked by a CI test -- score normalized to 10
0/2.5CII-Best-Practices — no effort to earn an OpenSSF best practices badge detected
4.5/7.5Code-Review — Found 19/29 approved changesets -- score normalized to 6
1.5/2.5Contributors — project has 2 contributing companies or organizations -- score normalized to 6
0/10Dangerous-Workflow — dangerous workflow patterns detected
7.5/7.5Dependency-Update-Tool — update tool detected
0/5Fuzzing — project is not fuzzed
2.5/2.5License — license file detected
7.5/7.5Maintained — 16 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 10
0/5Packaging — no data
0/5Pinned-Dependencies — dependency not pinned by hash detected -- score normalized to 0
0/5SAST — SAST tool is not run on all commits -- score normalized to 0
0/5Security-Policy — security policy file not detected
0/7.5Signed-Releases — no data
0/7.5Token-Permissions — detected GitHub workflow tokens with excessive permissions
3.8/7.5Vulnerabilities — 5 existing vulnerabilities detected
Inputs used
sourceopenssf_scorecard
checks_evaluated16
scorecard_versionv5.5.0
checks_inconclusive2
scorecard_aggregate4.4
Excluded from scoring (no data or not applicable): Packaging, Signed-Releases. Remaining weights renormalized.

Dependency advisories

100Exceptional
How it's scored
35/35Direct dependencies free of known advisories — no direct dependency carries a known advisory
25/25Indirect dependencies free of known advisories — no indirect dependency carries a known advisory
0/40No advisories left outstanding — no advisory carries a publication date
Inputs used
sourceosv
advisories0
affected_packages0
assessed_packages33
unassessed_packages0
affected_by_severitynone
direct_affected_packages0
Excluded from scoring (no data or not applicable): No advisories left outstanding. Remaining weights renormalized. Matched the pypi:judgeval@1.3.2 runtime dependency closure — what installing the published package pulls in — 33 packages. Reachability is not analyzed.

AI Readiness

How well is the repo equipped to be developed and maintained with AI coding agents? Carries a deliberately small weight (4%): agent tooling is a real maintenance signal, but a repository with none can still reach 100/100.

68Good · 4% of overall

Agent context & guidance

52Moderate
How it's scored
0/45Agent instructions — no CLAUDE.md / AGENTS.md / editor rules
15/15Machine-readable docs (llms.txt) — llms.txt served by the project website (https://docs.judgmentlabs.ai/llms.txt)
36.5/40Legible commit history — 67 of 98 human commits state their intent (structured subject or explanatory body)
Inputs used
has_llms_txtyes
llms_txt_urlhttps://docs.judgmentlabs.ai/llms.txt
legible_history_share0.684
agent_instruction_files—
agent_instruction_max_bytes—

Verify loop (build / test / typecheck)

64Moderate
How it's scored
0/18One-command bootstrap
22/22Automated tests
11/11Lint / format config — pyproject.toml ([tool.ruff])
11/11Static type checking — src/e2etests/py.typed, src/judgeval/py.typed, src/judgeval/utils/wrappers/py.typed
10/10Reproducible environment — lockfile
10/10Demonstrated agent practice — 10 of the last 100 commits agent-authored or agent-credited
0/8Automated maintenance — no automated dependency updates observed
0/10OpenSSF Scorecard: Pinned-Dependencies — dependency not pinned by hash detected -- score normalized to 0
Inputs used
has_nixno
has_testsyes
lockfilesuv.lock
has_dockerfileno
typed_languageno
bootstrap_files—
has_devcontainerno
has_linter_configyes
typecheck_configssrc/e2etests/py.typed, src/judgeval/py.typed, src/judgeval/utils/wrappers/py.typed
agent_commit_share0.1
toolchain_manifests—
dependency_bot_commit_share0

Code legibility for models

82Excellent
How it's scored
27/45Type-checkable code — Python with type-check config (src/e2etests/py.typed, src/judgeval/py.typed, src/judgeval/utils/wrappers/py.typed)
55/55Manageable file sizes — 0/296 source files over 60KB
Inputs used
primary_languagePython
largest_source_bytes51,845
source_files_sampled296
oversized_source_files0

Machine-readable interfaces

100Exceptional
How it's scored
0/40API schema (OpenAPI/GraphQL/proto) — not applicable to this kind of software
0/20MCP server — not applicable to this kind of software
40/40Runnable examples — examples
Inputs used
example_dirsexamples
has_mcp_signalno
api_schema_files—
interfaces_expected_of—
Excluded from scoring (no data or not applicable): API schema (OpenAPI/GraphQL/proto), MCP server. Remaining weights renormalized.

Key facts

1,063GitHub stars
24contributors
243commits, last 12 months
1days since last push
100releases
2bus factor
16open issues
PyPIpackage ecosystems

Data collection warnings

  • Star history unavailable: GitHub GraphQL error: Resource not accessible by personal access token
  • pypi download statistics for 'judgeval' unavailable this scan (stats endpoint failed after retries); adoption may be under-evidenced
  • pypi download figures for judgeval carried forward from the previous scan (stats endpoint unavailable this scan)

More detail

Star and fork history 0 ★ / 99 ⇿
0Stars
99Forks
100Releases

When each star and fork was added, collected from GitHub and bucketed by day. Cumulative growth sits directly above the daily additions it is made of, so the two read against each other: steady organic accretion looks nothing like an abrupt, short-lived burst. Where that difference is measurable, it is reported as growth authenticity.

02040608010099222025-062026-012026-09
Major 1Minor 35Patch 64

Each point covers 2 days.

OpenSSF Scorecard 4.4 / 10
4.4aggregate

Independent, tool-agnostic security assessment from the open-source OpenSSF Scorecard. Each check rewards a security practice, not a specific vendor's tool. Checks Scorecard could not determine are marked n/a and excluded from the security score (never counted as zero).Scorecard v5.5.0 · 2026-09-17 23:52 UTC

10Binary-Artifactsno binaries found in the repo
5Branch-Protectionbranch protection is not maximal on development and all release branches
10CI-Tests21 out of 21 merged PRs checked by a CI test -- score normalized to 10
0CII-Best-Practicesno effort to earn an OpenSSF best practices badge detected
6Code-ReviewFound 19/29 approved changesets -- score normalized to 6
6Contributorsproject has 2 contributing companies or organizations -- score normalized to 6
0Dangerous-Workflowdangerous workflow patterns detected
10Dependency-Update-Toolupdate tool detected
0Fuzzingproject is not fuzzed
10Licenselicense file detected
10Maintained16 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 10
n/aPackagingpackaging workflow not detected
0Pinned-Dependenciesdependency not pinned by hash detected -- score normalized to 0
0SASTSAST tool is not run on all commits -- score normalized to 0
0Security-Policysecurity policy file not detected
n/aSigned-Releasesno releases found
0Token-Permissionsdetected GitHub workflow tokens with excessive permissions
5Vulnerabilities5 existing vulnerabilities detected
Direct dependencies 8
RegistryPackageVersion constraintManifest
PyPIhttpx>=0.28.1pyproject.toml
PyPIopentelemetry-exporter-otlp>=1.36.0pyproject.toml
PyPIopentelemetry-sdk>=1.36.0pyproject.toml
PyPIorjson>=3.9.0pyproject.toml
PyPItyper>=0.9.0pyproject.toml
PyPIdotenv>=0.9.9pyproject.toml
PyPIpathspec>=1.0.4pyproject.toml
PyPIpackaging>=25.0pyproject.toml
All dependencies 214

Full resolved dependency set from the GitHub dependency graph: 10 direct and 204 indirect (transitive) packages. The transitive closure is complete when the repository commits a lockfile.

RegistryPackageVersionRelation
PyPIdotenv0.9.9direct
PyPIhttpx0.28.1direct
PyPIopentelemetry-exporter-otlp1.42.1direct
PyPIopentelemetry-exporter-otlp1.44.0direct
PyPIopentelemetry-sdk1.42.1direct
PyPIopentelemetry-sdk1.44.0direct
PyPIorjson3.12.0direct
PyPIpackaging26.3direct
PyPIpathspec1.1.1direct
PyPItyper0.27.2direct
PyPIaiohappyeyeballs2.7.1indirect
PyPIaiohttp3.14.3indirect
PyPIaiosignal1.4.0indirect
PyPIaiosqlite0.22.1indirect
PyPIaltair6.2.2indirect
PyPIannotated-doc0.0.5indirect
PyPIannotated-types0.8.0indirect
PyPIanthropic0.125.0indirect
PyPIanyio4.14.2indirect
PyPIasgiref3.12.1indirect
PyPIast-serialize0.8.0indirect
PyPIasync-timeout4.0.3indirect
PyPIasync-timeout5.0.1indirect
PyPIattrs26.1.0indirect
PyPIauthlib1.8.0indirect
PyPIbackports-asyncio-runner1.2.0indirect
PyPIbasic-distributed-tracing-example0.0.1indirect
PyPIbasic-example0.0.1indirect
PyPIboto31.43.86indirect
PyPIboto3-stubs1.43.86indirect
PyPIbotocore1.43.86indirect
PyPIbotocore-stubs1.43.67indirect
PyPIcertifi2026.7.22indirect
PyPIcffi2.1.1indirect
PyPIcfgv3.5.0indirect
PyPIcharset-normalizer3.5.1indirect
PyPIclaude-agent-sdk—indirect
PyPIclaude-agent-sdk0.2.150indirect
PyPIclick8.5.0indirect
PyPIcolorama0.4.6indirect
PyPIcoverage7.16.0indirect
PyPIcryptography50.0.1indirect
PyPIcyclopts4.23.3indirect
PyPIdatasets5.0.1indirect
PyPIdetect-agent0.6.0indirect
PyPIdill0.4.1indirect
PyPIdistlib0.4.3indirect
PyPIdistro1.9.0indirect
PyPIdocstring-parser0.18.0indirect
PyPIexceptiongroup1.3.1indirect
PyPIexecnet2.1.2indirect
PyPIfastapi0.141.1indirect
PyPIfilelock3.32.5indirect
PyPIfrozenlist1.8.0indirect
PyPIfsspec2026.6.0indirect
PyPIgoogle-adk2.8.0indirect
PyPIgoogle-adk-example0.0.1indirect
PyPIgoogle-auth2.57.0indirect
PyPIgoogle-genai2.21.0indirect
PyPIgoogleapis-common-protos1.75.2indirect
PyPIgraphviz0.21indirect
PyPIgreenlet3.5.5indirect
PyPIgriffe1.15.0indirect
PyPIgroq1.7.0indirect
PyPIgrpcio1.83.1indirect
PyPIh110.16.0indirect
PyPIhf-xet1.6.0indirect
PyPIhttpcore1.0.9indirect
PyPIhttpcore22.12.0indirect
PyPIhttptools0.8.0indirect
PyPIhttpx-sse0.4.3indirect
PyPIhttpx22.12.0indirect
PyPIhttpx2-jsfetch1.0indirect
PyPIhuggingface-hub1.29.0indirect
PyPIidentify2.6.19indirect
PyPIidna3.19indirect
PyPIiniconfig2.3.0indirect
PyPIitsdangerous2.2.0indirect
PyPIjinja23.1.6indirect
PyPIjiter0.16.0indirect
PyPIjmespath1.1.0indirect
PyPIjoserfc1.7.5indirect
PyPIjsonpatch1.33indirect
PyPIjsonpointer3.1.1indirect
PyPIjsonschema4.26.0indirect
PyPIjsonschema-specifications2025.9.1indirect
PyPIjudgeval—indirect
PyPIjudgeval0.0.0indirect
PyPIlangchain0.3.30indirect
PyPIlangchain-core0.4.0.dev0indirect
PyPIlangchain-text-splitters0.3.11indirect
PyPIlangsmith0.12.1indirect
PyPIlibrt0.15.0indirect
PyPImarkdown-it-py4.2.0indirect
PyPImarkupsafe3.0.3indirect
PyPImcp1.29.1indirect
PyPImdurl0.1.2indirect
PyPImultidict6.7.1indirect
PyPImultiprocess0.70.19indirect
PyPImypy2.3.1indirect
PyPImypy-boto3-s31.43.66indirect
PyPImypy-extensions1.1.0indirect
PyPInarwhals2.25.0indirect
PyPInodeenv1.10.0indirect
PyPInumpy2.2.6indirect
PyPInumpy2.4.6indirect
PyPInumpy2.5.2indirect
PyPIopenai1.109.1indirect
PyPIopenai3.6.0indirect
PyPIopenai-agents0.3.3indirect
PyPIopenlit1.36.7indirect
PyPIopentelemetry-api1.42.1indirect
PyPIopentelemetry-api1.44.0indirect
PyPIopentelemetry-exporter-otlp-proto-common1.42.1indirect
PyPIopentelemetry-exporter-otlp-proto-common1.44.0indirect
PyPIopentelemetry-exporter-otlp-proto-grpc1.42.1indirect
PyPIopentelemetry-exporter-otlp-proto-grpc1.44.0indirect
PyPIopentelemetry-exporter-otlp-proto-http1.42.1indirect
PyPIopentelemetry-exporter-otlp-proto-http1.44.0indirect
PyPIopentelemetry-instrumentation0.65b0indirect
PyPIopentelemetry-instrumentation-aiohttp-client0.65b0indirect
PyPIopentelemetry-instrumentation-asgi0.65b0indirect
PyPIopentelemetry-instrumentation-django0.65b0indirect
PyPIopentelemetry-instrumentation-falcon0.65b0indirect
PyPIopentelemetry-instrumentation-fastapi0.65b0indirect
PyPIopentelemetry-instrumentation-flask0.65b0indirect
PyPIopentelemetry-instrumentation-httpx0.65b0indirect
PyPIopentelemetry-instrumentation-openai0.62.3indirect
PyPIopentelemetry-instrumentation-pyramid0.65b0indirect
PyPIopentelemetry-instrumentation-requests0.65b0indirect
PyPIopentelemetry-instrumentation-starlette0.65b0indirect
PyPIopentelemetry-instrumentation-tornado0.65b0indirect
PyPIopentelemetry-instrumentation-urllib0.65b0indirect
PyPIopentelemetry-instrumentation-urllib30.65b0indirect
PyPIopentelemetry-instrumentation-wsgi0.65b0indirect
PyPIopentelemetry-proto1.42.1indirect
PyPIopentelemetry-proto1.44.0indirect
PyPIopentelemetry-semantic-conventions0.63b1indirect
PyPIopentelemetry-semantic-conventions0.65b0indirect
PyPIopentelemetry-semantic-conventions-ai0.5.1indirect
PyPIopentelemetry-util-http0.65b0indirect
PyPIpandas2.3.3indirect
PyPIpandas3.0.5indirect
PyPIpillow12.3.0indirect
PyPIplatformdirs4.11.7indirect
PyPIpluggy1.6.0indirect
PyPIpre-commit4.6.2indirect
PyPIpropcache0.5.2indirect
PyPIprotobuf6.33.6indirect
PyPIprotobuf7.36.1indirect
PyPIpyarrow25.0.1indirect
PyPIpyasn10.6.4indirect
PyPIpyasn1-modules0.4.2indirect
PyPIpycparser3.0indirect
PyPIpydantic2.13.5indirect
PyPIpydantic-core2.46.5indirect
PyPIpydantic-settings2.15.0indirect
PyPIpydeck0.9.3indirect
PyPIpygments2.21.0indirect
PyPIpyjwt2.13.0indirect
PyPIpytest9.1.1indirect
PyPIpytest-asyncio1.4.0indirect
PyPIpytest-cov7.1.0indirect
PyPIpytest-xdist3.8.0indirect
PyPIpython-dateutil2.9.0.post0indirect
PyPIpython-discovery1.6.0indirect
PyPIpython-dotenv1.2.3indirect
PyPIpython-multipart0.0.32indirect
PyPIpytz2026.3.post1indirect
PyPIpywin32312indirect
PyPIpyyaml6.0.3indirect
PyPIreferencing0.37.0indirect
PyPIrequests2.34.2indirect
PyPIrequests-toolbelt1.0.0indirect
PyPIrich15.0.0indirect
PyPIrich-rst2.1.0indirect
PyPIrpds-py0.30.0indirect
PyPIrpds-py2026.6.3indirect
PyPIruff0.9.10indirect
PyPIs3transfer0.19.2indirect
PyPIschedule1.2.2indirect
PyPIshellingham1.5.4indirect
PyPIsix1.17.0indirect
PyPIsniffio1.3.1indirect
PyPIsqlalchemy2.0.52indirect
PyPIsse-starlette3.4.8indirect
PyPIstarlette1.6.0indirect
PyPIstreamlit1.63.0indirect
PyPItenacity9.1.4indirect
PyPItogether2.32.0indirect
PyPItoml0.10.2indirect
PyPItomli2.4.1indirect
PyPItqdm4.70.0indirect
PyPItruststore0.10.4indirect
PyPItypes-pyyaml6.0.12.20260815indirect
PyPItypes-requests2.33.0.20260712indirect
PyPItypes-s3transfer0.16.0indirect
PyPItypes-tqdm4.70.0.20260827indirect
PyPItyping-extensions4.16.0indirect
PyPItyping-inspection0.4.4indirect
PyPItzdata2026.3indirect
PyPItzlocal5.4.4indirect
PyPIurllib32.7.0indirect
PyPIuuid-utils0.17.0indirect
PyPIuvicorn0.52.4indirect
PyPIvirtualenv21.7.8indirect
PyPIwatchdog6.0.0indirect
PyPIwebsockets15.0.1indirect
PyPIwebsockets16.1.1indirect
PyPIwrapt2.4.0indirect
PyPIxmltodict0.15.1indirect
PyPIxxhash4.0.1indirect
PyPIyarl1.24.5indirect
PyPIzstandard0.25.0indirect
Dependency advisories 0

Installing pypi:judgeval@1.3.2 pulls in 33 packages, direct and transitive: 0 carry known advisories, of which 0 are direct dependencies.

No known advisories affect the assessed dependencies.

An advisory means the version recorded in the dependency graph falls inside an advisory’s affected range. Reachability is not analysed, and the graph includes development and test pins — a finding may concern tooling rather than shipped software.

Raw JSON report machine-readable

Feedback

Spotted something off in this report, or have thoughts to share? Wrong measurements, missed tooling, ideas, questions — anything is welcome. Every message is read and gets a response.

The message is kept through sign-in.

Related records

Inspected repositories sharing catalogue tags or ecosystems with JudgmentLabs/judgeval. Read them side by side →

98comet-ml/opikDebug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.Exceptional96langfuse/langfuse🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.Exceptional96CopilotKit/CopilotKitThe Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI ProtocolExceptional99mlflow/mlflowThe open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.Exceptional98langchain-ai/langgraphBuild resilient agents.Exceptional98langchain-ai/langchainThe agent engineering platform.Exceptional

Scores are signals, not warranties. They reflect publicly visible practices on GitHub — not a code audit, and not a security guarantee.

Missing data is excluded and weights renormalized, never scored as zero. Methodology is versioned and open: metrics v2.10.0, schema v0.34.0 — full methodology · metrics wiki.

How one result sits in the wider record: aggregate statistics — PyPI.