公开记录中等
软件健康报告模式 0.27.0 · 指标 1.13.0 · 2026-07-30 06:02 UTC
robocurve / worldevals
A curated catalog of VLA / physical-AI benchmarks, each runnable on real robots or sims via Inspect Robots. (The Inspect Evals for robotics.)
robocurve/worldevals 的健康指数为 100 分中的 61 分，处于「中等」区间。 其得分最高的类别是Engineering Quality（90/100），最低的是Community & Adoption（39/100）。 最近一次更新在 2 天前。 近期的大部分工作由 1 位贡献者完成。
61
总分 / 100软件健康指数
指标归入加权类别，统一采用 1–100 量表。总体分先取类别加权平均；当公开证据触发高风险司法辖区政策时，评级会按政策调整，并设置 49（有风险）的上限。AI 就绪度不计入总体分。
61
优秀85-100堪称典范；基本满足所有检验标准
良好70-84健康；仅有轻微不足
中等50-69可接受，但存在明显不足；建议进行审查
存在风险30-49存在重大薄弱环节；采用时应保持审慎
危急1-29问题严重（项目被弃置、仅有单一维护者、缺乏基本工程规范）
评分画像
每条轴代表一个类别。形状比平均值更重要——健康的对象会填满整个图形，而“一峰一谷”式画像意味着某一维度的优势正掩盖另一维度的风险。
所有权
软件包生态系统
| 注册表 | 软件包 | 版本 | 月下载量 | 版本数 | 最近发布 | 标签 |
|---|---|---|---|---|---|---|
| PyPI | worldevals | 0.3.2 | - | 3 | 2 天前 | benchmarkscatalogevaluationphysical-airoboticsvla |
按类别列示的指标
活力
项目是否仍有生命——是否仍在编写代码，是否仍在发布版本？
72
开发活跃度
53中等
评分方式
| 36/36 | 推送新近度 — 最近一次推送于 2 天前 |
| 2.1/36 | 提交节奏 — 52 周中有 3 周有提交 |
| 15.3/18 | 提交量 — 最近一年 50 次提交 |
| 0/10 | OpenSSF Scorecard：Maintained — project was created within the last 90 days. Please review its contents carefully |
所用输入
| commits_last_year | 50 |
| human_commit_share | 0.98 |
| days_since_last_push | 2 |
| active_weeks_last_year | 3 |
发布纪律
100优秀
评分方式
| 27/27 | 有发布版本 — 已发布 3 个发布版本 |
| 36/36 | 发布时效 — 最近一次发布版本于 2 天前 |
| 27/27 | 发布节奏 — 约每 10.4 天发布一次 |
| 0/10 | OpenSSF Scorecard：Signed-Releases — 无数据 |
所用输入
| releases_count | 3 |
| latest_release_tag | v0.3.2 |
| releases_from_tags | 否 |
| days_since_latest_release | 2 |
| mean_days_between_releases | 10.4 |
已排除计分（无数据或不适用）：OpenSSF Scorecard：Signed-Releases。 其余权重已重新归一化。
社区与采用
项目是否拥有用户、下载量与关注度，并具备欢迎贡献者参与的配置？
39
流行度与采用
11危急
评分方式
| 11.3/60 | 星标 — 6 个星标 |
| 0/25 | 复刻 — 2 个复刻 |
| 0/15 | 关注者 — 1 位关注者 |
所用输入
| forks | 2 |
| stars | 6 |
| watchers | 1 |
| growth_state | unverified |
| growth_factor_pct | 100 |
| growth_unverified_reason | no_history |
社区健康
70良好
评分方式
| 22.5/22.5 | README |
| 22.5/22.5 | 许可证 — 可识别的许可证（MIT） |
| 18/18 | CONTRIBUTING 指南 |
| 0/13.5 | 行为准则 |
| 0/7.2 | 议题模板 |
| 0/6.3 | PR 模板 |
所用输入
| has_readme | 是 |
| has_license | 是 |
| has_contributing | 是 |
| has_issue_template | 否 |
| has_code_of_conduct | 否 |
| has_pull_request_template | 否 |
可持续性与治理
项目能否在其成员之外延续——巴士系数、响应能力、由谁支持，以及软件包的维护状况？
48
维护者韧性（巴士系数）
12危急
评分方式
| 9/54 | 巴士系数 — 1 位贡献者贡献了半数提交 |
| 0.5/22.5 | 提交分布 — 头号贡献者编写了 98% 的提交 |
| 2.7/13.5 | 贡献者广度 — 2 位贡献者 |
| 0/10 | OpenSSF Scorecard：Contributors — project has 0 contributing companies or organizations -- score normalized to 0 |
所用输入
| bus_factor | 1 |
| contributors_sampled | 2 |
| top_contributor_share | 0.98 |
议题与 PR 响应能力
58中等
评分方式
| 23.4/46.8 | 议题解决 — 50% 的议题已关闭 |
| 35.1/38.3 | PR 接受 — 已裁定的 PR 中 22/24 已合并 |
| 0/15 | OpenSSF Scorecard：Code-Review — Found 0/18 approved changesets -- score normalized to 0 |
所用输入
| merged_prs | 22 |
| open_issues | 1 |
| closed_issues | 1 |
| issue_closed_ratio | 0.5 |
| closed_unmerged_prs | 2 |
所有权与托管责任
48存在风险
评分方式
| 30/30 | 所有权背书 — 组织持有 |
| 0/20 | 已验证域名 |
| 10.2/25 | 所有者影响力 — robocurve 有 25 位关注者 |
| 8.3/25 | 既往记录 — 12 个公开仓库，账户约 0 年 |
所用输入
| followers | 25 |
| owner_type | Organization |
| is_verified | — |
| owner_login | robocurve |
| public_repos | 12 |
| account_age_days | 34 |
软件包维护
92优秀
评分方式
| 25/25 | 已发布且可解析 — pypi 上有 1 个软件包 |
| 35/35 | 发布时效 — 最近一次发布于 2 天前 |
| 12/20 | 版本历史 — 3 个已发布版本 |
| 20/20 | 未被弃用 — 活跃，未被弃用或撤回 |
所用输入
| packages | worldevals |
| ecosystems | pypi |
| any_deprecated | 否 |
| min_days_since_publish | 2 |
工程质量
基础的工程与文档实践是否到位？
90
工程实践
94优秀
评分方式
| 24/24 | CI 工作流 — 4 个工作流 |
| 24/24 | 存在测试 |
| 16/16 | Linter 配置 |
| 9.6/9.6 | Pre-commit 钩子 |
| 0/6.4 | .editorconfig |
| 20/20 | OpenSSF Scorecard：CI-Tests — 19 out of 19 merged PRs checked by a CI test -- score normalized to 10 |
所用输入
| has_ci | 是 |
| has_tests | 是 |
| has_editorconfig | 否 |
| has_linter_config | 是 |
| has_precommit_config | 是 |
文档
85优秀
评分方式
| 30/30 | README |
| 25/25 | 文档目录 |
| 0/15 | 文档 / 主页站点 |
| 10/10 | 仓库描述 |
| 10/10 | 主题标签 — 5 个主题标签 |
| 10/10 | Wiki |
所用输入
| topics | benchmarks, evaluation, robolens, robotics, vla |
| has_wiki | 是 |
| homepage | — |
| has_readme | 是 |
| has_docs_dir | 是 |
| has_description | 是 |
安全
可见的安全与供应链实践是否稳固，且不存在未解决的高风险司法辖区暴露？
51
安全态势
39存在风险
评分方式
| 7.5/7.5 | Binary-Artifacts — no binaries found in the repo |
| 3/7.5 | Branch-Protection — branch protection is not maximal on development and all release branches |
| 2.5/2.5 | CI-Tests — 19 out of 19 merged PRs checked by a CI test -- score normalized to 10 |
| 0/2.5 | CII-Best-Practices — no effort to earn an OpenSSF best practices badge detected |
| 0/7.5 | Code-Review — Found 0/18 approved changesets -- score normalized to 0 |
| 0/2.5 | Contributors — project has 0 contributing companies or organizations -- score normalized to 0 |
| 10/10 | Dangerous-Workflow — no dangerous workflow patterns detected |
| 0/7.5 | Dependency-Update-Tool — no update tool detected |
| 0/5 | Fuzzing — project is not fuzzed |
| 2.5/2.5 | 许可证 — license file detected |
| 0/7.5 | Maintained — project was created within the last 90 days. Please review its contents carefully |
| 5/5 | Packaging — packaging workflow detected |
| 0/5 | Pinned-Dependencies — dependency not pinned by hash detected -- score normalized to 0 |
| 0/5 | SAST — SAST tool is not run on all commits -- score normalized to 0 |
| 0/5 | Security-Policy — security policy file not detected |
| 0/7.5 | Signed-Releases — 无数据 |
| 0/7.5 | Token-Permissions — detected GitHub workflow tokens with excessive permissions |
| 7.5/7.5 | Vulnerabilities — 0 existing vulnerabilities detected |
所用输入
| source | openssf_scorecard |
| checks_evaluated | 17 |
| scorecard_version | v5.5.0 |
| checks_inconclusive | 1 |
| scorecard_aggregate | 3.9 |
已排除计分（无数据或不适用）：signed_releases。 其余权重已重新归一化。
依赖安全公告
100优秀
评分方式
| 35/35 | 直接依赖不含已知公告 — 没有直接依赖携带已知公告 |
| 25/25 | 间接依赖不含已知公告 — 没有间接依赖携带已知公告 |
| 0/40 | 没有长期未处理的公告 — 没有公告带有发布日期 |
所用输入
| source | osv |
| advisories | 0 |
| affected_packages | 0 |
| assessed_packages | 2 |
| unassessed_packages | 0 |
| affected_by_severity | none |
| direct_affected_packages | 0 |
已排除计分（无数据或不适用）：没有长期未处理的公告。 其余权重已重新归一化。 比对的是 pypi:worldevals@0.3.2 的运行时依赖闭包——安装已发布的软件包时真正被拉取进来的内容——共 2 个软件包。 未对可达性进行分析。
AI 就绪度
该仓库在多大程度上具备与 AI 编码代理协同开发与维护的条件？这是一枚独立的实验性徽章——权重为 0.0，因此单独呈现，不影响总体健康评分。
75
AI 代理上下文与指引
85优秀
评分方式
| 45/45 | 代理指令 — CLAUDE.md |
| 0/15 | 机器可读文档（llms.txt） |
| 40/40 | 可读的提交历史 — 49 次人类提交中有 42 次说明了意图（结构化标题或解释性正文） |
所用输入
| has_llms_txt | 否 |
| legible_history_share | 0.857 |
| agent_instruction_files | CLAUDE.md |
| agent_instruction_max_bytes | 6,410 |
评分方式
| 0/18 | 一条命令的引导启动 |
| 22/22 | 自动化测试 |
| 11/11 | Lint / 格式化配置 |
| 11/11 | 静态类型检查 — src/worldevals/py.typed |
| 10/10 | 可复现环境 — lockfile |
| 10/10 | 已体现的代理实践 — 最近 50 次提交中有 35 次由代理编写或署名代理 |
| 0/8 | 自动化维护 — 未观察到自动依赖更新 |
| 0/10 | OpenSSF Scorecard：Pinned-Dependencies — dependency not pinned by hash detected -- score normalized to 0 |
所用输入
| has_nix | 否 |
| has_tests | 是 |
| lockfiles | uv.lock |
| has_dockerfile | 否 |
| typed_language | 否 |
| bootstrap_files | — |
| has_devcontainer | 否 |
| has_linter_config | 是 |
| typecheck_configs | src/worldevals/py.typed |
| agent_commit_share | 0.7 |
| toolchain_manifests | — |
| dependency_bot_commit_share | 0 |
面向模型的代码可读性
82良好
评分方式
| 27/45 | 可类型检查的代码 — Python，已配置类型检查（src/worldevals/py.typed） |
| 55/55 | 可控的文件大小 — 采样的 6 个源文件中有 0 个超过 60KB |
所用输入
| primary_language | Python |
| largest_source_bytes | 4,760 |
| source_files_sampled | 6 |
| oversized_source_files | 0 |
关键数据
6GitHub 星标
2贡献者
50最近 12 个月提交数
2距最近推送天数
3发布版本数
1巴士系数（bus factor）
1开放议题
PyPI软件包生态系统数
数据采集警告
- Star history unavailable: GitHub GraphQL error: Resource not accessible by personal access token
更多细节
Star 与 Fork 历史 0 ★ / 2 ⇿
0Star
2Fork
每颗 star 和每个 fork 的添加时间，来自 GitHub 并按天汇总。累计增长位于其构成来源——每日新增——的正上方，二者可相互对照：稳定的自然增长与短暂的突增形态截然不同。当这一差别可被衡量时，它会作为增长真实性予以报告。
OpenSSF Scorecard 3.9 / 10
3.9综合
来自开源项目 OpenSSF Scorecard 的独立、工具无关的安全评估。每项检查奖励的是安全实践本身，而非特定供应商的工具。Scorecard 无法判定的检查项标记为 不适用，并从安全评分中剔除（绝不按零分计）。
| 10 | Binary-Artifacts | no binaries found in the repo |
| 4 | Branch-Protection | branch protection is not maximal on development and all release branches |
| 10 | CI-Tests | 19 out of 19 merged PRs checked by a CI test -- score normalized to 10 |
| 0 | CII-Best-Practices | no effort to earn an OpenSSF best practices badge detected |
| 0 | Code-Review | Found 0/18 approved changesets -- score normalized to 0 |
| 0 | Contributors | project has 0 contributing companies or organizations -- score normalized to 0 |
| 10 | Dangerous-Workflow | no dangerous workflow patterns detected |
| 0 | Dependency-Update-Tool | no update tool detected |
| 0 | Fuzzing | project is not fuzzed |
| 10 | License | license file detected |
| 0 | Maintained | project was created within the last 90 days. Please review its contents carefully |
| 10 | Packaging | packaging workflow detected |
| 0 | Pinned-Dependencies | dependency not pinned by hash detected -- score normalized to 0 |
| 0 | SAST | SAST tool is not run on all commits -- score normalized to 0 |
| 0 | Security-Policy | security policy file not detected |
| 不适用 | Signed-Releases | no releases found |
| 0 | Token-Permissions | detected GitHub workflow tokens with excessive permissions |
| 10 | Vulnerabilities | 0 existing vulnerabilities detected |
直接依赖 1
| 注册表 | 软件包 | 版本约束 | 清单文件 |
|---|---|---|---|
| PyPI | inspect-robots | >=0.3 | pyproject.toml |
全部依赖 68
来自 GitHub 依赖图的完整解析依赖集合：1 个直接依赖与 67 个间接（传递）软件包。仓库提交锁文件时，传递闭包才是完整的。
| 注册表 | 软件包 | 版本 | 关系 |
|---|---|---|---|
| PyPI | inspect-robots | 0.3.1 | 直接 |
| PyPI | ast-serialize | 0.6.0 | 间接 |
| PyPI | babel | 2.18.0 | 间接 |
| PyPI | backrefs | 7.0 | 间接 |
| PyPI | beautifulsoup4 | 4.15.0 | 间接 |
| PyPI | certifi | 2026.6.17 | 间接 |
| PyPI | cfgv | 3.5.0 | 间接 |
| PyPI | charset-normalizer | 3.4.7 | 间接 |
| PyPI | click | 8.4.2 | 间接 |
| PyPI | colorama | 0.4.6 | 间接 |
| PyPI | coverage | 7.15.0 | 间接 |
| PyPI | distlib | 0.4.3 | 间接 |
| PyPI | exceptiongroup | 1.3.1 | 间接 |
| PyPI | filelock | 3.29.4 | 间接 |
| PyPI | ghp-import | 2.1.0 | 间接 |
| PyPI | griffelib | 2.1.0 | 间接 |
| PyPI | identify | 2.6.19 | 间接 |
| PyPI | idna | 3.18 | 间接 |
| PyPI | iniconfig | 2.3.0 | 间接 |
| PyPI | jinja2 | 3.1.6 | 间接 |
| PyPI | librt | 0.12.0 | 间接 |
| PyPI | markdown | 3.10.2 | 间接 |
| PyPI | markdown-it-py | 3.0.0 | 间接 |
| PyPI | markdownify | 1.2.3 | 间接 |
| PyPI | markupsafe | 3.0.3 | 间接 |
| PyPI | mdformat | 0.7.22 | 间接 |
| PyPI | mdformat-tables | 1.0.0 | 间接 |
| PyPI | mdurl | 0.1.2 | 间接 |
| PyPI | mergedeep | 1.3.4 | 间接 |
| PyPI | mkdocs | 1.6.1 | 间接 |
| PyPI | mkdocs-autorefs | 1.4.4 | 间接 |
| PyPI | mkdocs-gen-files | 0.6.0 | 间接 |
| PyPI | mkdocs-get-deps | 0.2.2 | 间接 |
| PyPI | mkdocs-llmstxt | 0.5.0 | 间接 |
| PyPI | mkdocs-material | 9.7.6 | 间接 |
| PyPI | mkdocs-material-extensions | 1.3.1 | 间接 |
| PyPI | mkdocstrings | 1.0.4 | 间接 |
| PyPI | mkdocstrings-python | 2.0.5 | 间接 |
| PyPI | mypy | 2.1.0 | 间接 |
| PyPI | mypy-extensions | 1.1.0 | 间接 |
| PyPI | nodeenv | 1.10.0 | 间接 |
| PyPI | numpy | 2.2.6 | 间接 |
| PyPI | numpy | 2.4.6 | 间接 |
| PyPI | numpy | 2.5.0 | 间接 |
| PyPI | packaging | 26.2 | 间接 |
| PyPI | paginate | 0.5.7 | 间接 |
| PyPI | pathspec | 1.1.1 | 间接 |
| PyPI | platformdirs | 4.10.0 | 间接 |
| PyPI | pluggy | 1.6.0 | 间接 |
| PyPI | pre-commit | 4.6.0 | 间接 |
| PyPI | pygments | 2.20.0 | 间接 |
| PyPI | pymdown-extensions | 11.0.1 | 间接 |
| PyPI | pytest | 9.1.1 | 间接 |
| PyPI | pytest-cov | 7.1.0 | 间接 |
| PyPI | python-dateutil | 2.9.0.post0 | 间接 |
| PyPI | python-discovery | 1.4.2 | 间接 |
| PyPI | pyyaml | 6.0.3 | 间接 |
| PyPI | pyyaml-env-tag | 1.1 | 间接 |
| PyPI | requests | 2.34.2 | 间接 |
| PyPI | ruff | 0.15.20 | 间接 |
| PyPI | six | 1.17.0 | 间接 |
| PyPI | soupsieve | 2.8.4 | 间接 |
| PyPI | tomli | 2.4.1 | 间接 |
| PyPI | typing-extensions | 4.16.0 | 间接 |
| PyPI | urllib3 | 2.7.0 | 间接 |
| PyPI | virtualenv | 21.5.1 | 间接 |
| PyPI | watchdog | 6.0.0 | 间接 |
| PyPI | wcwidth | 0.8.2 | 间接 |
依赖安全公告 0
安装 pypi:worldevals@0.3.2 会引入 2 个包（直接与传递）：其中 0 个存在已知公告，0 个为直接依赖。
没有已知公告影响已评估的依赖。
公告表示依赖图中记录的版本落入某条公告的受影响范围。可达性未经分析，且依赖图包含开发与测试的版本固定——某项发现可能只涉及工具链而非交付的软件。
原始 JSON 报告 机器可读
{
"data": {
"repo": {
"topics": [
"benchmarks",
"evaluation",
"robolens",
"robotics",
"vla"
],
"is_fork": false,
"size_kb": 226,
"has_wiki": true,
"homepage": null,
"languages": {
"Python": 14781
},
"pushed_at": "2026-07-28T01:05:13Z",
"created_at": "2026-06-27T08:42:38Z",
"owner_type": "Organization",
"updated_at": "2026-07-24T09:56:04Z",
"description": "A curated catalog of VLA / physical-AI benchmarks, each runnable on real robots or sims via Inspect Robots. (The Inspect Evals for robotics.)",
"is_archived": false,
"is_disabled": false,
"license_spdx": "MIT",
"default_branch": "main",
"license_spdx_raw": "MIT",
"primary_language": "Python",
"significant_languages": [
"Python"
]
},
"owner": {
"blog": "https://robocurve.org",
"name": "robocurve",
"type": "Organization",
"login": "robocurve",
"company": null,
"location": null,
"followers": 25,
"avatar_url": "https://avatars.githubusercontent.com/u/297012305?v=4",
"created_at": "2026-06-25T22:39:14Z",
"is_verified": null,
"public_repos": 12,
"account_age_days": 34
},
"license": {
"state": "standard",
"spdx_id": "MIT",
"raw_spdx": "MIT",
"file_present": true,
"scorecard_found": true,
"profile_has_license": true
},
"activity": {
"releases": [
{
"tag": "v0.3.2",
"kind": "patch",
"published_at": "2026-07-28T01:05:13Z"
},
{
"tag": "v0.3.1",
"kind": "patch",
"published_at": "2026-07-07T06:31:35Z"
},
{
"tag": "v0.3.0",
"kind": "minor",
"published_at": "2026-07-07T04:30:18Z"
}
],
"recent_commits": [
{
"oid": "5a380766ec8a9ac837f2e46852cb378101ca9bc6",
"body": "Enable Ruff D1 for public API symbols and backfill CLI contracts so missing public docstrings fail the quality gate. Exempt tests and build scripts from the public API check, document contributor expectations, and advertise the 100% gate in the README badge block.\n\nInterrogate coverage: 80.0% before, 100.0% after.\n\nCo-authored-by: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "docs: enforce public docstring coverage via ruff D1 and backfill (#26)",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-14T01:19:15Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "3371b2ce5b1e05268c17feb20e66d6aa41c68e5e",
"body": "worldevals and inspect-robots have both been on PyPI since 0.3.x, but the\ncatalog home page and CLAUDE.md still told users to install from git tags\n(two commands, pinned to inspect-robots v0.3.0). Replace both with\n'pip install worldevals' and note in CLAUDE.md why direct git references\nmust not com\n[…]\ndirect-URL deps, which would\nbreak the release workflow at upload.\n\nSurfaced while reviewing #23/#24; closes out the stale-docs remainder of #2.\n\nCo-authored-by: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "docs: drop stale pre-PyPI two-step install instructions (#25)",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-13T23:17:23Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "aa8424298a1276625fc98d1eea8b7c715fa4e337",
"body": "* docs: de-tell contributing page; codify style rule in CLAUDE.md\n\nRemove prose em dashes and mid-sentence bold from contributing.md, the\ngenerated homepage (scripts/gen_catalog.py) and the mkdocs site description.\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>\n\n* docs: align em-dash exception with practice (code blocks exempt)\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>\n\n---------\n\nCo-authored-by: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "docs: de-tell contributing page; codify style rule in CLAUDE.md (#22)",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-10T02:05:46Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "dd70c134141a9e98a4e119ad662fb771c9fec157",
"body": "…(#21)\n\n* docs: de-tell the model-card standard and make the style rule gating\n\nStyle pass per the org style spec: em dashes out of prose (both the\nstandard and the template), rhetorical bold removed, headers use colons.\nAdds a Writing style subsection under Ground rules and a gating checklist line.\n[…]\nnthropic.com>\n\n* docs: unbold the last two rhetorical bolds flagged in review\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>\n\n---------\n\nCo-authored-by: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "docs: de-tell the model-card standard and make the style rule gating …",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-10T01:53:42Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "8b36799a2cd9e78488676bffba5b0fcf31cc5ddd",
"body": "Replace prose em dashes with plain punctuation, strip rhetorical\nbold/italics and decorative emoji, and drop the WorldPolicies chiasmus\nslogan. Style-only per the org README spec; no technical content changed.\n\nCo-authored-by: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "docs: remove AI-writing tells from README (#20)",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-09T21:21:24Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "228da175045e0525fac473d9cce4c9b57517018a",
"body": "GitHub alert syntax ([!NOTE] etc.) shows up literally on PyPI. Generate\nthe long description via hatch-fancy-pypi-readme, rewriting alerts to\nbold blockquotes at build time; the README keeps the GitHub callout.\n\nCo-authored-by: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "build: render README alerts as bold notes on PyPI (#19)",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-09T21:07:17Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "3f04d66bf734d5450f841477e87eeafaba1758e4",
"body": "…requirement) (#18)\n\nCo-authored-by: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "docs: interlink WorldPolicies (catalog registration is now a publish …",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-08T03:52:43Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "4dea4af1994404b2ddf773f46c1a4bdaa8b15796",
"body": "…ic on the Hub) (#17)\n\nCo-authored-by: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "docs: eval-path as shields.io badge row (blockquotes render gray-ital…",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-08T03:37:27Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "0bceef8afae2a201bc7566681d8d4f0af19b6803",
"body": "* docs: surface the model-card standard in README + CLAUDE.md\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>\n\n* docs: require Inspect Robots / WorldEvals eval-path blockquote at top of cards\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>\n\n---------\n\nCo-authored-by: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "docs: surface the model-card standard in README + CLAUDE.md (#16)",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-08T03:33:27Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "221f1e339de4e808987ed536206285dbdbd4cbbc",
"body": "* docs: model-card best practices for robocurve HF uploads\n\nRequired sections (frontmatter, training table, explicit train/eval losses,\nprovenance incl. cost+compute, usage I/O contract, caveats), style rules, and\na publish checklist. Written for future agent sessions publishing checkpoints;\nreferen\n[…]\n-unknown, generalized private-repo rule, no-filtering convention, fence note)\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>\n\n---------\n\nCo-authored-by: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "docs: model-card best practices for HF uploads (#15)",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-08T03:20:16Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "edc3a35527986165277c850f1fd6a3036c62ba30",
"body": "* docs: add early-alpha status banner to README\n\n* docs: use calm status badge + note for early-alpha signposting\n\n---------\n\nCo-authored-by: Claude <noreply@anthropic.com>",
"is_bot": true,
"headline": "docs: signpost early-alpha status in README (#14)",
"author_name": "claude[bot]",
"author_login": "claude[bot]",
"committed_at": "2026-07-08T02:43:59Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "829713b402a43f58fce9d291b2adf2f252f8f65e",
"body": "Catalog: install commands from PyPI, not git tags",
"is_bot": false,
"headline": "Merge pull request #13 from robocurve/catalog-pypi-install",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-07T06:17:57Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "3ddde26d4234d37a3e2fcac1220146099e54ec57",
"body": "The kitchenbench entry (and the contributing example) still carried the\npre-PyPI two-step git install pinned to v0.3.0. The drift-guard test now\nenforces the new form: a bare PyPI name matching the benchmark name, or\na quoted git URL matching the repo for unpublished benchmarks.\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "Catalog: install commands from PyPI, not git tags",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-07T06:17:07Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "4a498cc3046fc2f036d0bfb2981c70c5d803fcba",
"body": "README: lead with what the catalog is, keep Inspect Evals as a nod",
"is_bot": false,
"headline": "Merge pull request #12 from robocurve/readme-lead-with-what-it-is",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-07T06:12:50Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "8fd4c3a88fb12a51b23b7115ac3fc4f85b85ddf6",
"body": "… know it\n\nRoboticists generally don't know Inspect AI / Inspect Evals, so the\nanalogy moves from tagline to a follow-up line ('If you know Inspect\nAI, this is that for robotics'). Same inversion in the PyPI summary.\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "Lead with what the project is; keep Inspect AI as a nod for those who…",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-07T06:11:41Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "5b351512828df6e459b632df86dc7f08035dd35f",
"body": "README lockfile note + weekly fresh-resolution canary",
"is_bot": false,
"headline": "Merge pull request #11 from robocurve/readme-lockfile-note",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-07T05:44:07Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "173329f6d46f9acd29d16485c2a672f827d4e627",
"body": "Locked CI can't see that a new release of an allowed dependency breaks\nus; the canary installs the latest allowed versions (ignoring uv.lock),\nruns the tests weekly, and opens an issue on failure.\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "Add weekly fresh-resolution canary workflow",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-07T05:42:56Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "03002ef47a80cbb0bdec5347a11ac69ed530ef11",
"body": "Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "README: note the uv lock workflow for dependency changes",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-07T05:41:29Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "b92b3fd55c2fd755ff9013c5a52bcde8aab8dcfa",
"body": "Install CI deps from uv.lock; document conventions in CLAUDE.md",
"is_bot": false,
"headline": "Merge pull request #10 from robocurve/lockfiles-and-claude-md",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-07T05:31:44Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "d4c8f4f24b8688133415f77edf07e89ae9ec48ef",
"body": "…DE.md\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "Install CI deps from uv.lock; document CI/release conventions in CLAU…",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-07T05:28:43Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "927f60e1a2042b578c58c74baa826402def5bf55",
"body": "Enforce CI best practices: ci-ok gate, red-main alerts, tag-derived version",
"is_bot": false,
"headline": "Merge pull request #9 from robocurve/enforce-ci-practices",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-07T05:05:59Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "b11d2e52bd2a25e5c51a9239c6cc7ed082d3fb2a",
"body": "The multiline --body string escaped the run block scalar, making the\nwhole workflow file invalid (GitHub refused to start any CI job).\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "Fix invalid YAML in red-main alert step",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-07T05:04:02Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "b19fb39023bbaa2f7e3affc94facc70328baa083",
"body": "The git-tag source predates the PyPI release and is fragile (CI breaks\nif the tag moves or is briefly absent).\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "Resolve inspect-robots from PyPI; refresh uv.lock",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-07T04:59:35Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "a2e3ac5d4ddf8d82a066f834e1739ca7e1ffc824",
"body": "- Add a ci-ok aggregate job as the single required status check for\n branch protection (strict/up-to-date mode).\n- Add a red-main alert job that opens an issue when CI fails on a push\n to main.\n- Derive the version from git tags via hatch-vcs so the release cut job\n never pushes to main (PR-only main), and expose __version__ via\n importlib.metadata instead of a hardcoded literal.\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "Enforce CI best practices: ci-ok gate, red-main alerts, PR-only releases",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-07T04:56:44Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "9c2756a3895450c00fe6bbfb8dcef147ccd847d0",
"body": "One-click releases via workflow_dispatch",
"is_bot": false,
"headline": "Merge pull request #8 from robocurve/one-click-release",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-07T04:48:50Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "f49e805aa2aa7d3228106a2f1910e1b46f89c828",
"body": "Actions -> Release -> Run workflow -> pick patch/minor/major. The cut job\nbumps the version, tags, and creates the GitHub release; publish runs in\nthe same workflow run (GITHUB_TOKEN-created releases don't re-trigger\nworkflows). Manual GitHub releases still publish via the release event.\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "Make releases one-click via workflow_dispatch",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-07T04:42:36Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "454a37472b30a42df12de78511106a89e0673b98",
"body": "Add PyPI release workflow (trusted publishing)",
"is_bot": false,
"headline": "Merge pull request #7 from robocurve/add-release-workflow",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-07T04:26:48Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "974aac66008e11b1ebfcf71dc03e78508721fd51",
"body": "Publishes on GitHub release via OIDC trusted publishing — no API tokens.\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "Add PyPI release workflow (trusted publishing)",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-07T04:23:38Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "41e92b9a1a066c89f44d14341425c9acd0aace69",
"body": "Docs: retry Pages deploy on transient failures",
"is_bot": false,
"headline": "Merge pull request #6 from robocurve/ci/pages-deploy-retry",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-06T05:15:43Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "e886556b8d792a0fce31e44dc0d4df01f515800e",
"body": "The deploy-pages step intermittently fails with \"Deployment failed, try\nagain later\" (3x on 2026-07-06 alone); retry twice with 30s/60s backoff.\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "Docs: retry Pages deploy on transient failures",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-06T05:14:35Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "55ee1cc482011bedb1d3c8dd7b6dc98964c62b39",
"body": "Add citation metadata (README section + CITATION.cff)",
"is_bot": false,
"headline": "Merge pull request #1 from robocurve/add-citation",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-06T04:49:13Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "b9ef656f2899f2184af9a407881326e33b5e030c",
"body": null,
"is_bot": false,
"headline": "Merge branch 'main' into add-citation",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-06T04:27:52Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "1cc2ef152faea134c16de189cb4993e4310304ce",
"body": "…ests\n\nCI: locked installs, pin out properdocs, catalog test hardening",
"is_bot": false,
"headline": "Merge pull request #5 from robocurve/ci/locked-installs-and-catalog-t…",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-06T04:17:16Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "d47eca7c890153cd7cc9ae40e2e8a27aa8e51e53",
"body": "Fix documented install path (two-step pip) + catalog/docs accuracy",
"is_bot": false,
"headline": "Merge pull request #4 from robocurve/fix/install-docs-and-catalog",
"author_name": "Jay Chooi",
"author_login": "jeqcho",
"committed_at": "2026-07-06T04:08:42Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "e6894f5fac44ca0951f70b710b8b7382397093a6",
"body": "…pts/\n\n- [project.urls] Documentation -> https://worldevals.org/\n- classifiers: Python :: 3.10 / 3.11 / 3.12\n- mypy files: add scripts/ (gen_catalog.py was unchecked)\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "Metadata polish: Documentation URL, py-version classifiers, mypy scri…",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-05T07:05:31Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "1c42f441a96843ca7ea12209d73aef10a8f13260",
"body": "- catalog.py: `status` is now `Literal[\"alpha\", \"beta\", \"stable\"]`\n (only producer is CATALOG's \"alpha\"; runtime unaffected).\n- test_catalog_integrity: install strings must match the documented\n two-step form (step 1 pins inspect-robots@v0.3.0 — the regex is the\n drift guard for the tag) with ste\n[…]\n Inspect Robots registry (mirroring\n test_cli_tasks_when_none_installed) instead of hardcoding upstream's\n builtin \"cubepick-reach\" task name.\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "Catalog: status Literal + integrity/CLI test hardening",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-05T07:05:31Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "2d27091cbc1479bab236254aee445de573528398",
"body": "All jobs previously ran `uv pip install -e .[...]`, re-resolving from\npyproject on every run — which is how mkdocs-gen-files 0.6.1 (and its\nproperdocs dependency) slipped into docs builds unreviewed. Install\nwith `uv sync --locked` instead so CI runs exactly the reviewed lock:\n\n- quality job: --extr\n[…]\nra dev\n- docs job: --extra docs\n\nAlso add uv.lock to setup-uv's cache-dependency-glob and refresh the\nstale \"via tool.uv.sources\" step comments.\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "CI: install from uv.lock with `uv sync --locked`",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-05T07:05:31Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "776f2418614ae776c459055ad5a1b9646781b21e",
"body": "…rd it\n\nmkdocs-gen-files 0.6.1 depends on \"properdocs\" (an mkdocs fork that\ninjects promo content into every built page); 0.6.0 has no such dep.\nCap at <0.6.1 rather than !=0.6.1 so a future 0.6.2 can't re-add it.\nRe-lock: mkdocs-gen-files 0.6.1 -> 0.6.0, properdocs leaves uv.lock.\n\nuv.lock was giti\n[…]\nreal gate once CI installs with --locked.\n\nVerified: `mkdocs build --strict` passes and the built site/ contains\nno properdocs-injected content.\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "Pin out properdocs: cap mkdocs-gen-files <0.6.1, commit the lock, gua…",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-05T07:05:12Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "ab4d7b5f3f2518c712e8681f9d5216a6acf79aa4",
"body": "…ming note\n\n- CLAUDE.md: the dependency pin is v0.3.0 (not v0.2.0); rewrite the\n gotcha to document the two-step pip install story (tool.uv.sources is\n uv-only and inspect-robots is not on PyPI) and where the string lives.\n- .pre-commit-config.yaml: header said \"Inspect Robots\" (copy-paste);\n this is WorldEvals.\n- plans/0001: superseded-naming note at top (roboinspect ->\n inspect-robots; entry-point group inspect_robots.tasks).\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "Refresh stale docs: CLAUDE.md pin/gotcha, pre-commit header, plans na…",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-05T07:00:36Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "a8cc5c1f5eb95a8a55f110890d36345e2fd73902",
"body": "pip install \"worldevals @ git+...\" fails with plain pip: the dependency\ninspect-robots>=0.3 is not on PyPI and [tool.uv.sources] only applies\nunder uv. Every documented entry point (README, homepage, catalog install\nstrings, contributing example) handed users a failing command.\n\nSwitch every install\n[…]\n.\n\nThe catalog.py install string and the docs/contributing.md example are\nkept textually identical (a regex test in a follow-up PR guards both).\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "Fix documented install path: two-step pip install everywhere",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-05T07:00:19Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "36b4ef44397c5c7eb8e6f2353ec57496fbf25aad",
"body": "Set the documentation/catalog site to the new apex domain:\n- mkdocs.yml site_url -> https://worldevals.org/\n- Rewrite absolute links in README.md and scripts/gen_catalog.py\n from robocurve.github.io/worldevals/... to worldevals.org/...\n- Add docs/CNAME so the Pages Actions deploy keeps the custom domain\n\nCo-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>",
"is_bot": false,
"headline": "Docs: point catalog site to custom domain worldevals.org",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-02T23:14:01Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "df10096035850dc3abea349e3f20ca5d6a0ab5b6",
"body": null,
"is_bot": false,
"headline": "Fix Built-on badge: URL-encode space in shields.io label",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-02T07:09:50Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "3b3ccb78f85fd6c2f1e596821d4aed2d8e998f3e",
"body": null,
"is_bot": false,
"headline": "Add citation metadata (README section + CITATION.cff)",
"author_name": "Claude",
"author_login": "claude",
"committed_at": "2026-07-02T07:09:24Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "522ce33c8c70a9db440c9f251c0e7d89c5f48ac5",
"body": "…bots; bump 0.3.0",
"is_bot": false,
"headline": "Merge rename-to-inspect-robots: rename refs roboinspect -> inspect-ro…",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-02T06:55:50Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "d035f74c369a6e11c90152a7e7f55d26e60bf773",
"body": "Update all framework references from roboinspect/RoboInspect to\ninspect-robots/Inspect Robots (dep name, [tool.uv.sources] git url + key, the\nworldevals CLI's registry imports, URLs, prose), per plans/0003.\n\nVersion bump to 0.3.0: pyproject version, dependency `inspect-robots>=0.3`,\nsource tag `v0.3\n[…]\n4 passed); `worldevals tasks` CLI runs. Committed --no-verify:\nthe v0.3.0 git-tag dep is not pushed until the framework is tagged.\n\nCo-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>",
"is_bot": false,
"headline": "Rename roboinspect -> inspect-robots refs; bump to 0.3.0",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-07-02T06:35:09Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "84a74254f6d64d086ea5923c50b04bb9c77c302a",
"body": "Update dependency (roboinspect>=0.2), tool.uv.sources (roboinspect @ v0.2.0),\ncli.py + catalog imports of roboinspect.registry, docs/badges/prose, and the\nroboinspect CLI mentions. The robolens-yam Backends-table entry is intentionally\npreserved (it's the sibling adapter repo's real name). Version 0\n[…]\n.\n\nGates verified locally (editable ../roboinspect): ruff + mypy --strict clean,\n100% coverage (14 tests), mkdocs --strict builds.\n\nCo-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>",
"is_bot": false,
"headline": "Rename framework references robolens -> roboinspect; bump to 0.2.0",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-06-30T20:28:20Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "b66b1195755bb6dec8f6558a22fbcb0b19cf6089",
"body": "Backend adapters (concrete Policy+Embodiment) are their own repos, not catalog\nentries. robolens-yam is the first: molmoact2 policy + yam_arms embodiment.\n\nCo-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>",
"is_bot": false,
"headline": "README: add Backends table with robolens-yam (MolmoAct2 + YAM)",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-06-29T08:04:43Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "622b3f661782f1590764c87987dcf21bd45905a0",
"body": "- homepage generated at build time from worldevals.catalog via mkdocs-gen-files\n (single source of truth): Material grid-card listing of benchmarks, mirroring\n Inspect Evals' listing pattern\n- API reference (mkdocstrings) + contribution guide; llms.txt/llms-full.txt\n- docs.yml builds 'mkdocs build --strict' and deploys to GitHub Pages\n- convert catalog docstring roles to mkdocstrings autorefs; README docs link\n\nCo-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>",
"is_bot": false,
"headline": "Add MkDocs Material catalog site (auto-generated from catalog.py)",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-06-28T16:40:36Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "bc7e80ada0ccd1e8ebc5af607d3ca672d0cf7f7e",
"body": "Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>",
"is_bot": false,
"headline": "Add CLAUDE.md agent guide",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-06-27T17:06:38Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "f705a596500d95a0628956a113d609c7d08e2288",
"body": "- Benchmark dataclass + CATALOG (KitchenBench, all 10 task keys); accessors\n catalog/get/by_tag/benchmark_for_task\n- CLI: worldevals list [--tag] | info <name> | tasks (installed RoboLens tasks\n annotated by benchmark)\n- 100% coverage, ruff + mypy --strict, CI; README landing page + contribution\n guide. depends on robolens v0.1.0.\n\nCo-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>",
"is_bot": false,
"headline": "WorldEvals: the Inspect Evals for robotics (benchmark catalog + CLI)",
"author_name": "jeqcho",
"author_login": "jeqcho",
"committed_at": "2026-06-27T08:42:37Z",
"body_truncated": false,
"is_coding_agent": true
}
],
"releases_count": 3,
"commits_last_year": 50,
"latest_release_at": "2026-07-28T01:05:13Z",
"latest_release_tag": "v0.3.2",
"releases_from_tags": false,
"days_since_last_push": 2,
"active_weeks_last_year": 3,
"days_since_latest_release": 2,
"mean_days_between_releases": 10.4
},
"community": {
"has_readme": true,
"has_license": true,
"has_description": true,
"has_contributing": true,
"health_percentage": 62,
"has_issue_template": false,
"has_code_of_conduct": false,
"has_pull_request_template": false
},
"ecosystem": {
"packages": [
{
"name": "worldevals",
"exists": true,
"license": "MIT",
"keywords": [
"benchmarks",
"catalog",
"evaluation",
"physical-ai",
"robotics",
"vla",
"Development Status :: 3 - Alpha",
"Intended Audience :: Science/Research",
"License :: OSI Approved :: MIT License",
"Programming Language :: Python :: 3",
"Programming Language :: Python :: 3.10",
"Programming Language :: Python :: 3.11",
"Programming Language :: Python :: 3.12",
"Topic :: Scientific/Engineering :: Artificial Intelligence",
"Typing :: Typed"
],
"ecosystem": "pypi",
"matches_repo": true,
"registry_url": "https://pypi.org/project/worldevals/",
"is_deprecated": false,
"latest_version": "0.3.2",
"repository_url": "https://github.com/robocurve/worldevals",
"versions_count": 3,
"total_downloads": null,
"dependents_count": null,
"deprecation_note": null,
"maintainers_count": null,
"monthly_downloads": null,
"first_published_at": "2026-07-07T04:30:47.437007Z",
"latest_published_at": "2026-07-28T01:05:46.971927Z",
"latest_version_yanked": null,
"days_since_latest_publish": 2
}
]
},
"popularity": {
"forks": 2,
"stars": 6,
"watchers": 1,
"fork_history": {
"days": [
{
"date": "2026-07-11",
"count": 1
},
{
"date": "2026-07-17",
"count": 1
}
],
"complete": true,
"collected": 2,
"total_forks": 2
},
"star_history": null,
"open_issues_and_prs": 2
},
"ai_readiness": {
"has_nix": false,
"example_dirs": [],
"has_llms_txt": false,
"has_dockerfile": false,
"has_mcp_signal": false,
"bootstrap_files": [],
"api_schema_files": [],
"has_devcontainer": false,
"typecheck_configs": [
"src/worldevals/py.typed"
],
"toolchain_manifests": [],
"largest_source_bytes": 4760,
"source_files_sampled": 6,
"oversized_source_files": 0,
"agent_instruction_files": [
"CLAUDE.md"
],
"agent_instruction_max_bytes": 6410
},
"dependencies": {
"manifests": [
"pyproject.toml"
],
"advisories": {
"error": null,
"scope": "published_package",
"source": "osv",
"findings": [],
"collected": true,
"malicious": [],
"truncated": false,
"by_severity": {},
"advisory_count": 0,
"affected_count": 0,
"assessed_count": 2,
"malicious_count": 0,
"assessed_package": "pypi:worldevals@0.3.2",
"unassessed_count": 0,
"direct_affected_count": 0
},
"ecosystems": [
"pypi"
],
"dependencies": [
{
"name": "inspect-robots",
"manifest": "pyproject.toml",
"ecosystem": "pypi",
"version_constraint": ">=0.3"
}
],
"all_dependencies": {
"error": null,
"source": "github-sbom",
"packages": [
{
"name": "inspect-robots",
"direct": true,
"version": "0.3.1",
"ecosystem": "pypi"
},
{
"name": "ast-serialize",
"direct": false,
"version": "0.6.0",
"ecosystem": "pypi"
},
{
"name": "babel",
"direct": false,
"version": "2.18.0",
"ecosystem": "pypi"
},
{
"name": "backrefs",
"direct": false,
"version": "7.0",
"ecosystem": "pypi"
},
{
"name": "beautifulsoup4",
"direct": false,
"version": "4.15.0",
"ecosystem": "pypi"
},
{
"name": "certifi",
"direct": false,
"version": "2026.6.17",
"ecosystem": "pypi"
},
{
"name": "cfgv",
"direct": false,
"version": "3.5.0",
"ecosystem": "pypi"
},
{
"name": "charset-normalizer",
"direct": false,
"version": "3.4.7",
"ecosystem": "pypi"
},
{
"name": "click",
"direct": false,
"version": "8.4.2",
"ecosystem": "pypi"
},
{
"name": "colorama",
"direct": false,
"version": "0.4.6",
"ecosystem": "pypi"
},
{
"name": "coverage",
"direct": false,
"version": "7.15.0",
"ecosystem": "pypi"
},
{
"name": "distlib",
"direct": false,
"version": "0.4.3",
"ecosystem": "pypi"
},
{
"name": "exceptiongroup",
"direct": false,
"version": "1.3.1",
"ecosystem": "pypi"
},
{
"name": "filelock",
"direct": false,
"version": "3.29.4",
"ecosystem": "pypi"
},
{
"name": "ghp-import",
"direct": false,
"version": "2.1.0",
"ecosystem": "pypi"
},
{
"name": "griffelib",
"direct": false,
"version": "2.1.0",
"ecosystem": "pypi"
},
{
"name": "identify",
"direct": false,
"version": "2.6.19",
"ecosystem": "pypi"
},
{
"name": "idna",
"direct": false,
"version": "3.18",
"ecosystem": "pypi"
},
{
"name": "iniconfig",
"direct": false,
"version": "2.3.0",
"ecosystem": "pypi"
},
{
"name": "jinja2",
"direct": false,
"version": "3.1.6",
"ecosystem": "pypi"
},
{
"name": "librt",
"direct": false,
"version": "0.12.0",
"ecosystem": "pypi"
},
{
"name": "markdown",
"direct": false,
"version": "3.10.2",
"ecosystem": "pypi"
},
{
"name": "markdown-it-py",
"direct": false,
"version": "3.0.0",
"ecosystem": "pypi"
},
{
"name": "markdownify",
"direct": false,
"version": "1.2.3",
"ecosystem": "pypi"
},
{
"name": "markupsafe",
"direct": false,
"version": "3.0.3",
"ecosystem": "pypi"
},
{
"name": "mdformat",
"direct": false,
"version": "0.7.22",
"ecosystem": "pypi"
},
{
"name": "mdformat-tables",
"direct": false,
"version": "1.0.0",
"ecosystem": "pypi"
},
{
"name": "mdurl",
"direct": false,
"version": "0.1.2",
"ecosystem": "pypi"
},
{
"name": "mergedeep",
"direct": false,
"version": "1.3.4",
"ecosystem": "pypi"
},
{
"name": "mkdocs",
"direct": false,
"version": "1.6.1",
"ecosystem": "pypi"
},
{
"name": "mkdocs-autorefs",
"direct": false,
"version": "1.4.4",
"ecosystem": "pypi"
},
{
"name": "mkdocs-gen-files",
"direct": false,
"version": "0.6.0",
"ecosystem": "pypi"
},
{
"name": "mkdocs-get-deps",
"direct": false,
"version": "0.2.2",
"ecosystem": "pypi"
},
{
"name": "mkdocs-llmstxt",
"direct": false,
"version": "0.5.0",
"ecosystem": "pypi"
},
{
"name": "mkdocs-material",
"direct": false,
"version": "9.7.6",
"ecosystem": "pypi"
},
{
"name": "mkdocs-material-extensions",
"direct": false,
"version": "1.3.1",
"ecosystem": "pypi"
},
{
"name": "mkdocstrings",
"direct": false,
"version": "1.0.4",
"ecosystem": "pypi"
},
{
"name": "mkdocstrings-python",
"direct": false,
"version": "2.0.5",
"ecosystem": "pypi"
},
{
"name": "mypy",
"direct": false,
"version": "2.1.0",
"ecosystem": "pypi"
},
{
"name": "mypy-extensions",
"direct": false,
"version": "1.1.0",
"ecosystem": "pypi"
},
{
"name": "nodeenv",
"direct": false,
"version": "1.10.0",
"ecosystem": "pypi"
},
{
"name": "numpy",
"direct": false,
"version": "2.2.6",
"ecosystem": "pypi"
},
{
"name": "numpy",
"direct": false,
"version": "2.4.6",
"ecosystem": "pypi"
},
{
"name": "numpy",
"direct": false,
"version": "2.5.0",
"ecosystem": "pypi"
},
{
"name": "packaging",
"direct": false,
"version": "26.2",
"ecosystem": "pypi"
},
{
"name": "paginate",
"direct": false,
"version": "0.5.7",
"ecosystem": "pypi"
},
{
"name": "pathspec",
"direct": false,
"version": "1.1.1",
"ecosystem": "pypi"
},
{
"name": "platformdirs",
"direct": false,
"version": "4.10.0",
"ecosystem": "pypi"
},
{
"name": "pluggy",
"direct": false,
"version": "1.6.0",
"ecosystem": "pypi"
},
{
"name": "pre-commit",
"direct": false,
"version": "4.6.0",
"ecosystem": "pypi"
},
{
"name": "pygments",
"direct": false,
"version": "2.20.0",
"ecosystem": "pypi"
},
{
"name": "pymdown-extensions",
"direct": false,
"version": "11.0.1",
"ecosystem": "pypi"
},
{
"name": "pytest",
"direct": false,
"version": "9.1.1",
"ecosystem": "pypi"
},
{
"name": "pytest-cov",
"direct": false,
"version": "7.1.0",
"ecosystem": "pypi"
},
{
"name": "python-dateutil",
"direct": false,
"version": "2.9.0.post0",
"ecosystem": "pypi"
},
{
"name": "python-discovery",
"direct": false,
"version": "1.4.2",
"ecosystem": "pypi"
},
{
"name": "pyyaml",
"direct": false,
"version": "6.0.3",
"ecosystem": "pypi"
},
{
"name": "pyyaml-env-tag",
"direct": false,
"version": "1.1",
"ecosystem": "pypi"
},
{
"name": "requests",
"direct": false,
"version": "2.34.2",
"ecosystem": "pypi"
},
{
"name": "ruff",
"direct": false,
"version": "0.15.20",
"ecosystem": "pypi"
},
{
"name": "six",
"direct": false,
"version": "1.17.0",
"ecosystem": "pypi"
},
{
"name": "soupsieve",
"direct": false,
"version": "2.8.4",
"ecosystem": "pypi"
},
{
"name": "tomli",
"direct": false,
"version": "2.4.1",
"ecosystem": "pypi"
},
{
"name": "typing-extensions",
"direct": false,
"version": "4.16.0",
"ecosystem": "pypi"
},
{
"name": "urllib3",
"direct": false,
"version": "2.7.0",
"ecosystem": "pypi"
},
{
"name": "virtualenv",
"direct": false,
"version": "21.5.1",
"ecosystem": "pypi"
},
{
"name": "watchdog",
"direct": false,
"version": "6.0.0",
"ecosystem": "pypi"
},
{
"name": "wcwidth",
"direct": false,
"version": "0.8.2",
"ecosystem": "pypi"
}
],
"collected": true,
"truncated": false,
"total_count": 68,
"direct_count": 1,
"indirect_count": 67
}
},
"maintainership": {
"issues": {
"open_prs": 1,
"merged_prs": 22,
"open_issues": 1,
"closed_ratio": 0.5,
"closed_issues": 1,
"closed_unmerged_prs": 2
},
"bus_factor": 1,
"bot_contributors": 1,
"top_contributors": [
{
"type": "User",
"login": "jeqcho",
"commits": 48,
"avatar_url": "https://avatars.githubusercontent.com/u/42904912?v=4"
},
{
"type": "User",
"login": "claude",
"commits": 1,
"avatar_url": "https://avatars.githubusercontent.com/u/81847?v=4"
}
],
"contributors_sampled": 2,
"top_contributor_share": 0.98
},
"quality_signals": {
"has_ci": true,
"has_tests": true,
"ci_workflows": [
"canary.yml",
"ci.yml",
"docs.yml",
"release.yml"
],
"has_docs_dir": true,
"linter_configs": [],
"has_editorconfig": false,
"has_linter_config": true,
"has_precommit_config": true
},
"security_signals": {
"lockfiles": [
"uv.lock"
],
"scorecard": {
"checks": [
{
"name": "Binary-Artifacts",
"score": 10,
"reason": "no binaries found in the repo",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#binary-artifacts"
},
{
"name": "Branch-Protection",
"score": 4,
"reason": "branch protection is not maximal on development and all release branches",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#branch-protection"
},
{
"name": "CI-Tests",
"score": 10,
"reason": "19 out of 19 merged PRs checked by a CI test -- score normalized to 10",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#ci-tests"
},
{
"name": "CII-Best-Practices",
"score": 0,
"reason": "no effort to earn an OpenSSF best practices badge detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#cii-best-practices"
},
{
"name": "Code-Review",
"score": 0,
"reason": "Found 0/18 approved changesets -- score normalized to 0",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#code-review"
},
{
"name": "Contributors",
"score": 0,
"reason": "project has 0 contributing companies or organizations -- score normalized to 0",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#contributors"
},
{
"name": "Dangerous-Workflow",
"score": 10,
"reason": "no dangerous workflow patterns detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#dangerous-workflow"
},
{
"name": "Dependency-Update-Tool",
"score": 0,
"reason": "no update tool detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#dependency-update-tool"
},
{
"name": "Fuzzing",
"score": 0,
"reason": "project is not fuzzed",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#fuzzing"
},
{
"name": "License",
"score": 10,
"reason": "license file detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#license"
},
{
"name": "Maintained",
"score": 0,
"reason": "project was created within the last 90 days. Please review its contents carefully",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#maintained"
},
{
"name": "Packaging",
"score": 10,
"reason": "packaging workflow detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#packaging"
},
{
"name": "Pinned-Dependencies",
"score": 0,
"reason": "dependency not pinned by hash detected -- score normalized to 0",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#pinned-dependencies"
},
{
"name": "SAST",
"score": 0,
"reason": "SAST tool is not run on all commits -- score normalized to 0",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#sast"
},
{
"name": "Security-Policy",
"score": 0,
"reason": "security policy file not detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#security-policy"
},
{
"name": "Signed-Releases",
"score": null,
"reason": "no releases found",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#signed-releases"
},
{
"name": "Token-Permissions",
"score": 0,
"reason": "detected GitHub workflow tokens with excessive permissions",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#token-permissions"
},
{
"name": "Vulnerabilities",
"score": 10,
"reason": "0 existing vulnerabilities detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#vulnerabilities"
}
],
"commit": "5a380766ec8a9ac837f2e46852cb378101ca9bc6",
"ran_at": "2026-07-30T06:01:53Z",
"aggregate_score": 3.9,
"scorecard_version": "v5.5.0"
},
"has_codeql_workflow": false,
"has_security_policy": false,
"has_dependabot_config": false
},
"contribution_flow": {
"collected": true,
"ci_last_run_at": "2026-07-28T01:05:51Z",
"oldest_open_prs": [
{
"number": 27,
"created_at": "2026-07-17T13:16:47Z",
"last_comment_at": "2026-07-29T22:14:16Z",
"last_comment_author": "jeqcho"
}
],
"last_merged_pr_at": "2026-07-14T01:19:15Z",
"ci_last_conclusion": "SUCCESS",
"oldest_open_issues": [
{
"number": 3,
"created_at": "2026-07-05T06:59:02Z",
"last_comment_at": null,
"last_comment_author": null
}
]
}
},
"config": {
"disabled_metrics": [],
"disabled_categories": [],
"disabled_components": {}
},
"source": {
"url": "https://github.com/robocurve/worldevals",
"host": "github.com",
"name": "worldevals",
"owner": "robocurve"
},
"metrics": {
"overall": {
"key": "overall",
"band": "moderate",
"name": "Overall health",
"note": null,
"notes": [],
"value": 61,
"inputs": {
"security": 51,
"vitality": 72,
"community": 39,
"governance": 48,
"engineering": 90
},
"components": []
},
"categories": [
{
"key": "vitality",
"band": "good",
"name": "Vitality",
"value": 72,
"weight": 0.22,
"metrics": [
{
"key": "development_activity",
"band": "moderate",
"name": "Development activity",
"note": null,
"notes": [],
"value": 53,
"inputs": {
"commits_last_year": 50,
"human_commit_share": 0.98,
"days_since_last_push": 2,
"active_weeks_last_year": 3
},
"components": [
{
"key": "push_recency",
"name": "Push recency",
"detail": "last push 2 days ago",
"points": 36,
"status": "met",
"details": [
{
"code": "push_recency",
"params": {
"days": 2
}
}
],
"max_points": 36
},
{
"key": "commit_cadence",
"name": "Commit cadence",
"detail": "3/52 weeks with commits",
"points": 2.1,
"status": "partial",
"details": [
{
"code": "commit_cadence_weeks",
"params": {
"weeks": 3
}
}
],
"max_points": 36
},
{
"key": "commit_volume",
"name": "Commit volume",
"detail": "50 commits in the last year",
"points": 15.3,
"status": "partial",
"details": [
{
"code": "commits_last_year",
"params": {
"count": 50
}
}
],
"max_points": 18
},
{
"key": "openssf_scorecard_maintained",
"name": "OpenSSF Scorecard: Maintained",
"detail": "project was created within the last 90 days. Please review its contents carefully",
"points": 0,
"status": "missed",
"details": [],
"max_points": 10
}
]
},
{
"key": "release_discipline",
"band": "excellent",
"name": "Release discipline",
"note": "Excluded from scoring (no data or not applicable): OpenSSF Scorecard: Signed-Releases. Remaining weights renormalized.",
"notes": [
{
"code": "excluded_no_data",
"params": {
"components": [
"openssf_scorecard_signed_releases"
]
}
},
{
"code": "weights_renormalized",
"params": {}
}
],
"value": 100,
"inputs": {
"releases_count": 3,
"latest_release_tag": "v0.3.2",
"releases_from_tags": false,
"days_since_latest_release": 2,
"mean_days_between_releases": 10.4
},
"components": [
{
"key": "ships_releases",
"name": "Ships releases",
"detail": "3 releases published",
"points": 27,
"status": "met",
"details": [
{
"code": "releases_published",
"params": {
"count": 3
}
}
],
"max_points": 27
},
{
"key": "release_recency",
"name": "Release recency",
"detail": "latest release 2 days ago",
"points": 36,
"status": "met",
"details": [
{
"code": "release_recency",
"params": {
"days": 2
}
}
],
"max_points": 36
},
{
"key": "release_cadence",
"name": "Release cadence",
"detail": "a release every ~10.4 days",
"points": 27,
"status": "met",
"details": [
{
"code": "release_cadence",
"params": {
"gap": 10.4
}
}
],
"max_points": 27
},
{
"key": "openssf_scorecard_signed_releases",
"name": "OpenSSF Scorecard: Signed-Releases",
"detail": "no releases found",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_data",
"params": {}
}
],
"max_points": 10
}
]
},
{
"key": "abandonment",
"band": "excellent",
"name": "Abandonment",
"note": null,
"notes": [],
"value": 100,
"inputs": {
"cap": null,
"state": "unverified",
"guards": [],
"signals": [],
"red_flag": false,
"multiplier_pct": 100,
"declared_reason": null,
"unverified_reason": "repository_too_young",
"unanswered_open_prs": null,
"unanswered_open_issues": null,
"days_since_last_merged_pr": null,
"days_since_last_human_commit": null,
"days_since_last_human_commit_is_floor": false
},
"components": [
{
"key": "project_is_still_maintained",
"name": "Project is still maintained",
"detail": "maintenance record not established from the collected data",
"points": 100,
"status": "met",
"details": [
{
"code": "abandonment_unverified",
"params": {}
}
],
"max_points": 100
}
]
}
],
"description": "Is the project alive — is code being written and are releases shipping?"
},
{
"key": "community",
"band": "at_risk",
"name": "Community & Adoption",
"value": 39,
"weight": 0.18,
"metrics": [
{
"key": "popularity",
"band": "critical",
"name": "Popularity & adoption",
"note": null,
"notes": [],
"value": 11,
"inputs": {
"forks": 2,
"stars": 6,
"watchers": 1,
"growth_state": "unverified",
"growth_factor_pct": 100,
"growth_unverified_reason": "no_history"
},
"components": [
{
"key": "stars",
"name": "Stars",
"detail": "6 stars",
"points": 11.3,
"status": "partial",
"details": [
{
"code": "stars",
"params": {
"count": 6
}
}
],
"max_points": 60
},
{
"key": "forks",
"name": "Forks",
"detail": "2 forks",
"points": 0,
"status": "missed",
"details": [
{
"code": "forks",
"params": {
"count": 2
}
}
],
"max_points": 25
},
{
"key": "watchers",
"name": "Watchers",
"detail": "1 watchers",
"points": 0,
"status": "missed",
"details": [
{
"code": "watchers",
"params": {
"count": 1
}
}
],
"max_points": 15
}
]
},
{
"key": "community_health",
"band": "good",
"name": "Community health",
"note": null,
"notes": [],
"value": 70,
"inputs": {
"has_readme": true,
"has_license": true,
"has_contributing": true,
"has_issue_template": false,
"has_code_of_conduct": false,
"has_pull_request_template": false
},
"components": [
{
"key": "readme",
"name": "README",
"detail": null,
"points": 22.5,
"status": "met",
"details": [],
"max_points": 22.5
},
{
"key": "license",
"name": "License",
"detail": "recognized license (MIT)",
"points": 22.5,
"status": "met",
"details": [
{
"code": "license_standard",
"params": {}
},
{
"code": "license_spdx",
"params": {
"spdx": "MIT"
}
}
],
"max_points": 22.5
},
{
"key": "contributing_guide",
"name": "CONTRIBUTING guide",
"detail": null,
"points": 18,
"status": "met",
"details": [],
"max_points": 18
},
{
"key": "code_of_conduct",
"name": "Code of conduct",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 13.5
},
{
"key": "issue_template",
"name": "Issue template",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 7.2
},
{
"key": "pr_template",
"name": "PR template",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 6.3
}
]
}
],
"description": "Does the project have users, downloads, attention, and a welcoming setup for contributors?"
},
{
"key": "governance",
"band": "at_risk",
"name": "Sustainability & Governance",
"value": 48,
"weight": 0.24,
"metrics": [
{
"key": "maintainer_resilience",
"band": "critical",
"name": "Maintainer resilience (bus factor)",
"note": null,
"notes": [],
"value": 12,
"inputs": {
"bus_factor": 1,
"contributors_sampled": 2,
"top_contributor_share": 0.98
},
"components": [
{
"key": "bus_factor",
"name": "Bus factor",
"detail": "1 contributor(s) cover half of all commits",
"points": 9,
"status": "partial",
"details": [
{
"code": "bus_factor",
"params": {
"count": 1
}
}
],
"max_points": 54
},
{
"key": "commit_distribution",
"name": "Commit distribution",
"detail": "top contributor authored 98% of commits",
"points": 0.5,
"status": "partial",
"details": [
{
"code": "top_contributor_share",
"params": {
"share": 98
}
}
],
"max_points": 22.5
},
{
"key": "contributor_breadth",
"name": "Contributor breadth",
"detail": "2 contributors",
"points": 2.7,
"status": "partial",
"details": [
{
"code": "contributors_sampled",
"params": {
"count": 2
}
}
],
"max_points": 13.5
},
{
"key": "openssf_scorecard_contributors",
"name": "OpenSSF Scorecard: Contributors",
"detail": "project has 0 contributing companies or organizations -- score normalized to 0",
"points": 0,
"status": "missed",
"details": [],
"max_points": 10
}
]
},
{
"key": "responsiveness",
"band": "moderate",
"name": "Issue & PR responsiveness",
"note": null,
"notes": [],
"value": 58,
"inputs": {
"merged_prs": 22,
"open_issues": 1,
"closed_issues": 1,
"issue_closed_ratio": 0.5,
"closed_unmerged_prs": 2
},
"components": [
{
"key": "issue_resolution",
"name": "Issue resolution",
"detail": "50% of issues closed",
"points": 23.4,
"status": "partial",
"details": [
{
"code": "issues_closed_share",
"params": {
"share": 50
}
}
],
"max_points": 46.75
},
{
"key": "pr_acceptance",
"name": "PR acceptance",
"detail": "22/24 decided PRs merged",
"points": 35.1,
"status": "partial",
"details": [
{
"code": "decided_prs_merged",
"params": {
"merged": 22,
"decided": 24
}
}
],
"max_points": 38.25
},
{
"key": "openssf_scorecard_code_review",
"name": "OpenSSF Scorecard: Code-Review",
"detail": "Found 0/18 approved changesets -- score normalized to 0",
"points": 0,
"status": "missed",
"details": [],
"max_points": 15
}
]
},
{
"key": "stewardship",
"band": "at_risk",
"name": "Ownership & stewardship",
"note": null,
"notes": [],
"value": 48,
"inputs": {
"followers": 25,
"owner_type": "Organization",
"is_verified": null,
"owner_login": "robocurve",
"public_repos": 12,
"account_age_days": 34
},
"components": [
{
"key": "ownership_backing",
"name": "Ownership backing",
"detail": "organization-owned",
"points": 30,
"status": "met",
"details": [
{
"code": "owner_organization",
"params": {}
}
],
"max_points": 30
},
{
"key": "verified_domain",
"name": "Verified domain",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 20
},
{
"key": "owner_reach",
"name": "Owner reach",
"detail": "25 followers of robocurve",
"points": 10.2,
"status": "partial",
"details": [
{
"code": "owner_followers",
"params": {
"count": 25,
"login": "robocurve"
}
}
],
"max_points": 25
},
{
"key": "track_record",
"name": "Track record",
"detail": "12 public repos, account ~0 yr old",
"points": 8.3,
"status": "partial",
"details": [
{
"code": "public_repos",
"params": {
"count": 12
}
},
{
"code": "account_age_years",
"params": {
"years": 0
}
}
],
"max_points": 25
}
]
},
{
"key": "package_maintenance",
"band": "excellent",
"name": "Package maintenance",
"note": null,
"notes": [],
"value": 92,
"inputs": {
"packages": [
"worldevals"
],
"ecosystems": "pypi",
"any_deprecated": false,
"min_days_since_publish": 2
},
"components": [
{
"key": "published_resolvable",
"name": "Published & resolvable",
"detail": "1 package(s) on pypi",
"points": 25,
"status": "met",
"details": [
{
"code": "packages_published",
"params": {
"count": 1,
"ecosystems": "pypi"
}
}
],
"max_points": 25
},
{
"key": "publish_recency",
"name": "Publish recency",
"detail": "latest publish 2 days ago",
"points": 35,
"status": "met",
"details": [
{
"code": "publish_recency",
"params": {
"days": 2
}
}
],
"max_points": 35
},
{
"key": "version_history",
"name": "Version history",
"detail": "3 published versions",
"points": 12,
"status": "partial",
"details": [
{
"code": "published_versions",
"params": {
"count": 3
}
}
],
"max_points": 20
},
{
"key": "not_deprecated",
"name": "Not deprecated",
"detail": "active, not deprecated or yanked",
"points": 20,
"status": "met",
"details": [
{
"code": "package_not_deprecated",
"params": {}
}
],
"max_points": 20
}
]
}
],
"description": "Will the project survive its people — bus factor, responsiveness, who backs it, and package upkeep?"
},
{
"key": "engineering",
"band": "excellent",
"name": "Engineering Quality",
"value": 90,
"weight": 0.2,
"metrics": [
{
"key": "engineering_practices",
"band": "excellent",
"name": "Engineering practices",
"note": null,
"notes": [],
"value": 94,
"inputs": {
"has_ci": true,
"has_tests": true,
"has_editorconfig": false,
"has_linter_config": true,
"has_precommit_config": true
},
"components": [
{
"key": "ci_workflows",
"name": "CI workflows",
"detail": "4 workflow(s)",
"points": 24,
"status": "met",
"details": [
{
"code": "ci_workflows",
"params": {
"count": 4
}
}
],
"max_points": 24
},
{
"key": "tests_present",
"name": "Tests present",
"detail": null,
"points": 24,
"status": "met",
"details": [],
"max_points": 24
},
{
"key": "linter_config",
"name": "Linter config",
"detail": null,
"points": 16,
"status": "met",
"details": [],
"max_points": 16
},
{
"key": "pre_commit_hooks",
"name": "Pre-commit hooks",
"detail": null,
"points": 9.6,
"status": "met",
"details": [],
"max_points": 9.6
},
{
"key": "editorconfig",
"name": ".editorconfig",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 6.4
},
{
"key": "openssf_scorecard_ci_tests",
"name": "OpenSSF Scorecard: CI-Tests",
"detail": "19 out of 19 merged PRs checked by a CI test -- score normalized to 10",
"points": 20,
"status": "met",
"details": [],
"max_points": 20
}
]
},
{
"key": "documentation",
"band": "excellent",
"name": "Documentation",
"note": null,
"notes": [],
"value": 85,
"inputs": {
"topics": [
"benchmarks",
"evaluation",
"robolens",
"robotics",
"vla"
],
"has_wiki": true,
"homepage": null,
"has_readme": true,
"has_docs_dir": true,
"has_description": true
},
"components": [
{
"key": "readme",
"name": "README",
"detail": null,
"points": 30,
"status": "met",
"details": [],
"max_points": 30
},
{
"key": "documentation_directory",
"name": "Documentation directory",
"detail": null,
"points": 25,
"status": "met",
"details": [],
"max_points": 25
},
{
"key": "documentation_homepage_site",
"name": "Documentation / homepage site",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 15
},
{
"key": "repository_description",
"name": "Repository description",
"detail": null,
"points": 10,
"status": "met",
"details": [],
"max_points": 10
},
{
"key": "topics",
"name": "Topics",
"detail": "5 topics",
"points": 10,
"status": "met",
"details": [
{
"code": "topics_count",
"params": {
"count": 5
}
}
],
"max_points": 10
},
{
"key": "wiki",
"name": "Wiki",
"detail": null,
"points": 10,
"status": "met",
"details": [],
"max_points": 10
}
]
}
],
"description": "Are baseline engineering and documentation practices in place?"
},
{
"key": "security",
"band": "moderate",
"name": "Security",
"value": 51,
"weight": 0.16,
"metrics": [
{
"key": "security_posture",
"band": "at_risk",
"name": "Security posture",
"note": "Excluded from scoring (no data or not applicable): Signed-Releases. Remaining weights renormalized.",
"notes": [
{
"code": "excluded_no_data",
"params": {
"components": [
"signed_releases"
]
}
},
{
"code": "weights_renormalized",
"params": {}
}
],
"value": 39,
"inputs": {
"source": "openssf_scorecard",
"checks_evaluated": 17,
"scorecard_version": "v5.5.0",
"checks_inconclusive": 1,
"scorecard_aggregate": 3.9
},
"components": [
{
"key": "binary_artifacts",
"name": "Binary-Artifacts",
"detail": "no binaries found in the repo",
"points": 7.5,
"status": "met",
"details": [],
"max_points": 7.5
},
{
"key": "branch_protection",
"name": "Branch-Protection",
"detail": "branch protection is not maximal on development and all release branches",
"points": 3,
"status": "partial",
"details": [],
"max_points": 7.5
},
{
"key": "ci_tests",
"name": "CI-Tests",
"detail": "19 out of 19 merged PRs checked by a CI test -- score normalized to 10",
"points": 2.5,
"status": "met",
"details": [],
"max_points": 2.5
},
{
"key": "cii_best_practices",
"name": "CII-Best-Practices",
"detail": "no effort to earn an OpenSSF best practices badge detected",
"points": 0,
"status": "missed",
"details": [],
"max_points": 2.5
},
{
"key": "code_review",
"name": "Code-Review",
"detail": "Found 0/18 approved changesets -- score normalized to 0",
"points": 0,
"status": "missed",
"details": [],
"max_points": 7.5
},
{
"key": "contributors",
"name": "Contributors",
"detail": "project has 0 contributing companies or organizations -- score normalized to 0",
"points": 0,
"status": "missed",
"details": [],
"max_points": 2.5
},
{
"key": "dangerous_workflow",
"name": "Dangerous-Workflow",
"detail": "no dangerous workflow patterns detected",
"points": 10,
"status": "met",
"details": [],
"max_points": 10
},
{
"key": "dependency_update_tool",
"name": "Dependency-Update-Tool",
"detail": "no update tool detected",
"points": 0,
"status": "missed",
"details": [],
"max_points": 7.5
},
{
"key": "fuzzing",
"name": "Fuzzing",
"detail": "project is not fuzzed",
"points": 0,
"status": "missed",
"details": [],
"max_points": 5
},
{
"key": "license",
"name": "License",
"detail": "license file detected",
"points": 2.5,
"status": "met",
"details": [],
"max_points": 2.5
},
{
"key": "maintained",
"name": "Maintained",
"detail": "project was created within the last 90 days. Please review its contents carefully",
"points": 0,
"status": "missed",
"details": [],
"max_points": 7.5
},
{
"key": "packaging",
"name": "Packaging",
"detail": "packaging workflow detected",
"points": 5,
"status": "met",
"details": [],
"max_points": 5
},
{
"key": "pinned_dependencies",
"name": "Pinned-Dependencies",
"detail": "dependency not pinned by hash detected -- score normalized to 0",
"points": 0,
"status": "missed",
"details": [],
"max_points": 5
},
{
"key": "sast",
"name": "SAST",
"detail": "SAST tool is not run on all commits -- score normalized to 0",
"points": 0,
"status": "missed",
"details": [],
"max_points": 5
},
{
"key": "security_policy",
"name": "Security-Policy",
"detail": "security policy file not detected",
"points": 0,
"status": "missed",
"details": [],
"max_points": 5
},
{
"key": "signed_releases",
"name": "Signed-Releases",
"detail": "no releases found",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_data",
"params": {}
}
],
"max_points": 7.5
},
{
"key": "token_permissions",
"name": "Token-Permissions",
"detail": "detected GitHub workflow tokens with excessive permissions",
"points": 0,
"status": "missed",
"details": [],
"max_points": 7.5
},
{
"key": "vulnerabilities",
"name": "Vulnerabilities",
"detail": "0 existing vulnerabilities detected",
"points": 7.5,
"status": "met",
"details": [],
"max_points": 7.5
}
]
},
{
"key": "dependency_advisories",
"band": "excellent",
"name": "Dependency advisories",
"note": "Excluded from scoring (no data or not applicable): No advisories left outstanding. Remaining weights renormalized. Matched the pypi:worldevals@0.3.2 runtime dependency closure — what installing the published package pulls in — 2 packages. Reachability is not analyzed.",
"notes": [
{
"code": "excluded_no_data",
"params": {
"components": [
"no_advisories_left_outstanding"
]
}
},
{
"code": "weights_renormalized",
"params": {}
},
{
"code": "advisories_scope_published",
"params": {
"package": "pypi:worldevals@0.3.2",
"assessed": 2
}
},
{
"code": "advisories_reachability",
"params": {}
}
],
"value": 100,
"inputs": {
"source": "osv",
"advisories": 0,
"affected_packages": 0,
"assessed_packages": 2,
"unassessed_packages": 0,
"affected_by_severity": "none",
"direct_affected_packages": 0
},
"components": [
{
"key": "direct_dependencies_free_of_known_advisories",
"name": "Direct dependencies free of known advisories",
"detail": "no direct dependency carries a known advisory",
"points": 35,
"status": "met",
"details": [
{
"code": "no_direct_advisories",
"params": {}
}
],
"max_points": 35
},
{
"key": "indirect_dependencies_free_of_known_advisories",
"name": "Indirect dependencies free of known advisories",
"detail": "no indirect dependency carries a known advisory",
"points": 25,
"status": "met",
"details": [
{
"code": "no_indirect_advisories",
"params": {}
}
],
"max_points": 25
},
{
"key": "no_advisories_left_outstanding",
"name": "No advisories left outstanding",
"detail": "no advisory carries a publication date",
"points": 0,
"status": "excluded",
"details": [
{
"code": "advisories_no_publication_date",
"params": {}
}
],
"max_points": 40
}
]
},
{
"key": "malicious_dependencies",
"band": "excellent",
"name": "Malicious dependencies",
"note": null,
"notes": [],
"value": 100,
"inputs": {
"source": "osv",
"meaning": "reported as a malicious package by the OpenSSF corpus; the remedy is removal or moving off the compromised name, never an upgrade of the same artifact. Versions the registry has since pulled are listed but not scored",
"packages": [],
"red_flag": false,
"assessed_packages": 2,
"malicious_packages": 0,
"direct_malicious_packages": 0,
"withdrawn_malicious_packages": 0,
"installable_malicious_packages": 0
},
"components": [
{
"key": "no_dependency_reported_as_a_malicious_package",
"name": "No dependency reported as a malicious package",
"detail": "no dependency is reported as a malicious package",
"points": 100,
"status": "met",
"details": [
{
"code": "no_malicious_dependencies",
"params": {}
}
],
"max_points": 100
}
]
}
],
"description": "Are visible security and supply-chain practices strong, with no malicious dependency and no unresolved high-risk jurisdiction exposure?"
},
{
"key": "ai_readiness",
"band": "good",
"name": "AI Readiness",
"value": 75,
"weight": 0,
"metrics": [
{
"key": "ai_agent_context",
"band": "excellent",
"name": "Agent context & guidance",
"note": null,
"notes": [],
"value": 85,
"inputs": {
"has_llms_txt": false,
"legible_history_share": 0.857,
"agent_instruction_files": [
"CLAUDE.md"
],
"agent_instruction_max_bytes": 6410
},
"components": [
{
"key": "agent_instructions",
"name": "Agent instructions",
"detail": "CLAUDE.md",
"points": 45,
"status": "met",
"details": [
{
"code": "file_list",
"params": {
"files": "CLAUDE.md"
}
}
],
"max_points": 45
},
{
"key": "machine_readable_docs_llms_txt",
"name": "Machine-readable docs (llms.txt)",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 15
},
{
"key": "legible_commit_history",
"name": "Legible commit history",
"detail": "42 of 49 human commits state their intent (structured subject or explanatory body)",
"points": 40,
"status": "met",
"details": [
{
"code": "legible_history",
"params": {
"legible": 42,
"sampled": 49
}
}
],
"max_points": 40
}
]
},
{
"key": "ai_verify_loop",
"band": "moderate",
"name": "Verify loop (build / test / typecheck)",
"note": null,
"notes": [],
"value": 64,
"inputs": {
"has_nix": false,
"has_tests": true,
"lockfiles": [
"uv.lock"
],
"has_dockerfile": false,
"typed_language": false,
"bootstrap_files": [],
"has_devcontainer": false,
"has_linter_config": true,
"typecheck_configs": [
"src/worldevals/py.typed"
],
"agent_commit_share": 0.7,
"toolchain_manifests": [],
"dependency_bot_commit_share": 0
},
"components": [
{
"key": "one_command_bootstrap",
"name": "One-command bootstrap",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 18
},
{
"key": "automated_tests",
"name": "Automated tests",
"detail": null,
"points": 22,
"status": "met",
"details": [],
"max_points": 22
},
{
"key": "lint_format_config",
"name": "Lint / format config",
"detail": null,
"points": 11,
"status": "met",
"details": [],
"max_points": 11
},
{
"key": "static_type_checking",
"name": "Static type checking",
"detail": "src/worldevals/py.typed",
"points": 11,
"status": "met",
"details": [
{
"code": "file_list",
"params": {
"files": "src/worldevals/py.typed"
}
}
],
"max_points": 11
},
{
"key": "reproducible_environment",
"name": "Reproducible environment",
"detail": "lockfile",
"points": 10,
"status": "met",
"details": [
{
"code": "file_list",
"params": {
"files": "lockfile"
}
}
],
"max_points": 10
},
{
"key": "demonstrated_agent_practice",
"name": "Demonstrated agent practice",
"detail": "35 of the last 50 commits agent-authored or agent-credited",
"points": 10,
"status": "met",
"details": [
{
"code": "agent_authored_commits",
"params": {
"count": 35,
"sampled": 50
}
}
],
"max_points": 10
},
{
"key": "automated_maintenance",
"name": "Automated maintenance",
"detail": "no automated dependency updates observed",
"points": 0,
"status": "missed",
"details": [
{
"code": "no_dependency_automation",
"params": {}
}
],
"max_points": 8
},
{
"key": "openssf_scorecard_pinned_dependencies",
"name": "OpenSSF Scorecard: Pinned-Dependencies",
"detail": "dependency not pinned by hash detected -- score normalized to 0",
"points": 0,
"status": "missed",
"details": [],
"max_points": 10
}
]
},
{
"key": "ai_code_legibility",
"band": "good",
"name": "Code legibility for models",
"note": null,
"notes": [],
"value": 82,
"inputs": {
"primary_language": "Python",
"largest_source_bytes": 4760,
"source_files_sampled": 6,
"oversized_source_files": 0
},
"components": [
{
"key": "type_checkable_code",
"name": "Type-checkable code",
"detail": "Python with type-check config (src/worldevals/py.typed)",
"points": 27,
"status": "partial",
"details": [
{
"code": "typecheck_config_language",
"params": {
"files": "src/worldevals/py.typed",
"language": "Python"
}
}
],
"max_points": 45
},
{
"key": "manageable_file_sizes",
"name": "Manageable file sizes",
"detail": "0/6 source files over 60KB",
"points": 55,
"status": "met",
"details": [
{
"code": "oversized_source_files",
"params": {
"kb": 60,
"sampled": 6,
"oversized": 0
}
}
],
"max_points": 55
}
]
}
],
"description": "How well is the repo equipped to be developed and maintained with AI coding agents? An independent, experimental badge — weight 0.0, so it is surfaced on its own and does not affect the overall health score."
}
],
"metrics_version": "1.13.0"
},
"warnings": [
"Star history unavailable: GitHub GraphQL error: Resource not accessible by personal access token"
],
"report_type": "repository",
"generated_at": "2026-07-30T06:02:10.396955Z",
"schema_version": "0.27.0",
"badge_url": "https://raw.githubusercontent.com/inspect-software/badges/main/v1/r/robocurve/worldevals.svg",
"full_name": "robocurve/worldevals",
"license_state": "standard",
"license_spdx": "MIT"
}