公开记录
软件健康报告模式 0.9.0 · 指标 1.13.0 · 2026-07-14 05:54 UTC

spider-rs / spider

Get web data for AI agents and LLMs

RustMIT★ 2,601 星标⑂ 219 复刻始于 2018年1月在 GitHub 上查看 ↗
#ai-agent#automation#crawler#headless-chrome#rust#scraping#spider#web-crawler#web-data#web-scraping

spider-rs/spider 的健康指数为 100 分中的 71 分，处于「良好」区间。 其得分最高的类别是Vitality（92/100），最低的是Security（47/100）。 最近一次更新在 4 天前。 近期的大部分工作由 1 位贡献者完成。

71
总分 / 100
良好

软件健康指数

指标归入加权类别，统一采用 1–100 量表。总体分先取类别加权平均；当公开证据触发高风险司法辖区政策时，评级会按政策调整，并设置 49（有风险）的上限。AI 就绪度不计入总体分。

71
优秀85-100堪称典范；基本满足所有检验标准
良好70-84健康；仅有轻微不足
中等50-69可接受，但存在明显不足；建议进行审查
存在风险30-49存在重大薄弱环节；采用时应保持审慎
危急1-29问题严重（项目被弃置、仅有单一维护者、缺乏基本工程规范）
活力社区与采用可持续性与治理工程质量安全AI 就绪度

评分画像

每条轴代表一个类别。形状比平均值更重要——健康的对象会填满整个图形，而“一峰一谷”式画像意味着某一维度的优势正掩盖另一维度的风险。

所有权

spider-rs组织
105 关注者66 个公开仓库始于 2022年9月

该仓库由组织支持——共同承担、可问责的托管责任，可延续于任何单一维护者之后。

软件包生态系统

注册表软件包版本月下载量版本数最近发布
crates.iospider2.52.923,7902,2135 天前
crates.iospider_agent2.52.93,6094345 天前
crates.iospider_agent_html2.52.93,7473865 天前
crates.iospider_agent_types2.52.918,4263885 天前
crates.iospider_cli2.52.92,3372,1395 天前
crates.iospider_mcp2.52.98582565 天前

按类别列示的指标

活力

项目是否仍有生命——是否仍在编写代码，是否仍在发布版本？

92优秀 · 占总体的 22%

开发活跃度

93优秀
评分方式
36/36推送新近度 — 最近一次推送于 4 天前
29.1/36提交节奏 — 52 周中有 42 周有提交
18/18提交量 — 最近一年 851 次提交
10/10OpenSSF Scorecard：Maintained — 30 commit(s) and 3 issue activity found in the last 90 days -- score normalized to 10
所用输入
commits_last_year851
human_commit_share—
days_since_last_push4
active_weeks_last_year42

发布纪律

90优秀
评分方式
27/27有发布版本 — 已发布 100 个发布版本
27/36发布时效 — 最近一次发布版本于 104 天前
27/27发布节奏 — 约每 6 天发布一次
0/10OpenSSF Scorecard：Signed-Releases — 无数据
所用输入
releases_count100
latest_release_tagv2.52.2
releases_from_tags否
days_since_latest_release104
mean_days_between_releases6
已排除计分（无数据或不适用）：OpenSSF Scorecard：Signed-Releases。 其余权重已重新归一化。

社区与采用

项目是否拥有用户、下载量与关注度，并具备欢迎贡献者参与的配置？

85优秀 · 占总体的 18%

流行度与采用

82良好
评分方式
55.4/60星标 — 2,601 个星标
19.5/25复刻 — 219 个复刻
7/15关注者 — 19 位关注者
所用输入
forks219
stars2,601
watchers19
growth_stateunverified
growth_factor_pct100
growth_unverified_reasonno_history

社区健康

92优秀
评分方式
22.5/22.5README
22.5/22.5许可证 — 可识别的许可证（MIT）
18/18CONTRIBUTING 指南
13.5/13.5行为准则
0/7.2议题模板
6.3/6.3PR 模板
所用输入
has_readme是
has_license是
has_contributing是
has_issue_template否
has_code_of_conduct是
has_pull_request_template是

生态采用（下载量）

79良好
评分方式
63/80月度下载量 — crates 合计每月 52,767 次下载
0/20注册表被依赖数 — 该生态系统不报告此项
所用输入
packagesspider, spider_agent, spider_agent_html, spider_agent_types, spider_cli, spider_mcp
dependents—
ecosystemscrates
total_downloads3,974,283
monthly_downloads52,767
已排除计分（无数据或不适用）：注册表被依赖数。 其余权重已重新归一化。

可持续性与治理

项目能否在其成员之外延续——巴士系数、响应能力、由谁支持，以及软件包的维护状况？

64中等 · 占总体的 24%

维护者韧性（巴士系数）

30存在风险
评分方式
9/54巴士系数 — 1 位贡献者贡献了半数提交
1/22.5提交分布 — 头号贡献者编写了 96% 的提交
13.5/13.5贡献者广度 — 32 位贡献者
6/10OpenSSF Scorecard：Contributors — project has 2 contributing companies or organizations -- score normalized to 6
所用输入
bus_factor1
contributors_sampled32
top_contributor_share0.956

议题与 PR 响应能力

74良好
评分方式
46.8/46.8议题解决 — 100% 的议题已关闭
25.8/38.3PR 接受 — 已裁定的 PR 中 118/175 已合并
1.5/15OpenSSF Scorecard：Code-Review — Found 4/29 approved changesets -- score normalized to 1
所用输入
merged_prs118
open_issues0
closed_issues184
issue_closed_ratio1
closed_unmerged_prs57

所有权与托管责任

65中等
评分方式
30/30所有权背书 — 组织持有
0/20已验证域名
14.6/25所有者影响力 — spider-rs 有 105 位关注者
20.7/25既往记录 — 66 个公开仓库，账户约 3 年
所用输入
followers105
owner_typeOrganization
is_verified—
owner_loginspider-rs
public_repos66
account_age_days1,406

软件包维护

100优秀
评分方式
25/25已发布且可解析 — crates 上有 6 个软件包
35/35发布时效 — 最近一次发布于 5 天前
20/20版本历史 — 2,213 个已发布版本
20/20未被弃用 — 活跃，未被弃用或撤回
所用输入
packagesspider, spider_agent, spider_agent_html, spider_agent_types, spider_cli, spider_mcp
ecosystemscrates
any_deprecated否
min_days_since_publish5

工程质量

基础的工程与文档实践是否到位？

64中等 · 占总体的 20%

工程实践

64中等
评分方式
24/24CI 工作流 — 6 个工作流
24/24存在测试
0/16Linter 配置
0/9.6Pre-commit 钩子
6.4/6.4.editorconfig
10/20OpenSSF Scorecard：CI-Tests — 5 out of 9 merged PRs checked by a CI test -- score normalized to 5
所用输入
has_ci是
has_tests是
has_editorconfig是
has_linter_config否
has_precommit_config否

文档

65中等
评分方式
30/30README
0/25文档目录
15/15文档 / 主页站点 — https://spider.cloud/github
10/10仓库描述
10/10主题标签 — 10 个主题标签
0/10Wiki
所用输入
topicsai-agent, automation, crawler, headless-chrome, rust, scraping, spider, web-crawler, web-data, web-scraping
has_wiki否
homepagehttps://spider.cloud/github
has_readme是
has_docs_dir否
has_description是

安全

可见的安全与供应链实践是否稳固，且不存在未解决的高风险司法辖区暴露？

47存在风险 · 占总体的 16%

安全态势

47存在风险
评分方式
7.5/7.5Binary-Artifacts — no binaries found in the repo
0/7.5Branch-Protection — branch protection not enabled on development/release branches
1.2/2.5CI-Tests — 5 out of 9 merged PRs checked by a CI test -- score normalized to 5
0/2.5CII-Best-Practices — no effort to earn an OpenSSF best practices badge detected
0.8/7.5Code-Review — Found 4/29 approved changesets -- score normalized to 1
1.5/2.5Contributors — project has 2 contributing companies or organizations -- score normalized to 6
10/10Dangerous-Workflow — no dangerous workflow patterns detected
7.5/7.5Dependency-Update-Tool — update tool detected
0/5Fuzzing — project is not fuzzed
2.5/2.5许可证 — license file detected
7.5/7.5Maintained — 30 commit(s) and 3 issue activity found in the last 90 days -- score normalized to 10
0/5Packaging — 无数据
0/5Pinned-Dependencies — dependency not pinned by hash detected -- score normalized to 0
0/5SAST — SAST tool is not run on all commits -- score normalized to 0
5/5Security-Policy — security policy file detected
0/7.5Signed-Releases — 无数据
0/7.5Token-Permissions — detected GitHub workflow tokens with excessive permissions
0/7.5Vulnerabilities — 25 existing vulnerabilities detected
所用输入
sourceopenssf_scorecard
checks_evaluated16
scorecard_versionv5.5.0
checks_inconclusive2
scorecard_aggregate4.7
已排除计分（无数据或不适用）：packaging, signed_releases。 其余权重已重新归一化。

AI 就绪度

该仓库在多大程度上具备与 AI 编码代理协同开发与维护的条件？这是一枚独立的实验性徽章——权重为 0.0，因此单独呈现，不影响总体健康评分。

67中等 · 占总体的 0%

AI 代理上下文与指引

75良好
评分方式
45/45代理指令 — CLAUDE.md
0/15机器可读文档（llms.txt）
0/40可读的提交历史 — 无数据
所用输入
has_llms_txt否
legible_history_share—
agent_instruction_filesCLAUDE.md
agent_instruction_max_bytes18,586
已排除计分（无数据或不适用）：可读的提交历史。 其余权重已重新归一化。

验证循环（构建 / 测试 / 类型检查）

53中等
评分方式
0/18一条命令的引导启动
22/22自动化测试
0/11Lint / 格式化配置
11/11静态类型检查 — Rust（静态类型）
10/10可复现环境 — Nix, lockfile
0/10已体现的代理实践 — 无数据
5/8自动化维护 — 已配置依赖自动化，但在抽样提交中未观察到
0/10OpenSSF Scorecard：Pinned-Dependencies — dependency not pinned by hash detected -- score normalized to 0
所用输入
has_nix是
has_tests是
lockfilesCargo.lock
has_dockerfile否
typed_language是
bootstrap_files—
has_devcontainer否
has_linter_config否
typecheck_configs—
agent_commit_share—
toolchain_manifests—
dependency_bot_commit_share0
已排除计分（无数据或不适用）：已体现的代理实践。 其余权重已重新归一化。

面向模型的代码可读性

98优秀
评分方式
45/45可类型检查的代码 — Rust（静态类型）
52.8/55可控的文件大小 — 采样的 274 个源文件中有 11 个超过 60KB
所用输入
primary_languageRust
largest_source_bytes829,382
source_files_sampled274
oversized_source_files11

机器可读接口

60中等
评分方式
0/40API 模式（OpenAPI/GraphQL/proto）
20/20MCP 服务器
40/40可运行示例 — examples
所用输入
example_dirsexamples
has_mcp_signal是
api_schema_files—

关键数据

2,601GitHub 星标
32贡献者
851最近 12 个月提交数
4距最近推送天数
100发布版本数
1巴士系数（bus factor）
0开放议题
crates.io软件包生态系统数

数据采集警告

  • Could not fetch crates package 'benches' from its registry
  • Could not fetch crates package 'spider_examples' from its registry

更多细节

OpenSSF Scorecard 4.7 / 10
4.7综合

来自开源项目 OpenSSF Scorecard 的独立、工具无关的安全评估。每项检查奖励的是安全实践本身，而非特定供应商的工具。Scorecard 无法判定的检查项标记为 不适用，并从安全评分中剔除（绝不按零分计）。Scorecard v5.5.0 · 2026-07-14 05:53 UTC

10Binary-Artifactsno binaries found in the repo
0Branch-Protectionbranch protection not enabled on development/release branches
5CI-Tests5 out of 9 merged PRs checked by a CI test -- score normalized to 5
0CII-Best-Practicesno effort to earn an OpenSSF best practices badge detected
1Code-ReviewFound 4/29 approved changesets -- score normalized to 1
6Contributorsproject has 2 contributing companies or organizations -- score normalized to 6
10Dangerous-Workflowno dangerous workflow patterns detected
10Dependency-Update-Toolupdate tool detected
0Fuzzingproject is not fuzzed
10Licenselicense file detected
10Maintained30 commit(s) and 3 issue activity found in the last 90 days -- score normalized to 10
不适用Packagingpackaging workflow not detected
0Pinned-Dependenciesdependency not pinned by hash detected -- score normalized to 0
0SASTSAST tool is not run on all commits -- score normalized to 0
10Security-Policysecurity policy file detected
不适用Signed-Releasesno releases found
0Token-Permissionsdetected GitHub workflow tokens with excessive permissions
0Vulnerabilities25 existing vulnerabilities detected
直接依赖 162
注册表软件包版本约束清单文件
crates.iocriterion0.8benches/Cargo.toml
crates.iospider—benches/Cargo.toml
crates.iospider_utils—benches/Cargo.toml
crates.iospider2examples/Cargo.toml
crates.iospider_utils2examples/Cargo.toml
crates.iospider_transformations2examples/Cargo.toml
crates.iourl2spider/Cargo.toml
crates.iotokio-stream0.1spider/Cargo.toml
crates.iohashbrown0.17spider/Cargo.toml
crates.iolog0.4spider/Cargo.toml
crates.iopercent-encoding2spider/Cargo.toml
crates.ioregex1spider/Cargo.toml
crates.ioua_generator^0.5spider/Cargo.toml
crates.iostring_concat0.0.1spider/Cargo.toml
crates.iolazy_static1spider/Cargo.toml
crates.ioahash0.8spider/Cargo.toml
crates.ioarc-swap1spider/Cargo.toml
crates.iodashmap6spider/Cargo.toml
crates.iosmallvec1spider/Cargo.toml
crates.ionum_cpus1spider/Cargo.toml
crates.iobytes1spider/Cargo.toml
crates.ioserde1spider/Cargo.toml
crates.ioflexbuffers25spider/Cargo.toml
crates.ioitertools0.14spider/Cargo.toml
crates.iocase_insensitive_string0.2spider/Cargo.toml
crates.iositemap0.4spider/Cargo.toml
crates.iochrono0.4spider/Cargo.toml
crates.iocron0.16spider/Cargo.toml
crates.ioasync-trait0.1spider/Cargo.toml
crates.iostrum0.28spider/Cargo.toml
crates.ioasync_job0.1spider/Cargo.toml
crates.ioreqwest-middleware0.5spider/Cargo.toml
crates.iohttp-cache-reqwest1.0.0-alpha.7spider/Cargo.toml
crates.ioconst_format0.2spider/Cargo.toml
crates.ioasync-openai0.35spider/Cargo.toml
crates.iotiktoken-rs0.11spider/Cargo.toml
crates.iogemini-rust1.7spider/Cargo.toml
crates.iolol_html2spider/Cargo.toml
crates.iocookie0.18spider/Cargo.toml
crates.ioserde_json1spider/Cargo.toml
crates.ioquick-xml0.41spider/Cargo.toml
crates.iomoka0.12spider/Cargo.toml
crates.iofastrand2spider/Cargo.toml
crates.iohickory-resolver0.26spider/Cargo.toml
crates.iohttp-cache-semantics3spider/Cargo.toml
crates.iohttp-cache1.0.0-alpha.5spider/Cargo.toml
crates.iohttp-global-cache0.2.0spider/Cargo.toml
crates.iohttp1spider/Cargo.toml
crates.iophf0.13spider/Cargo.toml
crates.ioauto_encoder0.2spider/Cargo.toml
crates.iosimdutf80.1spider/Cargo.toml
crates.iobase640.22spider/Cargo.toml
crates.iostring-interner0.19spider/Cargo.toml
crates.iohttpdate1spider/Cargo.toml
crates.iorand0.9spider/Cargo.toml
crates.ioserde_regex1spider/Cargo.toml
crates.iollm_json1spider/Cargo.toml
crates.iothirtyfour0.36spider/Cargo.toml
crates.iostatrs0.18spider/Cargo.toml
crates.ioaho-corasick1spider/Cargo.toml
crates.iomemchr2spider/Cargo.toml
crates.iotracing0.1spider/Cargo.toml
crates.iosysinfo0.38spider/Cargo.toml
crates.iosqlx0.8spider/Cargo.toml
crates.ioh20.4spider/Cargo.toml
crates.iotower0.5spider/Cargo.toml
crates.iopin-project-lite0.2spider/Cargo.toml
crates.iosonic-rs0.5spider/Cargo.toml
crates.iowreq5spider/Cargo.toml
crates.iowreq-util2spider/Cargo.toml
crates.iowhich8.0spider/Cargo.toml
crates.iohome0.5spider/Cargo.toml
crates.iozerocopy0.8spider/Cargo.toml
crates.iotempfile3spider/Cargo.toml
crates.iotikv-jemallocator0.6spider/Cargo.toml
crates.iomimalloc0.1spider/Cargo.toml
crates.iochromey2spider/Cargo.toml
crates.iospider_remote_cache0.4spider/Cargo.toml
crates.iospider_firewall2spider/Cargo.toml
crates.iospider_fingerprint2spider/Cargo.toml
crates.iospider_agent_types2.52.9spider/Cargo.toml
crates.iospider_agent2.52.9spider/Cargo.toml
crates.iotokio1spider_agent/Cargo.toml
crates.ioasync-trait0.1spider_agent/Cargo.toml
crates.ioreqwest0.13spider_agent/Cargo.toml
crates.ioserde1spider_agent/Cargo.toml
crates.ioserde_json1spider_agent/Cargo.toml
crates.iolog0.4spider_agent/Cargo.toml
crates.iothiserror2spider_agent/Cargo.toml
crates.iodashmap6spider_agent/Cargo.toml
crates.ioparking_lot0.12spider_agent/Cargo.toml
crates.iobase640.22spider_agent/Cargo.toml
crates.iospider_agent_types2.52.9spider_agent/Cargo.toml
crates.iospider_agent_html2.52.9spider_agent/Cargo.toml
crates.iolol_html2spider_agent/Cargo.toml
crates.ioaho-corasick1spider_agent/Cargo.toml
crates.iollm_models_spider0.1spider_agent/Cargo.toml
crates.ioasync-openai0.35spider_agent/Cargo.toml
crates.iotiktoken-rs0.11spider_agent/Cargo.toml
crates.iochromey2spider_agent/Cargo.toml
crates.iothirtyfour0.36spider_agent/Cargo.toml
crates.iotempfile3spider_agent/Cargo.toml
crates.iofutures0.3spider_agent/Cargo.toml
crates.iomemvid-rs1.2spider_agent/Cargo.toml
crates.iospider_skills0.1.7spider_agent/Cargo.toml
crates.ioaws-sdk-s31spider_agent/Cargo.toml
crates.ioaws-config1spider_agent/Cargo.toml
crates.iorustpython-vm0.4spider_agent/Cargo.toml
crates.iorustpython-pylib0.4spider_agent/Cargo.toml
crates.ioboa_engine0.20spider_agent/Cargo.toml
crates.ioboa_runtime0.20spider_agent/Cargo.toml
crates.ioflume0.11spider_agent/Cargo.toml
crates.iocap-std3spider_agent/Cargo.toml
crates.iolol_html2spider_agent_html/Cargo.toml
crates.ioaho-corasick1spider_agent_html/Cargo.toml
crates.ioserde1spider_agent_html/Cargo.toml
crates.ioserde_json1spider_agent_html/Cargo.toml
crates.iospider_agent_types2.52.9spider_agent_html/Cargo.toml
crates.ioserde1spider_agent_types/Cargo.toml
crates.ioserde_json1spider_agent_types/Cargo.toml
crates.ioaho-corasick1spider_agent_types/Cargo.toml
crates.iomemchr2spider_agent_types/Cargo.toml
crates.iollm_models_spider0.1.9spider_agent_types/Cargo.toml
crates.ioclap4spider_cli/Cargo.toml
crates.ioenv_logger0.11spider_cli/Cargo.toml
crates.ioserde_json1spider_cli/Cargo.toml
crates.iopercent-encoding2spider_cli/Cargo.toml
crates.iounicode-normalization0.1spider_cli/Cargo.toml
crates.iotokio1spider_cli/Cargo.toml
crates.ioreqwest0.13spider_cli/Cargo.toml
crates.iobase640.22spider_cli/Cargo.toml
crates.iosha20.10spider_cli/Cargo.toml
crates.iogetrandom0.2spider_cli/Cargo.toml
crates.iospider2spider_cli/Cargo.toml
crates.iospider_transformations2spider_cli/Cargo.toml
crates.iormcp1spider_mcp/Cargo.toml
crates.iotokio1spider_mcp/Cargo.toml
crates.ioserde1spider_mcp/Cargo.toml
crates.ioserde_json1spider_mcp/Cargo.toml
crates.ioclap4spider_mcp/Cargo.toml
crates.ioenv_logger0.11spider_mcp/Cargo.toml
crates.iolog0.4spider_mcp/Cargo.toml
crates.iodashmap6spider_mcp/Cargo.toml
crates.iouuid1spider_mcp/Cargo.toml
crates.iospider2spider_mcp/Cargo.toml
crates.iospider_transformations2spider_mcp/Cargo.toml
crates.ioindexmap2spider_utils/Cargo.toml
crates.iosxd-document0.3spider_utils/Cargo.toml
crates.iosxd-xpath0.4spider_utils/Cargo.toml
crates.ioserde1spider_utils/Cargo.toml
crates.iospider_scraper0.1spider_utils/Cargo.toml
crates.iolazy_static1spider_utils/Cargo.toml
crates.iohashbrown0.17spider_utils/Cargo.toml
crates.iolog0.4spider_utils/Cargo.toml
crates.iowarp0.4spider_worker/Cargo.toml
crates.iolazy_static1spider_worker/Cargo.toml
crates.ioenv_logger0.11spider_worker/Cargo.toml
crates.iohyper1spider_worker/Cargo.toml
crates.iohyper-util0.1spider_worker/Cargo.toml
crates.iotokio-rustls0.26spider_worker/Cargo.toml
crates.iorustls-pemfile2spider_worker/Cargo.toml
crates.iospider2spider_worker/Cargo.toml
原始 JSON 报告 机器可读
{
  "data": {
    "repo": {
      "topics": [
        "ai-agent",
        "automation",
        "crawler",
        "headless-chrome",
        "rust",
        "scraping",
        "spider",
        "web-crawler",
        "web-data",
        "web-scraping"
      ],
      "is_fork": false,
      "size_kb": 13285,
      "has_wiki": false,
      "homepage": "https://spider.cloud/github",
      "languages": {
        "Nix": 566,
        "Rust": 5107783,
        "Shell": 2016
      },
      "pushed_at": "2026-07-09T14:25:05Z",
      "created_at": "2018-01-07T18:49:20Z",
      "owner_type": "Organization",
      "updated_at": "2026-07-13T22:43:30Z",
      "description": "Get web data for AI agents and LLMs",
      "is_archived": false,
      "is_disabled": false,
      "license_spdx": "MIT",
      "default_branch": "main",
      "primary_language": "Rust"
    },
    "owner": {
      "blog": "https://spider.cloud",
      "name": "spider-rs",
      "type": "Organization",
      "login": "spider-rs",
      "company": null,
      "location": "United States of America",
      "followers": 105,
      "avatar_url": "https://avatars.githubusercontent.com/u/112983871?v=4",
      "created_at": "2022-09-06T20:34:03Z",
      "is_verified": null,
      "public_repos": 66,
      "account_age_days": 1406
    },
    "activity": {
      "releases_count": 100,
      "commits_last_year": 851,
      "latest_release_at": "2026-03-31T21:58:42Z",
      "latest_release_tag": "v2.52.2",
      "days_since_last_push": 4,
      "active_weeks_last_year": 42,
      "days_since_latest_release": 104,
      "mean_days_between_releases": 6
    },
    "community": {
      "has_readme": true,
      "has_license": true,
      "has_description": true,
      "has_contributing": true,
      "health_percentage": 87,
      "has_issue_template": false,
      "has_code_of_conduct": true,
      "has_pull_request_template": true
    },
    "ecosystem": {
      "packages": [
        {
          "name": "spider",
          "exists": true,
          "license": "MIT",
          "ecosystem": "crates",
          "matches_repo": true,
          "registry_url": "https://crates.io/crates/spider",
          "is_deprecated": false,
          "latest_version": "2.52.9",
          "repository_url": "https://github.com/spider-rs/spider",
          "versions_count": 2213,
          "total_downloads": 2048275,
          "dependents_count": null,
          "deprecation_note": null,
          "maintainers_count": null,
          "monthly_downloads": 23790,
          "first_published_at": "2018-02-05T12:33:26.444917Z",
          "latest_published_at": "2026-07-09T01:07:15.936634Z",
          "latest_version_yanked": false,
          "days_since_latest_publish": 5
        },
        {
          "name": "spider_agent",
          "exists": true,
          "license": "MIT",
          "ecosystem": "crates",
          "matches_repo": true,
          "registry_url": "https://crates.io/crates/spider_agent",
          "is_deprecated": false,
          "latest_version": "2.52.9",
          "repository_url": "https://github.com/spider-rs/spider",
          "versions_count": 434,
          "total_downloads": 16552,
          "dependents_count": null,
          "deprecation_note": null,
          "maintainers_count": null,
          "monthly_downloads": 3609,
          "first_published_at": "2026-02-03T14:11:35.274923Z",
          "latest_published_at": "2026-07-09T01:07:07.561448Z",
          "latest_version_yanked": false,
          "days_since_latest_publish": 5
        },
        {
          "name": "spider_agent_html",
          "exists": true,
          "license": "MIT",
          "ecosystem": "crates",
          "matches_repo": true,
          "registry_url": "https://crates.io/crates/spider_agent_html",
          "is_deprecated": false,
          "latest_version": "2.52.9",
          "repository_url": "https://github.com/spider-rs/spider",
          "versions_count": 386,
          "total_downloads": 16532,
          "dependents_count": null,
          "deprecation_note": null,
          "maintainers_count": null,
          "monthly_downloads": 3747,
          "first_published_at": "2026-02-11T00:04:13.053719Z",
          "latest_published_at": "2026-07-09T01:06:56.853980Z",
          "latest_version_yanked": false,
          "days_since_latest_publish": 5
        },
        {
          "name": "spider_agent_types",
          "exists": true,
          "license": "MIT",
          "ecosystem": "crates",
          "matches_repo": true,
          "registry_url": "https://crates.io/crates/spider_agent_types",
          "is_deprecated": false,
          "latest_version": "2.52.9",
          "repository_url": "https://github.com/spider-rs/spider",
          "versions_count": 388,
          "total_downloads": 77203,
          "dependents_count": null,
          "deprecation_note": null,
          "maintainers_count": null,
          "monthly_downloads": 18426,
          "first_published_at": "2026-02-11T00:04:06.364826Z",
          "latest_published_at": "2026-07-09T01:06:48.746875Z",
          "latest_version_yanked": false,
          "days_since_latest_publish": 5
        },
        {
          "name": "spider_cli",
          "exists": true,
          "license": "MIT",
          "ecosystem": "crates",
          "matches_repo": true,
          "registry_url": "https://crates.io/crates/spider_cli",
          "is_deprecated": false,
          "latest_version": "2.52.9",
          "repository_url": "https://github.com/spider-rs/spider",
          "versions_count": 2139,
          "total_downloads": 1811837,
          "dependents_count": null,
          "deprecation_note": null,
          "maintainers_count": null,
          "monthly_downloads": 2337,
          "first_published_at": "2022-04-15T19:10:15.768565Z",
          "latest_published_at": "2026-07-09T01:07:29.108413Z",
          "latest_version_yanked": false,
          "days_since_latest_publish": 5
        },
        {
          "name": "spider_mcp",
          "exists": true,
          "license": "MIT",
          "ecosystem": "crates",
          "matches_repo": true,
          "registry_url": "https://crates.io/crates/spider_mcp",
          "is_deprecated": false,
          "latest_version": "2.52.9",
          "repository_url": "https://github.com/spider-rs/spider",
          "versions_count": 256,
          "total_downloads": 3884,
          "dependents_count": null,
          "deprecation_note": null,
          "maintainers_count": null,
          "monthly_downloads": 858,
          "first_published_at": "2026-03-25T21:01:08.664915Z",
          "latest_published_at": "2026-07-09T01:07:45.835665Z",
          "latest_version_yanked": false,
          "days_since_latest_publish": 5
        }
      ]
    },
    "popularity": {
      "forks": 219,
      "stars": 2601,
      "watchers": 19,
      "open_issues_and_prs": 0
    },
    "ai_readiness": {
      "has_nix": true,
      "example_dirs": [
        "examples"
      ],
      "has_llms_txt": false,
      "has_dockerfile": false,
      "has_mcp_signal": true,
      "bootstrap_files": [],
      "api_schema_files": [],
      "has_devcontainer": false,
      "typecheck_configs": [],
      "largest_source_bytes": 829382,
      "source_files_sampled": 274,
      "oversized_source_files": 11,
      "agent_instruction_files": [
        "CLAUDE.md"
      ],
      "agent_instruction_max_bytes": 18586
    },
    "dependencies": {
      "manifests": [
        "Cargo.toml",
        "benches/Cargo.toml",
        "examples/Cargo.toml",
        "spider/Cargo.toml",
        "spider_agent/Cargo.toml",
        "spider_agent_html/Cargo.toml",
        "spider_agent_types/Cargo.toml",
        "spider_cli/Cargo.toml",
        "spider_mcp/Cargo.toml",
        "spider_utils/Cargo.toml",
        "spider_worker/Cargo.toml"
      ],
      "ecosystems": [
        "crates"
      ],
      "dependencies": [
        {
          "name": "criterion",
          "manifest": "benches/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.8"
        },
        {
          "name": "spider",
          "manifest": "benches/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": null
        },
        {
          "name": "spider_utils",
          "manifest": "benches/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": null
        },
        {
          "name": "spider",
          "manifest": "examples/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "spider_utils",
          "manifest": "examples/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "spider_transformations",
          "manifest": "examples/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "url",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "tokio-stream",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.1"
        },
        {
          "name": "hashbrown",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.17"
        },
        {
          "name": "log",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.4"
        },
        {
          "name": "percent-encoding",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "regex",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "ua_generator",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "^0.5"
        },
        {
          "name": "string_concat",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.0.1"
        },
        {
          "name": "lazy_static",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "ahash",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.8"
        },
        {
          "name": "arc-swap",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "dashmap",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "6"
        },
        {
          "name": "smallvec",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "num_cpus",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "bytes",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "serde",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "flexbuffers",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "25"
        },
        {
          "name": "itertools",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.14"
        },
        {
          "name": "case_insensitive_string",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.2"
        },
        {
          "name": "sitemap",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.4"
        },
        {
          "name": "chrono",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.4"
        },
        {
          "name": "cron",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.16"
        },
        {
          "name": "async-trait",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.1"
        },
        {
          "name": "strum",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.28"
        },
        {
          "name": "async_job",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.1"
        },
        {
          "name": "reqwest-middleware",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.5"
        },
        {
          "name": "http-cache-reqwest",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1.0.0-alpha.7"
        },
        {
          "name": "const_format",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.2"
        },
        {
          "name": "async-openai",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.35"
        },
        {
          "name": "tiktoken-rs",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.11"
        },
        {
          "name": "gemini-rust",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1.7"
        },
        {
          "name": "lol_html",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "cookie",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.18"
        },
        {
          "name": "serde_json",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "quick-xml",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.41"
        },
        {
          "name": "moka",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.12"
        },
        {
          "name": "fastrand",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "hickory-resolver",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.26"
        },
        {
          "name": "http-cache-semantics",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "3"
        },
        {
          "name": "http-cache",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1.0.0-alpha.5"
        },
        {
          "name": "http-global-cache",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.2.0"
        },
        {
          "name": "http",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "phf",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.13"
        },
        {
          "name": "auto_encoder",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.2"
        },
        {
          "name": "simdutf8",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.1"
        },
        {
          "name": "base64",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.22"
        },
        {
          "name": "string-interner",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.19"
        },
        {
          "name": "httpdate",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "rand",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.9"
        },
        {
          "name": "serde_regex",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "llm_json",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "thirtyfour",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.36"
        },
        {
          "name": "statrs",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.18"
        },
        {
          "name": "aho-corasick",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "memchr",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "tracing",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.1"
        },
        {
          "name": "sysinfo",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.38"
        },
        {
          "name": "sqlx",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.8"
        },
        {
          "name": "h2",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.4"
        },
        {
          "name": "tower",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.5"
        },
        {
          "name": "pin-project-lite",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.2"
        },
        {
          "name": "sonic-rs",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.5"
        },
        {
          "name": "wreq",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "5"
        },
        {
          "name": "wreq-util",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "which",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "8.0"
        },
        {
          "name": "home",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.5"
        },
        {
          "name": "zerocopy",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.8"
        },
        {
          "name": "tempfile",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "3"
        },
        {
          "name": "tikv-jemallocator",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.6"
        },
        {
          "name": "mimalloc",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.1"
        },
        {
          "name": "chromey",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "spider_remote_cache",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.4"
        },
        {
          "name": "spider_firewall",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "spider_fingerprint",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "spider_agent_types",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2.52.9"
        },
        {
          "name": "spider_agent",
          "manifest": "spider/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2.52.9"
        },
        {
          "name": "tokio",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "async-trait",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.1"
        },
        {
          "name": "reqwest",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.13"
        },
        {
          "name": "serde",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "serde_json",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "log",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.4"
        },
        {
          "name": "thiserror",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "dashmap",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "6"
        },
        {
          "name": "parking_lot",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.12"
        },
        {
          "name": "base64",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.22"
        },
        {
          "name": "spider_agent_types",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2.52.9"
        },
        {
          "name": "spider_agent_html",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2.52.9"
        },
        {
          "name": "lol_html",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "aho-corasick",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "llm_models_spider",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.1"
        },
        {
          "name": "async-openai",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.35"
        },
        {
          "name": "tiktoken-rs",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.11"
        },
        {
          "name": "chromey",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "thirtyfour",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.36"
        },
        {
          "name": "tempfile",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "3"
        },
        {
          "name": "futures",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.3"
        },
        {
          "name": "memvid-rs",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1.2"
        },
        {
          "name": "spider_skills",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.1.7"
        },
        {
          "name": "aws-sdk-s3",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "aws-config",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "rustpython-vm",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.4"
        },
        {
          "name": "rustpython-pylib",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.4"
        },
        {
          "name": "boa_engine",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.20"
        },
        {
          "name": "boa_runtime",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.20"
        },
        {
          "name": "flume",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.11"
        },
        {
          "name": "cap-std",
          "manifest": "spider_agent/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "3"
        },
        {
          "name": "lol_html",
          "manifest": "spider_agent_html/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "aho-corasick",
          "manifest": "spider_agent_html/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "serde",
          "manifest": "spider_agent_html/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "serde_json",
          "manifest": "spider_agent_html/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "spider_agent_types",
          "manifest": "spider_agent_html/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2.52.9"
        },
        {
          "name": "serde",
          "manifest": "spider_agent_types/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "serde_json",
          "manifest": "spider_agent_types/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "aho-corasick",
          "manifest": "spider_agent_types/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "memchr",
          "manifest": "spider_agent_types/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "llm_models_spider",
          "manifest": "spider_agent_types/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.1.9"
        },
        {
          "name": "clap",
          "manifest": "spider_cli/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "4"
        },
        {
          "name": "env_logger",
          "manifest": "spider_cli/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.11"
        },
        {
          "name": "serde_json",
          "manifest": "spider_cli/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "percent-encoding",
          "manifest": "spider_cli/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "unicode-normalization",
          "manifest": "spider_cli/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.1"
        },
        {
          "name": "tokio",
          "manifest": "spider_cli/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "reqwest",
          "manifest": "spider_cli/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.13"
        },
        {
          "name": "base64",
          "manifest": "spider_cli/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.22"
        },
        {
          "name": "sha2",
          "manifest": "spider_cli/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.10"
        },
        {
          "name": "getrandom",
          "manifest": "spider_cli/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.2"
        },
        {
          "name": "spider",
          "manifest": "spider_cli/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "spider_transformations",
          "manifest": "spider_cli/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "rmcp",
          "manifest": "spider_mcp/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "tokio",
          "manifest": "spider_mcp/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "serde",
          "manifest": "spider_mcp/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "serde_json",
          "manifest": "spider_mcp/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "clap",
          "manifest": "spider_mcp/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "4"
        },
        {
          "name": "env_logger",
          "manifest": "spider_mcp/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.11"
        },
        {
          "name": "log",
          "manifest": "spider_mcp/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.4"
        },
        {
          "name": "dashmap",
          "manifest": "spider_mcp/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "6"
        },
        {
          "name": "uuid",
          "manifest": "spider_mcp/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "spider",
          "manifest": "spider_mcp/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "spider_transformations",
          "manifest": "spider_mcp/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "indexmap",
          "manifest": "spider_utils/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "sxd-document",
          "manifest": "spider_utils/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.3"
        },
        {
          "name": "sxd-xpath",
          "manifest": "spider_utils/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.4"
        },
        {
          "name": "serde",
          "manifest": "spider_utils/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "spider_scraper",
          "manifest": "spider_utils/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.1"
        },
        {
          "name": "lazy_static",
          "manifest": "spider_utils/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "hashbrown",
          "manifest": "spider_utils/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.17"
        },
        {
          "name": "log",
          "manifest": "spider_utils/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.4"
        },
        {
          "name": "warp",
          "manifest": "spider_worker/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.4"
        },
        {
          "name": "lazy_static",
          "manifest": "spider_worker/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "env_logger",
          "manifest": "spider_worker/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.11"
        },
        {
          "name": "hyper",
          "manifest": "spider_worker/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "1"
        },
        {
          "name": "hyper-util",
          "manifest": "spider_worker/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.1"
        },
        {
          "name": "tokio-rustls",
          "manifest": "spider_worker/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "0.26"
        },
        {
          "name": "rustls-pemfile",
          "manifest": "spider_worker/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        },
        {
          "name": "spider",
          "manifest": "spider_worker/Cargo.toml",
          "ecosystem": "crates",
          "version_constraint": "2"
        }
      ]
    },
    "maintainership": {
      "issues": {
        "open_prs": 0,
        "merged_prs": 118,
        "open_issues": 0,
        "closed_ratio": 1,
        "closed_issues": 184,
        "closed_unmerged_prs": 57
      },
      "bus_factor": 1,
      "top_contributors": [
        {
          "type": "User",
          "login": "j-mendez",
          "commits": 2156,
          "avatar_url": "https://avatars.githubusercontent.com/u/8095978?u=6a2426a9c1e3982c9eb8ea985e2fb7b788cdc2b9&v=4"
        },
        {
          "type": "User",
          "login": "madeindjs",
          "commits": 60,
          "avatar_url": "https://avatars.githubusercontent.com/u/11815139?v=4"
        },
        {
          "type": "User",
          "login": "Dragnucs",
          "commits": 7,
          "avatar_url": "https://avatars.githubusercontent.com/u/6125772?u=d5c7bb28cfc59fa08fe7884b6eea35252fb4aa83&v=4"
        },
        {
          "type": "User",
          "login": "azudev4",
          "commits": 3,
          "avatar_url": "https://avatars.githubusercontent.com/u/186385229?u=585f51a2191603a90a4a97bc912db60e823c971f&v=4"
        },
        {
          "type": "User",
          "login": "zanmato",
          "commits": 2,
          "avatar_url": "https://avatars.githubusercontent.com/u/580791?u=878f7feb2339f6517c5c21ef0e894f9e3814cfac&v=4"
        },
        {
          "type": "User",
          "login": "CaptainLazarus",
          "commits": 2,
          "avatar_url": "https://avatars.githubusercontent.com/u/35800668?u=2fffc8d1fe80f578213eae6a32d8a248c10cf20b&v=4"
        },
        {
          "type": "User",
          "login": "incizzle",
          "commits": 1,
          "avatar_url": "https://avatars.githubusercontent.com/u/19642216?u=ab31708b28d004bb7ca2fbfcb9c9bf7f55cdc5e5&v=4"
        },
        {
          "type": "User",
          "login": "jmikedupont2",
          "commits": 1,
          "avatar_url": "https://avatars.githubusercontent.com/u/16427113?u=2bdad12714de646188f98a07736a54f765ad5e3b&v=4"
        },
        {
          "type": "User",
          "login": "0x77dev",
          "commits": 1,
          "avatar_url": "https://avatars.githubusercontent.com/u/46429701?u=32c1b94910337c15b0761da1a76fbec14ee0b2e6&v=4"
        },
        {
          "type": "User",
          "login": "pwnwriter",
          "commits": 1,
          "avatar_url": "https://avatars.githubusercontent.com/u/90331517?u=69e445f801cc183e3657c7890b3178987577c5fa&v=4"
        }
      ],
      "contributors_sampled": 32,
      "top_contributor_share": 0.956
    },
    "quality_signals": {
      "has_ci": true,
      "has_tests": true,
      "ci_workflows": [
        "audit.yml",
        "bench.yml",
        "lint.yml",
        "release.yml",
        "rust.yml",
        "stale.yml"
      ],
      "has_docs_dir": false,
      "linter_configs": [],
      "has_editorconfig": true,
      "has_linter_config": false,
      "has_precommit_config": false
    },
    "security_signals": {
      "lockfiles": [
        "Cargo.lock"
      ],
      "scorecard": {
        "checks": [
          {
            "name": "Binary-Artifacts",
            "score": 10,
            "reason": "no binaries found in the repo",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#binary-artifacts"
          },
          {
            "name": "Branch-Protection",
            "score": 0,
            "reason": "branch protection not enabled on development/release branches",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#branch-protection"
          },
          {
            "name": "CI-Tests",
            "score": 5,
            "reason": "5 out of 9 merged PRs checked by a CI test -- score normalized to 5",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#ci-tests"
          },
          {
            "name": "CII-Best-Practices",
            "score": 0,
            "reason": "no effort to earn an OpenSSF best practices badge detected",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#cii-best-practices"
          },
          {
            "name": "Code-Review",
            "score": 1,
            "reason": "Found 4/29 approved changesets -- score normalized to 1",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#code-review"
          },
          {
            "name": "Contributors",
            "score": 6,
            "reason": "project has 2 contributing companies or organizations -- score normalized to 6",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#contributors"
          },
          {
            "name": "Dangerous-Workflow",
            "score": 10,
            "reason": "no dangerous workflow patterns detected",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#dangerous-workflow"
          },
          {
            "name": "Dependency-Update-Tool",
            "score": 10,
            "reason": "update tool detected",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#dependency-update-tool"
          },
          {
            "name": "Fuzzing",
            "score": 0,
            "reason": "project is not fuzzed",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#fuzzing"
          },
          {
            "name": "License",
            "score": 10,
            "reason": "license file detected",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#license"
          },
          {
            "name": "Maintained",
            "score": 10,
            "reason": "30 commit(s) and 3 issue activity found in the last 90 days -- score normalized to 10",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#maintained"
          },
          {
            "name": "Packaging",
            "score": null,
            "reason": "packaging workflow not detected",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#packaging"
          },
          {
            "name": "Pinned-Dependencies",
            "score": 0,
            "reason": "dependency not pinned by hash detected -- score normalized to 0",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#pinned-dependencies"
          },
          {
            "name": "SAST",
            "score": 0,
            "reason": "SAST tool is not run on all commits -- score normalized to 0",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#sast"
          },
          {
            "name": "Security-Policy",
            "score": 10,
            "reason": "security policy file detected",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#security-policy"
          },
          {
            "name": "Signed-Releases",
            "score": null,
            "reason": "no releases found",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#signed-releases"
          },
          {
            "name": "Token-Permissions",
            "score": 0,
            "reason": "detected GitHub workflow tokens with excessive permissions",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#token-permissions"
          },
          {
            "name": "Vulnerabilities",
            "score": 0,
            "reason": "25 existing vulnerabilities detected",
            "documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#vulnerabilities"
          }
        ],
        "commit": "73e497c46b4e7774b8421ae2d54a0e5bee8fd9f8",
        "ran_at": "2026-07-14T05:53:49Z",
        "aggregate_score": 4.7,
        "scorecard_version": "v5.5.0"
      },
      "has_codeql_workflow": false,
      "has_security_policy": true,
      "has_dependabot_config": true
    }
  },
  "config": {
    "disabled_metrics": [],
    "disabled_categories": [],
    "disabled_components": {}
  },
  "source": {
    "url": "https://github.com/spider-rs/spider",
    "host": "github.com",
    "name": "spider",
    "owner": "spider-rs"
  },
  "metrics": {
    "overall": {
      "key": "overall",
      "band": "good",
      "name": "Overall health",
      "note": null,
      "notes": [],
      "value": 71,
      "inputs": {
        "security": 47,
        "vitality": 92,
        "community": 85,
        "governance": 64,
        "engineering": 64
      },
      "components": []
    },
    "categories": [
      {
        "key": "vitality",
        "band": "excellent",
        "name": "Vitality",
        "value": 92,
        "weight": 0.22,
        "metrics": [
          {
            "key": "development_activity",
            "band": "excellent",
            "name": "Development activity",
            "note": null,
            "notes": [],
            "value": 93,
            "inputs": {
              "commits_last_year": 851,
              "human_commit_share": null,
              "days_since_last_push": 4,
              "active_weeks_last_year": 42
            },
            "components": [
              {
                "key": "push_recency",
                "name": "Push recency",
                "detail": "last push 4 days ago",
                "points": 36,
                "status": "met",
                "details": [
                  {
                    "code": "push_recency",
                    "params": {
                      "days": 4
                    }
                  }
                ],
                "max_points": 36
              },
              {
                "key": "commit_cadence",
                "name": "Commit cadence",
                "detail": "42/52 weeks with commits",
                "points": 29.1,
                "status": "partial",
                "details": [
                  {
                    "code": "commit_cadence_weeks",
                    "params": {
                      "weeks": 42
                    }
                  }
                ],
                "max_points": 36
              },
              {
                "key": "commit_volume",
                "name": "Commit volume",
                "detail": "851 commits in the last year",
                "points": 18,
                "status": "met",
                "details": [
                  {
                    "code": "commits_last_year",
                    "params": {
                      "count": 851
                    }
                  }
                ],
                "max_points": 18
              },
              {
                "key": "openssf_scorecard_maintained",
                "name": "OpenSSF Scorecard: Maintained",
                "detail": "30 commit(s) and 3 issue activity found in the last 90 days -- score normalized to 10",
                "points": 10,
                "status": "met",
                "details": [],
                "max_points": 10
              }
            ]
          },
          {
            "key": "release_discipline",
            "band": "excellent",
            "name": "Release discipline",
            "note": "Excluded from scoring (no data or not applicable): OpenSSF Scorecard: Signed-Releases. Remaining weights renormalized.",
            "notes": [
              {
                "code": "excluded_no_data",
                "params": {
                  "components": [
                    "openssf_scorecard_signed_releases"
                  ]
                }
              },
              {
                "code": "weights_renormalized",
                "params": {}
              }
            ],
            "value": 90,
            "inputs": {
              "releases_count": 100,
              "latest_release_tag": "v2.52.2",
              "releases_from_tags": false,
              "days_since_latest_release": 104,
              "mean_days_between_releases": 6
            },
            "components": [
              {
                "key": "ships_releases",
                "name": "Ships releases",
                "detail": "100 releases published",
                "points": 27,
                "status": "met",
                "details": [
                  {
                    "code": "releases_published",
                    "params": {
                      "count": 100
                    }
                  }
                ],
                "max_points": 27
              },
              {
                "key": "release_recency",
                "name": "Release recency",
                "detail": "latest release 104 days ago",
                "points": 27,
                "status": "partial",
                "details": [
                  {
                    "code": "release_recency",
                    "params": {
                      "days": 104
                    }
                  }
                ],
                "max_points": 36
              },
              {
                "key": "release_cadence",
                "name": "Release cadence",
                "detail": "a release every ~6 days",
                "points": 27,
                "status": "met",
                "details": [
                  {
                    "code": "release_cadence",
                    "params": {
                      "gap": 6
                    }
                  }
                ],
                "max_points": 27
              },
              {
                "key": "openssf_scorecard_signed_releases",
                "name": "OpenSSF Scorecard: Signed-Releases",
                "detail": "no releases found",
                "points": 0,
                "status": "excluded",
                "details": [
                  {
                    "code": "no_data",
                    "params": {}
                  }
                ],
                "max_points": 10
              }
            ]
          },
          {
            "key": "abandonment",
            "band": "excellent",
            "name": "Abandonment",
            "note": null,
            "notes": [],
            "value": 100,
            "inputs": {
              "cap": null,
              "state": "unverified",
              "guards": [],
              "signals": [],
              "red_flag": false,
              "multiplier_pct": 100,
              "declared_reason": null,
              "unverified_reason": "no_commit_sample",
              "unanswered_open_prs": null,
              "unanswered_open_issues": null,
              "days_since_last_merged_pr": null,
              "days_since_last_human_commit": null,
              "days_since_last_human_commit_is_floor": false
            },
            "components": [
              {
                "key": "project_is_still_maintained",
                "name": "Project is still maintained",
                "detail": "maintenance record not established from the collected data",
                "points": 100,
                "status": "met",
                "details": [
                  {
                    "code": "abandonment_unverified",
                    "params": {}
                  }
                ],
                "max_points": 100
              }
            ]
          }
        ],
        "description": "Is the project alive — is code being written and are releases shipping?"
      },
      {
        "key": "community",
        "band": "excellent",
        "name": "Community & Adoption",
        "value": 85,
        "weight": 0.18,
        "metrics": [
          {
            "key": "popularity",
            "band": "good",
            "name": "Popularity & adoption",
            "note": null,
            "notes": [],
            "value": 82,
            "inputs": {
              "forks": 219,
              "stars": 2601,
              "watchers": 19,
              "growth_state": "unverified",
              "growth_factor_pct": 100,
              "growth_unverified_reason": "no_history"
            },
            "components": [
              {
                "key": "stars",
                "name": "Stars",
                "detail": "2,601 stars",
                "points": 55.4,
                "status": "partial",
                "details": [
                  {
                    "code": "stars",
                    "params": {
                      "count": 2601
                    }
                  }
                ],
                "max_points": 60
              },
              {
                "key": "forks",
                "name": "Forks",
                "detail": "219 forks",
                "points": 19.5,
                "status": "partial",
                "details": [
                  {
                    "code": "forks",
                    "params": {
                      "count": 219
                    }
                  }
                ],
                "max_points": 25
              },
              {
                "key": "watchers",
                "name": "Watchers",
                "detail": "19 watchers",
                "points": 7,
                "status": "partial",
                "details": [
                  {
                    "code": "watchers",
                    "params": {
                      "count": 19
                    }
                  }
                ],
                "max_points": 15
              }
            ]
          },
          {
            "key": "community_health",
            "band": "excellent",
            "name": "Community health",
            "note": null,
            "notes": [],
            "value": 92,
            "inputs": {
              "has_readme": true,
              "has_license": true,
              "has_contributing": true,
              "has_issue_template": false,
              "has_code_of_conduct": true,
              "has_pull_request_template": true
            },
            "components": [
              {
                "key": "readme",
                "name": "README",
                "detail": null,
                "points": 22.5,
                "status": "met",
                "details": [],
                "max_points": 22.5
              },
              {
                "key": "license",
                "name": "License",
                "detail": "recognized license (MIT)",
                "points": 22.5,
                "status": "met",
                "details": [
                  {
                    "code": "license_standard",
                    "params": {}
                  },
                  {
                    "code": "license_spdx",
                    "params": {
                      "spdx": "MIT"
                    }
                  }
                ],
                "max_points": 22.5
              },
              {
                "key": "contributing_guide",
                "name": "CONTRIBUTING guide",
                "detail": null,
                "points": 18,
                "status": "met",
                "details": [],
                "max_points": 18
              },
              {
                "key": "code_of_conduct",
                "name": "Code of conduct",
                "detail": null,
                "points": 13.5,
                "status": "met",
                "details": [],
                "max_points": 13.5
              },
              {
                "key": "issue_template",
                "name": "Issue template",
                "detail": null,
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 7.2
              },
              {
                "key": "pr_template",
                "name": "PR template",
                "detail": null,
                "points": 6.3,
                "status": "met",
                "details": [],
                "max_points": 6.3
              }
            ]
          },
          {
            "key": "ecosystem_adoption",
            "band": "good",
            "name": "Ecosystem adoption (downloads)",
            "note": "Excluded from scoring (no data or not applicable): Registry dependents. Remaining weights renormalized.",
            "notes": [
              {
                "code": "excluded_no_data",
                "params": {
                  "components": [
                    "registry_dependents"
                  ]
                }
              },
              {
                "code": "weights_renormalized",
                "params": {}
              }
            ],
            "value": 79,
            "inputs": {
              "packages": [
                "spider",
                "spider_agent",
                "spider_agent_html",
                "spider_agent_types",
                "spider_cli",
                "spider_mcp"
              ],
              "dependents": null,
              "ecosystems": "crates",
              "total_downloads": 3974283,
              "monthly_downloads": 52767
            },
            "components": [
              {
                "key": "monthly_downloads",
                "name": "Monthly downloads",
                "detail": "52,767 downloads/month across crates",
                "points": 63,
                "status": "partial",
                "details": [
                  {
                    "code": "downloads_monthly",
                    "params": {
                      "count": 52767,
                      "ecosystems": "crates"
                    }
                  }
                ],
                "max_points": 80
              },
              {
                "key": "registry_dependents",
                "name": "Registry dependents",
                "detail": "not reported by this ecosystem",
                "points": 0,
                "status": "excluded",
                "details": [
                  {
                    "code": "not_reported_by_this_ecosystem",
                    "params": {}
                  }
                ],
                "max_points": 20
              }
            ]
          }
        ],
        "description": "Does the project have users, downloads, attention, and a welcoming setup for contributors?"
      },
      {
        "key": "governance",
        "band": "moderate",
        "name": "Sustainability & Governance",
        "value": 64,
        "weight": 0.24,
        "metrics": [
          {
            "key": "maintainer_resilience",
            "band": "at_risk",
            "name": "Maintainer resilience (bus factor)",
            "note": null,
            "notes": [],
            "value": 30,
            "inputs": {
              "bus_factor": 1,
              "contributors_sampled": 32,
              "top_contributor_share": 0.956
            },
            "components": [
              {
                "key": "bus_factor",
                "name": "Bus factor",
                "detail": "1 contributor(s) cover half of all commits",
                "points": 9,
                "status": "partial",
                "details": [
                  {
                    "code": "bus_factor",
                    "params": {
                      "count": 1
                    }
                  }
                ],
                "max_points": 54
              },
              {
                "key": "commit_distribution",
                "name": "Commit distribution",
                "detail": "top contributor authored 96% of commits",
                "points": 1,
                "status": "partial",
                "details": [
                  {
                    "code": "top_contributor_share",
                    "params": {
                      "share": 96
                    }
                  }
                ],
                "max_points": 22.5
              },
              {
                "key": "contributor_breadth",
                "name": "Contributor breadth",
                "detail": "32 contributors",
                "points": 13.5,
                "status": "met",
                "details": [
                  {
                    "code": "contributors_sampled",
                    "params": {
                      "count": 32
                    }
                  }
                ],
                "max_points": 13.5
              },
              {
                "key": "openssf_scorecard_contributors",
                "name": "OpenSSF Scorecard: Contributors",
                "detail": "project has 2 contributing companies or organizations -- score normalized to 6",
                "points": 6,
                "status": "partial",
                "details": [],
                "max_points": 10
              }
            ]
          },
          {
            "key": "responsiveness",
            "band": "good",
            "name": "Issue & PR responsiveness",
            "note": null,
            "notes": [],
            "value": 74,
            "inputs": {
              "merged_prs": 118,
              "open_issues": 0,
              "closed_issues": 184,
              "issue_closed_ratio": 1,
              "closed_unmerged_prs": 57
            },
            "components": [
              {
                "key": "issue_resolution",
                "name": "Issue resolution",
                "detail": "100% of issues closed",
                "points": 46.8,
                "status": "met",
                "details": [
                  {
                    "code": "issues_closed_share",
                    "params": {
                      "share": 100
                    }
                  }
                ],
                "max_points": 46.75
              },
              {
                "key": "pr_acceptance",
                "name": "PR acceptance",
                "detail": "118/175 decided PRs merged",
                "points": 25.8,
                "status": "partial",
                "details": [
                  {
                    "code": "decided_prs_merged",
                    "params": {
                      "merged": 118,
                      "decided": 175
                    }
                  }
                ],
                "max_points": 38.25
              },
              {
                "key": "openssf_scorecard_code_review",
                "name": "OpenSSF Scorecard: Code-Review",
                "detail": "Found 4/29 approved changesets -- score normalized to 1",
                "points": 1.5,
                "status": "partial",
                "details": [],
                "max_points": 15
              }
            ]
          },
          {
            "key": "stewardship",
            "band": "moderate",
            "name": "Ownership & stewardship",
            "note": null,
            "notes": [],
            "value": 65,
            "inputs": {
              "followers": 105,
              "owner_type": "Organization",
              "is_verified": null,
              "owner_login": "spider-rs",
              "public_repos": 66,
              "account_age_days": 1406
            },
            "components": [
              {
                "key": "ownership_backing",
                "name": "Ownership backing",
                "detail": "organization-owned",
                "points": 30,
                "status": "met",
                "details": [
                  {
                    "code": "owner_organization",
                    "params": {}
                  }
                ],
                "max_points": 30
              },
              {
                "key": "verified_domain",
                "name": "Verified domain",
                "detail": null,
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 20
              },
              {
                "key": "owner_reach",
                "name": "Owner reach",
                "detail": "105 followers of spider-rs",
                "points": 14.6,
                "status": "partial",
                "details": [
                  {
                    "code": "owner_followers",
                    "params": {
                      "count": 105,
                      "login": "spider-rs"
                    }
                  }
                ],
                "max_points": 25
              },
              {
                "key": "track_record",
                "name": "Track record",
                "detail": "66 public repos, account ~3 yr old",
                "points": 20.7,
                "status": "partial",
                "details": [
                  {
                    "code": "public_repos",
                    "params": {
                      "count": 66
                    }
                  },
                  {
                    "code": "account_age_years",
                    "params": {
                      "years": 3
                    }
                  }
                ],
                "max_points": 25
              }
            ]
          },
          {
            "key": "package_maintenance",
            "band": "excellent",
            "name": "Package maintenance",
            "note": null,
            "notes": [],
            "value": 100,
            "inputs": {
              "packages": [
                "spider",
                "spider_agent",
                "spider_agent_html",
                "spider_agent_types",
                "spider_cli",
                "spider_mcp"
              ],
              "ecosystems": "crates",
              "any_deprecated": false,
              "min_days_since_publish": 5
            },
            "components": [
              {
                "key": "published_resolvable",
                "name": "Published & resolvable",
                "detail": "6 package(s) on crates",
                "points": 25,
                "status": "met",
                "details": [
                  {
                    "code": "packages_published",
                    "params": {
                      "count": 6,
                      "ecosystems": "crates"
                    }
                  }
                ],
                "max_points": 25
              },
              {
                "key": "publish_recency",
                "name": "Publish recency",
                "detail": "latest publish 5 days ago",
                "points": 35,
                "status": "met",
                "details": [
                  {
                    "code": "publish_recency",
                    "params": {
                      "days": 5
                    }
                  }
                ],
                "max_points": 35
              },
              {
                "key": "version_history",
                "name": "Version history",
                "detail": "2213 published versions",
                "points": 20,
                "status": "met",
                "details": [
                  {
                    "code": "published_versions",
                    "params": {
                      "count": 2213
                    }
                  }
                ],
                "max_points": 20
              },
              {
                "key": "not_deprecated",
                "name": "Not deprecated",
                "detail": "active, not deprecated or yanked",
                "points": 20,
                "status": "met",
                "details": [
                  {
                    "code": "package_not_deprecated",
                    "params": {}
                  }
                ],
                "max_points": 20
              }
            ]
          }
        ],
        "description": "Will the project survive its people — bus factor, responsiveness, who backs it, and package upkeep?"
      },
      {
        "key": "engineering",
        "band": "moderate",
        "name": "Engineering Quality",
        "value": 64,
        "weight": 0.2,
        "metrics": [
          {
            "key": "engineering_practices",
            "band": "moderate",
            "name": "Engineering practices",
            "note": null,
            "notes": [],
            "value": 64,
            "inputs": {
              "has_ci": true,
              "has_tests": true,
              "has_editorconfig": true,
              "has_linter_config": false,
              "has_precommit_config": false
            },
            "components": [
              {
                "key": "ci_workflows",
                "name": "CI workflows",
                "detail": "6 workflow(s)",
                "points": 24,
                "status": "met",
                "details": [
                  {
                    "code": "ci_workflows",
                    "params": {
                      "count": 6
                    }
                  }
                ],
                "max_points": 24
              },
              {
                "key": "tests_present",
                "name": "Tests present",
                "detail": null,
                "points": 24,
                "status": "met",
                "details": [],
                "max_points": 24
              },
              {
                "key": "linter_config",
                "name": "Linter config",
                "detail": null,
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 16
              },
              {
                "key": "pre_commit_hooks",
                "name": "Pre-commit hooks",
                "detail": null,
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 9.6
              },
              {
                "key": "editorconfig",
                "name": ".editorconfig",
                "detail": null,
                "points": 6.4,
                "status": "met",
                "details": [],
                "max_points": 6.4
              },
              {
                "key": "openssf_scorecard_ci_tests",
                "name": "OpenSSF Scorecard: CI-Tests",
                "detail": "5 out of 9 merged PRs checked by a CI test -- score normalized to 5",
                "points": 10,
                "status": "partial",
                "details": [],
                "max_points": 20
              }
            ]
          },
          {
            "key": "documentation",
            "band": "moderate",
            "name": "Documentation",
            "note": null,
            "notes": [],
            "value": 65,
            "inputs": {
              "topics": [
                "ai-agent",
                "automation",
                "crawler",
                "headless-chrome",
                "rust",
                "scraping",
                "spider",
                "web-crawler",
                "web-data",
                "web-scraping"
              ],
              "has_wiki": false,
              "homepage": "https://spider.cloud/github",
              "has_readme": true,
              "has_docs_dir": false,
              "has_description": true
            },
            "components": [
              {
                "key": "readme",
                "name": "README",
                "detail": null,
                "points": 30,
                "status": "met",
                "details": [],
                "max_points": 30
              },
              {
                "key": "documentation_directory",
                "name": "Documentation directory",
                "detail": null,
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 25
              },
              {
                "key": "documentation_homepage_site",
                "name": "Documentation / homepage site",
                "detail": "https://spider.cloud/github",
                "points": 15,
                "status": "met",
                "details": [],
                "max_points": 15
              },
              {
                "key": "repository_description",
                "name": "Repository description",
                "detail": null,
                "points": 10,
                "status": "met",
                "details": [],
                "max_points": 10
              },
              {
                "key": "topics",
                "name": "Topics",
                "detail": "10 topics",
                "points": 10,
                "status": "met",
                "details": [
                  {
                    "code": "topics_count",
                    "params": {
                      "count": 10
                    }
                  }
                ],
                "max_points": 10
              },
              {
                "key": "wiki",
                "name": "Wiki",
                "detail": null,
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 10
              }
            ]
          }
        ],
        "description": "Are baseline engineering and documentation practices in place?"
      },
      {
        "key": "security",
        "band": "at_risk",
        "name": "Security",
        "value": 47,
        "weight": 0.16,
        "metrics": [
          {
            "key": "security_posture",
            "band": "at_risk",
            "name": "Security posture",
            "note": "Excluded from scoring (no data or not applicable): Packaging, Signed-Releases. Remaining weights renormalized.",
            "notes": [
              {
                "code": "excluded_no_data",
                "params": {
                  "components": [
                    "packaging",
                    "signed_releases"
                  ]
                }
              },
              {
                "code": "weights_renormalized",
                "params": {}
              }
            ],
            "value": 47,
            "inputs": {
              "source": "openssf_scorecard",
              "checks_evaluated": 16,
              "scorecard_version": "v5.5.0",
              "checks_inconclusive": 2,
              "scorecard_aggregate": 4.7
            },
            "components": [
              {
                "key": "binary_artifacts",
                "name": "Binary-Artifacts",
                "detail": "no binaries found in the repo",
                "points": 7.5,
                "status": "met",
                "details": [],
                "max_points": 7.5
              },
              {
                "key": "branch_protection",
                "name": "Branch-Protection",
                "detail": "branch protection not enabled on development/release branches",
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 7.5
              },
              {
                "key": "ci_tests",
                "name": "CI-Tests",
                "detail": "5 out of 9 merged PRs checked by a CI test -- score normalized to 5",
                "points": 1.2,
                "status": "partial",
                "details": [],
                "max_points": 2.5
              },
              {
                "key": "cii_best_practices",
                "name": "CII-Best-Practices",
                "detail": "no effort to earn an OpenSSF best practices badge detected",
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 2.5
              },
              {
                "key": "code_review",
                "name": "Code-Review",
                "detail": "Found 4/29 approved changesets -- score normalized to 1",
                "points": 0.8,
                "status": "partial",
                "details": [],
                "max_points": 7.5
              },
              {
                "key": "contributors",
                "name": "Contributors",
                "detail": "project has 2 contributing companies or organizations -- score normalized to 6",
                "points": 1.5,
                "status": "partial",
                "details": [],
                "max_points": 2.5
              },
              {
                "key": "dangerous_workflow",
                "name": "Dangerous-Workflow",
                "detail": "no dangerous workflow patterns detected",
                "points": 10,
                "status": "met",
                "details": [],
                "max_points": 10
              },
              {
                "key": "dependency_update_tool",
                "name": "Dependency-Update-Tool",
                "detail": "update tool detected",
                "points": 7.5,
                "status": "met",
                "details": [],
                "max_points": 7.5
              },
              {
                "key": "fuzzing",
                "name": "Fuzzing",
                "detail": "project is not fuzzed",
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 5
              },
              {
                "key": "license",
                "name": "License",
                "detail": "license file detected",
                "points": 2.5,
                "status": "met",
                "details": [],
                "max_points": 2.5
              },
              {
                "key": "maintained",
                "name": "Maintained",
                "detail": "30 commit(s) and 3 issue activity found in the last 90 days -- score normalized to 10",
                "points": 7.5,
                "status": "met",
                "details": [],
                "max_points": 7.5
              },
              {
                "key": "packaging",
                "name": "Packaging",
                "detail": "packaging workflow not detected",
                "points": 0,
                "status": "excluded",
                "details": [
                  {
                    "code": "no_data",
                    "params": {}
                  }
                ],
                "max_points": 5
              },
              {
                "key": "pinned_dependencies",
                "name": "Pinned-Dependencies",
                "detail": "dependency not pinned by hash detected -- score normalized to 0",
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 5
              },
              {
                "key": "sast",
                "name": "SAST",
                "detail": "SAST tool is not run on all commits -- score normalized to 0",
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 5
              },
              {
                "key": "security_policy",
                "name": "Security-Policy",
                "detail": "security policy file detected",
                "points": 5,
                "status": "met",
                "details": [],
                "max_points": 5
              },
              {
                "key": "signed_releases",
                "name": "Signed-Releases",
                "detail": "no releases found",
                "points": 0,
                "status": "excluded",
                "details": [
                  {
                    "code": "no_data",
                    "params": {}
                  }
                ],
                "max_points": 7.5
              },
              {
                "key": "token_permissions",
                "name": "Token-Permissions",
                "detail": "detected GitHub workflow tokens with excessive permissions",
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 7.5
              },
              {
                "key": "vulnerabilities",
                "name": "Vulnerabilities",
                "detail": "25 existing vulnerabilities detected",
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 7.5
              }
            ]
          },
          {
            "key": "high_risk_jurisdiction_exposure",
            "band": "excellent",
            "name": "High-Risk Jurisdiction Exposure",
            "note": "Only high-confidence self-published location evidence affects this multiplier. Ambiguous matches are review-only; country evidence is not proof of nationality, citizenship, legal registration, malicious intent, or sanctions status.",
            "notes": [
              {
                "code": "jurisdiction_evidence_limits",
                "params": {}
              }
            ],
            "value": 100,
            "inputs": {
              "meaning": "self-published location evidence; not nationality or citizenship",
              "red_flag": false,
              "exposures": [],
              "policy_countries": [
                "Russia",
                "Iran",
                "North Korea"
              ],
              "review_only_matches": 0,
              "assessed_self_published_locations": 7
            },
            "components": [
              {
                "key": "policy_exposure_multiplier",
                "name": "Policy exposure multiplier",
                "detail": "no confirmed policy-scope location match",
                "points": 100,
                "status": "met",
                "details": [
                  {
                    "code": "jurisdiction_no_match",
                    "params": {}
                  }
                ],
                "max_points": 100
              }
            ]
          }
        ],
        "description": "Are visible security and supply-chain practices strong, with no malicious dependency and no unresolved high-risk jurisdiction exposure?"
      },
      {
        "key": "ai_readiness",
        "band": "moderate",
        "name": "AI Readiness",
        "value": 67,
        "weight": 0,
        "metrics": [
          {
            "key": "ai_agent_context",
            "band": "good",
            "name": "Agent context & guidance",
            "note": "Excluded from scoring (no data or not applicable): Legible commit history. Remaining weights renormalized.",
            "notes": [
              {
                "code": "excluded_no_data",
                "params": {
                  "components": [
                    "legible_commit_history"
                  ]
                }
              },
              {
                "code": "weights_renormalized",
                "params": {}
              }
            ],
            "value": 75,
            "inputs": {
              "has_llms_txt": false,
              "legible_history_share": null,
              "agent_instruction_files": [
                "CLAUDE.md"
              ],
              "agent_instruction_max_bytes": 18586
            },
            "components": [
              {
                "key": "agent_instructions",
                "name": "Agent instructions",
                "detail": "CLAUDE.md",
                "points": 45,
                "status": "met",
                "details": [
                  {
                    "code": "file_list",
                    "params": {
                      "files": "CLAUDE.md"
                    }
                  }
                ],
                "max_points": 45
              },
              {
                "key": "machine_readable_docs_llms_txt",
                "name": "Machine-readable docs (llms.txt)",
                "detail": null,
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 15
              },
              {
                "key": "legible_commit_history",
                "name": "Legible commit history",
                "detail": "no data",
                "points": 0,
                "status": "excluded",
                "details": [
                  {
                    "code": "no_data",
                    "params": {}
                  }
                ],
                "max_points": 40
              }
            ]
          },
          {
            "key": "ai_verify_loop",
            "band": "moderate",
            "name": "Verify loop (build / test / typecheck)",
            "note": "Excluded from scoring (no data or not applicable): Demonstrated agent practice. Remaining weights renormalized.",
            "notes": [
              {
                "code": "excluded_no_data",
                "params": {
                  "components": [
                    "demonstrated_agent_practice"
                  ]
                }
              },
              {
                "code": "weights_renormalized",
                "params": {}
              }
            ],
            "value": 53,
            "inputs": {
              "has_nix": true,
              "has_tests": true,
              "lockfiles": [
                "Cargo.lock"
              ],
              "has_dockerfile": false,
              "typed_language": true,
              "bootstrap_files": [],
              "has_devcontainer": false,
              "has_linter_config": false,
              "typecheck_configs": [],
              "agent_commit_share": null,
              "toolchain_manifests": [],
              "dependency_bot_commit_share": 0
            },
            "components": [
              {
                "key": "one_command_bootstrap",
                "name": "One-command bootstrap",
                "detail": null,
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 18
              },
              {
                "key": "automated_tests",
                "name": "Automated tests",
                "detail": null,
                "points": 22,
                "status": "met",
                "details": [],
                "max_points": 22
              },
              {
                "key": "lint_format_config",
                "name": "Lint / format config",
                "detail": null,
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 11
              },
              {
                "key": "static_type_checking",
                "name": "Static type checking",
                "detail": "Rust (statically typed)",
                "points": 11,
                "status": "met",
                "details": [
                  {
                    "code": "statically_typed_language",
                    "params": {
                      "language": "Rust"
                    }
                  }
                ],
                "max_points": 11
              },
              {
                "key": "reproducible_environment",
                "name": "Reproducible environment",
                "detail": "Nix, lockfile",
                "points": 10,
                "status": "met",
                "details": [
                  {
                    "code": "file_list",
                    "params": {
                      "files": "Nix, lockfile"
                    }
                  }
                ],
                "max_points": 10
              },
              {
                "key": "demonstrated_agent_practice",
                "name": "Demonstrated agent practice",
                "detail": "no data",
                "points": 0,
                "status": "excluded",
                "details": [
                  {
                    "code": "no_data",
                    "params": {}
                  }
                ],
                "max_points": 10
              },
              {
                "key": "automated_maintenance",
                "name": "Automated maintenance",
                "detail": "dependency automation configured, none observed in the sampled commits",
                "points": 5,
                "status": "partial",
                "details": [
                  {
                    "code": "dependency_bot_config_only",
                    "params": {}
                  }
                ],
                "max_points": 8
              },
              {
                "key": "openssf_scorecard_pinned_dependencies",
                "name": "OpenSSF Scorecard: Pinned-Dependencies",
                "detail": "dependency not pinned by hash detected -- score normalized to 0",
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 10
              }
            ]
          },
          {
            "key": "ai_code_legibility",
            "band": "excellent",
            "name": "Code legibility for models",
            "note": null,
            "notes": [],
            "value": 98,
            "inputs": {
              "primary_language": "Rust",
              "largest_source_bytes": 829382,
              "source_files_sampled": 274,
              "oversized_source_files": 11
            },
            "components": [
              {
                "key": "type_checkable_code",
                "name": "Type-checkable code",
                "detail": "Rust (statically typed)",
                "points": 45,
                "status": "met",
                "details": [
                  {
                    "code": "statically_typed_language",
                    "params": {
                      "language": "Rust"
                    }
                  }
                ],
                "max_points": 45
              },
              {
                "key": "manageable_file_sizes",
                "name": "Manageable file sizes",
                "detail": "11/274 source files over 60KB",
                "points": 52.8,
                "status": "partial",
                "details": [
                  {
                    "code": "oversized_source_files",
                    "params": {
                      "kb": 60,
                      "sampled": 274,
                      "oversized": 11
                    }
                  }
                ],
                "max_points": 55
              }
            ]
          },
          {
            "key": "ai_interfaces",
            "band": "moderate",
            "name": "Machine-readable interfaces",
            "note": null,
            "notes": [],
            "value": 60,
            "inputs": {
              "example_dirs": [
                "examples"
              ],
              "has_mcp_signal": true,
              "api_schema_files": []
            },
            "components": [
              {
                "key": "api_schema_openapi_graphql_proto",
                "name": "API schema (OpenAPI/GraphQL/proto)",
                "detail": null,
                "points": 0,
                "status": "missed",
                "details": [],
                "max_points": 40
              },
              {
                "key": "mcp_server",
                "name": "MCP server",
                "detail": null,
                "points": 20,
                "status": "met",
                "details": [],
                "max_points": 20
              },
              {
                "key": "runnable_examples",
                "name": "Runnable examples",
                "detail": "examples",
                "points": 40,
                "status": "met",
                "details": [
                  {
                    "code": "file_list",
                    "params": {
                      "files": "examples"
                    }
                  }
                ],
                "max_points": 40
              }
            ]
          }
        ],
        "description": "How well is the repo equipped to be developed and maintained with AI coding agents? An independent, experimental badge — weight 0.0, so it is surfaced on its own and does not affect the overall health score."
      }
    ],
    "metrics_version": "1.13.0"
  },
  "warnings": [
    "Could not fetch crates package 'benches' from its registry",
    "Could not fetch crates package 'spider_examples' from its registry"
  ],
  "report_type": "repository",
  "generated_at": "2026-07-14T05:54:08.905191Z",
  "schema_version": "0.9.0",
  "badge_url": "https://raw.githubusercontent.com/inspect-software/badges/main/v1/s/spider-rs/spider.svg",
  "full_name": "spider-rs/spider",
  "license_state": "standard",
  "license_spdx": "MIT"
}

相关记录

与 spider-rs/spider 共享目录标签或生态系统的已检测仓库。 并排阅读 →

84apify/crawleeCrawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.良好81mendableai/firecrawlThe API to search, scrape, and interact with the web at scale. 🔥良好82apify/apify-sdk-pythonApify SDK for Python—The official library for building Apify Actors: serverless cloud programs for web scraping, browser automation, data processing, and AI agents. Manages the Actor lifecycle, storages (datasets, key-value stores, request queues), events, proxies, and pay-per-event monetization. Built on top of the the Apify API Client.良好81d4vinci/scrapling🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!良好84apify/apify-client-pythonApify API client for Python—Programmatically run Actors, manage and stream data from storages (datasets, key-value stores, request queues), schedule and monitor runs, and access the full Apify platform API. Sync and async interfaces with automatic retries and pagination.良好89puppeteer/puppeteerJavaScript API for Chrome and Firefox优秀

评分是信号，而非担保。 评分反映的是 GitHub 上公开可见的实践——不是代码审计，也不是安全保证。

缺失数据将被剔除并重新归一化权重，绝不按零分计。方法论已版本化并公开：指标 v1.13.0、模式 v0.9.0—— 完整方法论 · 指标知识库.

单项结果在整体记录中的位置： 汇总统计 — crates.io.