harbor-framework / harbor
Framework for evaluating and improving agents
harbor-framework/harbor holds a health index of 93 out of 100, placing it in the Exceptional band. It scores highest on Vitality (99/100) and lowest on Security (56/100). It was last updated today. 2 contributors account for most of its recent work.
Software health index
Metrics are grouped into weighted categories on one standardized 1–100 scale. Overall starts as their weighted mean, calibrated against the distribution of the public record so bands carry percentile meaning; when public evidence triggers the High-Risk Jurisdiction Policy, the rating is adjusted and receives an At Risk ceiling of 34.
Score profile
Each axis is a category. The shape matters more than the average — a healthy subject fills the whole shape, while a spike-and-crater profile means strength in one dimension is masking risk in another.
The weighted overall 79 is calibrated to 93 on the published index scale (record calibration 2026-08-02).
Ownership
This repository is backed by an organization — shared, accountable stewardship that can outlive any single maintainer.
Package ecosystems
| Registry | Package | Version | Downloads / mo | Versions | Last publish |
|---|---|---|---|---|---|
| PyPI | harbor | 0.22.0 | 7,743,135 | 128 | 5 days ago |
Metrics by category
Vitality
Is the project alive — is code being written and are releases shipping?
Development activity
How it's scored
| 36/36 | Push recency — last push 0 days ago |
| 35.3/36 | Commit cadence — 51/52 weeks with commits |
| 18/18 | Commit volume — 1,453 commits in the last year |
| 10/10 | OpenSSF Scorecard: Maintained — 30 commit(s) and 8 issue activity found in the last 90 days -- score normalized to 10 |
Inputs used
| commits_last_year | 1,453 |
| human_commit_share | 1 |
| days_since_last_push | 0 |
| active_weeks_last_year | 51 |
Release discipline
How it's scored
| 27/27 | Ships releases — 27 releases published |
| 36/36 | Release recency — latest release 5 days ago |
| 27/27 | Release cadence — a release every ~7.3 days |
| 0/10 | OpenSSF Scorecard: Signed-Releases — no data |
Inputs used
| releases_count | 27 |
| latest_release_tag | v0.22.0 |
| releases_from_tags | no |
| days_since_latest_release | 5 |
| mean_days_between_releases | 7.3 |
Community & Adoption
Does the project have users, downloads, attention, and a welcoming setup for contributors?
Popularity & adoption
How it's scored
| 59.6/60 | Stars — 4,694 stars |
| 25/25 | Forks — 1,669 forks |
| 7.2/15 | Watchers — 21 watchers |
Inputs used
| forks | 1,669 |
| stars | 4,694 |
| watchers | 21 |
| growth_state | unverified |
| growth_factor_pct | 100 |
| growth_unverified_reason | window_too_short |
Community health
How it's scored
| 22.5/22.5 | README |
| 22.5/22.5 | License — recognized license (Apache-2.0) |
| 18/18 | CONTRIBUTING guide |
| 0/13.5 | Code of conduct |
| 0/7.2 | Issue template |
| 0/6.3 | PR template |
Inputs used
| has_readme | yes |
| has_license | yes |
| readme_badges | 2 |
| has_contributing | yes |
| has_issue_template | no |
| has_code_of_conduct | no |
| readme_badge_services | shields.io |
| has_pull_request_template | no |
Sustainability & Governance
Will the project survive its people — bus factor, responsiveness, who backs it, and package upkeep?
Maintainer resilience (bus factor)
How it's scored
| 25.2/54 | Bus factor — 2 contributor(s) cover half of all commits |
| 12.2/22.5 | Commit distribution — top contributor authored 46% of commits |
| 13.5/13.5 | Contributor breadth — 100 contributors |
| 10/10 | OpenSSF Scorecard: Contributors — project has 38 contributing companies or organizations |
Inputs used
| bus_factor | 2 |
| contributors_sampled | 100 |
| top_contributor_share | 0.46 |
Issue & PR responsiveness
How it's scored
| 16.1/42 | Issue resolution — 38% of issues closed |
| 16.2/30 | PR acceptance — 1,102/2,035 decided PRs merged |
| 6.5/13 | Newcomer PR acceptance — 3/6 first-time contributors' PRs merged in 30d |
| 12/15 | OpenSSF Scorecard: Code-Review — Found 25/30 approved changesets -- score normalized to 8 |
Inputs used
| merged_prs | 1,102 |
| open_issues | 236 |
| closed_issues | 147 |
| prs_merged_7d | 46 |
| prs_decided_7d | 60 |
| prs_merged_30d | 46 |
| prs_decided_30d | 60 |
| issue_closed_ratio | 0.384 |
| closed_unmerged_prs | 933 |
| first_time_authors_30d | 6 |
| first_time_prs_merged_30d | 3 |
| first_time_prs_decided_30d | 6 |
Ownership & stewardship
How it's scored
| 30/30 | Ownership backing — organization-owned |
| 0/20 | Verified domain |
| 17.2/25 | Owner reach — 246 followers of harbor-framework |
| 10.7/25 | Track record — 19 public repos, account ~0 yr old |
Inputs used
| followers | 246 |
| owner_type | Organization |
| is_verified | no |
| owner_login | harbor-framework |
| public_repos | 19 |
| account_age_days | 217 |
Package maintenance
How it's scored
| 25/25 | Published & resolvable — 1 package(s) on pypi |
| 35/35 | Publish recency — latest publish 5 days ago |
| 20/20 | Version history — 128 published versions |
| 20/20 | Not deprecated — active, not deprecated or yanked |
Inputs used
| packages | harbor |
| ecosystems | pypi |
| any_deprecated | no |
| min_days_since_publish | 5 |
Engineering Quality
Are baseline engineering and documentation practices in place?
Engineering practices
How it's scored
| 24/24 | CI workflows — 15 workflow(s) |
| 24/24 | Tests present |
| 16/16 | Linter config — eslint.config.mjs, pyproject.toml ([tool.ruff]) |
| 0/9.6 | Pre-commit hooks |
| 0/6.4 | .editorconfig |
| 20/20 | OpenSSF Scorecard: CI-Tests — 27 out of 27 merged PRs checked by a CI test -- score normalized to 10 |
Inputs used
| has_ci | yes |
| has_tests | yes |
| has_editorconfig | no |
| has_linter_config | yes |
| has_precommit_config | no |
Documentation
How it's scored
| 30/30 | README |
| 25/25 | Documentation directory |
| 15/15 | Documentation / homepage site — https://harborframework.com/ |
| 10/10 | Repository description |
| 10/10 | Topics — 3 topics |
| 10/10 | Wiki |
Inputs used
| topics | evals, rl-environments, terminal-bench |
| has_wiki | yes |
| homepage | https://harborframework.com/ |
| docs_site | https://harborframework.com/ |
| has_readme | yes |
| has_docs_dir | yes |
| has_description | yes |
Security
Are visible security and supply-chain practices strong, without unresolved high-risk jurisdiction exposure?
Security posture
How it's scored
| 7.5/7.5 | Binary-Artifacts — no binaries found in the repo |
| 3/7.5 | Branch-Protection — branch protection is not maximal on development and all release branches |
| 2.5/2.5 | CI-Tests — 27 out of 27 merged PRs checked by a CI test -- score normalized to 10 |
| 0/2.5 | CII-Best-Practices — no effort to earn an OpenSSF best practices badge detected |
| 6/7.5 | Code-Review — Found 25/30 approved changesets -- score normalized to 8 |
| 2.5/2.5 | Contributors — project has 38 contributing companies or organizations |
| 10/10 | Dangerous-Workflow — no dangerous workflow patterns detected |
| 0/7.5 | Dependency-Update-Tool — no update tool detected |
| 0/5 | Fuzzing — project is not fuzzed |
| 2.5/2.5 | License — license file detected |
| 7.5/7.5 | Maintained — 30 commit(s) and 8 issue activity found in the last 90 days -- score normalized to 10 |
| 0/5 | Packaging — no data |
| 0/5 | Pinned-Dependencies — dependency not pinned by hash detected -- score normalized to 0 |
| 0/5 | SAST — SAST tool is not run on all commits -- score normalized to 0 |
| 0/5 | Security-Policy — security policy file not detected |
| 0/7.5 | Signed-Releases — no data |
| 0/7.5 | Token-Permissions — detected GitHub workflow tokens with excessive permissions |
| 0/7.5 | Vulnerabilities — 265 existing vulnerabilities detected |
Inputs used
| source | openssf_scorecard |
| checks_evaluated | 16 |
| scorecard_version | v5.5.0 |
| checks_inconclusive | 2 |
| scorecard_aggregate | 4.5 |
Dependency advisories
How it's scored
| 35/35 | Direct dependencies free of known advisories — no direct dependency carries a known advisory |
| 25/25 | Indirect dependencies free of known advisories — no indirect dependency carries a known advisory |
| 0/40 | No advisories left outstanding — no advisory carries a publication date |
Inputs used
| source | osv |
| advisories | 0 |
| affected_packages | 0 |
| assessed_packages | 82 |
| unassessed_packages | 0 |
| affected_by_severity | none |
| direct_affected_packages | 0 |
AI Readiness
How well is the repo equipped to be developed and maintained with AI coding agents? Carries a deliberately small weight (4%): agent tooling is a real maintenance signal, but a repository with none can still reach 100/100.
Agent context & guidance
How it's scored
| 45/45 | Agent instructions — AGENTS.md, CLAUDE.md, adapters/adebench/src/adebench/task-template/environment/AGENTS.md, adapters/adebench/src/adebench/task-template/environment/CLAUDE.md, adapters/adebench/src/adebench/task-template/environment/GEMINI.md, apps/viewer/CLAUDE.md, docs-mintlify/.mintlify/AGENTS.md, docs/AGENTS.md, docs/CLAUDE.md, packages/rewardkit/AGENTS.md, packages/rewardkit/CLAUDE.md, packages/rewardkit/src/rewardkit/prompts/agent.md |
| 15/15 | Machine-readable docs (llms.txt) — llms.txt served by the project website (https://harborframework.com/llms-full.txt) |
| 40/40 | Legible commit history — 94 of 100 human commits state their intent (structured subject or explanatory body) |
Inputs used
| has_llms_txt | yes |
| llms_txt_url | https://harborframework.com/llms-full.txt |
| legible_history_share | 0.94 |
| agent_instruction_files | AGENTS.md, CLAUDE.md, adapters/adebench/src/adebench/task-template/environment/AGENTS.md, adapters/adebench/src/adebench/task-template/environment/CLAUDE.md, adapters/adebench/src/adebench/task-template/environment/GEMINI.md, apps/viewer/CLAUDE.md, docs-mintlify/.mintlify/AGENTS.md, docs/AGENTS.md, docs/CLAUDE.md, packages/rewardkit/AGENTS.md, packages/rewardkit/CLAUDE.md, packages/rewardkit/src/rewardkit/prompts/agent.md |
| agent_instruction_max_bytes | 16,145 |
Verify loop (build / test / typecheck)
How it's scored
| 0/18 | One-command bootstrap |
| 22/22 | Automated tests |
| 11/11 | Lint / format config — eslint.config.mjs, pyproject.toml ([tool.ruff]) |
| 11/11 | Static type checking — apps/viewer/tsconfig.json, docs/tsconfig.json |
| 10/10 | Reproducible environment — Dockerfile, lockfile |
| 10/10 | Demonstrated agent practice — 26 of the last 100 commits agent-authored or agent-credited |
| 0/8 | Automated maintenance — no automated dependency updates observed |
| 0/10 | OpenSSF Scorecard: Pinned-Dependencies — dependency not pinned by hash detected -- score normalized to 0 |
Inputs used
| has_nix | no |
| has_tests | yes |
| lockfiles | package-lock.json, uv.lock |
| has_dockerfile | yes |
| typed_language | no |
| bootstrap_files | — |
| has_devcontainer | no |
| has_linter_config | yes |
| typecheck_configs | apps/viewer/tsconfig.json, docs/tsconfig.json |
| agent_commit_share | 0.26 |
| toolchain_manifests | — |
| dependency_bot_commit_share | 0 |
Code legibility for models
How it's scored
| 27/45 | Type-checkable code — Python with type-check config (apps/viewer/tsconfig.json, docs/tsconfig.json) |
| 53.9/55 | Manageable file sizes — 30/1,461 source files over 60KB |
Inputs used
| primary_language | Python |
| largest_source_bytes | 145,959 |
| source_files_sampled | 1,461 |
| oversized_source_files | 30 |
Machine-readable interfaces
How it's scored
| 0/40 | API schema (OpenAPI/GraphQL/proto) |
| 20/20 | MCP server |
| 40/40 | Runnable examples — examples |
Inputs used
| example_dirs | examples |
| has_mcp_signal | yes |
| api_schema_files | — |
| interfaces_expected_of | network-service |
Key facts
Data collection warnings
- Star history unavailable: GitHub GraphQL error: Resource not accessible by personal access token
- Star history carried forward from 2026-07-21: GitHub restricted the stargazers API to repository admins, so it can no longer be collected. The repository has 4694 stars today.
- First-time contributor figures cover 12 of 30 authors (cap 12)
- GitHub dependency-graph SBOM unavailable (404); the dependency graph may be disabled for this repository
More detail
Star and fork history 3,333 ★ / 1,669 ⇿
When each star and fork was added, collected from GitHub and bucketed by day. Cumulative growth sits directly above the daily additions it is made of, so the two read against each other: steady organic accretion looks nothing like an abrupt, short-lived burst. Where that difference is measurable, it is reported as growth authenticity.
Only the most recent history is shown — this repository exceeds the collection window, so the earliest history is not captured.
Star history is shown as collected on 2026-07-21. GitHub restricted the stargazers API to repository administrators in July 2026, so this series can no longer be extended; the current star total above remains live.
OpenSSF Scorecard 4.5 / 10
Independent, tool-agnostic security assessment from the open-source OpenSSF Scorecard. Each check rewards a security practice, not a specific vendor's tool. Checks Scorecard could not determine are marked n/a and excluded from the security score (never counted as zero).
| 10 | Binary-Artifacts | no binaries found in the repo |
| 4 | Branch-Protection | branch protection is not maximal on development and all release branches |
| 10 | CI-Tests | 27 out of 27 merged PRs checked by a CI test -- score normalized to 10 |
| 0 | CII-Best-Practices | no effort to earn an OpenSSF best practices badge detected |
| 8 | Code-Review | Found 25/30 approved changesets -- score normalized to 8 |
| 10 | Contributors | project has 38 contributing companies or organizations |
| 10 | Dangerous-Workflow | no dangerous workflow patterns detected |
| 0 | Dependency-Update-Tool | no update tool detected |
| 0 | Fuzzing | project is not fuzzed |
| 10 | License | license file detected |
| 10 | Maintained | 30 commit(s) and 8 issue activity found in the last 90 days -- score normalized to 10 |
| n/a | Packaging | packaging workflow not detected |
| 0 | Pinned-Dependencies | dependency not pinned by hash detected -- score normalized to 0 |
| 0 | SAST | SAST tool is not run on all commits -- score normalized to 0 |
| 0 | Security-Policy | security policy file not detected |
| n/a | Signed-Releases | no releases found |
| 0 | Token-Permissions | detected GitHub workflow tokens with excessive permissions |
| 0 | Vulnerabilities | 265 existing vulnerabilities detected |
Direct dependencies 21
| Registry | Package | Version constraint | Manifest |
|---|---|---|---|
| PyPI | pydantic | >=2.11.7 | pyproject.toml |
| PyPI | shortuuid | >=1.0.13 | pyproject.toml |
| PyPI | typer | >=0.16.0 | pyproject.toml |
| PyPI | requests | >=2.32.4 | pyproject.toml |
| PyPI | pyyaml | >=6.0.2 | pyproject.toml |
| PyPI | rich | >=14.1.0 | pyproject.toml |
| PyPI | toml | >=0.10.2 | pyproject.toml |
| PyPI | tenacity | >=9.1.2 | pyproject.toml |
| PyPI | python-dotenv | >=1.1.1 | pyproject.toml |
| PyPI | litellm | >=1.92.0 | pyproject.toml |
| PyPI | jinja2 | >=3.1.6 | pyproject.toml |
| PyPI | dirhash | >=0.5.0 | pyproject.toml |
| PyPI | packaging | >=25.0 | pyproject.toml |
| PyPI | fastapi | >=0.128.0 | pyproject.toml |
| PyPI | uvicorn | >=0.38.0 | pyproject.toml |
| PyPI | pathspec | >=1.0.3 | pyproject.toml |
| PyPI | supabase | >=2.28.2 | pyproject.toml |
| PyPI | httpx | >=0.27.0 | pyproject.toml |
| PyPI | filelock | >=3.29.4 | pyproject.toml |
| PyPI | platformdirs | >=4.10.0 | pyproject.toml |
| PyPI | pyjwt | >=2.10.1 | pyproject.toml |
All dependencies not collected
The resolved dependency set could not be collected for this report: GitHub dependency-graph SBOM unavailable (404); the dependency graph may be disabled for this repository
Dependency advisories 0
Installing pypi:harbor@0.22.0 pulls in 82 packages, direct and transitive: 0 carry known advisories, of which 0 are direct dependencies.
No known advisories affect the assessed dependencies.
An advisory means the version recorded in the dependency graph falls inside an advisory’s affected range. Reachability is not analysed, and the graph includes development and test pins — a finding may concern tooling rather than shipped software.
Raw JSON report machine-readable
Feedback
Spotted something off in this report, or have thoughts to share? Wrong measurements, missed tooling, ideas, questions — anything is welcome. Every message is read and gets a response.
Scores are signals, not warranties. They reflect publicly visible practices on GitHub — not a code audit, and not a security guarantee.
Missing data is excluded and weights renormalized, never scored as zero. Methodology is versioned and open: metrics v2.10.0, schema v0.34.0 — full methodology · metrics wiki.
How one result sits in the wider record: aggregate statistics — PyPI.