Public recordModerate
Software health reportschema 0.30.0 · metrics 2.5.0 · 2026-08-04 07:02 UTC
zirkelc / ai-test-kit
Test Kit for AI SDK
zirkelc/ai-test-kit holds a health index of 57 out of 100, placing it in the Moderate band. It scores highest on Vitality (69/100) and lowest on Security (41/100). It was last updated 10 days ago. A single contributor accounts for most of its recent work.
57
overall / 100Software health index
Metrics are grouped into weighted categories on one standardized 1–100 scale. Overall starts as their weighted mean, calibrated against the distribution of the public record so bands carry percentile meaning; when public evidence triggers the High-Risk Jurisdiction Policy, the rating is adjusted and receives an At Risk ceiling of 34.
57
Exceptional93-100The record's top tier (≈ top 5%); essentially all checked criteria met
Excellent80-92Strong across the board; minor gaps
Good65-79Healthy; gaps are limited and manageable
Moderate50-64Acceptable with notable gaps; review recommended
Weak35-49Material weaknesses across several areas
At Risk20-34Significant weaknesses; adoption warrants caution
Critical1-19Severe problems (abandoned, single-maintainer, no hygiene)
Score profile
Each axis is a category. The shape matters more than the average — a healthy subject fills the whole shape, while a spike-and-crater profile means strength in one dimension is masking risk in another.
The weighted overall 55 is calibrated to 57 on the published index scale (record calibration 2026-08-02).
Ownership
Chris CookPersonal account
77 followers158 public repossince Jul 2011Flyweight.io
This repository is owned by a personal account. A single-owner project carries more continuity risk than an organization-backed one.
Package ecosystems
| Registry | Package | Version | Downloads / mo | Versions | Last publish |
|---|---|---|---|---|---|
| npm | ai-test-kit | 3.2.0 | 6,702 | 25 | 10 days ago |
Metrics by category
Vitality
Is the project alive — is code being written and are releases shipping?
69
Development activity
49Weak
How it's scored
| 28.8/36 | Push recency — last push 10 days ago |
| 4.2/36 | Commit cadence — 6/52 weeks with commits |
| 15.6/18 | Commit volume — 54 commits in the last year |
| 0/10 | OpenSSF Scorecard: Maintained — project was created within the last 90 days. Please review its contents carefully |
Inputs used
| commits_last_year | 54 |
| human_commit_share | 1 |
| days_since_last_push | 10 |
| active_weeks_last_year | 6 |
Release discipline
100Exceptional
How it's scored
| 27/27 | Ships releases — 24 releases published |
| 36/36 | Release recency — latest release 10 days ago |
| 27/27 | Release cadence — a release every ~3.2 days |
| 0/10 | OpenSSF Scorecard: Signed-Releases — no data |
Inputs used
| releases_count | 24 |
| latest_release_tag | v3.2.0 |
| releases_from_tags | no |
| days_since_latest_release | 10 |
| mean_days_between_releases | 3.2 |
Excluded from scoring (no data or not applicable): OpenSSF Scorecard: Signed-Releases. Remaining weights renormalized.
Community & Adoption
Does the project have users, downloads, attention, and a welcoming setup for contributors?
43
Popularity & adoption
24At Risk
How it's scored
| 24/60 | Stars — 31 stars |
| 0/25 | Forks — 0 forks |
| 0/15 | Watchers — 0 watchers |
Inputs used
| forks | 0 |
| stars | 31 |
| watchers | 0 |
| growth_state | unverified |
| growth_factor_pct | 100 |
| growth_unverified_reason | no_history |
Community health
50Moderate
How it's scored
| 22.5/22.5 | README |
| 22.5/22.5 | License — recognized license (MIT) |
| 0/18 | CONTRIBUTING guide |
| 0/13.5 | Code of conduct |
| 0/7.2 | Issue template |
| 0/6.3 | PR template |
Inputs used
| has_readme | yes |
| has_license | yes |
| readme_badges | 2 |
| has_contributing | no |
| has_issue_template | no |
| has_code_of_conduct | no |
| readme_badge_services | shields.io |
| has_pull_request_template | no |
Ecosystem adoption (downloads)
64Moderate
How it's scored
| 51/80 | Monthly downloads — 6,702 downloads/month across npm |
| 0/20 | Registry dependents — not reported by this ecosystem |
Inputs used
| packages | ai-test-kit |
| dependents | — |
| ecosystems | npm |
| total_downloads | — |
| monthly_downloads | 6,702 |
Excluded from scoring (no data or not applicable): Registry dependents. Remaining weights renormalized.
Sustainability & Governance
Will the project survive its people — bus factor, responsiveness, who backs it, and package upkeep?
56
Maintainer resilience (bus factor)
16Critical
How it's scored
| 9/54 | Bus factor — 1 contributor(s) cover half of all commits |
| 0/22.5 | Commit distribution — top contributor authored 100% of commits |
| 1.4/13.5 | Contributor breadth — 1 contributors |
| 6/10 | OpenSSF Scorecard: Contributors — project has 2 contributing companies or organizations -- score normalized to 6 |
Inputs used
| bus_factor | 1 |
| contributors_sampled | 1 |
| top_contributor_share | 1 |
Issue & PR responsiveness
64Moderate
How it's scored
| 0/42 | Issue resolution — no issues or no data |
| 28.9/30 | PR acceptance — 27/28 decided PRs merged |
| 0/13 | Newcomer PR acceptance — no first-time contributor's PR decided in 30d |
| 0/15 | OpenSSF Scorecard: Code-Review — Found 0/30 approved changesets -- score normalized to 0 |
Inputs used
| merged_prs | 27 |
| open_issues | 0 |
| closed_issues | 0 |
| prs_merged_7d | 0 |
| prs_decided_7d | 0 |
| prs_merged_30d | 2 |
| prs_decided_30d | 2 |
| issue_closed_ratio | — |
| closed_unmerged_prs | 1 |
| first_time_authors_30d | 0 |
| first_time_prs_merged_30d | 0 |
| first_time_prs_decided_30d | 0 |
Excluded from scoring (no data or not applicable): Issue resolution, newcomer_pr_acceptance. Remaining weights renormalized.
Ownership & stewardship
61Moderate
How it's scored
| 10/30 | Ownership backing — personal (user) account |
| 0/20 | Verified domain — not applicable to user accounts |
| 13.6/25 | Owner reach — 77 followers of zirkelc |
| 25/25 | Track record — 158 public repos, account ~15 yr old |
Inputs used
| followers | 77 |
| owner_type | User |
| is_verified | — |
| owner_login | zirkelc |
| public_repos | 158 |
| account_age_days | 5,482 |
Excluded from scoring (no data or not applicable): Verified domain. Remaining weights renormalized.
Package maintenance
100Exceptional
How it's scored
| 25/25 | Published & resolvable — 1 package(s) on npm |
| 35/35 | Publish recency — latest publish 10 days ago |
| 20/20 | Version history — 25 published versions |
| 20/20 | Not deprecated — active, not deprecated or yanked |
Inputs used
| packages | ai-test-kit |
| ecosystems | npm |
| any_deprecated | no |
| min_days_since_publish | 10 |
Engineering Quality
Are baseline engineering and documentation practices in place?
64
Engineering practices
74Good
How it's scored
| 24/24 | CI workflows — 2 workflow(s) |
| 24/24 | Tests present |
| 0/16 | Linter config |
| 0/9.6 | Pre-commit hooks |
| 6.4/6.4 | .editorconfig |
| 20/20 | OpenSSF Scorecard: CI-Tests — 13 out of 13 merged PRs checked by a CI test -- score normalized to 10 |
Inputs used
| has_ci | yes |
| has_tests | yes |
| has_editorconfig | yes |
| has_linter_config | no |
| has_precommit_config | no |
Documentation
50Moderate
How it's scored
| 30/30 | README |
| 0/25 | Documentation directory |
| 0/15 | Documentation / homepage site |
| 10/10 | Repository description |
| 0/10 | Topics |
| 10/10 | Wiki |
Inputs used
| topics | — |
| has_wiki | yes |
| homepage | — |
| has_readme | yes |
| has_docs_dir | no |
| has_description | yes |
Security
Are visible security and supply-chain practices strong, without unresolved high-risk jurisdiction exposure?
41
Security posture
26At Risk
How it's scored
| 7.5/7.5 | Binary-Artifacts — no binaries found in the repo |
| 0/7.5 | Branch-Protection — branch protection not enabled on development/release branches |
| 2.5/2.5 | CI-Tests — 13 out of 13 merged PRs checked by a CI test -- score normalized to 10 |
| 0/2.5 | CII-Best-Practices — no effort to earn an OpenSSF best practices badge detected |
| 0/7.5 | Code-Review — Found 0/30 approved changesets -- score normalized to 0 |
| 1.5/2.5 | Contributors — project has 2 contributing companies or organizations -- score normalized to 6 |
| 10/10 | Dangerous-Workflow — no dangerous workflow patterns detected |
| 0/7.5 | Dependency-Update-Tool — no update tool detected |
| 0/5 | Fuzzing — project is not fuzzed |
| 2.5/2.5 | License — license file detected |
| 0/7.5 | Maintained — project was created within the last 90 days. Please review its contents carefully |
| 0/5 | Packaging — no data |
| 0/5 | Pinned-Dependencies — dependency not pinned by hash detected -- score normalized to 0 |
| 0/5 | SAST — SAST tool is not run on all commits -- score normalized to 0 |
| 0/5 | Security-Policy — security policy file not detected |
| 0/7.5 | Signed-Releases — no data |
| 0/7.5 | Token-Permissions — detected GitHub workflow tokens with excessive permissions |
| 0/7.5 | Vulnerabilities — 28 existing vulnerabilities detected |
Inputs used
| source | openssf_scorecard |
| checks_evaluated | 16 |
| scorecard_version | v5.5.0 |
| checks_inconclusive | 2 |
| scorecard_aggregate | 2.6 |
Excluded from scoring (no data or not applicable): packaging, signed_releases. Remaining weights renormalized.
Dependency advisories
100Exceptional
How it's scored
| 35/35 | Direct dependencies free of known advisories — no direct dependency carries a known advisory |
| 25/25 | Indirect dependencies free of known advisories — no indirect dependency carries a known advisory |
| 0/40 | No advisories left outstanding — no advisory carries a publication date |
Inputs used
| source | osv |
| advisories | 0 |
| affected_packages | 0 |
| assessed_packages | 1 |
| unassessed_packages | 0 |
| affected_by_severity | none |
| direct_affected_packages | 0 |
Excluded from scoring (no data or not applicable): No advisories left outstanding. Remaining weights renormalized. Matched the npm:ai-test-kit@3.2.0 runtime dependency closure — what installing the published package pulls in — 1 packages. Reachability is not analyzed.
AI Readiness
How well is the repo equipped to be developed and maintained with AI coding agents? Carries a deliberately small weight (4%): agent tooling is a real maintenance signal, but a repository with none can still reach 100/100.
52
Agent context & guidance
40Weak
How it's scored
| 0/45 | Agent instructions — no CLAUDE.md / AGENTS.md / editor rules |
| 0/15 | Machine-readable docs (llms.txt) |
| 40/40 | Legible commit history — 51 of 54 human commits state their intent (structured subject or explanatory body) |
Inputs used
| has_llms_txt | no |
| legible_history_share | 0.944 |
| agent_instruction_files | — |
| agent_instruction_max_bytes | — |
How it's scored
| 0/18 | One-command bootstrap |
| 22/22 | Automated tests |
| 0/11 | Lint / format config |
| 11/11 | Static type checking — test-d/tsconfig.json, tsconfig.json |
| 10/10 | Reproducible environment — lockfile |
| 0/10 | Demonstrated agent practice — no agent-authored commits among the last 54 |
| 0/8 | Automated maintenance — no automated dependency updates observed |
| 0/10 | OpenSSF Scorecard: Pinned-Dependencies — dependency not pinned by hash detected -- score normalized to 0 |
Inputs used
| has_nix | no |
| has_tests | yes |
| lockfiles | pnpm-lock.yaml |
| has_dockerfile | no |
| typed_language | yes |
| bootstrap_files | — |
| has_devcontainer | no |
| has_linter_config | no |
| typecheck_configs | test-d/tsconfig.json, tsconfig.json |
| agent_commit_share | 0 |
| toolchain_manifests | — |
| dependency_bot_commit_share | 0 |
Code legibility for models
100Exceptional
How it's scored
| 45/45 | Type-checkable code — TypeScript (statically typed) |
| 55/55 | Manageable file sizes — 0/51 source files over 60KB |
Inputs used
| primary_language | TypeScript |
| largest_source_bytes | 15,918 |
| source_files_sampled | 51 |
| oversized_source_files | 0 |
Key facts
31GitHub stars
1contributors
54commits, last 12 months
10days since last push
24releases
1bus factor
0open issues
npmpackage ecosystems
Data collection warnings
- Star history unavailable: GitHub GraphQL error: Resource not accessible by personal access token
- GitHub dependency-graph SBOM unavailable (404); the dependency graph may be disabled for this repository
More detail
OpenSSF Scorecard 2.6 / 10
2.6aggregate
Independent, tool-agnostic security assessment from the open-source OpenSSF Scorecard. Each check rewards a security practice, not a specific vendor's tool. Checks Scorecard could not determine are marked n/a and excluded from the security score (never counted as zero).
| 10 | Binary-Artifacts | no binaries found in the repo |
| 0 | Branch-Protection | branch protection not enabled on development/release branches |
| 10 | CI-Tests | 13 out of 13 merged PRs checked by a CI test -- score normalized to 10 |
| 0 | CII-Best-Practices | no effort to earn an OpenSSF best practices badge detected |
| 0 | Code-Review | Found 0/30 approved changesets -- score normalized to 0 |
| 6 | Contributors | project has 2 contributing companies or organizations -- score normalized to 6 |
| 10 | Dangerous-Workflow | no dangerous workflow patterns detected |
| 0 | Dependency-Update-Tool | no update tool detected |
| 0 | Fuzzing | project is not fuzzed |
| 10 | License | license file detected |
| 0 | Maintained | project was created within the last 90 days. Please review its contents carefully |
| n/a | Packaging | packaging workflow not detected |
| 0 | Pinned-Dependencies | dependency not pinned by hash detected -- score normalized to 0 |
| 0 | SAST | SAST tool is not run on all commits -- score normalized to 0 |
| 0 | Security-Policy | security policy file not detected |
| n/a | Signed-Releases | no releases found |
| 0 | Token-Permissions | detected GitHub workflow tokens with excessive permissions |
| 0 | Vulnerabilities | 28 existing vulnerabilities detected |
Direct dependencies 1
| Registry | Package | Version constraint | Manifest |
|---|---|---|---|
| npm | @vitest/spy | ^4.0.0 | package.json |
All dependencies not collected
The resolved dependency set could not be collected for this report: GitHub dependency-graph SBOM unavailable (404); the dependency graph may be disabled for this repository
Dependency advisories 0
Installing npm:ai-test-kit@3.2.0 pulls in 1 packages, direct and transitive: 0 carry known advisories, of which 0 are direct dependencies.
No known advisories affect the assessed dependencies.
An advisory means the version recorded in the dependency graph falls inside an advisory’s affected range. Reachability is not analysed, and the graph includes development and test pins — a finding may concern tooling rather than shipped software.
Raw JSON report machine-readable
{
"data": {
"repo": {
"topics": [],
"is_fork": false,
"size_kb": 835,
"has_wiki": true,
"homepage": null,
"languages": {
"Shell": 239,
"TypeScript": 168632
},
"pushed_at": "2026-07-24T14:28:34Z",
"created_at": "2026-06-08T09:22:28Z",
"owner_type": "User",
"updated_at": "2026-07-24T14:30:05Z",
"description": "Test Kit for AI SDK",
"is_archived": false,
"is_disabled": false,
"license_spdx": "MIT",
"default_branch": "main",
"license_spdx_raw": "MIT",
"primary_language": "TypeScript",
"significant_languages": [
"TypeScript"
]
},
"owner": {
"blog": "https://zirkelc.dev",
"name": "Chris Cook",
"type": "User",
"login": "zirkelc",
"company": "Flyweight.io",
"location": "Germany",
"followers": 77,
"avatar_url": "https://avatars.githubusercontent.com/u/950244?v=4",
"created_at": "2011-07-31T18:01:52Z",
"is_verified": null,
"public_repos": 158,
"account_age_days": 5482
},
"license": {
"state": "standard",
"spdx_id": "MIT",
"raw_spdx": "MIT",
"file_present": true,
"scorecard_found": true,
"profile_has_license": true
},
"activity": {
"releases": [
{
"tag": "v3.2.0",
"kind": "minor",
"published_at": "2026-07-24T14:27:54Z"
},
{
"tag": "v3.1.0",
"kind": "minor",
"published_at": "2026-07-23T14:24:20Z"
},
{
"tag": "v3.0.1",
"kind": "patch",
"published_at": "2026-06-30T12:34:39Z"
},
{
"tag": "v3.0.0",
"kind": "major",
"published_at": "2026-06-30T12:23:54Z"
},
{
"tag": "v2.1.1",
"kind": "patch",
"published_at": "2026-06-30T12:12:46Z"
},
{
"tag": "v2.1.0",
"kind": "minor",
"published_at": "2026-06-30T11:53:48Z"
},
{
"tag": "v2.0.1",
"kind": "patch",
"published_at": "2026-06-26T07:55:12Z"
},
{
"tag": "v3.0.0-next.3",
"kind": "prerelease",
"published_at": "2026-06-25T16:35:58Z"
},
{
"tag": "v3.0.0-next.2",
"kind": "prerelease",
"published_at": "2026-06-25T15:36:57Z"
},
{
"tag": "v3.0.0-next.1",
"kind": "prerelease",
"published_at": "2026-06-25T14:59:34Z"
},
{
"tag": "v3.0.0-next",
"kind": "prerelease",
"published_at": "2026-06-25T14:35:32Z"
},
{
"tag": "v2.0.0",
"kind": "major",
"published_at": "2026-06-24T15:58:20Z"
},
{
"tag": "v2.0.0-next.4",
"kind": "prerelease",
"published_at": "2026-06-24T09:54:13Z"
},
{
"tag": "v2.0.0-next.3",
"kind": "prerelease",
"published_at": "2026-06-23T07:01:06Z"
},
{
"tag": "v1.4.1",
"kind": "patch",
"published_at": "2026-06-23T07:00:35Z"
},
{
"tag": "v2.0.0-next.2",
"kind": "prerelease",
"published_at": "2026-06-22T10:00:12Z"
},
{
"tag": "v2.0.0-next.1",
"kind": "prerelease",
"published_at": "2026-06-19T14:51:24Z"
},
{
"tag": "v2.0.0-next",
"kind": "prerelease",
"published_at": "2026-06-19T14:20:07Z"
},
{
"tag": "v1.4.0",
"kind": "minor",
"published_at": "2026-06-18T11:42:40Z"
},
{
"tag": "v1.3.0",
"kind": "minor",
"published_at": "2026-06-15T12:50:24Z"
},
{
"tag": "v1.2.0",
"kind": "minor",
"published_at": "2026-06-15T09:31:34Z"
},
{
"tag": "v1.1.0",
"kind": "minor",
"published_at": "2026-06-11T11:00:39Z"
},
{
"tag": "v1.0.1",
"kind": "patch",
"published_at": "2026-06-11T09:16:51Z"
},
{
"tag": "v1.0.0",
"kind": "major",
"published_at": "2026-06-11T07:52:23Z"
}
],
"recent_commits": [
{
"oid": "a9fc913a689f7bae5aaa6b051e62c00595e25920",
"body": null,
"is_bot": false,
"headline": "chore(main): release 3.2.0 (#28)",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-07-24T14:27:21Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "702abb348a8fd955d07c699ceee6c75c3133c88f",
"body": "Add MockLanguageModel.stream() and .generate() as single-method mocks:\neach drives one of doStream/doGenerate and leaves the other unimplemented\n(throws when called). Sugar for from({ doStream }) / from({ doGenerate }).\n\nAlso accept a pre-built Language.streamResult() in the doStream form by\nadding LanguageModelV4StreamResult to StreamResponse.",
"is_bot": false,
"headline": "feat(language): add stream/generate single-method mock helpers",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-07-24T14:24:59Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "a82650d0d8c4ac3893053d30f5958b5492d69d3c",
"body": null,
"is_bot": false,
"headline": "chore(main): release 3.1.0 (#27)",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-07-23T14:23:39Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "73bacd504f2a270f4564b0e49fef1612c6947ef1",
"body": "Expose the primitives the streamText/streamReasoning/streamToolInput blocks\ncompose: streamTextStart/Delta/End, streamReasoningStart/Delta/End, and\nstreamToolInputStart/Delta/End. The block builders now build from them.\n\nDelta builders take the delta string first, then an optional { id } (id\ndefaults to '1'), mirroring the block builders; start/end take options only\nand streamToolInputStart takes the tool name first. Each returns a single\nLanguageModelV4StreamPart.",
"is_bot": false,
"headline": "feat(language): add singular stream-part builders",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-07-23T13:34:40Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "df47e5c3f4919349658d407237374de1841cc9f2",
"body": "Add compile-time exhaustiveness tripwires: assert the set of type tags the\nbuilders cover equals each SDK union (UIMessageChunk, UIMessagePart,\nLanguageModelV4Content, LanguageModelV4StreamPart). A future ai/provider\nupgrade that adds or removes a part or chunk type now fails typecheck until a\nmatching builder and the tag list are updated in lockstep.",
"is_bot": false,
"headline": "test(types): guard builder coverage against SDK part/chunk unions",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-07-23T12:14:01Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "dccea9a8f023e81863a9c1075fde6a952bbd9986",
"body": "Bump ai 7.0.0->7.0.35, @ai-sdk/provider 4.0.0->4.0.3,\n@ai-sdk/provider-utils 5.0.0->5.0.12 (all within the same major).\ndevDependencies floors updated; peerDependencies kept broad. Typecheck,\nbuild, tests, and lint all pass.",
"is_bot": false,
"headline": "chore(deps): upgrade AI SDK deps to latest",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-07-23T12:02:57Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "3baebe55b177e8473cf50e32ecbd4ec502e23234",
"body": null,
"is_bot": false,
"headline": "chore(main): release 3.0.1 (#26)",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-30T12:34:06Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "c9f62ce8e613f322a77f358af5b20187d4359331",
"body": "v3 is now the stable release on main, so link the version compatibility\nnote to /tree/v3.x (matching the v2.x line) instead of the next branch.",
"is_bot": false,
"headline": "docs: point 3.x compatibility link at the v3.x floating tag",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-30T12:31:07Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "783a5cf1fb8acc7d748aab0d029e236614ed1d77",
"body": null,
"is_bot": false,
"headline": "chore(main): release 3.0.0 (#25)",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-30T12:23:13Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "aed14946725cf0aae2a85815109021ac06ec4529",
"body": "* feat!: target AI SDK 7 (provider spec v4)\n\nMigrate the kit from the V3 provider spec to V4: rename the\nLanguageModel/EmbeddingModel/ImageModel V3 types to V4, bump\nspecificationVersion to 'v4', and wrap file() data in the V4\ndiscriminated union ({ type: 'data', data }). Dependencies move to\n@ai-sd\n[…]\ndocs: link version compatibility note to floating tags\n\n* chore(next): release 3.0.0-next.2 (#18)\n\n* docs: update version compatibility notes for ai-test-kit\n\n* chore(next): release 3.0.0-next.3 (#20)",
"is_bot": false,
"headline": "feat!: AI SDK 7 support (provider spec v4) (#19)",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-30T12:19:52Z",
"body_truncated": true,
"is_coding_agent": false
},
{
"oid": "b17bcef9646cf4c3fe4613245430047371081181",
"body": null,
"is_bot": false,
"headline": "chore(main): release 2.1.0 (#22)",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-30T11:53:09Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "37388ee494b7ff8da876f29ae8af43228b33cd73",
"body": "Add halo spotlight on the active motif element, deepen the banner backdrop, and add a gradient accent rule under the wordmark.",
"is_bot": false,
"headline": "docs: refresh logo and banner assets",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-26T15:59:43Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "1f92aa6f32e8ce6e2980d80b252bf4ec9462dc25",
"body": "When finishReason is omitted, result and streamParts now derive it from\ncontent: a pending client tool call yields tool-calls, otherwise stop. A\ntool call is not pending if it is providerExecuted or already resolved by\na matching tool-result in the same content. An explicit finishReason\nalways wins. The content-blind streamFinish atom is unchanged.",
"is_bot": false,
"headline": "feat(language): derive finish reason from content",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-26T11:08:24Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "94b411be806acd90723423d16249f382e16f8c1a",
"body": null,
"is_bot": false,
"headline": "Merge branch 'main' of https://github.com/zirkelc/ai-test-kit",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-26T10:24:26Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "50e05481d53ea922ddec9410464c40a63c8981cb",
"body": "Make Language.toolCall, toolResult, and streamToolInput type-safe via an\noptional `<TOOLS extends ToolSet>` generic. Passing a tool-set correlates\ntoolName to its input/output via a discriminated union; omitting it keeps\nthe loose, unconstrained shape so existing call sites are unaffected.\n\nAdd type tests in language.test-d.ts and document the generic in the README.",
"is_bot": false,
"headline": "feat(language): add optional tool-set generic to tool builders",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-26T10:20:22Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "54896b5f6fd4a9de3cbea6b67914afb84ef7b96f",
"body": null,
"is_bot": false,
"headline": "chore(main): release 2.0.1 (#21)",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-26T07:54:40Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "aab6c108060c8ca23cec153c6333ce55e9bca0d2",
"body": null,
"is_bot": false,
"headline": "chore: add FUNDING.yml sponsor button",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-26T07:50:49Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "8f12f1af641fb2d1fc6bea956f9a2f560d36d7d2",
"body": null,
"is_bot": false,
"headline": "chore(main): release 2.0.0 (#15)",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-24T15:57:41Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "c8e447f667ef625d82c05048002c457096a5dabd",
"body": "* feat!: restructure model namespaces into Language/Embedding/Image\n\nCollapse the per-model builders into one singular payload namespace per\nmodel family and slim the mocks to `from` + `callOptions`.\n\n- Language: merges the former ContentParts + StreamParts into a single\n `Language` namespace; stre\n[…]\nions from model.doGenerate.mock\n.calls (each entry is the call's argument tuple, so [i][0]) instead of\nmodel.doGenerateCalls[i]. Same for doStream / doEmbed.\n\n* chore(next): release 2.0.0-next.4 (#13)",
"is_bot": false,
"headline": "feat!: v2 model namespaces, streamParts, vitest decoupling (#14)",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-24T15:54:27Z",
"body_truncated": true,
"is_coding_agent": false
},
{
"oid": "0f045cfe1d85e7f7e99be2782185535ef42109ea",
"body": null,
"is_bot": false,
"headline": "chore(main): release 1.4.1 (#8)",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-23T06:59:58Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "dbd885c3ea51baf9cbc0973f495f0870700655dd",
"body": "Avoid double CI runs: with pull_request already triggering CI, an\nunfiltered push trigger ran a second time on every PR'd branch. Limit\npush CI to the long-lived branches; feature branches run via their PR.",
"is_bot": false,
"headline": "ci: scope push trigger to main and next",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-19T14:36:44Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "7cbc2e137319d14b35860fb545b06350367b8f0a",
"body": "A release flagged `prerelease: true` (cut from the `next` branch) publishes\nunder the `next` dist-tag instead of `latest`. This lives on the default\nbranch because a `release`-triggered workflow always runs from the default\nbranch's copy, regardless of which branch the release was tagged on.",
"is_bot": false,
"headline": "ci: publish prereleases under the next dist-tag",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-19T13:50:31Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "75e1650349b8c676c172a9c4a8b22a86748806b9",
"body": null,
"is_bot": false,
"headline": "chore(main): release 1.4.0 (#7)",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-18T11:42:08Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "b94bfb5682a656678986837206523686ca142a8d",
"body": "Align the explicit two-method form with the LanguageModelV3 method names\nand the kit's own doGenerateCalls / doStreamCalls (matching AI SDK's\nMockLanguageModelV3 constructor): { generate, stream } -> { doGenerate,\ndoStream }. The other MockResponse forms (string, Error, { content },\narrays) are unchanged.",
"is_bot": false,
"headline": "feat: rename MockResponse keys to doGenerate/doStream",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-18T11:39:59Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "7bd22c08432ba3aa272c32dd46bfcc6be5e167af",
"body": "The pluralize refactor renamed the namespaces but left the files singular.\nRename to match: stream.ts -> streams.ts (Streams), iterable.ts ->\niterables.ts (Iterables), content.ts -> content-parts.ts (ContentParts,\nmatching the sibling stream-parts.ts). Internal-only; public entry points\nand exports are unchanged.",
"is_bot": false,
"headline": "refactor: rename files to match pluralized namespaces",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-16T14:28:37Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "b2efc6d0619e82fc7b96a9fe3267d5432aafaf8d",
"body": null,
"is_bot": false,
"headline": "chore(main): release 1.3.0 (#6)",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-15T12:49:10Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "04c5a28f7f68a5b4278b675fc533a898d489e24f",
"body": "Root-level, layer-agnostic builders for the provider errors a mock model\nthrows, to drive retry, fallback, and error-handling tests:\n\n- Errors.from: generic APICallError builder; isRetryable is left to\n APICallError to derive from the status code (408/409/429/5xx)\n- rateLimited (429), serviceUnavai\n[…]\n\n internalServerError (500), badRequest (400), unauthorized (401)\n- timeout / abort: TimeoutError / AbortError DOMExceptions\n- RetryAfter (number | Date | { ms }) maps to retry-after / retry-after-ms",
"is_bot": false,
"headline": "feat: add Errors namespace for mocking provider errors",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-15T12:46:17Z",
"body_truncated": true,
"is_coding_agent": false
},
{
"oid": "4d2302570aa103a85db34fb62eed7bcc4d8e921e",
"body": null,
"is_bot": false,
"headline": "chore(main): release 1.2.0 (#5)",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-15T09:30:47Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "b090ad5ec2ffffa075b2ba7849f4c71f8d066f64",
"body": "Stream and Iterable operate on any ReadableStream<PART> / AsyncIterable<ITEM>,\nso they no longer belong under ai-test-kit/language. Move them to the root\nai-test-kit entry (with StreamDelayOptions); MockLanguageModel keeps using\nsimulateStream internally. Drop the language-specific Stream.text() and\n[…]\n construction verb stays (mirrors Array.from and the Mock*.from\nfactories).\n\nImport Stream/Iterable from 'ai-test-kit' (now Streams/Iterables); Content is\nnow ContentParts from 'ai-test-kit/language'.",
"is_bot": false,
"headline": "refactor: move Stream/Iterable to root and pluralize builder namespaces",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-15T09:25:08Z",
"body_truncated": true,
"is_coding_agent": false
},
{
"oid": "c23af4840efdd2d5a9d61977880463398327cd31",
"body": "Add MockEmbeddingModel (ai-test-kit/embedding) and MockImageModel\n(ai-test-kit/image), mirroring MockLanguageModel: a from() factory over\nthe V3 spec, vi.fn() spies with doEmbedCalls/doGenerateCalls history,\nauto model ids, and identity/capability overrides. Sequencing reuses the\ntop-level-array convention; an embeddings matrix / images array is one\nnesting level shallower, so single and sequenced responses never collide.\n\nExtract the shared model-id counter to internal/identity.ts.",
"is_bot": false,
"headline": "feat: add embedding and image model mocks",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-12T10:41:58Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "4cb79a23ea400309b0a65ea5a5f08a2a24d3c1e3",
"body": "Correct the UIMessageParts example (the tool is `search`, so `tool-weather`\nwas not a valid key) and make the UIMessagePartOf / UIMessageChunkOf prefix\nexamples concrete: parts resolve per-tool, chunks resolve to the fixed tool\nlifecycle tags. Note that matching is by assignability, so a bare `tool`\nprefix is `never` and the `tool-${string}` template is required.",
"is_bot": false,
"headline": "docs: fix tool part key and clarify tool-${string} prefix selection",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-11T11:37:32Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "8d62f9b8874fb7005d415f02d5bf858c647cce19",
"body": null,
"is_bot": false,
"headline": "docs: enlarge checkmarks and add spacing below logo mark",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-11T11:21:11Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "3775af619172f58b42b21fd10eb86b6d8f519b40",
"body": null,
"is_bot": false,
"headline": "docs: add logo and banner assets, logo into README",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-11T11:15:37Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "d30681515dfb21c07c500ac1dd6a9f4cccf85637",
"body": "GitHub is removing the Node 20 runner. Move the actions still on Node 20\nto their Node 24 majors: pnpm/action-setup v4 -> v6 (ci + release) and\ngoogleapis/release-please-action v4 -> v5. v5's only breaking change is\nthe runtime bump; inputs and manifest mode are unchanged.",
"is_bot": false,
"headline": "ci: bump actions to Node 24 runtimes (#4)",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-11T11:14:40Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "c0b963345c8ef6353a75bc5fe144b231d9308635",
"body": null,
"is_bot": false,
"headline": "chore(main): release 1.1.0 (#3)",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-11T11:00:07Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "dfcd094c0595ec9567c1e0438038c699758e5e72",
"body": "The declaration bundler inlined fromUIMessage's anonymous return type by\nexpanding the generic Omit<Extract<…>> argument shapes into a\nnon-homomorphic Exclude<\"field\" & keyof …> distribution, which dropped\nevery optional modifier. Bound builders such as UIChunks.textStart({ id })\nthen wrongly requir\n[…]\ned-only args.\nIt lives in test-d/ with its own tsconfig and runs via `pnpm test:types`\nafter a build, since the defect surfaces only in the bundled .d.mts and a\nsource-level type test cannot catch it.",
"is_bot": false,
"headline": "fix(ui): preserve optional fields in fromUIMessage bound builders",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-11T10:55:55Z",
"body_truncated": true,
"is_coding_agent": false
},
{
"oid": "1510477e207eea9c15f87ef0d4c3f3012f5677c0",
"body": "Add InferUIMessagePart, UIMessagePartOf / UIMessageChunkOf, and the\nUIMessageParts / UIMessageChunks bundles to ai-test-kit/ui — the type-level\ncounterpart to fromUIMessage for selecting part/chunk variants by type.\n\nEnforce types too: a `typecheck` script (tsc --noEmit) run in CI, vitest\ntypecheck enabled so `*.test-d.ts` run with the suite, and exhaustive type\ntests for every UI builder and inferer.",
"is_bot": false,
"headline": "feat(ui): add UIMessage type inferers",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-11T10:14:37Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "ff50804844341acafc004dbb8a402c02e0157230",
"body": null,
"is_bot": false,
"headline": "chore(main): release 1.0.1 (#2)",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-11T09:16:21Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "564d13bfeb2d7aa4f2098caa6cb24ba458dfc432",
"body": "These builders declared the wide UIMessagePart/UIMessageChunk union as\ntheir return type, forcing an `as` cast when assigning a built part to its\nspecific member type. Narrow them to the precise variant via PartOf/ChunkOf,\nand make PartArgs distributive so dynamic-tool args keep their per-state\ndiscrimination.",
"is_bot": false,
"headline": "fix(ui): narrow data/tool/dynamicTool builder return types",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-11T08:29:46Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "0c5604a2807ba995d844aa19922e77eb985ecbd0",
"body": "…mponents--ai-test-kit\n\nchore(main): release 1.0.0",
"is_bot": false,
"headline": "Merge pull request #1 from zirkelc/release-please--branches--main--co…",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-11T07:51:53Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "d9ca5a9c2c69318aa21abed190640fd095c0059b",
"body": null,
"is_bot": false,
"headline": "chore(main): release 1.0.0",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-11T07:47:32Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "b2d10be9be4ca121fc824c4cf247a752a10149ec",
"body": null,
"is_bot": false,
"headline": "docs: tighten intro and drop ai/test reference",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-11T07:46:53Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "7f47b749db7c71448e682870d212a7721fc14b7b",
"body": "The `lint:ci` step and the lint-staged pre-commit formatter already cover\nformatting, so the separate `format:ci` step in the lint job was redundant.\nAlso expands the README intro paragraph.\n\nRelease-As: 1.0.0",
"is_bot": false,
"headline": "ci: drop redundant format check from lint job",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-11T07:35:56Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "309536448bd519b7c439f6c5a47bddbdd666d0b6",
"body": "Drop the redundant `LanguageModelV3StreamResult` arm from `StreamResponse`\n(the bare `ReadableStream` arm and the function form cover it). Accept a bare\nunified finish-reason string in the `{ content, finishReason }` form, matching\n`StreamParts.finish`. Document and test the `doGenerate`/`doStream` function\nforms and `generateResult`. Fix `UIChunks.toolInput` double-encoding string\ninputs by routing through `toJSONString` like the language-layer builders.",
"is_bot": false,
"headline": "refactor: simplify stream response union and align builders",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-11T07:00:50Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "79a7a4397c6ec7f8838b0bfe2ba176c2cdf9eabe",
"body": "Add an `Iterable` namespace (from/toArray/toStream) as the async-iterable\ncomplement to `Stream`, and `Stream.toIterable` so the two bridge both ways.\nAlso accept a `ReadableStream` as a stream response: `streamResult(stream)`\nwraps it as-is and `from({ stream: <ReadableStream> })` now resolves a bare\nstream. Helpers ported (inlined) from ai-stream-utils.",
"is_bot": false,
"headline": "feat: add Iterable namespace and stream/iterable bridges",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-10T16:59:31Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "1731d43a37417a474900cb8a7995eb5e023ba149",
"body": "Add `abortSignal` to `StreamDelayOptions` and auto-wire the doStream call's\nsignal into every simulated stream, so a stream aborted mid-flight rejects\nwith an AbortError like a real provider. Replace the `simulateReadableStream`\ncall with a single in-house `simulateStream` port (delay-before-each-part,\n`null` skips) extended with abort handling, dropping the `ai` import.",
"is_bot": false,
"headline": "feat: error simulated streams with AbortError on abort",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-10T16:35:56Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "6a0df1dd14d9549976bedab43b6194d4da79aef3",
"body": null,
"is_bot": false,
"headline": "feat: add publishConfig for public access in package.json",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-10T15:39:00Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "5171228bea4eda494537ca5362f9c1184ab2e56c",
"body": null,
"is_bot": false,
"headline": "fix tsdown",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-10T15:37:53Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "2d04342433e45352cc2f83f30a73967ec055910b",
"body": "Add an `ai-test-kit/ui` entry point with UIParts, UIChunks, UIMessages,\nand fromUIMessage builders for the AI SDK UI layer (UIMessagePart,\nUIMessageChunk, UIMessage), optionally bound to a custom UIMessage type\nvia fromUIMessage().\n\nReshape MockLanguageModel from a callable factory into a plain name\n[…]\nname .result() to\n.generateResult() to pair with .streamResult().\n\nExpand the README API reference to per-method signatures with examples,\ngrouped by layer, and cover both layers in the Usage section.",
"is_bot": false,
"headline": "feat: add UI message builders and reshape MockLanguageModel namespace",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-10T15:27:02Z",
"body_truncated": true,
"is_coding_agent": false
},
{
"oid": "d6cf148c196d3145171792e4360da0cf10ce7b30",
"body": "Add the namespaced testing API under the ai-test-kit/language subpath:\nMockLanguageModel (vi.fn-spy mock plus result builders), Content and\nStreamParts atom builders, Stream operations, and Options determinism\nhelpers. Includes co-located tests, README, and release-please CI and\npublish workflows. Renames the package to ai-test-kit.",
"is_bot": false,
"headline": "feat: implement mock language model test utilities",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-09T15:08:01Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "48f9666958bdcb6b5fe04f6b66636314eb99c348",
"body": null,
"is_bot": false,
"headline": "chore: rename package to ai-sdk-test",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-08T09:29:48Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "fc766170a78e33a6a1eb209375cbffe05566ef52",
"body": null,
"is_bot": false,
"headline": "fix: point types to emitted dist/index.d.mts",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-08T09:25:31Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "e339b757191addbc72c889aa77d3b764015afcaf",
"body": null,
"is_bot": false,
"headline": "chore: reserve ai-test",
"author_name": "zirkelc",
"author_login": "zirkelc",
"committed_at": "2026-06-08T09:23:34Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "562f0a3c222e63def9e09a09f3f76d02cfd3f7c3",
"body": null,
"is_bot": false,
"headline": "Initial commit",
"author_name": "Chris Cook",
"author_login": "zirkelc",
"committed_at": "2026-06-08T09:22:32Z",
"body_truncated": false,
"is_coding_agent": false
}
],
"releases_count": 24,
"commits_last_year": 54,
"latest_release_at": "2026-07-24T14:27:54Z",
"latest_release_tag": "v3.2.0",
"releases_from_tags": false,
"days_since_last_push": 10,
"active_weeks_last_year": 6,
"days_since_latest_release": 10,
"mean_days_between_releases": 3.2
},
"artifacts": {
"collected": true,
"structure": [],
"declarations": [
{
"name": "ai-test-kit",
"path": "package.json",
"tokens": [
"npm.entry",
"npm.peer_dependencies"
],
"ecosystem": "npm"
}
]
},
"community": {
"has_readme": true,
"has_license": true,
"readme_badges": {
"hosts": [
"shields.io"
],
"total": 2,
"header": 2,
"collected": true,
"has_inspect_badge": false
},
"has_description": true,
"has_contributing": false,
"health_percentage": 42,
"has_issue_template": false,
"has_code_of_conduct": false,
"has_pull_request_template": false
},
"ecosystem": {
"packages": [
{
"name": "ai-test-kit",
"exists": true,
"license": "MIT",
"keywords": [],
"ecosystem": "npm",
"categories": [],
"matches_repo": true,
"registry_url": "https://www.npmjs.com/package/ai-test-kit",
"declared_type": null,
"is_deprecated": false,
"latest_version": "3.2.0",
"repository_url": "https://github.com/zirkelc/ai-test-kit",
"versions_count": 25,
"total_downloads": null,
"dependents_count": null,
"deprecation_note": null,
"maintainers_count": 1,
"monthly_downloads": 6702,
"first_published_at": "2026-06-10T15:39:49.210000Z",
"latest_published_at": "2026-07-24T14:28:32.537000Z",
"latest_version_yanked": null,
"days_since_latest_publish": 10
}
]
},
"popularity": {
"forks": 0,
"stars": 31,
"watchers": 0,
"fork_history": {
"days": [],
"complete": true,
"collected": 0,
"total_forks": 0
},
"star_history": null,
"open_issues_and_prs": 0
},
"ai_readiness": {
"has_nix": false,
"example_dirs": [],
"has_llms_txt": false,
"has_dockerfile": false,
"has_mcp_signal": false,
"bootstrap_files": [],
"api_schema_files": [],
"has_devcontainer": false,
"typecheck_configs": [
"test-d/tsconfig.json",
"tsconfig.json"
],
"toolchain_manifests": [],
"largest_source_bytes": 15918,
"source_files_sampled": 51,
"oversized_source_files": 0,
"agent_instruction_files": [],
"agent_instruction_max_bytes": null
},
"dependencies": {
"manifests": [
"package.json"
],
"advisories": {
"error": null,
"scope": "published_package",
"source": "osv",
"findings": [],
"collected": true,
"malicious": [],
"truncated": false,
"by_severity": {},
"advisory_count": 0,
"affected_count": 0,
"assessed_count": 1,
"malicious_count": 0,
"assessed_package": "npm:ai-test-kit@3.2.0",
"unassessed_count": 0,
"direct_affected_count": 0
},
"ecosystems": [
"npm"
],
"dependencies": [
{
"name": "@vitest/spy",
"manifest": "package.json",
"ecosystem": "npm",
"version_constraint": "^4.0.0"
}
],
"all_dependencies": {
"error": "GitHub dependency-graph SBOM unavailable (404); the dependency graph may be disabled for this repository",
"source": null,
"packages": [],
"collected": false,
"truncated": false,
"total_count": null,
"direct_count": null,
"indirect_count": null
}
},
"maintainership": {
"issues": {
"open_prs": 0,
"merged_prs": 27,
"open_issues": 0,
"closed_ratio": null,
"closed_issues": 0,
"closed_unmerged_prs": 1
},
"bus_factor": 1,
"bot_contributors": 0,
"top_contributors": [
{
"type": "User",
"login": "zirkelc",
"commits": 54,
"avatar_url": "https://avatars.githubusercontent.com/u/950244?v=4"
}
],
"contributors_sampled": 1,
"top_contributor_share": 1
},
"quality_signals": {
"has_ci": true,
"has_tests": true,
"ci_workflows": [
"ci.yml",
"release.yml"
],
"has_docs_dir": false,
"linter_configs": [],
"has_editorconfig": true,
"has_linter_config": false,
"has_precommit_config": false
},
"security_signals": {
"lockfiles": [
"pnpm-lock.yaml"
],
"scorecard": {
"checks": [
{
"name": "Binary-Artifacts",
"score": 10,
"reason": "no binaries found in the repo",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#binary-artifacts"
},
{
"name": "Branch-Protection",
"score": 0,
"reason": "branch protection not enabled on development/release branches",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#branch-protection"
},
{
"name": "CI-Tests",
"score": 10,
"reason": "13 out of 13 merged PRs checked by a CI test -- score normalized to 10",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#ci-tests"
},
{
"name": "CII-Best-Practices",
"score": 0,
"reason": "no effort to earn an OpenSSF best practices badge detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#cii-best-practices"
},
{
"name": "Code-Review",
"score": 0,
"reason": "Found 0/30 approved changesets -- score normalized to 0",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#code-review"
},
{
"name": "Contributors",
"score": 6,
"reason": "project has 2 contributing companies or organizations -- score normalized to 6",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#contributors"
},
{
"name": "Dangerous-Workflow",
"score": 10,
"reason": "no dangerous workflow patterns detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#dangerous-workflow"
},
{
"name": "Dependency-Update-Tool",
"score": 0,
"reason": "no update tool detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#dependency-update-tool"
},
{
"name": "Fuzzing",
"score": 0,
"reason": "project is not fuzzed",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#fuzzing"
},
{
"name": "License",
"score": 10,
"reason": "license file detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#license"
},
{
"name": "Maintained",
"score": 0,
"reason": "project was created within the last 90 days. Please review its contents carefully",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#maintained"
},
{
"name": "Packaging",
"score": null,
"reason": "packaging workflow not detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#packaging"
},
{
"name": "Pinned-Dependencies",
"score": 0,
"reason": "dependency not pinned by hash detected -- score normalized to 0",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#pinned-dependencies"
},
{
"name": "SAST",
"score": 0,
"reason": "SAST tool is not run on all commits -- score normalized to 0",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#sast"
},
{
"name": "Security-Policy",
"score": 0,
"reason": "security policy file not detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#security-policy"
},
{
"name": "Signed-Releases",
"score": null,
"reason": "no releases found",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#signed-releases"
},
{
"name": "Token-Permissions",
"score": 0,
"reason": "detected GitHub workflow tokens with excessive permissions",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#token-permissions"
},
{
"name": "Vulnerabilities",
"score": 0,
"reason": "28 existing vulnerabilities detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#vulnerabilities"
}
],
"commit": "a9fc913a689f7bae5aaa6b051e62c00595e25920",
"ran_at": "2026-08-04T07:02:17Z",
"aggregate_score": 2.6,
"scorecard_version": "v5.5.0"
},
"has_codeql_workflow": false,
"has_security_policy": false,
"has_dependabot_config": false
},
"contribution_flow": {
"collected": true,
"recent_prs": {
"merged_7d": 0,
"decided_7d": 0,
"merged_30d": 2,
"authors_30d": 1,
"decided_30d": 2,
"sample_size": 28,
"window_days": 30,
"sample_exhausted": false,
"authors_probed_30d": 1,
"newcomer_merged_30d": 0,
"bot_prs_excluded_30d": 0,
"newcomer_authors_30d": 0,
"newcomer_decided_30d": 0
},
"ci_last_run_at": "2026-07-24T14:28:38Z",
"oldest_open_prs": [],
"last_merged_pr_at": "2026-07-24T14:27:21Z",
"ci_last_conclusion": "SUCCESS",
"oldest_open_issues": []
}
},
"config": {
"disabled_metrics": [],
"disabled_categories": [],
"disabled_components": {}
},
"source": {
"url": "https://github.com/zirkelc/ai-test-kit",
"host": "github.com",
"name": "ai-test-kit",
"owner": "zirkelc"
},
"metrics": {
"overall": {
"key": "overall",
"band": "moderate",
"name": "Overall health",
"note": "The weighted overall 55 is calibrated to 57 on the published index scale (record calibration 2026-08-02).",
"notes": [
{
"code": "overall_calibration",
"params": {
"raw": 55,
"calibrated": 57,
"calibration": "2026-08-02"
}
}
],
"value": 57,
"inputs": {
"security": 41,
"vitality": 69,
"community": 43,
"governance": 56,
"calibration": "2026-08-02",
"engineering": 64,
"ai_readiness": 52,
"weighted_overall_raw": 55
},
"components": []
},
"categories": [
{
"key": "vitality",
"band": "good",
"name": "Vitality",
"value": 69,
"weight": 0.21,
"metrics": [
{
"key": "development_activity",
"band": "weak",
"name": "Development activity",
"note": null,
"notes": [],
"value": 49,
"inputs": {
"commits_last_year": 54,
"human_commit_share": 1,
"days_since_last_push": 10,
"active_weeks_last_year": 6
},
"components": [
{
"key": "push_recency",
"name": "Push recency",
"detail": "last push 10 days ago",
"points": 28.8,
"status": "partial",
"details": [
{
"code": "push_recency",
"params": {
"days": 10
}
}
],
"max_points": 36
},
{
"key": "commit_cadence",
"name": "Commit cadence",
"detail": "6/52 weeks with commits",
"points": 4.2,
"status": "partial",
"details": [
{
"code": "commit_cadence_weeks",
"params": {
"weeks": 6
}
}
],
"max_points": 36
},
{
"key": "commit_volume",
"name": "Commit volume",
"detail": "54 commits in the last year",
"points": 15.6,
"status": "partial",
"details": [
{
"code": "commits_last_year",
"params": {
"count": 54
}
}
],
"max_points": 18
},
{
"key": "openssf_scorecard_maintained",
"name": "OpenSSF Scorecard: Maintained",
"detail": "project was created within the last 90 days. Please review its contents carefully",
"points": 0,
"status": "missed",
"details": [],
"max_points": 10
}
]
},
{
"key": "release_discipline",
"band": "exceptional",
"name": "Release discipline",
"note": "Excluded from scoring (no data or not applicable): OpenSSF Scorecard: Signed-Releases. Remaining weights renormalized.",
"notes": [
{
"code": "excluded_no_data",
"params": {
"components": [
"openssf_scorecard_signed_releases"
]
}
},
{
"code": "weights_renormalized",
"params": {}
}
],
"value": 100,
"inputs": {
"releases_count": 24,
"latest_release_tag": "v3.2.0",
"releases_from_tags": false,
"days_since_latest_release": 10,
"mean_days_between_releases": 3.2
},
"components": [
{
"key": "ships_releases",
"name": "Ships releases",
"detail": "24 releases published",
"points": 27,
"status": "met",
"details": [
{
"code": "releases_published",
"params": {
"count": 24
}
}
],
"max_points": 27
},
{
"key": "release_recency",
"name": "Release recency",
"detail": "latest release 10 days ago",
"points": 36,
"status": "met",
"details": [
{
"code": "release_recency",
"params": {
"days": 10
}
}
],
"max_points": 36
},
{
"key": "release_cadence",
"name": "Release cadence",
"detail": "a release every ~3.2 days",
"points": 27,
"status": "met",
"details": [
{
"code": "release_cadence",
"params": {
"gap": 3.2
}
}
],
"max_points": 27
},
{
"key": "openssf_scorecard_signed_releases",
"name": "OpenSSF Scorecard: Signed-Releases",
"detail": "no releases found",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_data",
"params": {}
}
],
"max_points": 10
}
]
},
{
"key": "abandonment",
"band": "exceptional",
"name": "Abandonment",
"note": null,
"notes": [],
"value": 100,
"inputs": {
"cap": null,
"state": "unverified",
"guards": [],
"signals": [],
"red_flag": false,
"multiplier_pct": 100,
"declared_reason": null,
"unverified_reason": "repository_too_young",
"unanswered_open_prs": null,
"unanswered_open_issues": null,
"days_since_last_merged_pr": null,
"days_since_last_human_commit": null,
"days_since_last_human_commit_is_floor": false
},
"components": [
{
"key": "project_is_still_maintained",
"name": "Project is still maintained",
"detail": "maintenance record not established from the collected data",
"points": 100,
"status": "met",
"details": [
{
"code": "abandonment_unverified",
"params": {}
}
],
"max_points": 100
}
]
}
],
"description": "Is the project alive — is code being written and are releases shipping?"
},
{
"key": "community",
"band": "weak",
"name": "Community & Adoption",
"value": 43,
"weight": 0.17,
"metrics": [
{
"key": "popularity",
"band": "at_risk",
"name": "Popularity & adoption",
"note": null,
"notes": [],
"value": 24,
"inputs": {
"forks": 0,
"stars": 31,
"watchers": 0,
"growth_state": "unverified",
"growth_factor_pct": 100,
"growth_unverified_reason": "no_history"
},
"components": [
{
"key": "stars",
"name": "Stars",
"detail": "31 stars",
"points": 24,
"status": "partial",
"details": [
{
"code": "stars",
"params": {
"count": 31
}
}
],
"max_points": 60
},
{
"key": "forks",
"name": "Forks",
"detail": "0 forks",
"points": 0,
"status": "missed",
"details": [
{
"code": "forks",
"params": {
"count": 0
}
}
],
"max_points": 25
},
{
"key": "watchers",
"name": "Watchers",
"detail": "0 watchers",
"points": 0,
"status": "missed",
"details": [
{
"code": "watchers",
"params": {
"count": 0
}
}
],
"max_points": 15
}
]
},
{
"key": "community_health",
"band": "moderate",
"name": "Community health",
"note": null,
"notes": [],
"value": 50,
"inputs": {
"has_readme": true,
"has_license": true,
"readme_badges": 2,
"has_contributing": false,
"has_issue_template": false,
"has_code_of_conduct": false,
"readme_badge_services": [
"shields.io"
],
"has_pull_request_template": false
},
"components": [
{
"key": "readme",
"name": "README",
"detail": null,
"points": 22.5,
"status": "met",
"details": [],
"max_points": 22.5
},
{
"key": "license",
"name": "License",
"detail": "recognized license (MIT)",
"points": 22.5,
"status": "met",
"details": [
{
"code": "license_standard",
"params": {}
},
{
"code": "license_spdx",
"params": {
"spdx": "MIT"
}
}
],
"max_points": 22.5
},
{
"key": "contributing_guide",
"name": "CONTRIBUTING guide",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 18
},
{
"key": "code_of_conduct",
"name": "Code of conduct",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 13.5
},
{
"key": "issue_template",
"name": "Issue template",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 7.2
},
{
"key": "pr_template",
"name": "PR template",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 6.3
}
]
},
{
"key": "ecosystem_adoption",
"band": "moderate",
"name": "Ecosystem adoption (downloads)",
"note": "Excluded from scoring (no data or not applicable): Registry dependents. Remaining weights renormalized.",
"notes": [
{
"code": "excluded_no_data",
"params": {
"components": [
"registry_dependents"
]
}
},
{
"code": "weights_renormalized",
"params": {}
}
],
"value": 64,
"inputs": {
"packages": [
"ai-test-kit"
],
"dependents": null,
"ecosystems": "npm",
"total_downloads": null,
"monthly_downloads": 6702
},
"components": [
{
"key": "monthly_downloads",
"name": "Monthly downloads",
"detail": "6,702 downloads/month across npm",
"points": 51,
"status": "partial",
"details": [
{
"code": "downloads_monthly",
"params": {
"count": 6702,
"ecosystems": "npm"
}
}
],
"max_points": 80
},
{
"key": "registry_dependents",
"name": "Registry dependents",
"detail": "not reported by this ecosystem",
"points": 0,
"status": "excluded",
"details": [
{
"code": "not_reported_by_this_ecosystem",
"params": {}
}
],
"max_points": 20
}
]
}
],
"description": "Does the project have users, downloads, attention, and a welcoming setup for contributors?"
},
{
"key": "governance",
"band": "moderate",
"name": "Sustainability & Governance",
"value": 56,
"weight": 0.23,
"metrics": [
{
"key": "maintainer_resilience",
"band": "critical",
"name": "Maintainer resilience (bus factor)",
"note": null,
"notes": [],
"value": 16,
"inputs": {
"bus_factor": 1,
"contributors_sampled": 1,
"top_contributor_share": 1
},
"components": [
{
"key": "bus_factor",
"name": "Bus factor",
"detail": "1 contributor(s) cover half of all commits",
"points": 9,
"status": "partial",
"details": [
{
"code": "bus_factor",
"params": {
"count": 1
}
}
],
"max_points": 54
},
{
"key": "commit_distribution",
"name": "Commit distribution",
"detail": "top contributor authored 100% of commits",
"points": 0,
"status": "missed",
"details": [
{
"code": "top_contributor_share",
"params": {
"share": 100
}
}
],
"max_points": 22.5
},
{
"key": "contributor_breadth",
"name": "Contributor breadth",
"detail": "1 contributors",
"points": 1.4,
"status": "partial",
"details": [
{
"code": "contributors_sampled",
"params": {
"count": 1
}
}
],
"max_points": 13.5
},
{
"key": "openssf_scorecard_contributors",
"name": "OpenSSF Scorecard: Contributors",
"detail": "project has 2 contributing companies or organizations -- score normalized to 6",
"points": 6,
"status": "partial",
"details": [],
"max_points": 10
}
]
},
{
"key": "responsiveness",
"band": "moderate",
"name": "Issue & PR responsiveness",
"note": "Excluded from scoring (no data or not applicable): Issue resolution, Newcomer PR acceptance. Remaining weights renormalized.",
"notes": [
{
"code": "excluded_no_data",
"params": {
"components": [
"issue_resolution",
"newcomer_pr_acceptance"
]
}
},
{
"code": "weights_renormalized",
"params": {}
}
],
"value": 64,
"inputs": {
"merged_prs": 27,
"open_issues": 0,
"closed_issues": 0,
"prs_merged_7d": 0,
"prs_decided_7d": 0,
"prs_merged_30d": 2,
"prs_decided_30d": 2,
"issue_closed_ratio": null,
"closed_unmerged_prs": 1,
"first_time_authors_30d": 0,
"first_time_prs_merged_30d": 0,
"first_time_prs_decided_30d": 0
},
"components": [
{
"key": "issue_resolution",
"name": "Issue resolution",
"detail": "no issues or no data",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_issues_or_data",
"params": {}
}
],
"max_points": 42
},
{
"key": "pr_acceptance",
"name": "PR acceptance",
"detail": "27/28 decided PRs merged",
"points": 28.9,
"status": "partial",
"details": [
{
"code": "decided_prs_merged",
"params": {
"merged": 27,
"decided": 28
}
}
],
"max_points": 30
},
{
"key": "newcomer_pr_acceptance",
"name": "Newcomer PR acceptance",
"detail": "no first-time contributor's PR decided in 30d",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_newcomer_prs",
"params": {
"days": 30
}
}
],
"max_points": 13
},
{
"key": "openssf_scorecard_code_review",
"name": "OpenSSF Scorecard: Code-Review",
"detail": "Found 0/30 approved changesets -- score normalized to 0",
"points": 0,
"status": "missed",
"details": [],
"max_points": 15
}
]
},
{
"key": "stewardship",
"band": "moderate",
"name": "Ownership & stewardship",
"note": "Excluded from scoring (no data or not applicable): Verified domain. Remaining weights renormalized.",
"notes": [
{
"code": "excluded_no_data",
"params": {
"components": [
"verified_domain"
]
}
},
{
"code": "weights_renormalized",
"params": {}
}
],
"value": 61,
"inputs": {
"followers": 77,
"owner_type": "User",
"is_verified": null,
"owner_login": "zirkelc",
"public_repos": 158,
"account_age_days": 5482
},
"components": [
{
"key": "ownership_backing",
"name": "Ownership backing",
"detail": "personal (user) account",
"points": 10,
"status": "partial",
"details": [
{
"code": "owner_personal",
"params": {}
}
],
"max_points": 30
},
{
"key": "verified_domain",
"name": "Verified domain",
"detail": "not applicable to user accounts",
"points": 0,
"status": "excluded",
"details": [
{
"code": "not_applicable_to_user_accounts",
"params": {}
}
],
"max_points": 20
},
{
"key": "owner_reach",
"name": "Owner reach",
"detail": "77 followers of zirkelc",
"points": 13.6,
"status": "partial",
"details": [
{
"code": "owner_followers",
"params": {
"count": 77,
"login": "zirkelc"
}
}
],
"max_points": 25
},
{
"key": "track_record",
"name": "Track record",
"detail": "158 public repos, account ~15 yr old",
"points": 25,
"status": "met",
"details": [
{
"code": "public_repos",
"params": {
"count": 158
}
},
{
"code": "account_age_years",
"params": {
"years": 15
}
}
],
"max_points": 25
}
]
},
{
"key": "package_maintenance",
"band": "exceptional",
"name": "Package maintenance",
"note": null,
"notes": [],
"value": 100,
"inputs": {
"packages": [
"ai-test-kit"
],
"ecosystems": "npm",
"any_deprecated": false,
"min_days_since_publish": 10
},
"components": [
{
"key": "published_resolvable",
"name": "Published & resolvable",
"detail": "1 package(s) on npm",
"points": 25,
"status": "met",
"details": [
{
"code": "packages_published",
"params": {
"count": 1,
"ecosystems": "npm"
}
}
],
"max_points": 25
},
{
"key": "publish_recency",
"name": "Publish recency",
"detail": "latest publish 10 days ago",
"points": 35,
"status": "met",
"details": [
{
"code": "publish_recency",
"params": {
"days": 10
}
}
],
"max_points": 35
},
{
"key": "version_history",
"name": "Version history",
"detail": "25 published versions",
"points": 20,
"status": "met",
"details": [
{
"code": "published_versions",
"params": {
"count": 25
}
}
],
"max_points": 20
},
{
"key": "not_deprecated",
"name": "Not deprecated",
"detail": "active, not deprecated or yanked",
"points": 20,
"status": "met",
"details": [
{
"code": "package_not_deprecated",
"params": {}
}
],
"max_points": 20
}
]
}
],
"description": "Will the project survive its people — bus factor, responsiveness, who backs it, and package upkeep?"
},
{
"key": "engineering",
"band": "moderate",
"name": "Engineering Quality",
"value": 64,
"weight": 0.19,
"metrics": [
{
"key": "engineering_practices",
"band": "good",
"name": "Engineering practices",
"note": null,
"notes": [],
"value": 74,
"inputs": {
"has_ci": true,
"has_tests": true,
"has_editorconfig": true,
"has_linter_config": false,
"has_precommit_config": false
},
"components": [
{
"key": "ci_workflows",
"name": "CI workflows",
"detail": "2 workflow(s)",
"points": 24,
"status": "met",
"details": [
{
"code": "ci_workflows",
"params": {
"count": 2
}
}
],
"max_points": 24
},
{
"key": "tests_present",
"name": "Tests present",
"detail": null,
"points": 24,
"status": "met",
"details": [],
"max_points": 24
},
{
"key": "linter_config",
"name": "Linter config",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 16
},
{
"key": "pre_commit_hooks",
"name": "Pre-commit hooks",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 9.6
},
{
"key": "editorconfig",
"name": ".editorconfig",
"detail": null,
"points": 6.4,
"status": "met",
"details": [],
"max_points": 6.4
},
{
"key": "openssf_scorecard_ci_tests",
"name": "OpenSSF Scorecard: CI-Tests",
"detail": "13 out of 13 merged PRs checked by a CI test -- score normalized to 10",
"points": 20,
"status": "met",
"details": [],
"max_points": 20
}
]
},
{
"key": "documentation",
"band": "moderate",
"name": "Documentation",
"note": null,
"notes": [],
"value": 50,
"inputs": {
"topics": [],
"has_wiki": true,
"homepage": null,
"has_readme": true,
"has_docs_dir": false,
"has_description": true
},
"components": [
{
"key": "readme",
"name": "README",
"detail": null,
"points": 30,
"status": "met",
"details": [],
"max_points": 30
},
{
"key": "documentation_directory",
"name": "Documentation directory",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 25
},
{
"key": "documentation_homepage_site",
"name": "Documentation / homepage site",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 15
},
{
"key": "repository_description",
"name": "Repository description",
"detail": null,
"points": 10,
"status": "met",
"details": [],
"max_points": 10
},
{
"key": "topics",
"name": "Topics",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 10
},
{
"key": "wiki",
"name": "Wiki",
"detail": null,
"points": 10,
"status": "met",
"details": [],
"max_points": 10
}
]
}
],
"description": "Are baseline engineering and documentation practices in place?"
},
{
"key": "security",
"band": "weak",
"name": "Security",
"value": 41,
"weight": 0.16,
"metrics": [
{
"key": "security_posture",
"band": "at_risk",
"name": "Security posture",
"note": "Excluded from scoring (no data or not applicable): Packaging, Signed-Releases. Remaining weights renormalized.",
"notes": [
{
"code": "excluded_no_data",
"params": {
"components": [
"packaging",
"signed_releases"
]
}
},
{
"code": "weights_renormalized",
"params": {}
}
],
"value": 26,
"inputs": {
"source": "openssf_scorecard",
"checks_evaluated": 16,
"scorecard_version": "v5.5.0",
"checks_inconclusive": 2,
"scorecard_aggregate": 2.6
},
"components": [
{
"key": "binary_artifacts",
"name": "Binary-Artifacts",
"detail": "no binaries found in the repo",
"points": 7.5,
"status": "met",
"details": [],
"max_points": 7.5
},
{
"key": "branch_protection",
"name": "Branch-Protection",
"detail": "branch protection not enabled on development/release branches",
"points": 0,
"status": "missed",
"details": [],
"max_points": 7.5
},
{
"key": "ci_tests",
"name": "CI-Tests",
"detail": "13 out of 13 merged PRs checked by a CI test -- score normalized to 10",
"points": 2.5,
"status": "met",
"details": [],
"max_points": 2.5
},
{
"key": "cii_best_practices",
"name": "CII-Best-Practices",
"detail": "no effort to earn an OpenSSF best practices badge detected",
"points": 0,
"status": "missed",
"details": [],
"max_points": 2.5
},
{
"key": "code_review",
"name": "Code-Review",
"detail": "Found 0/30 approved changesets -- score normalized to 0",
"points": 0,
"status": "missed",
"details": [],
"max_points": 7.5
},
{
"key": "contributors",
"name": "Contributors",
"detail": "project has 2 contributing companies or organizations -- score normalized to 6",
"points": 1.5,
"status": "partial",
"details": [],
"max_points": 2.5
},
{
"key": "dangerous_workflow",
"name": "Dangerous-Workflow",
"detail": "no dangerous workflow patterns detected",
"points": 10,
"status": "met",
"details": [],
"max_points": 10
},
{
"key": "dependency_update_tool",
"name": "Dependency-Update-Tool",
"detail": "no update tool detected",
"points": 0,
"status": "missed",
"details": [],
"max_points": 7.5
},
{
"key": "fuzzing",
"name": "Fuzzing",
"detail": "project is not fuzzed",
"points": 0,
"status": "missed",
"details": [],
"max_points": 5
},
{
"key": "license",
"name": "License",
"detail": "license file detected",
"points": 2.5,
"status": "met",
"details": [],
"max_points": 2.5
},
{
"key": "maintained",
"name": "Maintained",
"detail": "project was created within the last 90 days. Please review its contents carefully",
"points": 0,
"status": "missed",
"details": [],
"max_points": 7.5
},
{
"key": "packaging",
"name": "Packaging",
"detail": "packaging workflow not detected",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_data",
"params": {}
}
],
"max_points": 5
},
{
"key": "pinned_dependencies",
"name": "Pinned-Dependencies",
"detail": "dependency not pinned by hash detected -- score normalized to 0",
"points": 0,
"status": "missed",
"details": [],
"max_points": 5
},
{
"key": "sast",
"name": "SAST",
"detail": "SAST tool is not run on all commits -- score normalized to 0",
"points": 0,
"status": "missed",
"details": [],
"max_points": 5
},
{
"key": "security_policy",
"name": "Security-Policy",
"detail": "security policy file not detected",
"points": 0,
"status": "missed",
"details": [],
"max_points": 5
},
{
"key": "signed_releases",
"name": "Signed-Releases",
"detail": "no releases found",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_data",
"params": {}
}
],
"max_points": 7.5
},
{
"key": "token_permissions",
"name": "Token-Permissions",
"detail": "detected GitHub workflow tokens with excessive permissions",
"points": 0,
"status": "missed",
"details": [],
"max_points": 7.5
},
{
"key": "vulnerabilities",
"name": "Vulnerabilities",
"detail": "28 existing vulnerabilities detected",
"points": 0,
"status": "missed",
"details": [],
"max_points": 7.5
}
]
},
{
"key": "dependency_advisories",
"band": "exceptional",
"name": "Dependency advisories",
"note": "Excluded from scoring (no data or not applicable): No advisories left outstanding. Remaining weights renormalized. Matched the npm:ai-test-kit@3.2.0 runtime dependency closure — what installing the published package pulls in — 1 packages. Reachability is not analyzed.",
"notes": [
{
"code": "excluded_no_data",
"params": {
"components": [
"no_advisories_left_outstanding"
]
}
},
{
"code": "weights_renormalized",
"params": {}
},
{
"code": "advisories_scope_published",
"params": {
"package": "npm:ai-test-kit@3.2.0",
"assessed": 1
}
},
{
"code": "advisories_reachability",
"params": {}
}
],
"value": 100,
"inputs": {
"source": "osv",
"advisories": 0,
"affected_packages": 0,
"assessed_packages": 1,
"unassessed_packages": 0,
"affected_by_severity": "none",
"direct_affected_packages": 0
},
"components": [
{
"key": "direct_dependencies_free_of_known_advisories",
"name": "Direct dependencies free of known advisories",
"detail": "no direct dependency carries a known advisory",
"points": 35,
"status": "met",
"details": [
{
"code": "no_direct_advisories",
"params": {}
}
],
"max_points": 35
},
{
"key": "indirect_dependencies_free_of_known_advisories",
"name": "Indirect dependencies free of known advisories",
"detail": "no indirect dependency carries a known advisory",
"points": 25,
"status": "met",
"details": [
{
"code": "no_indirect_advisories",
"params": {}
}
],
"max_points": 25
},
{
"key": "no_advisories_left_outstanding",
"name": "No advisories left outstanding",
"detail": "no advisory carries a publication date",
"points": 0,
"status": "excluded",
"details": [
{
"code": "advisories_no_publication_date",
"params": {}
}
],
"max_points": 40
}
]
},
{
"key": "malicious_dependencies",
"band": "exceptional",
"name": "Malicious dependencies",
"note": null,
"notes": [],
"value": 100,
"inputs": {
"source": "osv",
"meaning": "reported as a malicious package by the OpenSSF corpus; the remedy is removal or moving off the compromised name, never an upgrade of the same artifact. Versions the registry has since pulled are listed but not scored",
"packages": [],
"red_flag": false,
"assessed_packages": 1,
"malicious_packages": 0,
"direct_malicious_packages": 0,
"withdrawn_malicious_packages": 0,
"installable_malicious_packages": 0
},
"components": [
{
"key": "no_dependency_reported_as_a_malicious_package",
"name": "No dependency reported as a malicious package",
"detail": "no dependency is reported as a malicious package",
"points": 100,
"status": "met",
"details": [
{
"code": "no_malicious_dependencies",
"params": {}
}
],
"max_points": 100
}
]
},
{
"key": "high_risk_jurisdiction_exposure",
"band": "exceptional",
"name": "High-Risk Jurisdiction Exposure",
"note": "Only high-confidence self-published location evidence affects this multiplier. Ambiguous matches are review-only; country evidence is not proof of nationality, citizenship, legal registration, malicious intent, or sanctions status.",
"notes": [
{
"code": "jurisdiction_evidence_limits",
"params": {}
}
],
"value": 100,
"inputs": {
"meaning": "self-published location evidence; not nationality or citizenship",
"red_flag": false,
"exposures": [],
"policy_countries": [
"Russia",
"Iran",
"North Korea"
],
"commit_weight_rule": {
"min_commits": 50,
"min_commit_share": 0.1
},
"review_only_matches": 0,
"below_threshold_exposures": [],
"assessed_self_published_locations": 2
},
"components": [
{
"key": "policy_exposure_multiplier",
"name": "Policy exposure multiplier",
"detail": "no confirmed policy-scope location match",
"points": 100,
"status": "met",
"details": [
{
"code": "jurisdiction_no_match",
"params": {}
}
],
"max_points": 100
}
]
}
],
"description": "Are visible security and supply-chain practices strong, with no malicious dependency and no unresolved high-risk jurisdiction exposure?"
},
{
"key": "ai_readiness",
"band": "moderate",
"name": "AI Readiness",
"value": 52,
"weight": 0.04,
"metrics": [
{
"key": "ai_agent_context",
"band": "weak",
"name": "Agent context & guidance",
"note": null,
"notes": [],
"value": 40,
"inputs": {
"has_llms_txt": false,
"legible_history_share": 0.944,
"agent_instruction_files": [],
"agent_instruction_max_bytes": null
},
"components": [
{
"key": "agent_instructions",
"name": "Agent instructions",
"detail": "no CLAUDE.md / AGENTS.md / editor rules",
"points": 0,
"status": "missed",
"details": [
{
"code": "no_agent_instructions",
"params": {}
}
],
"max_points": 45
},
{
"key": "machine_readable_docs_llms_txt",
"name": "Machine-readable docs (llms.txt)",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 15
},
{
"key": "legible_commit_history",
"name": "Legible commit history",
"detail": "51 of 54 human commits state their intent (structured subject or explanatory body)",
"points": 40,
"status": "met",
"details": [
{
"code": "legible_history",
"params": {
"legible": 51,
"sampled": 54
}
}
],
"max_points": 40
}
]
},
{
"key": "ai_verify_loop",
"band": "weak",
"name": "Verify loop (build / test / typecheck)",
"note": null,
"notes": [],
"value": 43,
"inputs": {
"has_nix": false,
"has_tests": true,
"lockfiles": [
"pnpm-lock.yaml"
],
"has_dockerfile": false,
"typed_language": true,
"bootstrap_files": [],
"has_devcontainer": false,
"has_linter_config": false,
"typecheck_configs": [
"test-d/tsconfig.json",
"tsconfig.json"
],
"agent_commit_share": 0,
"toolchain_manifests": [],
"dependency_bot_commit_share": 0
},
"components": [
{
"key": "one_command_bootstrap",
"name": "One-command bootstrap",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 18
},
{
"key": "automated_tests",
"name": "Automated tests",
"detail": null,
"points": 22,
"status": "met",
"details": [],
"max_points": 22
},
{
"key": "lint_format_config",
"name": "Lint / format config",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 11
},
{
"key": "static_type_checking",
"name": "Static type checking",
"detail": "test-d/tsconfig.json, tsconfig.json",
"points": 11,
"status": "met",
"details": [
{
"code": "file_list",
"params": {
"files": "test-d/tsconfig.json, tsconfig.json"
}
}
],
"max_points": 11
},
{
"key": "reproducible_environment",
"name": "Reproducible environment",
"detail": "lockfile",
"points": 10,
"status": "met",
"details": [
{
"code": "file_list",
"params": {
"files": "lockfile"
}
}
],
"max_points": 10
},
{
"key": "demonstrated_agent_practice",
"name": "Demonstrated agent practice",
"detail": "no agent-authored commits among the last 54",
"points": 0,
"status": "missed",
"details": [
{
"code": "no_agent_authored_commits",
"params": {
"sampled": 54
}
}
],
"max_points": 10
},
{
"key": "automated_maintenance",
"name": "Automated maintenance",
"detail": "no automated dependency updates observed",
"points": 0,
"status": "missed",
"details": [
{
"code": "no_dependency_automation",
"params": {}
}
],
"max_points": 8
},
{
"key": "openssf_scorecard_pinned_dependencies",
"name": "OpenSSF Scorecard: Pinned-Dependencies",
"detail": "dependency not pinned by hash detected -- score normalized to 0",
"points": 0,
"status": "missed",
"details": [],
"max_points": 10
}
]
},
{
"key": "ai_code_legibility",
"band": "exceptional",
"name": "Code legibility for models",
"note": null,
"notes": [],
"value": 100,
"inputs": {
"primary_language": "TypeScript",
"largest_source_bytes": 15918,
"source_files_sampled": 51,
"oversized_source_files": 0
},
"components": [
{
"key": "type_checkable_code",
"name": "Type-checkable code",
"detail": "TypeScript (statically typed)",
"points": 45,
"status": "met",
"details": [
{
"code": "statically_typed_language",
"params": {
"language": "TypeScript"
}
}
],
"max_points": 45
},
{
"key": "manageable_file_sizes",
"name": "Manageable file sizes",
"detail": "0/51 source files over 60KB",
"points": 55,
"status": "met",
"details": [
{
"code": "oversized_source_files",
"params": {
"kb": 60,
"sampled": 51,
"oversized": 0
}
}
],
"max_points": 55
}
]
}
],
"description": "How well is the repo equipped to be developed and maintained with AI coding agents? Carries a deliberately small weight: agent tooling is a real maintenance signal, but its absence must never gate the top of the scale (calibration saturates at raw 91, so 100/100 remains reachable with AI Readiness at zero)."
}
],
"classification": {
"top": [
"library"
],
"labels": [
"library"
],
"scores": {
"library": 19
},
"primary": "library",
"evidence": [
{
"tier": "declared",
"label": "library",
"source": "npm.entry",
"weight": 8
},
{
"tier": "distribution",
"label": "library",
"source": "registry:npm",
"weight": 6
},
{
"tier": "declared",
"label": "library",
"source": "npm.peer_dependencies",
"weight": 3
},
{
"tier": "description",
"label": "library",
"source": "description:library",
"weight": 2
}
],
"artifacts": [
{
"path": "package.json",
"labels": [
"library"
],
"ecosystem": "npm"
}
],
"confidence": "high",
"host_extension": false,
"runs_as_process": false,
"consumed_by_code": true
},
"metrics_version": "2.5.0"
},
"warnings": [
"Star history unavailable: GitHub GraphQL error: Resource not accessible by personal access token",
"GitHub dependency-graph SBOM unavailable (404); the dependency graph may be disabled for this repository"
],
"report_type": "repository",
"generated_at": "2026-08-04T07:02:27.662724Z",
"schema_version": "0.30.0",
"badge_url": "https://raw.githubusercontent.com/inspect-software/badges/main/v1/z/zirkelc/ai-test-kit.svg",
"full_name": "zirkelc/ai-test-kit",
"license_state": "standard",
"license_spdx": "MIT"
}Scores are signals, not warranties. They reflect publicly visible practices on GitHub — not a code audit, and not a security guarantee.
Missing data is excluded and weights renormalized, never scored as zero. Methodology is versioned and open: metrics v2.5.0, schema v0.30.0 — full methodology · metrics wiki.
How one result sits in the wider record: aggregate statistics — npm.