Public record
Software health reportschema 0.27.0 · metrics 2.5.0 · 2026-07-28 15:56 UTC

Giskard-AI / giskard-oss

🐢 Open-Source Evaluation & Testing library for LLM Agents

PythonApache-2.0★ 5,722 stars⑂ 510 forkssince Mar 2022View on GitHub ↗

Giskard-AI/giskard-oss holds a health index of 96 out of 100, placing it in the Exceptional band. It scores highest on AI Readiness (92/100) and lowest on Security (76/100). It was last updated today. 3 contributors account for most of its recent work.

96
overall / 100
Exceptional

Software health index

Metrics are grouped into weighted categories on one standardized 1–100 scale. Overall starts as their weighted mean, calibrated against the distribution of the public record so bands carry percentile meaning; when public evidence triggers the High-Risk Jurisdiction Policy, the rating is adjusted and receives an At Risk ceiling of 34.

96
Exceptional93-100The record's top tier (≈ top 5%); essentially all checked criteria met
Excellent80-92Strong across the board; minor gaps
Good65-79Healthy; gaps are limited and manageable
Moderate50-64Acceptable with notable gaps; review recommended
Weak35-49Material weaknesses across several areas
At Risk20-34Significant weaknesses; adoption warrants caution
Critical1-19Severe problems (abandoned, single-maintainer, no hygiene)
VitalityCommunity &AdoptionSustainability &GovernanceEngineeringQualitySecurityAI Readiness

Score profile

Each axis is a category. The shape matters more than the average — a healthy subject fills the whole shape, while a spike-and-crater profile means strength in one dimension is masking risk in another.

The weighted overall 84 is calibrated to 96 on the published index scale (record calibration 2026-08-02).

Ownership

GiskardOrganization
268 followers34 public repossince Sep 2020

This repository is backed by an organization — shared, accountable stewardship that can outlive any single maintainer.

Package ecosystems

RegistryPackageVersionDownloads / moVersionsLast publishTags
PyPIgiskardpoints to another repo — not scored2.19.224,77311322 days agoartificial-intelligencemachine-learningqualitymlops
PyPIgiskard-llm1.0.0b55,550415 days ago
PyPIgiskard-core0.1.76,19313221 days ago
PyPIgiskard-scan1.0.0b3701215 days ago
PyPIgiskard-agents0.3.46,19112125 days ago
PyPIgiskard-checks1.0.2b55,903815 days ago

Metrics by category

Vitality

Is the project alive — is code being written and are releases shipping?

88Excellent · 21% of overall
How it's scored
36/36Push recency — last push 0 days ago
21.5/36Commit cadence — 31/52 weeks with commits
18/18Commit volume — 239 commits in the last year
10/10OpenSSF Scorecard: Maintained — 30 commit(s) and 6 issue activity found in the last 90 days -- score normalized to 10
Inputs used
commits_last_year239
human_commit_share0.74
days_since_last_push0
active_weeks_last_year31
How it's scored
27/27Ships releases — 100 releases published
36/36Release recency — latest release 15 days ago
27/27Release cadence — a release every ~3.8 days
0/10OpenSSF Scorecard: Signed-Releases — Project has not signed or included provenance with any releases.
Inputs used
releases_count100
latest_release_taggiskard-scan/v1.0.0b3
releases_from_tagsno
days_since_latest_release15
mean_days_between_releases3.8

Community & Adoption

Does the project have users, downloads, attention, and a welcoming setup for contributors?

87Excellent · 17% of overall
How it's scored
60/60Stars — 5,722 stars
22.6/25Forks — 510 forks
8.9/15Watchers — 41 watchers
Inputs used
forks510
stars5,722
watchers41
growth_stateunverified
growth_factor_pct100
growth_unverified_reasonno_history

Community health

92Excellent
How it's scored
22.5/22.5README
22.5/22.5License — recognized license (Apache-2.0)
18/18CONTRIBUTING guide
13.5/13.5Code of conduct
0/7.2Issue template
6.3/6.3PR template
Inputs used
has_readmeyes
has_licenseyes
readme_badges
has_contributingyes
has_issue_templateno
has_code_of_conductyes
readme_badge_services
has_pull_request_templateyes
How it's scored
58.5/80Monthly downloads — 24,538 downloads/month across pypi
0/20Registry dependents — not reported by this ecosystem
Inputs used
packagesgiskard-llm, giskard-core, giskard-scan, giskard-agents, giskard-checks
dependents
ecosystemspypi
total_downloads
monthly_downloads24,538
Excluded from scoring (no data or not applicable): Registry dependents. Remaining weights renormalized.

Sustainability & Governance

Will the project survive its people — bus factor, responsiveness, who backs it, and package upkeep?

80Excellent · 23% of overall
How it's scored
36/54Bus factor — 3 contributor(s) cover half of all commits
17.5/22.5Commit distribution — top contributor authored 22% of commits
13.5/13.5Contributor breadth — 67 contributors
10/10OpenSSF Scorecard: Contributors — project has 16 contributing companies or organizations
Inputs used
bus_factor3
contributors_sampled67
top_contributor_share0.222
How it's scored
39.6/42Issue resolution — 94% of issues closed
18.9/30PR acceptance — 1,204/1,913 decided PRs merged
0/13Newcomer PR acceptance — no first-time contributor's PR decided in 30d
10.5/15OpenSSF Scorecard: Code-Review — Found 18/25 approved changesets -- score normalized to 7
Inputs used
merged_prs1,204
open_issues33
closed_issues548
prs_merged_7d
prs_decided_7d
prs_merged_30d
prs_decided_30d
issue_closed_ratio0.943
closed_unmerged_prs709
first_time_authors_30d
first_time_prs_merged_30d
first_time_prs_decided_30d
Excluded from scoring (no data or not applicable): newcomer_pr_acceptance. Remaining weights renormalized.
How it's scored
30/30Ownership backing — organization-owned
0/20Verified domain
17.5/25Owner reach — 268 followers of Giskard-AI
22.9/25Track record — 34 public repos, account ~5 yr old
Inputs used
followers268
owner_typeOrganization
is_verified
owner_loginGiskard-AI
public_repos34
account_age_days2,133

Package maintenance

100Exceptional
How it's scored
25/25Published & resolvable — 5 package(s) on pypi
35/35Publish recency — latest publish 15 days ago
20/20Version history — 13 published versions
20/20Not deprecated — active, not deprecated or yanked
Inputs used
packagesgiskard-llm, giskard-core, giskard-scan, giskard-agents, giskard-checks
ecosystemspypi
any_deprecatedno
min_days_since_publish15

Engineering Quality

Are baseline engineering and documentation practices in place?

86Excellent · 19% of overall
How it's scored
24/24CI workflows — 6 workflow(s)
24/24Tests present
16/16Linter config
9.6/9.6Pre-commit hooks
0/6.4.editorconfig
20/20OpenSSF Scorecard: CI-Tests — 27 out of 27 merged PRs checked by a CI test -- score normalized to 10
Inputs used
has_ciyes
has_testsyes
has_editorconfigno
has_linter_configyes
has_precommit_configyes
How it's scored
30/30README
0/25Documentation directory
15/15Documentation / homepage site — https://docs.giskard.ai
10/10Repository description
10/10Topics — 17 topics
10/10Wiki
Inputs used
topicsmlops, ml-validation, ml-testing, ai-testing, llmops, responsible-ai, fairness-ai, trustworthy-ai, llm-eval, llm-evaluation, rag-evaluation, ai-security, llm-security, ai-red-team, red-team-tools, llm, agent-evaluation
has_wikiyes
homepagehttps://docs.giskard.ai
has_readmeyes
has_docs_dirno
has_descriptionyes

Security

Are visible security and supply-chain practices strong, without unresolved high-risk jurisdiction exposure?

76Good · 16% of overall
How it's scored
7.5/7.5Binary-Artifacts — no binaries found in the repo
6/7.5Branch-Protection — branch protection is not maximal on development and all release branches
2.5/2.5CI-Tests — 27 out of 27 merged PRs checked by a CI test -- score normalized to 10
0/2.5CII-Best-Practices — no effort to earn an OpenSSF best practices badge detected
5.2/7.5Code-Review — Found 18/25 approved changesets -- score normalized to 7
2.5/2.5Contributors — project has 16 contributing companies or organizations
0/10Dangerous-Workflow — dangerous workflow patterns detected
7.5/7.5Dependency-Update-Tool — update tool detected
0/5Fuzzing — project is not fuzzed
2.5/2.5License — license file detected
7.5/7.5Maintained — 30 commit(s) and 6 issue activity found in the last 90 days -- score normalized to 10
0/5Packaging — no data
5/5Pinned-Dependencies — all dependencies are pinned
5/5SAST — SAST tool is run on all commits
5/5Security-Policy — security policy file detected
0/7.5Signed-Releases — Project has not signed or included provenance with any releases.
7.5/7.5Token-Permissions — GitHub workflow tokens follow principle of least privilege
6.8/7.5Vulnerabilities — 1 existing vulnerabilities detected
Inputs used
sourceopenssf_scorecard
checks_evaluated17
scorecard_versionv5.5.0
checks_inconclusive1
scorecard_aggregate7
Excluded from scoring (no data or not applicable): packaging. Remaining weights renormalized.

Dependency advisories

100Exceptional
How it's scored
35/35Direct dependencies free of known advisories — no direct dependency carries a known advisory
25/25Indirect dependencies free of known advisories — no indirect dependency carries a known advisory
0/40No advisories left outstanding — no advisory carries a publication date
Inputs used
sourceosv
advisories0
affected_packages0
assessed_packages86
unassessed_packages0
affected_by_severitynone
direct_affected_packages0
Excluded from scoring (no data or not applicable): No advisories left outstanding. Remaining weights renormalized. Matched the pypi:giskard@2.19.2 runtime dependency closure — what installing the published package pulls in — 86 packages. Reachability is not analyzed.

AI Readiness

How well is the repo equipped to be developed and maintained with AI coding agents? Carries a deliberately small weight (4%): agent tooling is a real maintenance signal, but a repository with none can still reach 100/100.

92Excellent · 4% of overall
How it's scored
45/45Agent instructions — .claude/CLAUDE.md, .cursor/rules/documentation.mdc, .cursor/rules/guidelines.mdc, .cursor/rules/python.mdc, AGENTS.md
0/15Machine-readable docs (llms.txt)
40/40Legible commit history — 74 of 74 human commits state their intent (structured subject or explanatory body)
Inputs used
has_llms_txtno
legible_history_share1
agent_instruction_files.claude/CLAUDE.md, .cursor/rules/documentation.mdc, .cursor/rules/guidelines.mdc, .cursor/rules/python.mdc, AGENTS.md
agent_instruction_max_bytes3,828
How it's scored
18/18One-command bootstrap — Makefile
22/22Automated tests
11/11Lint / format config
11/11Static type checking — libs/giskard-agents/src/giskard/agents/py.typed, pyrightconfig.json
10/10Reproducible environment — lockfile
10/10Demonstrated agent practice — 53 of the last 100 commits agent-authored or agent-credited
8/8Automated maintenance — 15 of the last 100 commits are automated dependency updates
10/10OpenSSF Scorecard: Pinned-Dependencies — all dependencies are pinned
Inputs used
has_nixno
has_testsyes
lockfilesuv.lock
has_dockerfileno
typed_languageno
bootstrap_filesMakefile
has_devcontainerno
has_linter_configyes
typecheck_configslibs/giskard-agents/src/giskard/agents/py.typed, pyrightconfig.json
agent_commit_share0.53
toolchain_manifests
dependency_bot_commit_share0.15
How it's scored
27/45Type-checkable code — Python with type-check config (libs/giskard-agents/src/giskard/agents/py.typed, pyrightconfig.json)
55/55Manageable file sizes — 0/267 source files over 60KB
Inputs used
primary_languagePython
largest_source_bytes53,668
source_files_sampled267
oversized_source_files0

Key facts

5,722GitHub stars
67contributors
239commits, last 12 months
0days since last push
100releases
3bus factor
33open issues
PyPIpackage ecosystems

Data collection warnings

  • Star history unavailable: GitHub GraphQL error: Resource not accessible by personal access token
  • pypi package 'giskard' points at a different repository (https://github.com/Giskard-AI/giskard); excluded from ecosystem scoring

More detail

Star and fork history 0 ★ / 510 ⇿
0Stars
510Forks
100Releases

When each star and fork was added, collected from GitHub and bucketed by day. Cumulative growth sits directly above the daily additions it is made of, so the two read against each other: steady organic accretion looks nothing like an abrupt, short-lived burst. Where that difference is measurable, it is reported as growth authenticity.

0100200300400500600502442022-042024-052026-07
Major 1Minor 19Patch 39

Each point covers 4 days.

OpenSSF Scorecard 7.0 / 10
7.0aggregate

Independent, tool-agnostic security assessment from the open-source OpenSSF Scorecard. Each check rewards a security practice, not a specific vendor's tool. Checks Scorecard could not determine are marked n/a and excluded from the security score (never counted as zero).Scorecard v5.5.0 · 2026-07-28 15:56 UTC

10Binary-Artifactsno binaries found in the repo
8Branch-Protectionbranch protection is not maximal on development and all release branches
10CI-Tests27 out of 27 merged PRs checked by a CI test -- score normalized to 10
0CII-Best-Practicesno effort to earn an OpenSSF best practices badge detected
7Code-ReviewFound 18/25 approved changesets -- score normalized to 7
10Contributorsproject has 16 contributing companies or organizations
0Dangerous-Workflowdangerous workflow patterns detected
10Dependency-Update-Toolupdate tool detected
0Fuzzingproject is not fuzzed
10Licenselicense file detected
10Maintained30 commit(s) and 6 issue activity found in the last 90 days -- score normalized to 10
n/aPackagingpackaging workflow not detected
10Pinned-Dependenciesall dependencies are pinned
10SASTSAST tool is run on all commits
10Security-Policysecurity policy file detected
0Signed-ReleasesProject has not signed or included provenance with any releases.
10Token-PermissionsGitHub workflow tokens follow principle of least privilege
9Vulnerabilities1 existing vulnerabilities detected
Direct dependencies 28
RegistryPackageVersion constraintManifest
PyPIgiskard-checks>=1.0.2b4,<2pyproject.toml
PyPIgiskard-llm>=1.0.0a1,<2libs/giskard-agents/pyproject.toml
PyPIpydantic>=2.11.0,<3libs/giskard-agents/pyproject.toml
PyPIgriffe>=1.7.0,<3libs/giskard-agents/pyproject.toml
PyPItyping-extensions>=4.14.0,<5libs/giskard-agents/pyproject.toml
PyPIjinja2>=3.1.6,<4libs/giskard-agents/pyproject.toml
PyPIlogfire-api>=3.22.0,<5libs/giskard-agents/pyproject.toml
PyPItenacity>=9.1.0,<10libs/giskard-agents/pyproject.toml
PyPIgiskard-core>=1.0.1b3,<2libs/giskard-agents/pyproject.toml
PyPInumpy>=2.4.1,<3libs/giskard-agents/pyproject.toml
PyPIjsonpath-ng>=1.7.0,<2libs/giskard-checks/pyproject.toml
PyPIpydantic>=2.12,<3libs/giskard-checks/pyproject.toml
PyPIpydantic-settings>=2.7,<3libs/giskard-checks/pyproject.toml
PyPIgiskard-agents>=1.0.2b2libs/giskard-checks/pyproject.toml
PyPIjinja2>=3.1.6,<4libs/giskard-checks/pyproject.toml
PyPIgiskard-core>=1.0.1b3,<2libs/giskard-checks/pyproject.toml
PyPIjsonschema>=4.23.0,<5libs/giskard-checks/pyproject.toml
PyPInumpy>=2.4.1,<3libs/giskard-checks/pyproject.toml
PyPIregex>=2026.1.15libs/giskard-checks/pyproject.toml
PyPIrich>=14.2.0,<16libs/giskard-checks/pyproject.toml
PyPIposthog>=7.10.3libs/giskard-core/pyproject.toml
PyPIpydantic>=2.11.0,<3libs/giskard-core/pyproject.toml
PyPIgiskard-core>=1.0.1b3,<2libs/giskard-llm/pyproject.toml
PyPIpydantic>=2.11.0,<3libs/giskard-llm/pyproject.toml
PyPIgiskard-checks>=1.0.2b3,<2libs/giskard-scan/pyproject.toml
PyPIgiskard-agents>=1.0.2b3,<2libs/giskard-scan/pyproject.toml
PyPInumpy>=2.4.1,<3libs/giskard-scan/pyproject.toml
PyPIhuggingface-hub>=1.11.0,<2libs/giskard-scan/pyproject.toml
All dependencies 172

Full resolved dependency set from the GitHub dependency graph: 36 direct and 136 indirect (transitive) packages. The transitive closure is complete when the repository commits a lockfile.

RegistryPackageVersionRelation
PyPIgiskard-agentsdirect
PyPIgiskard-agents1.0.2b5direct
PyPIgiskard-checksdirect
PyPIgiskard-checks1.0.2b4direct
PyPIgiskard-coredirect
PyPIgiskard-core1.0.1b5direct
PyPIgiskard-llmdirect
PyPIgiskard-llm1.0.0b5direct
PyPIgriffedirect
PyPIgriffe2.1.0direct
PyPIhuggingface-hubdirect
PyPIhuggingface-hub1.20.1direct
PyPIjinja2direct
PyPIjinja23.1.6direct
PyPIjsonpath-ngdirect
PyPIjsonpath-ng1.8.0direct
PyPIjsonschemadirect
PyPIjsonschema4.26.0direct
PyPIlogfire-apidirect
PyPIlogfire-api4.37.0direct
PyPInumpydirect
PyPInumpy2.5.0direct
PyPIposthogdirect
PyPIposthog7.20.2direct
PyPIpydanticdirect
PyPIpydantic2.13.4direct
PyPIpydantic-settingsdirect
PyPIpydantic-settings2.14.2direct
PyPIregexdirect
PyPIregex2026.5.9direct
PyPIrichdirect
PyPIrich15.0.0direct
PyPItenacitydirect
PyPItenacity9.1.4direct
PyPItyping-extensionsdirect
PyPItyping-extensions4.15.0direct
PyPIaiohappyeyeballs2.6.2indirect
PyPIaiohttp3.14.1indirect
PyPIaiosignal1.4.0indirect
PyPIannotated-doc0.0.4indirect
PyPIannotated-types0.7.0indirect
PyPIanthropicindirect
PyPIanthropic0.111.0indirect
PyPIanyio4.14.0indirect
PyPIappnope0.1.4indirect
PyPIastroid4.0.4indirect
PyPIasttokens3.0.1indirect
PyPIattrs26.1.0indirect
PyPIbackoff2.2.1indirect
PyPIboolean-py5.0indirect
PyPIcachecontrol0.14.4indirect
PyPIceline-regorusindirect
PyPIceline-regorus0.9.1.post20260227075446indirect
PyPIcertifi2026.6.17indirect
PyPIcffi2.0.0indirect
PyPIcharset-normalizer3.4.7indirect
PyPIclick8.4.1indirect
PyPIcolorama0.4.6indirect
PyPIcomm0.2.3indirect
PyPIcoverage7.14.3indirect
PyPIcryptography49.0.0indirect
PyPIcyclonedx-python-lib11.11.0indirect
PyPIdebugpy1.8.21indirect
PyPIdecorator5.3.1indirect
PyPIdefusedxml0.7.1indirect
PyPIdill0.4.1indirect
PyPIdistro1.9.0indirect
PyPIdocstring-parser0.18.0indirect
PyPIexecuting2.2.1indirect
PyPIfastuuid0.14.0indirect
PyPIfilelock3.29.4indirect
PyPIfrozenlist1.8.0indirect
PyPIfsspec2026.6.0indirect
PyPIgiskard3.0.0b1indirect
PyPIgiskard-scan1.0.0b2indirect
PyPIgoogle-auth2.55.0indirect
PyPIgoogle-genaiindirect
PyPIgoogle-genai2.4.0indirect
PyPIgriffecli2.1.0indirect
PyPIgriffelib2.1.0indirect
PyPIh110.16.0indirect
PyPIhatchlingindirect
PyPIhf-xet1.5.1indirect
PyPIhttpcore1.0.9indirect
PyPIhttpx0.28.1indirect
PyPIidna3.18indirect
PyPIimportlib-metadata8.9.0indirect
PyPIiniconfig2.3.0indirect
PyPIipykernel7.3.0indirect
PyPIipython9.14.1indirect
PyPIipython-pygments-lexers1.1.1indirect
PyPIisort8.0.1indirect
PyPIjedi0.20.0indirect
PyPIjiter0.15.0indirect
PyPIjoblib1.5.3indirect
PyPIjsonschema-specifications2025.9.1indirect
PyPIjupyter-client8.9.1indirect
PyPIjupyter-core5.9.1indirect
PyPIlicense-expression30.4.4indirect
PyPIlitellmindirect
PyPIlitellm1.89.3indirect
PyPImarkdown-it-py4.2.0indirect
PyPImarkupsafe3.0.3indirect
PyPImatplotlib-inline0.2.2indirect
PyPImccabe0.7.0indirect
PyPImdurl0.1.2indirect
PyPImsgpack1.2.1indirect
PyPImultidict6.7.1indirect
PyPInest-asyncio21.7.2indirect
PyPInltk3.10.0indirect
PyPIopenaiindirect
PyPIopenai2.43.0indirect
PyPIpackageurl-python0.17.6indirect
PyPIpackaging26.2indirect
PyPIparso0.8.7indirect
PyPIpexpect4.9.0indirect
PyPIpip26.1.2indirect
PyPIpip-api0.0.34indirect
PyPIpip-audit2.10.1indirect
PyPIpip-requirements-parser32.0.1indirect
PyPIplatformdirs4.10.0indirect
PyPIpluggy1.6.0indirect
PyPIprompt-toolkit3.0.52indirect
PyPIpropcache0.5.2indirect
PyPIpsutil7.2.2indirect
PyPIptyprocess0.7.0indirect
PyPIpure-eval0.2.3indirect
PyPIpy-serializable2.1.0indirect
PyPIpyasn10.6.4indirect
PyPIpyasn1-modules0.4.2indirect
PyPIpycparser3.0indirect
PyPIpydantic-core2.46.4indirect
PyPIpygments2.20.0indirect
PyPIpylint4.0.6indirect
PyPIpylint-plugin-utils0.9.0indirect
PyPIpylint-pydantic0.4.1indirect
PyPIpyparsing3.3.2indirect
PyPIpyphen0.17.2indirect
PyPIpytest9.1.1indirect
PyPIpytest-asyncio1.4.0indirect
PyPIpytest-cov7.1.0indirect
PyPIpytest-timeout2.4.0indirect
PyPIpython-dateutil2.9.0.post0indirect
PyPIpython-dotenv1.2.2indirect
PyPIpyyaml6.0.3indirect
PyPIpyzmq27.1.0indirect
PyPIreferencing0.37.0indirect
PyPIrequests2.34.2indirect
PyPIrpds-py2026.5.1indirect
PyPIsetuptools82.0.1indirect
PyPIshellingham1.5.4indirect
PyPIsix1.17.0indirect
PyPIsniffio1.3.1indirect
PyPIsortedcontainers2.4.0indirect
PyPIstack-data0.6.3indirect
PyPItextstatindirect
PyPItextstat0.7.13indirect
PyPItiktoken0.13.0indirect
PyPItokenizers0.23.1indirect
PyPItomli2.4.1indirect
PyPItomli-w1.2.0indirect
PyPItomlkit0.15.0indirect
PyPItornado6.5.7indirect
PyPItqdm4.68.3indirect
PyPItraitlets5.15.1indirect
PyPItyper0.25.1indirect
PyPItyping-inspection0.4.2indirect
PyPIurllib32.7.0indirect
PyPIwcwidth0.8.1indirect
PyPIwebsockets16.0indirect
PyPIyarl1.24.2indirect
PyPIzipp4.1.0indirect
Dependency advisories 0

Installing pypi:giskard@2.19.2 pulls in 86 packages, direct and transitive: 0 carry known advisories, of which 0 are direct dependencies.

No known advisories affect the assessed dependencies.

An advisory means the version recorded in the dependency graph falls inside an advisory’s affected range. Reachability is not analysed, and the graph includes development and test pins — a finding may concern tooling rather than shipped software.

Raw JSON report machine-readable

Scores are signals, not warranties. They reflect publicly visible practices on GitHub — not a code audit, and not a security guarantee.

Missing data is excluded and weights renormalized, never scored as zero. Methodology is versioned and open: metrics v2.5.0, schema v0.27.0 — full methodology · metrics wiki.

How one result sits in the wider record: aggregate statisticsPyPI.