# PAIR-code/what-if-tool — health index 17/100 (Critical)

> Inspection of the public repository PAIR-code/what-if-tool by inspect.software. It holds a health index of 17 out of 100, placing it in the Critical band. The index is a signal derived from publicly visible practice, not a warranty, a security audit, or an endorsement, and it is independent of payment.

- Repository: https://github.com/PAIR-code/what-if-tool
- Report page: https://inspect.software/software/PAIR-code/what-if-tool
- Full JSON report: https://inspect.software/api/repositories/PAIR-code/what-if-tool/report
- Badge: https://raw.githubusercontent.com/inspect-software/badges/main/v1/p/PAIR-code/what-if-tool.svg
- Inspected: 2026-08-13
- Methodology: metrics 2.10.0, report schema 0.31.0 (https://inspect.software/methodology.md)

## Category summary

| Category | Weight | Index | Band |
|---|---|---|---|
| Vitality | 21% | 31/100 | At Risk |
| Community & Adoption | 17% | 73/100 | Good |
| Sustainability & Governance | 23% | 62/100 | Moderate |
| Engineering Quality | 19% | 56/100 | Moderate |
| Security | 16% | 20/100 | At Risk |
| AI Readiness | 4% | 44/100 | Weak |

The weighted overall 49 is calibrated to 48 on the published index scale (record calibration 2026-08-02). A dependency reported as a malicious package applies a 35% multiplier to weighted overall health and gives it a Critical ceiling of 19.

## Repository facts

| Field | Value |
|---|---|
| Description | Source code/webpage/demos for the What-If Tool |
| Classification | web-ui |
| Homepage | https://pair-code.github.io/what-if-tool |
| Primary language | HTML |
| License | Apache-2.0 |
| Stars | 1,006 |
| Forks | 183 |
| Created | 2018-09-07 |
| Last push | 2026-06-21 |
| Latest release | v1.8.1 |
| Commits (last year) | 2 |
| Bus factor | 1 |
| Topics | ml-fairness, visualization, machine-learning, jupyterlab-extension, colaboratory, tensorboard |

## Published packages

| Registry | Package | Latest | Monthly downloads |
|---|---|---|---|
| pypi | tensorboard_plugin_wit | 1.8.1 | 1,955,004 |

## Vitality — 31/100 (At Risk)

Is the project alive — is code being written and are releases shipping? Weight: 21% of the overall index.

### Development activity — 23/100 (At Risk)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Push recency | partial | 18 / 36 | last push 52 days ago |
| Commit cadence | partial | 0.7 / 36 | 1/52 weeks with commits |
| Commit volume | partial | 4.3 / 18 | 2 commits in the last year |
| OpenSSF Scorecard: Maintained | not met | 0 / 10 | 0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0 |

### Release discipline — 44/100 (Weak)

Excluded from scoring (no data or not applicable): OpenSSF Scorecard: Signed-Releases. Remaining weights renormalized.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Ships releases | met | 27 / 27 | 3 releases published |
| Release recency | not met | 0 / 36 | latest release 1765 days ago |
| Release cadence | partial | 12.6 / 27 | a release every ~236.5 days |
| OpenSSF Scorecard: Signed-Releases | excluded | 0 / 10 | no releases found |

### Abandonment — 100/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Project is still maintained | met | 100 / 100 | last human commit 169 days ago |

## Community & Adoption — 73/100 (Good)

Does the project have users, downloads, attention, and a welcoming setup for contributors? Weight: 17% of the overall index.

### Popularity & adoption — 76/100 (Good)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Stars | partial | 48.7 / 60 | 1,006 stars |
| Forks | partial | 18.8 / 25 | 183 forks |
| Watchers | partial | 8 / 15 | 29 watchers |

### Community health — 70/100 (Good)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| README | met | 22.5 / 22.5 | — |
| License | met | 22.5 / 22.5 | recognized license (Apache-2.0) |
| CONTRIBUTING guide | met | 18 / 18 | — |
| Code of conduct | not met | 0 / 13.5 | — |
| Issue template | not met | 0 / 7.2 | — |
| PR template | not met | 0 / 6.3 | — |

## Sustainability & Governance — 62/100 (Moderate)

Will the project survive its people — bus factor, responsiveness, who backs it, and package upkeep? Weight: 23% of the overall index.

### Maintainer resilience (bus factor) — 34/100 (At Risk)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Bus factor | partial | 9 / 54 | 1 contributor(s) cover half of all commits |
| Commit distribution | partial | 5.9 / 22.5 | top contributor authored 74% of commits |
| Contributor breadth | met | 13.5 / 13.5 | 19 contributors |
| OpenSSF Scorecard: Contributors | partial | 6 / 10 | project has 2 contributing companies or organizations -- score normalized to 6 |

### Issue & PR responsiveness — 62/100 (Moderate)

Excluded from scoring (no data or not applicable): Newcomer PR acceptance. Remaining weights renormalized.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Issue resolution | partial | 18.5 / 42 | 44% of issues closed |
| PR acceptance | partial | 24.8 / 30 | 82/99 decided PRs merged |
| Newcomer PR acceptance | excluded | 0 / 13 | no first-time contributor's PR decided in 30d |
| OpenSSF Scorecard: Code-Review | partial | 10.5 / 15 | Found 10/13 approved changesets -- score normalized to 7 |

### Ownership & stewardship — 95/100 (Exceptional)

Excluded from scoring (no data or not applicable): Verified domain. Remaining weights renormalized.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Ownership backing | met | 30 / 30 | organization-owned |
| Verified domain | excluded | 0 / 20 | verified-domain status not read for this organization |
| Owner reach | partial | 21.7 / 25 | 1,050 followers of PAIR-code |
| Track record | partial | 24.1 / 25 | 45 public repos, account ~9 yr old |

## Engineering Quality — 56/100 (Moderate)

Are baseline engineering and documentation practices in place? Weight: 19% of the overall index.

### Engineering practices — 26/100 (At Risk)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| CI workflows | not met | 0 / 24 | — |
| Tests present | met | 24 / 24 | — |
| Linter config | not met | 0 / 16 | — |
| Pre-commit hooks | not met | 0 / 9.6 | — |
| .editorconfig | not met | 0 / 6.4 | — |
| OpenSSF Scorecard: CI-Tests | partial | 2 / 20 | 1 out of 10 merged PRs checked by a CI test -- score normalized to 1 |

### Documentation — 100/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| README | met | 30 / 30 | — |
| Documentation directory | met | 25 / 25 | — |
| Documentation / homepage site | met | 15 / 15 | https://pair-code.github.io/what-if-tool |
| Repository description | met | 10 / 10 | — |
| Topics | met | 10 / 10 | 6 topics |
| Wiki | met | 10 / 10 | — |

## Security — 20/100 (At Risk)

Are visible security and supply-chain practices strong, with no malicious dependency and no unresolved high-risk jurisdiction exposure? Weight: 16% of the overall index.

### Security posture — 12/100 (Critical)

Excluded from scoring (no data or not applicable): Dangerous-Workflow, Packaging, Signed-Releases, Token-Permissions. Remaining weights renormalized. A dependency reported as a malicious package applies a 35% multiplier to Security posture and gives it a Critical ceiling of 19.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Binary-Artifacts | met | 7.5 / 7.5 | no binaries found in the repo |
| Branch-Protection | not met | 0 / 7.5 | branch protection not enabled on development/release branches |
| CI-Tests | partial | 0.2 / 2.5 | 1 out of 10 merged PRs checked by a CI test -- score normalized to 1 |
| CII-Best-Practices | not met | 0 / 2.5 | no effort to earn an OpenSSF best practices badge detected |
| Code-Review | partial | 5.2 / 7.5 | Found 10/13 approved changesets -- score normalized to 7 |
| Contributors | partial | 1.5 / 2.5 | project has 2 contributing companies or organizations -- score normalized to 6 |
| Dangerous-Workflow | excluded | 0 / 10 | no workflows found |
| Dependency-Update-Tool | met | 7.5 / 7.5 | update tool detected |
| Fuzzing | not met | 0 / 5 | project is not fuzzed |
| License | met | 2.5 / 2.5 | license file detected |
| Maintained | not met | 0 / 7.5 | 0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0 |
| Packaging | excluded | 0 / 5 | packaging workflow not detected |
| Pinned-Dependencies | not met | 0 / 5 | dependency not pinned by hash detected -- score normalized to 0 |
| SAST | not met | 0 / 5 | SAST tool is not run on all commits -- score normalized to 0 |
| Security-Policy | not met | 0 / 5 | security policy file not detected |
| Signed-Releases | excluded | 0 / 7.5 | no releases found |
| Token-Permissions | excluded | 0 / 7.5 | No tokens found |
| Vulnerabilities | not met | 0 / 7.5 | 151 existing vulnerabilities detected |

### Dependency advisories — 53/100 (Moderate)

Excluded from scoring (no data or not applicable): Indirect dependencies free of known advisories. Remaining weights renormalized. Matched 672 resolved dependencies against OSV; 3 could not be assessed (no resolved version, an unsupported ecosystem, or beyond the reported package list). This repository publishes no package the index resolves, so the repository dependency graph was assessed instead. That graph mixes development and test pins with shipped dependencies, so only the declared runtime dependencies are scored; transitive findings are reported as context and excluded from the score. Reachability is not analyzed.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Direct dependencies free of known advisories | partial | 10.4 / 35 | 2 affected: @angular/common 8.1.2 (high 8.2), @angular/core 8.1.2 (moderate 6.1) |
| Indirect dependencies free of known advisories | excluded | 0 / 25 | transitive set not separable from development and test dependencies in this scope |
| No advisories left outstanding | partial | 29.5 / 40 | 2 advisory-carrying package(s) unaddressed past 90 days; oldest published 1539 days ago |

### Malicious dependencies — 35/100 (Weak)

1 resolved dependency(ies) resolve to a version the registry still serves and the OpenSSF corpus reports as malicious. Direct and indirect are treated alike: an install-time payload runs at any depth in the graph. A report here concerns the package as published, not the maintainers of this repository, which may have resolved it unknowingly.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| No dependency reported as a malicious package | partial | 35 / 100 | 1 reported as malicious: fsevents 1.2.9 |

### High-Risk Jurisdiction Exposure — 100/100 (Exceptional)

Only high-confidence self-published location evidence affects this multiplier. Ambiguous matches are review-only; country evidence is not proof of nationality, citizenship, legal registration, malicious intent, or sanctions status.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Policy exposure multiplier | met | 100 / 100 | no confirmed policy-scope location match |

## AI Readiness — 44/100 (Weak)

How well is the repo equipped to be developed and maintained with AI coding agents? Carries a deliberately small weight: agent tooling is a real maintenance signal, but its absence must never gate the top of the scale (calibration saturates at raw 91, so 100/100 remains reachable with AI Readiness at zero).

### Agent context & guidance — 18/100 (Critical)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Agent instructions | not met | 0 / 45 | no CLAUDE.md / AGENTS.md / editor rules |
| Machine-readable docs (llms.txt) | not met | 0 / 15 | — |
| Legible commit history | partial | 18 / 40 | 33 of 98 human commits state their intent (structured subject or explanatory body) |

### Verify loop (build / test / typecheck) — 40/100 (Weak)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| One-command bootstrap | not met | 0 / 18 | — |
| Automated tests | met | 22 / 22 | — |
| Lint / format config | not met | 0 / 11 | — |
| Static type checking | not met | 0 / 11 | — |
| Reproducible environment | met | 10 / 10 | lockfile |
| Demonstrated agent practice | not met | 0 / 10 | no agent-authored commits among the last 100 |
| Automated maintenance | met | 8 / 8 | 2 of the last 100 commits are automated dependency updates |
| OpenSSF Scorecard: Pinned-Dependencies | not met | 0 / 10 | dependency not pinned by hash detected -- score normalized to 0 |

### Code legibility for models — 48/100 (Weak)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Type-checkable code | not met | 0 / 45 | HTML without a type-check config |
| Manageable file sizes | partial | 47.8 / 55 | 5/38 source files over 60KB |

### Machine-readable interfaces — 100/100 (Exceptional)

Excluded from scoring (no data or not applicable): API schema (OpenAPI/GraphQL/proto), MCP server. Remaining weights renormalized.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| API schema (OpenAPI/GraphQL/proto) | excluded | 0 / 40 | not applicable to this kind of software |
| MCP server | excluded | 0 / 20 | not applicable to this kind of software |
| Runnable examples | met | 40 / 40 | demos, notebooks |

## Collection warnings

- Star history unavailable: GitHub GraphQL error: Resource not accessible by personal access token
- Could not fetch npm package 'wit-website' from its registry
- pypi package 'tensorboard_plugin_wit' points at a different repository (https://whatif-tool.dev); excluded from ecosystem scoring
- Advisory severity resolved for 120 of 153 advisories (lookup cap); the remainder are reported as unknown severity

## What this report is

inspect.software measures public repositories against a single published, versioned methodology and reports the result as a 1–100 health index. Findings are signals derived from what is visible in public repository data — they are not a security audit, a warranty, or an endorsement, and no result depends on payment.

- Methodology, formulas and weights: https://inspect.software/methodology.md
- What a result does and does not claim: https://inspect.software/wiki/signals-not-warranties.md
- Rating bands: https://inspect.software/wiki/scoring-bands.md
- Corrections: https://inspect.software/contact.md
- Index of all documents: https://inspect.software/llms.txt