# xorbitsai/inference — health index 97/100 (Exceptional)

> Inspection of the public repository xorbitsai/inference by inspect.software. It holds a health index of 97 out of 100, placing it in the Exceptional band. The index is a signal derived from publicly visible practice, not a warranty, a security audit, or an endorsement, and it is independent of payment.

- Repository: https://github.com/xorbitsai/inference
- Report page: https://inspect.software/software/xorbitsai/inference
- Full JSON report: https://inspect.software/api/repositories/xorbitsai/inference/report
- Badge: https://raw.githubusercontent.com/inspect-software/badges/main/v1/x/xorbitsai/inference.svg
- Inspected: 2026-09-20
- Methodology: metrics 2.10.0, report schema 0.34.0 (https://inspect.software/methodology.md)

## Category summary

| Category | Weight | Index | Band |
|---|---|---|---|
| Vitality | 21% | 100/100 | Exceptional |
| Community & Adoption | 17% | 77/100 | Good |
| Sustainability & Governance | 23% | 88/100 | Excellent |
| Engineering Quality | 19% | 95/100 | Exceptional |
| Security | 16% | 55/100 | Moderate |
| AI Readiness | 4% | 87/100 | Excellent |

The weighted overall 85 is calibrated to 97 on the published index scale (record calibration 2026-08-02).

## Repository facts

| Field | Value |
|---|---|
| Description | Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API. |
| Classification | cli, network-service, library, web-ui, plugin |
| Homepage | https://inference.readthedocs.io |
| Primary language | Python |
| License | Apache-2.0 |
| Stars | 9,579 |
| Forks | 866 |
| Created | 2023-06-14 |
| Last push | 2026-09-20 |
| Latest release | v3.4.0 |
| Commits (last year) | 878 |
| Bus factor | 7 |
| Topics | pytorch, deployment, llm, artificial-intelligence, machine-learning, whisper, inference, openai-api, gemma, llamacpp, vllm, qwen, diffusers, glm, glm-5-3, kimi, kimi-k3, llama-cpp, sglang, transformers |

## Published packages

| Registry | Package | Latest | Monthly downloads |
|---|---|---|---|
| pypi | xinference | 3.4.0 | 8,895 |

## Vitality — 100/100 (Exceptional)

Is the project alive — is code being written and are releases shipping? Weight: 21% of the overall index.

### Development activity — 100/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Push recency | met | 36 / 36 | last push 0 days ago |
| Commit cadence | met | 36 / 36 | 52/52 weeks with commits |
| Commit volume | met | 18 / 18 | 878 commits in the last year |
| OpenSSF Scorecard: Maintained | excluded | 0 / 10 | OpenSSF Scorecard unavailable |

### Release discipline — 100/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Ships releases | met | 27 / 27 | 100 releases published |
| Release recency | met | 36 / 36 | latest release 8 days ago |
| Release cadence | met | 27 / 27 | a release every ~12.4 days |
| OpenSSF Scorecard: Signed-Releases | excluded | 0 / 10 | OpenSSF Scorecard unavailable |

### Abandonment — 100/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Project is still maintained | met | 100 / 100 | last human commit 0 days ago |

## Community & Adoption — 77/100 (Good)

Does the project have users, downloads, attention, and a welcoming setup for contributors? Weight: 17% of the overall index.

### Popularity & adoption — 94/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Stars | met | 60 / 60 | 9,579 stars |
| Forks | partial | 24.5 / 25 | 866 forks |
| Watchers | partial | 10 / 15 | 64 watchers |

### Community health — 65/100 (Good)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| README | met | 22.5 / 22.5 | — |
| License | met | 22.5 / 22.5 | recognized license (Apache-2.0) |
| CONTRIBUTING guide | not met | 0 / 18 | — |
| Code of conduct | met | 13.5 / 13.5 | — |
| Issue template | not met | 0 / 7.2 | — |
| PR template | not met | 0 / 6.3 | — |

### Ecosystem adoption (downloads) — 66/100 (Good)

Excluded from scoring (no data or not applicable): Registry dependents. Remaining weights renormalized.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Monthly downloads | partial | 52.7 / 80 | 8,895 downloads/month across pypi |
| Registry dependents | excluded | 0 / 20 | not reported by this ecosystem |

## Sustainability & Governance — 88/100 (Excellent)

Will the project survive its people — bus factor, responsiveness, who backs it, and package upkeep? Weight: 23% of the overall index.

### Maintainer resilience (bus factor) — 93/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Bus factor | partial | 51.3 / 54 | 7 contributor(s) cover half of all commits |
| Commit distribution | partial | 19.2 / 22.5 | top contributor authored 15% of commits |
| Contributor breadth | met | 13.5 / 13.5 | 100 contributors |
| OpenSSF Scorecard: Contributors | excluded | 0 / 10 | OpenSSF Scorecard unavailable |

### Issue & PR responsiveness — 96/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Issue resolution | partial | 41.9 / 42 | 100% of issues closed |
| PR acceptance | partial | 27.1 / 30 | 2301/2550 decided PRs merged |
| Newcomer PR acceptance | met | 13 / 13 | 4/4 first-time contributors' PRs merged in 30d |
| OpenSSF Scorecard: Code-Review | excluded | 0 / 15 | OpenSSF Scorecard unavailable |

### Ownership & stewardship — 66/100 (Good)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Ownership backing | met | 30 / 30 | organization-owned |
| Verified domain | not met | 0 / 20 | — |
| Owner reach | partial | 18.1 / 25 | 326 followers of xorbitsai |
| Track record | partial | 17.8 / 25 | 19 public repos, account ~4 yr old |

### Package maintenance — 100/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Published & resolvable | met | 25 / 25 | 1 package(s) on pypi |
| Publish recency | met | 35 / 35 | latest publish 8 days ago |
| Version history | met | 20 / 20 | 151 published versions |
| Not deprecated | met | 20 / 20 | active, not deprecated or yanked |

## Engineering Quality — 95/100 (Exceptional)

Are baseline engineering and documentation practices in place? Weight: 19% of the overall index.

### Engineering practices — 92/100 (Excellent)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| CI workflows | met | 24 / 24 | 8 workflow(s) |
| Tests present | met | 24 / 24 | — |
| Linter config | met | 16 / 16 | eslint.config.mjs, pyproject.toml ([tool.ruff], [tool.black], [tool.isort]) |
| Pre-commit hooks | met | 9.6 / 9.6 | — |
| .editorconfig | not met | 0 / 6.4 | — |
| OpenSSF Scorecard: CI-Tests | excluded | 0 / 20 | OpenSSF Scorecard unavailable |

### Documentation — 100/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| README | met | 30 / 30 | — |
| Documentation directory | met | 25 / 25 | — |
| Documentation / homepage site | met | 15 / 15 | https://inference.readthedocs.io |
| Repository description | met | 10 / 10 | — |
| Topics | met | 10 / 10 | 20 topics |
| Wiki | met | 10 / 10 | — |

## Security — 55/100 (Moderate)

Are visible security and supply-chain practices strong, with no malicious dependency and no unresolved high-risk jurisdiction exposure? Weight: 16% of the overall index.

### Security posture — 55/100 (Moderate)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Security policy (SECURITY.md) | met | 30 / 30 | — |
| Dependabot config | not met | 0 / 25 | — |
| Dependency lockfiles | met | 25 / 25 | package-lock.json |
| CodeQL workflow | not met | 0 / 20 | — |

### Dependency advisories — 54/100 (Moderate)

Matched the pypi:xinference@3.4.0 runtime dependency closure — what installing the published package pulls in — 114 packages. Reachability is not analyzed.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Direct dependencies free of known advisories | partial | 14.8 / 35 | 1 affected: click 8.1.8 (high 7.2) |
| Indirect dependencies free of known advisories | partial | 10.2 / 25 | 1 affected: ecdsa 0.19.2 (high 7.4) |
| No advisories left outstanding | partial | 29.3 / 40 | 2 advisory-carrying package(s) unaddressed past 90 days; oldest published 971 days ago |

### Malicious dependencies — 100/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| No dependency reported as a malicious package | met | 100 / 100 | no dependency is reported as a malicious package |

### High-Risk Jurisdiction Exposure — 100/100 (Exceptional)

Only high-confidence self-published location evidence affects this multiplier. Ambiguous matches are review-only; country evidence is not proof of nationality, citizenship, legal registration, malicious intent, or sanctions status.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Policy exposure multiplier | met | 100 / 100 | no confirmed policy-scope location match |

## AI Readiness — 87/100 (Excellent)

How well is the repo equipped to be developed and maintained with AI coding agents? Carries a deliberately small weight: agent tooling is a real maintenance signal, but its absence must never gate the top of the scale (calibration saturates at raw 91, so 100/100 remains reachable with AI Readiness at zero).

### Agent context & guidance — 100/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Agent instructions | met | 45 / 45 | AGENTS.md, CLAUDE.md |
| Machine-readable docs (llms.txt) | met | 15 / 15 | llms.txt served by the project website (https://docs.dify.ai/llms.txt) |
| Legible commit history | met | 40 / 40 | 100 of 100 human commits state their intent (structured subject or explanatory body) |

### Verify loop (build / test / typecheck) — 82/100 (Excellent)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| One-command bootstrap | met | 18 / 18 | doc/Makefile |
| Automated tests | met | 22 / 22 | — |
| Lint / format config | met | 11 / 11 | eslint.config.mjs, pyproject.toml ([tool.ruff], [tool.black], [tool.isort]) |
| Static type checking | met | 11 / 11 | frontend/tsconfig.json, xinference/thirdparty/magika/py.typed |
| Reproducible environment | met | 10 / 10 | Dockerfile, lockfile |
| Demonstrated agent practice | partial | 2 / 10 | 1 of the last 100 commits agent-authored or agent-credited |
| Automated maintenance | not met | 0 / 8 | no automated dependency updates observed |
| OpenSSF Scorecard: Pinned-Dependencies | excluded | 0 / 10 | OpenSSF Scorecard unavailable |

### Code legibility for models — 81/100 (Excellent)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Type-checkable code | partial | 27 / 45 | Python with type-check config (frontend/tsconfig.json, xinference/thirdparty/magika/py.typed) |
| Manageable file sizes | partial | 54.2 / 55 | 43/2789 source files over 60KB |

### Machine-readable interfaces — 80/100 (Excellent)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| API schema (OpenAPI/GraphQL/proto) | met | 40 / 40 | xinference/thirdparty/fish_speech/fish_speech/datasets/protos/text-data.proto |
| MCP server | not met | 0 / 20 | — |
| Runnable examples | met | 40 / 40 | example, examples, notebooks |

## Collection warnings

- Star history unavailable: GitHub GraphQL error: Resource not accessible by personal access token
- First-time contributor figures cover 12 of 15 authors (cap 12)
- OpenSSF Scorecard did not return a usable result (killed by SIGKILL — most likely the container's memory limit; 2026/09/20 07:43:40 Warning: PATs stored in env variables GITHUB_AUTH_TOKEN and GITHUB_TOKEN differ. Scorecard will use the former.); skipping Scorecard checks

## What this report is

inspect.software measures public repositories against a single published, versioned methodology and reports the result as a 1–100 health index. Findings are signals derived from what is visible in public repository data — they are not a security audit, a warranty, or an endorsement, and no result depends on payment.

- Methodology, formulas and weights: https://inspect.software/methodology.md
- What a result does and does not claim: https://inspect.software/wiki/signals-not-warranties.md
- Rating bands: https://inspect.software/wiki/scoring-bands.md
- Corrections: https://inspect.software/contact.md
- Index of all documents: https://inspect.software/llms.txt