# comet-ml/opik — health index 96/100 (Exceptional)

> Inspection of the public repository comet-ml/opik by inspect.software. It holds a health index of 96 out of 100, placing it in the Exceptional band. The index is a signal derived from publicly visible practice, not a warranty, a security audit, or an endorsement, and it is independent of payment.

- Repository: https://github.com/comet-ml/opik
- Report page: https://inspect.software/software/comet-ml/opik
- Full JSON report: https://inspect.software/api/repositories/comet-ml/opik/report
- Badge: https://raw.githubusercontent.com/inspect-software/badges/main/v1/c/comet-ml/opik.svg
- Inspected: 2026-08-05
- Methodology: metrics 2.5.0, report schema 0.31.0 (https://inspect.software/methodology.md)

## Category summary

| Category | Weight | Index | Band |
|---|---|---|---|
| Vitality | 21% | 100/100 | Exceptional |
| Community & Adoption | 17% | 87/100 | Excellent |
| Sustainability & Governance | 23% | 88/100 | Excellent |
| Engineering Quality | 19% | 86/100 | Excellent |
| Security | 16% | 44/100 | Weak |
| AI Readiness | 4% | 93/100 | Exceptional |

The weighted overall 83 is calibrated to 96 on the published index scale (record calibration 2026-08-02).

## Repository facts

| Field | Value |
|---|---|
| Description | Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. |
| Classification | library, network-service, mcp-server, cli, web-ui |
| Homepage | https://www.comet.com/docs/opik/ |
| Primary language | Python |
| License | Apache-2.0 |
| Stars | 21,114 |
| Forks | 1,672 |
| Created | 2023-05-10 |
| Last push | 2026-08-05 |
| Latest release | 2.2.18 |
| Commits (last year) | 4,161 |
| Bus factor | 6 |
| Topics | open-source, langchain, openai, playground, prompt-engineering, llama-index, llm, llm-evaluation, llm-observability, llmops, hacktoberfest, hacktoberfest2025, evaluation |

## Published packages

| Registry | Package | Latest | Monthly downloads |
|---|---|---|---|
| pypi | opik | 2.2.18 | — |
| pypi | opik_optimizer | 3.1.1 | — |
| npm | opik | 2.2.18 | 111,941 |

## Vitality — 100/100 (Exceptional)

Is the project alive — is code being written and are releases shipping? Weight: 21% of the overall index.

### Development activity — 100/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Push recency | met | 36 / 36 | last push 0 days ago |
| Commit cadence | met | 36 / 36 | 52/52 weeks with commits |
| Commit volume | met | 18 / 18 | 4161 commits in the last year |
| OpenSSF Scorecard: Maintained | excluded | 0 / 10 | OpenSSF Scorecard unavailable |

### Release discipline — 100/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Ships releases | met | 27 / 27 | 100 releases published |
| Release recency | met | 36 / 36 | latest release 0 days ago |
| Release cadence | met | 27 / 27 | a release every ~0.8 days |
| OpenSSF Scorecard: Signed-Releases | excluded | 0 / 10 | OpenSSF Scorecard unavailable |

### Abandonment — 100/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Project is still maintained | met | 100 / 100 | last human commit 0 days ago |

## Community & Adoption — 87/100 (Excellent)

Does the project have users, downloads, attention, and a welcoming setup for contributors? Weight: 17% of the overall index.

### Popularity & adoption — 97/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Stars | met | 60 / 60 | 21,114 stars |
| Forks | met | 25 / 25 | 1,672 forks |
| Watchers | partial | 11.7 / 15 | 128 watchers |

### Community health — 77/100 (Good)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| README | met | 22.5 / 22.5 | — |
| License | met | 22.5 / 22.5 | recognized license (Apache-2.0) |
| CONTRIBUTING guide | met | 18 / 18 | — |
| Code of conduct | not met | 0 / 13.5 | — |
| Issue template | not met | 0 / 7.2 | — |
| PR template | met | 6.3 / 6.3 | — |

### Ecosystem adoption (downloads) — 84/100 (Excellent)

Excluded from scoring (no data or not applicable): Registry dependents. Remaining weights renormalized.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Monthly downloads | partial | 67.3 / 80 | 111,941 downloads/month across npm, pypi |
| Registry dependents | excluded | 0 / 20 | not reported by this ecosystem |

## Sustainability & Governance — 88/100 (Excellent)

Will the project survive its people — bus factor, responsiveness, who backs it, and package upkeep? Weight: 23% of the overall index.

### Maintainer resilience (bus factor) — 90/100 (Excellent)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Bus factor | partial | 48.6 / 54 | 6 contributor(s) cover half of all commits |
| Commit distribution | partial | 18.7 / 22.5 | top contributor authored 17% of commits |
| Contributor breadth | met | 13.5 / 13.5 | 96 contributors |
| OpenSSF Scorecard: Contributors | excluded | 0 / 10 | OpenSSF Scorecard unavailable |

### Issue & PR responsiveness — 88/100 (Excellent)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Issue resolution | partial | 36.4 / 42 | 87% of issues closed |
| PR acceptance | partial | 25.7 / 30 | 5941/6927 decided PRs merged |
| Newcomer PR acceptance | met | 13 / 13 | 1/1 first-time contributors' PRs merged in 30d |
| OpenSSF Scorecard: Code-Review | excluded | 0 / 15 | OpenSSF Scorecard unavailable |

### Ownership & stewardship — 76/100 (Good)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Ownership backing | met | 30 / 30 | organization-owned |
| Verified domain | not met | 0 / 20 | — |
| Owner reach | partial | 20.7 / 25 | 766 followers of comet-ml |
| Track record | met | 25 / 25 | 71 public repos, account ~8 yr old |

### Package maintenance — 100/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Published & resolvable | met | 25 / 25 | 3 package(s) on npm, pypi |
| Publish recency | met | 35 / 35 | latest publish 0 days ago |
| Version history | met | 20 / 20 | 559 published versions |
| Not deprecated | met | 20 / 20 | active, not deprecated or yanked |

## Engineering Quality — 86/100 (Excellent)

Are baseline engineering and documentation practices in place? Weight: 19% of the overall index.

### Engineering practices — 100/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| CI workflows | met | 24 / 24 | 79 workflow(s) |
| Tests present | met | 24 / 24 | — |
| Linter config | met | 16 / 16 | .eslintrc, .ruff.toml, eslint.config.js, eslint.config.mjs |
| Pre-commit hooks | met | 9.6 / 9.6 | — |
| .editorconfig | met | 6.4 / 6.4 | — |
| OpenSSF Scorecard: CI-Tests | excluded | 0 / 20 | OpenSSF Scorecard unavailable |

### Documentation — 65/100 (Good)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| README | met | 30 / 30 | — |
| Documentation directory | not met | 0 / 25 | — |
| Documentation / homepage site | met | 15 / 15 | https://www.comet.com/docs/opik/ |
| Repository description | met | 10 / 10 | — |
| Topics | met | 10 / 10 | 13 topics |
| Wiki | not met | 0 / 10 | — |

## Security — 44/100 (Weak)

Are visible security and supply-chain practices strong, with no malicious dependency and no unresolved high-risk jurisdiction exposure? Weight: 16% of the overall index.

### Security posture — 50/100 (Moderate)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Security policy (SECURITY.md) | not met | 0 / 30 | — |
| Dependabot config | met | 25 / 25 | — |
| Dependency lockfiles | met | 25 / 25 | package-lock.json, pnpm-lock.yaml |
| CodeQL workflow | not met | 0 / 20 | — |

### Dependency advisories — 18/100 (Critical)

Excluded from scoring (no data or not applicable): Indirect dependencies free of known advisories. Remaining weights renormalized. Matched 2522 resolved dependencies against OSV; 142 could not be assessed (no resolved version, an unsupported ecosystem, or beyond the reported package list). This repository publishes no package the index resolves, so the repository dependency graph was assessed instead. That graph mixes development and test pins with shipped dependencies, so only the declared runtime dependencies are scored; transitive findings are reported as context and excluded from the score. Reachability is not analyzed.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Direct dependencies free of known advisories | partial | 1.7 / 35 | 20 affected: litellm 1.83.14 (critical 9.8), axios 1.13.4 (high 8.7), axios 1.16.0 (high 8.2), +17 more |
| Indirect dependencies free of known advisories | excluded | 0 / 25 | transitive set not separable from development and test dependencies in this scope |
| No advisories left outstanding | partial | 12 / 40 | 13 advisory-carrying package(s) unaddressed past 90 days; oldest published 350 days ago |

### Malicious dependencies — 100/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| No dependency reported as a malicious package | met | 100 / 100 | no dependency is reported as a malicious package |

### High-Risk Jurisdiction Exposure — 100/100 (Exceptional)

Only high-confidence self-published location evidence affects this multiplier. Ambiguous matches are review-only; country evidence is not proof of nationality, citizenship, legal registration, malicious intent, or sanctions status.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Policy exposure multiplier | met | 100 / 100 | no confirmed policy-scope location match |

## AI Readiness — 93/100 (Exceptional)

How well is the repo equipped to be developed and maintained with AI coding agents? Carries a deliberately small weight: agent tooling is a real maintenance signal, but its absence must never gate the top of the scale (calibration saturates at raw 91, so 100/100 remains reachable with AI Readiness at zero).

### Agent context & guidance — 85/100 (Excellent)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Agent instructions | met | 45 / 45 | .github/copilot-instructions.md, .github/instructions/python_sdk.instructions.md, AGENTS.md, apps/opik-backend/AGENTS.md, apps/opik-documentation/AGENTS.md, sdks/opik_optimizer/AGENTS.md, sdks/python/AGENTS.md, sdks/typescript/AGENTS.md |
| Machine-readable docs (llms.txt) | not met | 0 / 15 | — |
| Legible commit history | met | 40 / 40 | 78 of 88 human commits state their intent (structured subject or explanatory body) |

### Verify loop (build / test / typecheck) — 100/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| One-command bootstrap | met | 18 / 18 | Makefile, apps/opik-documentation/python-sdk-docs/Makefile, sdks/opik_optimizer/Makefile |
| Automated tests | met | 22 / 22 | — |
| Lint / format config | met | 11 / 11 | .eslintrc, .ruff.toml, eslint.config.js, eslint.config.mjs |
| Static type checking | met | 11 / 11 | apps/opik-frontend/tsconfig.json, extensions/cursor/tsconfig.json, sdks/opik_optimizer/src/opik_optimizer/py.typed, sdks/python/src/opik/py.typed, sdks/typescript/src/opik/configure/tsconfig.json, sdks/typescript/src/opik/integrations/opik-gemini/tsconfig.json, sdks/typescript/src/opik/integrations/opik-langchain/tsconfig.json, sdks/typescript/src/opik/integrations/opik-openai/tsconfig.json, sdks/typescript/src/opik/integrations/opik-otel/tsconfig.json, sdks/typescript/src/opik/integrations/opik-vercel/tsconfig.json, sdks/typescript/tsconfig.json, tests_end_to_end/e2e/tsconfig.json, tests_end_to_end/visual-tests/tsconfig.json |
| Reproducible environment | met | 10 / 10 | Dockerfile, lockfile |
| Demonstrated agent practice | met | 10 / 10 | 53 of the last 100 commits agent-authored or agent-credited |
| Automated maintenance | met | 8 / 8 | 12 of the last 100 commits are automated dependency updates |
| OpenSSF Scorecard: Pinned-Dependencies | excluded | 0 / 10 | OpenSSF Scorecard unavailable |

### Code legibility for models — 82/100 (Excellent)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Type-checkable code | partial | 27 / 45 | Python with type-check config (apps/opik-frontend/tsconfig.json, extensions/cursor/tsconfig.json, sdks/opik_optimizer/src/opik_optimizer/py.typed, sdks/python/src/opik/py.typed, sdks/typescript/src/opik/configure/tsconfig.json, sdks/typescript/src/opik/integrations/opik-gemini/tsconfig.json, sdks/typescript/src/opik/integrations/opik-langchain/tsconfig.json, sdks/typescript/src/opik/integrations/opik-openai/tsconfig.json, sdks/typescript/src/opik/integrations/opik-otel/tsconfig.json, sdks/typescript/src/opik/integrations/opik-vercel/tsconfig.json, sdks/typescript/tsconfig.json, tests_end_to_end/e2e/tsconfig.json, tests_end_to_end/visual-tests/tsconfig.json) |
| Manageable file sizes | partial | 54.6 / 55 | 78/9762 source files over 60KB |

### Machine-readable interfaces — 100/100 (Exceptional)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| API schema (OpenAPI/GraphQL/proto) | met | 40 / 40 | sdks/code_generation/fern/openapi/openapi.yaml |
| MCP server | met | 20 / 20 | — |
| Runnable examples | met | 40 / 40 | cookbook, examples, notebooks |

## Collection warnings

- Star history unavailable: GitHub GraphQL error: Resource not accessible by personal access token
- First-time contributor figures cover 12 of 15 authors (cap 12)
- Could not fetch maven package 'com.comet.opik:opik-backend' from its registry
- Could not fetch pypi package 'opik_backend' from its registry
- Could not fetch npm package 'opik-visual-tests' from its registry
- deps.dev does not index pypi:opik@2.2.18; advisories assessed against the repository dependency graph instead
- Advisory severity resolved for 120 of 223 advisories (lookup cap); the remainder are reported as unknown severity
- OpenSSF Scorecard did not return a usable result (2026/08/05 04:19:24 Warning: PATs stored in env variables GITHUB_AUTH_TOKEN and GITHUB_TOKEN differ. Scorecard will use the former.); skipping Scorecard checks

## What this report is

inspect.software measures public repositories against a single published, versioned methodology and reports the result as a 1–100 health index. Findings are signals derived from what is visible in public repository data — they are not a security audit, a warranty, or an endorsement, and no result depends on payment.

- Methodology, formulas and weights: https://inspect.software/methodology.md
- What a result does and does not claim: https://inspect.software/wiki/signals-not-warranties.md
- Rating bands: https://inspect.software/wiki/scoring-bands.md
- Corrections: https://inspect.software/contact.md
- Index of all documents: https://inspect.software/llms.txt