# apify/crawlee — health index 84/100 (Good)

> Inspection of the public repository apify/crawlee by inspect.software. It holds a health index of 84 out of 100, placing it in the Good band. The index is a signal derived from publicly visible practice, not a warranty, a security audit, or an endorsement, and it is independent of payment.

- Repository: https://github.com/apify/crawlee
- Report page: https://inspect.software/software/apify/crawlee
- Full JSON report: https://inspect.software/api/repositories/apify/crawlee/report
- Badge: https://raw.githubusercontent.com/inspect-software/badges/main/v1/a/apify/crawlee.svg
- Inspected: 2026-07-19
- Methodology: metrics 1.13.0, report schema 0.14.0 (https://inspect.software/methodology.md)

## Category summary

| Category | Weight | Index | Band |
|---|---|---|---|
| Vitality | 22% | 99/100 | Excellent |
| Community & Adoption | 18% | 84/100 | Good |
| Sustainability & Governance | 24% | 80/100 | Good |
| Engineering Quality | 20% | 94/100 | Excellent |
| Security | 16% | 54/100 | Moderate |
| AI Readiness | not counted | 70/100 | Good |

## Repository facts

| Field | Value |
|---|---|
| Description | Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation. |
| Homepage | https://crawlee.dev |
| Primary language | TypeScript |
| License | Apache-2.0 |
| Stars | 24,800 |
| Forks | 1,562 |
| Created | 2016-08-26 |
| Last push | 2026-07-17 |
| Latest release | v3.17.0 |
| Commits (last year) | 392 |
| Bus factor | 3 |
| Topics | web-scraping, web-crawling, npm, headless-chrome, puppeteer, automation, apify, scraping, crawling, crawler, headless, scraper, web-crawler, javascript, nodejs, playwright, typescript |

## Vitality — 99/100 (Excellent)

Is the project alive — is code being written and are releases shipping? Weight: 22% of the overall index.

### Development activity — 99/100 (Excellent)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Push recency | met | 36 / 36 | last push 1 days ago |
| Commit cadence | partial | 34.6 / 36 | 50/52 weeks with commits |
| Commit volume | met | 18 / 18 | 392 commits in the last year |
| OpenSSF Scorecard: Maintained | met | 10 / 10 | 30 commit(s) and 14 issue activity found in the last 90 days -- score normalized to 10 |

### Release discipline — 100/100 (Excellent)

Excluded from scoring (no data or not applicable): OpenSSF Scorecard: Signed-Releases. Remaining weights renormalized.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Ships releases | met | 27 / 27 | 100 releases published |
| Release recency | met | 36 / 36 | latest release 44 days ago |
| Release cadence | met | 27 / 27 | a release every ~38 days |
| OpenSSF Scorecard: Signed-Releases | excluded | 0 / 10 | no releases found |

### Abandonment — 100/100 (Excellent)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Project is still maintained | met | 100 / 100 | maintenance record not established from the collected data |

## Community & Adoption — 84/100 (Good)

Does the project have users, downloads, attention, and a welcoming setup for contributors? Weight: 18% of the overall index.

### Popularity & adoption — 97/100 (Excellent)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Stars | met | 60 / 60 | 24,800 stars |
| Forks | met | 25 / 25 | 1,562 forks |
| Watchers | partial | 11.8 / 15 | 131 watchers |

### Community health — 70/100 (Good)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| README | met | 22.5 / 22.5 | — |
| License | met | 22.5 / 22.5 | recognized license (Apache-2.0) |
| CONTRIBUTING guide | met | 18 / 18 | — |
| Code of conduct | not met | 0 / 13.5 | — |
| Issue template | not met | 0 / 7.2 | — |
| PR template | not met | 0 / 6.3 | — |

## Sustainability & Governance — 80/100 (Good)

Will the project survive its people — bus factor, responsiveness, who backs it, and package upkeep? Weight: 24% of the overall index.

### Maintainer resilience (bus factor) — 77/100 (Good)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Bus factor | partial | 36 / 54 | 3 contributor(s) cover half of all commits |
| Commit distribution | partial | 17.4 / 22.5 | top contributor authored 23% of commits |
| Contributor breadth | met | 13.5 / 13.5 | 100 contributors |
| OpenSSF Scorecard: Contributors | met | 10 / 10 | project has 25 contributing companies or organizations |

### Issue & PR responsiveness — 84/100 (Good)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Issue resolution | partial | 41.8 / 46.8 | 89% of issues closed |
| PR acceptance | partial | 29.8 / 38.2 | 1770/2271 decided PRs merged |
| OpenSSF Scorecard: Code-Review | partial | 12 / 15 | Found 24/28 approved changesets -- score normalized to 8 |

### Ownership & stewardship — 79/100 (Good)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Ownership backing | met | 30 / 30 | organization-owned |
| Verified domain | not met | 0 / 20 | — |
| Owner reach | partial | 24 / 25 | 2,143 followers of apify |
| Track record | met | 25 / 25 | 241 public repos, account ~9 yr old |

## Engineering Quality — 94/100 (Excellent)

Are baseline engineering and documentation practices in place? Weight: 20% of the overall index.

### Engineering practices — 90/100 (Excellent)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| CI workflows | met | 24 / 24 | 8 workflow(s) |
| Tests present | met | 24 / 24 | — |
| Linter config | met | 16 / 16 | .eslintrc.json, biome.json, eslint.config.mjs |
| Pre-commit hooks | not met | 0 / 9.6 | — |
| .editorconfig | met | 6.4 / 6.4 | — |
| OpenSSF Scorecard: CI-Tests | met | 20 / 20 | 26 out of 26 merged PRs checked by a CI test -- score normalized to 10 |

### Documentation — 100/100 (Excellent)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| README | met | 30 / 30 | — |
| Documentation directory | met | 25 / 25 | — |
| Documentation / homepage site | met | 15 / 15 | https://crawlee.dev |
| Repository description | met | 10 / 10 | — |
| Topics | met | 10 / 10 | 17 topics |
| Wiki | met | 10 / 10 | — |

## Security — 54/100 (Moderate)

Are visible security and supply-chain practices strong, with no malicious dependency and no unresolved high-risk jurisdiction exposure? Weight: 16% of the overall index.

### Security posture — 54/100 (Moderate)

Excluded from scoring (no data or not applicable): Packaging, Signed-Releases. Remaining weights renormalized.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Binary-Artifacts | met | 7.5 / 7.5 | no binaries found in the repo |
| Branch-Protection | partial | 3.8 / 7.5 | branch protection is not maximal on development and all release branches |
| CI-Tests | met | 2.5 / 2.5 | 26 out of 26 merged PRs checked by a CI test -- score normalized to 10 |
| CII-Best-Practices | not met | 0 / 2.5 | no effort to earn an OpenSSF best practices badge detected |
| Code-Review | partial | 6 / 7.5 | Found 24/28 approved changesets -- score normalized to 8 |
| Contributors | met | 2.5 / 2.5 | project has 25 contributing companies or organizations |
| Dangerous-Workflow | met | 10 / 10 | no dangerous workflow patterns detected |
| Dependency-Update-Tool | met | 7.5 / 7.5 | update tool detected |
| Fuzzing | not met | 0 / 5 | project is not fuzzed |
| License | met | 2.5 / 2.5 | license file detected |
| Maintained | met | 7.5 / 7.5 | 30 commit(s) and 14 issue activity found in the last 90 days -- score normalized to 10 |
| Packaging | excluded | 0 / 5 | packaging workflow not detected |
| Pinned-Dependencies | not met | 0 / 5 | dependency not pinned by hash detected -- score normalized to 0 |
| SAST | not met | 0 / 5 | SAST tool is not run on all commits -- score normalized to 0 |
| Security-Policy | not met | 0 / 5 | security policy file not detected |
| Signed-Releases | excluded | 0 / 7.5 | no releases found |
| Token-Permissions | not met | 0 / 7.5 | detected GitHub workflow tokens with excessive permissions |
| Vulnerabilities | not met | 0 / 7.5 | 10 existing vulnerabilities detected |

### High-Risk Jurisdiction Exposure — 100/100 (Excellent)

Only high-confidence self-published location evidence affects this multiplier. Ambiguous matches are review-only; country evidence is not proof of nationality, citizenship, legal registration, malicious intent, or sanctions status.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Policy exposure multiplier | met | 100 / 100 | no confirmed policy-scope location match |

## AI Readiness — 70/100 (Good)

How well is the repo equipped to be developed and maintained with AI coding agents? An independent, experimental badge — weight 0.0, so it is surfaced on its own and does not affect the overall health score.

### Agent context & guidance — 75/100 (Good)

Excluded from scoring (no data or not applicable): Legible commit history. Remaining weights renormalized.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Agent instructions | met | 45 / 45 | .claude/CLAUDE.md |
| Machine-readable docs (llms.txt) | not met | 0 / 15 | — |
| Legible commit history | excluded | 0 / 40 | no data |

### Verify loop (build / test / typecheck) — 66/100 (Moderate)

Excluded from scoring (no data or not applicable): Demonstrated agent practice, Automated maintenance. Remaining weights renormalized.

| Criterion | Status | Points | Detail |
|---|---|---|---|
| One-command bootstrap | not met | 0 / 18 | — |
| Automated tests | met | 22 / 22 | — |
| Lint / format config | met | 11 / 11 | .eslintrc.json, biome.json, eslint.config.mjs |
| Static type checking | met | 11 / 11 | docs/tsconfig.json, packages/basic-crawler/test/tsconfig.json, packages/basic-crawler/tsconfig.json, packages/browser-crawler/test/tsconfig.json, packages/browser-crawler/tsconfig.json, packages/browser-pool/test/tsconfig.json, packages/browser-pool/tsconfig.json, packages/cheerio-crawler/test/tsconfig.json, packages/cheerio-crawler/tsconfig.json, packages/cli/tsconfig.json, packages/core/test/tsconfig.json, packages/core/tsconfig.json, packages/crawlee/tsconfig.json, packages/http-crawler/tsconfig.json, packages/impit-client/tsconfig.json, packages/jsdom-crawler/tsconfig.json, packages/linkedom-crawler/tsconfig.json, packages/memory-storage/test/tsconfig.json, packages/memory-storage/tsconfig.json, packages/playwright-crawler/tsconfig.json, packages/puppeteer-crawler/tsconfig.json, packages/stagehand-crawler/tsconfig.json, packages/templates/templates/camoufox-ts/tsconfig.json, packages/templates/templates/cheerio-ts/tsconfig.json, packages/templates/templates/empty-ts/tsconfig.json, packages/templates/templates/getting-started-ts/tsconfig.json, packages/templates/templates/playwright-ts/tsconfig.json, packages/templates/templates/puppeteer-ts/tsconfig.json, packages/templates/tsconfig.json, packages/types/tsconfig.json, packages/utils/test/tsconfig.json, packages/utils/tsconfig.json, test/e2e/cheerio-curl-impersonate-ts/actor/tsconfig.json, test/e2e/cheerio-default-ts/actor/tsconfig.json, test/e2e/cheerio-impit-ts/actor/tsconfig.json, test/e2e/cheerio-stop-resume-ts/actor/tsconfig.json, test/e2e/jsdom-default-ts/actor/tsconfig.json, test/e2e/jsdom-react-ts/actor/tsconfig.json, test/e2e/linkedom-default-ts/actor/tsconfig.json, test/e2e/tsconfig.json, test/tsconfig.json, tsconfig.json, website/versioned_docs/version-3.10/examples/tsconfig.json, website/versioned_docs/version-3.10/introduction/tsconfig.json, website/versioned_docs/version-3.11/examples/tsconfig.json, website/versioned_docs/version-3.11/introduction/tsconfig.json, website/versioned_docs/version-3.12/examples/tsconfig.json, website/versioned_docs/version-3.12/introduction/tsconfig.json, website/versioned_docs/version-3.13/examples/tsconfig.json, website/versioned_docs/version-3.13/introduction/tsconfig.json, website/versioned_docs/version-3.14/examples/tsconfig.json, website/versioned_docs/version-3.14/introduction/tsconfig.json, website/versioned_docs/version-3.15/examples/tsconfig.json, website/versioned_docs/version-3.15/introduction/tsconfig.json, website/versioned_docs/version-3.16/tsconfig.json, website/versioned_docs/version-3.17/tsconfig.json |
| Reproducible environment | met | 10 / 10 | Dockerfile, lockfile |
| Demonstrated agent practice | excluded | 0 / 10 | no data |
| Automated maintenance | excluded | 0 / 8 | no data |
| OpenSSF Scorecard: Pinned-Dependencies | not met | 0 / 10 | dependency not pinned by hash detected -- score normalized to 0 |

### Code legibility for models — 100/100 (Excellent)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| Type-checkable code | met | 45 / 45 | TypeScript (statically typed) |
| Manageable file sizes | partial | 54.9 / 55 | 2/1379 source files over 60KB |

### Machine-readable interfaces — 40/100 (At risk)

| Criterion | Status | Points | Detail |
|---|---|---|---|
| API schema (OpenAPI/GraphQL/proto) | not met | 0 / 40 | — |
| MCP server | not met | 0 / 20 | — |
| Runnable examples | met | 40 / 40 | examples |

## Collection warnings

- Could not fetch npm package 'crawlee-docs' from its registry
- Resolved dependency list truncated to 2000 of 2772 packages (counts remain complete)

## What this report is

inspect.software measures public repositories against a single published, versioned methodology and reports the result as a 1–100 health index. Findings are signals derived from what is visible in public repository data — they are not a security audit, a warranty, or an endorsement, and no result depends on payment.

- Methodology, formulas and weights: https://inspect.software/methodology.md
- What a result does and does not claim: https://inspect.software/wiki/signals-not-warranties.md
- Rating bands: https://inspect.software/wiki/scoring-bands.md
- Corrections: https://inspect.software/contact.md
- Index of all documents: https://inspect.software/llms.txt