Public record
Software health reportschema 0.34.0 · metrics 2.10.0 · 2026-10-19 10:00 UTC

apache / stormcrawler

A scalable, mature and versatile web crawler based on Apache Storm

JavaApache-2.0★ 1,008 stars⑂ 295 forkssince Apr 2013View on GitHub ↗

apache/stormcrawler holds a health index of 94 out of 100, placing it in the Exceptional band. It scores highest on Vitality (96/100) and lowest on Security (63/100). It was last updated today. A single contributor accounts for most of its recent work.

94
overall / 100
Exceptional

Software health index

Metrics are grouped into weighted categories on one standardized 1–100 scale. Overall starts as their weighted mean, calibrated against the distribution of the public record so bands carry percentile meaning; when public evidence triggers the High-Risk Jurisdiction Policy, the rating is adjusted and receives an At Risk ceiling of 34.

94
Exceptional93-100The record's top tier (≈ top 5%); essentially all checked criteria met
Excellent80-92Strong across the board; minor gaps
Good65-79Healthy; gaps are limited and manageable
Moderate50-64Acceptable with notable gaps; review recommended
Weak35-49Material weaknesses across several areas
At Risk20-34Significant weaknesses; adoption warrants caution
Critical1-19Severe problems (abandoned, single-maintainer, no hygiene)
VitalityCommunity &AdoptionSustainability &GovernanceEngineeringQualitySecurityAI Readiness

Score profile

Each axis is a category. The shape matters more than the average — a healthy subject fills the whole shape, while a spike-and-crater profile means strength in one dimension is masking risk in another.

The weighted overall 81 is calibrated to 94 on the published index scale (record calibration 2026-08-02).

Ownership

The Apache Software FoundationOrganization · verified domain
24,675 followers3,187 public repossince Jan 2009

This repository is backed by an organization — shared, accountable stewardship that can outlive any single maintainer.

Package ecosystems

RegistryPackageVersionDownloads / moVersionsLast publish
Mavenorg.apache.stormcrawler:stormcrawler-core3.7.0-978 days ago
Mavenorg.apache.stormcrawler:stormcrawler-archetype3.7.0-978 days ago

Metrics by category

Vitality

Is the project alive — is code being written and are releases shipping?

96Exceptional · 21% of overall
How it's scored
36/36Push recency — last push 0 days ago
35.3/36Commit cadence — 51/52 weeks with commits
18/18Commit volume — 435 commits in the last year
10/10OpenSSF Scorecard: Maintained — 30 commit(s) and 2 issue activity found in the last 90 days -- score normalized to 10
Inputs used
commits_last_year435
human_commit_share0.6
days_since_last_push0
active_weeks_last_year51
How it's scored
27/27Ships releases — 35 releases published
36/36Release recency — latest release 81 days ago
19.8/27Release cadence — a release every ~104.3 days
0/10OpenSSF Scorecard: Signed-Releases — no data
Inputs used
releases_count35
latest_release_tagstormcrawler-3.7.0
releases_from_tagsno
days_since_latest_release81
mean_days_between_releases104.3
Excluded from scoring (no data or not applicable): OpenSSF Scorecard: Signed-Releases. Remaining weights renormalized.

Community & Adoption

Does the project have users, downloads, attention, and a welcoming setup for contributors?

85Excellent · 17% of overall
How it's scored
48.7/60Stars — 1,008 stars
20.6/25Forks — 295 forks
9.9/15Watchers — 62 watchers
Inputs used
forks295
stars1,008
watchers62
growth_stateunverified
growth_factor_pct100
growth_unverified_reasonno_history

Community health

92Excellent
How it's scored
22.5/22.5README
22.5/22.5License — recognized license (Apache-2.0)
18/18CONTRIBUTING guide
13.5/13.5Code of conduct
0/7.2Issue template
6.3/6.3PR template
Inputs used
has_readmeyes
has_licenseyes
readme_badges2
has_contributingyes
has_issue_templateno
has_code_of_conductyes
readme_badge_servicesgithub.com, shields.io
has_pull_request_templateyes

Sustainability & Governance

Will the project survive its people — bus factor, responsiveness, who backs it, and package upkeep?

77Good · 23% of overall
How it's scored
9/54Bus factor — 1 contributor(s) cover half of all commits
5.1/22.5Commit distribution — top contributor authored 78% of commits
13.5/13.5Contributor breadth — 69 contributors
10/10OpenSSF Scorecard: Contributors — project has 18 contributing companies or organizations
Inputs used
bus_factor1
contributors_sampled69
top_contributor_share0.775
How it's scored
41.4/42Issue resolution — 98% of issues closed
26.8/30PR acceptance — 1,139/1,273 decided PRs merged
0/13Newcomer PR acceptance — 0/2 first-time contributors' PRs merged in 30d
15/15OpenSSF Scorecard: Code-Review — all changesets reviewed
Inputs used
merged_prs1,139
open_issues14
closed_issues918
prs_merged_7d3
prs_decided_7d3
prs_merged_30d27
prs_decided_30d32
issue_closed_ratio0.985
closed_unmerged_prs134
first_time_authors_30d2
first_time_prs_merged_30d0
first_time_prs_decided_30d2
How it's scored
30/30Ownership backing — organization-owned
20/20Verified domain
25/25Owner reach — 24,675 followers of apache
25/25Track record — 3,187 public repos, account ~17 yr old
Inputs used
followers24,675
owner_typeOrganization
is_verifiedyes
owner_loginapache
public_repos3,187
account_age_days6,483

Package maintenance

100Exceptional
How it's scored
25/25Published & resolvable — 2 package(s) on maven
35/35Publish recency — latest publish 78 days ago
20/20Version history — 9 published versions
20/20Not deprecated — active, not deprecated or yanked
Inputs used
packagesorg.apache.stormcrawler:stormcrawler-core, org.apache.stormcrawler:stormcrawler-archetype
ecosystemsmaven
any_deprecatedno
min_days_since_publish78

Engineering Quality

Are baseline engineering and documentation practices in place?

79Good · 19% of overall
How it's scored
24/24CI workflows — 3 workflow(s)
24/24Tests present
0/16Linter config
0/9.6Pre-commit hooks
6.4/6.4.editorconfig
18/20OpenSSF Scorecard: CI-Tests — 29 out of 30 merged PRs checked by a CI test -- score normalized to 9
Inputs used
has_ciyes
has_testsyes
has_editorconfigyes
has_linter_configno
has_precommit_configno

Documentation

90Excellent
How it's scored
30/30README
25/25Documentation directory
15/15Documentation / homepage site — https://stormcrawler.apache.org/
10/10Repository description
10/10Topics — 6 topics
0/10Wiki
Inputs used
topicsweb-crawler, apache-storm, distributed, java, crawler, stormcrawler
has_wikino
homepagehttps://stormcrawler.apache.org/
docs_sitehttps://stormcrawler.apache.org/
has_readmeyes
has_docs_diryes
has_descriptionyes

Security

Are visible security and supply-chain practices strong, without unresolved high-risk jurisdiction exposure?

63Moderate · 16% of overall
How it's scored
7.5/7.5Binary-Artifacts — no binaries found in the repo
4.5/7.5Branch-Protection — branch protection is not maximal on development and all release branches
2.2/2.5CI-Tests — 29 out of 30 merged PRs checked by a CI test -- score normalized to 9
0/2.5CII-Best-Practices — no effort to earn an OpenSSF best practices badge detected
7.5/7.5Code-Review — all changesets reviewed
2.5/2.5Contributors — project has 18 contributing companies or organizations
10/10Dangerous-Workflow — no dangerous workflow patterns detected
7.5/7.5Dependency-Update-Tool — update tool detected
0/5Fuzzing — project is not fuzzed
2.5/2.5License — license file detected
7.5/7.5Maintained — 30 commit(s) and 2 issue activity found in the last 90 days -- score normalized to 10
5/5Packaging — packaging workflow detected
5/5Pinned-Dependencies — all dependencies are pinned
0/5SAST — SAST tool is not run on all commits -- score normalized to 0
5/5Security-Policy — security policy file detected
0/7.5Signed-Releases — no data
0/7.5Token-Permissions — detected GitHub workflow tokens with excessive permissions
0/7.5Vulnerabilities — 11 existing vulnerabilities detected
Inputs used
sourceopenssf_scorecard
checks_evaluated17
scorecard_versionv5.5.0
checks_inconclusive1
scorecard_aggregate6.8
Excluded from scoring (no data or not applicable): Signed-Releases. Remaining weights renormalized.
How it's scored
11.8/35Direct dependencies free of known advisories — 2 affected: com.fasterxml.jackson.core:jackson-databind 2.22.0 (high 7.5), org.jsoup:jsoup 1.22.2 (high 7.5)
3.8/25Indirect dependencies free of known advisories — 6 affected: io.netty:netty-handler 4.2.12.Final (critical 9.1), org.bouncycastle:bcprov-jdk18on 1.84 (critical 9.1), com.fasterxml.jackson.core:jackson-core 2.22.0 (high 7.5), +3 more
25/40No advisories left outstanding — 4 advisory-carrying package(s) unaddressed past 90 days; oldest published 165 days ago
Inputs used
sourceosv
advisories32
affected_packages8
assessed_packages70
unassessed_packages0
affected_by_severitycritical 2, high 5, low 1
direct_affected_packages2
Matched the maven:org.apache.stormcrawler:stormcrawler-core@3.7.0 runtime dependency closure — what installing the published package pulls in — 70 packages. Reachability is not analyzed.

AI Readiness

How well is the repo equipped to be developed and maintained with AI coding agents? Carries a deliberately small weight (4%): agent tooling is a real maintenance signal, but a repository with none can still reach 100/100.

87Excellent · 4% of overall
How it's scored
45/45Agent instructions — AGENTS.md
0/15Machine-readable docs (llms.txt)
40/40Legible commit history — 60 of 60 human commits state their intent (structured subject or explanatory body)
Inputs used
has_llms_txtno
llms_txt_url—
legible_history_share1
agent_instruction_filesAGENTS.md
agent_instruction_max_bytes296
How it's scored
12.6/18One-command bootstrap — archetype/pom.xml, archetype/src/main/resources/archetype-resources/pom.xml, core/pom.xml (toolchain convention, no task runner)
22/22Automated tests
0/11Lint / format config
11/11Static type checking — Java (statically typed)
10/10Reproducible environment — Dockerfile
10/10Demonstrated agent practice — 9 of the last 100 commits agent-authored or agent-credited
8/8Automated maintenance — 27 of the last 100 commits are automated dependency updates
10/10OpenSSF Scorecard: Pinned-Dependencies — all dependencies are pinned
Inputs used
has_nixno
has_testsyes
lockfiles—
has_dockerfileyes
typed_languageyes
bootstrap_files—
has_devcontainerno
has_linter_configno
typecheck_configs—
agent_commit_share0.09
toolchain_manifestsarchetype/pom.xml, archetype/src/main/resources/archetype-resources/pom.xml, core/pom.xml, docs/pom.xml, external/ai/pom.xml, external/aws/pom.xml, external/langid/pom.xml, external/opensearch-java/pom.xml, external/opensearch/archetype/pom.xml, external/opensearch/archetype/src/main/resources/archetype-resources/pom.xml, external/opensearch/pom.xml, external/playwright/pom.xml, external/pom.xml, external/solr/archetype/pom.xml, external/solr/archetype/src/main/resources/archetype-resources/pom.xml, external/solr/pom.xml, external/sql/pom.xml, external/tika/pom.xml, external/urlfrontier/pom.xml, external/warc/pom.xml, pom.xml
dependency_bot_commit_share0.27
How it's scored
45/45Type-checkable code — Java (statically typed)
54.9/55Manageable file sizes — 1/398 source files over 60KB
Inputs used
primary_languageJava
largest_source_bytes61,565
source_files_sampled398
oversized_source_files1

Key facts

1,008GitHub stars
69contributors
435commits, last 12 months
0days since last push
35releases
1bus factor
14open issues
Mavenpackage ecosystems

Data collection warnings

  • Star history unavailable: GitHub GraphQL error: Resource not accessible by personal access token

More detail

Star and fork history 0 ★ / 295 ⇿
0Stars
295Forks
35Releases

When each star and fork was added, collected from GitHub and bucketed by day. Cumulative growth sits directly above the daily additions it is made of, so the two read against each other: steady organic accretion looks nothing like an abrupt, short-lived burst. Where that difference is measurable, it is reported as growth authenticity.

05010015020025030029362013-092020-042026-10
Major 0Minor 0Patch 2

Each point covers 12 days.

OpenSSF Scorecard 6.8 / 10
6.8aggregate

Independent, tool-agnostic security assessment from the open-source OpenSSF Scorecard. Each check rewards a security practice, not a specific vendor's tool. Checks Scorecard could not determine are marked n/a and excluded from the security score (never counted as zero).Scorecard v5.5.0 · 2026-10-19 10:00 UTC

10Binary-Artifactsno binaries found in the repo
6Branch-Protectionbranch protection is not maximal on development and all release branches
9CI-Tests29 out of 30 merged PRs checked by a CI test -- score normalized to 9
0CII-Best-Practicesno effort to earn an OpenSSF best practices badge detected
10Code-Reviewall changesets reviewed
10Contributorsproject has 18 contributing companies or organizations
10Dangerous-Workflowno dangerous workflow patterns detected
10Dependency-Update-Toolupdate tool detected
0Fuzzingproject is not fuzzed
10Licenselicense file detected
10Maintained30 commit(s) and 2 issue activity found in the last 90 days -- score normalized to 10
10Packagingpackaging workflow detected
10Pinned-Dependenciesall dependencies are pinned
0SASTSAST tool is not run on all commits -- score normalized to 0
10Security-Policysecurity policy file detected
n/aSigned-Releasesno releases found
0Token-Permissionsdetected GitHub workflow tokens with excessive permissions
0Vulnerabilities11 existing vulnerabilities detected
Direct dependencies 35
RegistryPackageVersion constraintManifest
Mavenorg.apache.storm:storm-client—core/pom.xml
Mavenorg.apache.tika:tika-core${tika.version}core/pom.xml
Mavenorg.apache.commons:commons-compress—core/pom.xml
Mavencommons-cli:commons-cli${cli.version}core/pom.xml
Mavencom.github.crawler-commons:crawler-commons${crawler-commons.version}core/pom.xml
Mavenxerces:xercesImpl${xerces.version}core/pom.xml
Mavencom.fasterxml.jackson.core:jackson-databind—core/pom.xml
Mavencom.github.ben-manes.caffeine:caffeine${caffeine.version}core/pom.xml
Mavenorg.jsoup:jsoup${jsoup.version}core/pom.xml
Mavencom.ibm.icu:icu4j${icu4j.version}core/pom.xml
Mavencom.rometools:rome${rometools.version}core/pom.xml
Mavenorg.apache.httpcomponents:httpclient${httpclient.version}core/pom.xml
Mavenorg.yaml:snakeyaml${snakeyaml.version}core/pom.xml
Mavenorg.apache.commons:commons-lang3${commons.lang.version}core/pom.xml
Mavencom.squareup.okhttp3:okhttp${okhttp.version}core/pom.xml
Mavencom.squareup.okhttp3:okhttp-brotli${okhttp.version}core/pom.xml
Mavencom.squareup.okhttp3:okhttp-zstd${okhttp.version}core/pom.xml
Mavencom.google.guava:guava${guava.version}core/pom.xml
Mavencom.fasterxml.jackson.core:jackson-core${jackson.version}core/pom.xml
Mavencom.fasterxml.jackson.core:jackson-annotations${jackson-annotations.version}core/pom.xml
Mavenorg.apache.storm:storm-client—external/pom.xml
Mavenorg.apache.stormcrawler:stormcrawler-core${project.version}external/pom.xml
Mavencom.cosium.code:google-java-format${git-code-format-maven-plugin.version}pom.xml
Mavencom.puppycrawl.tools:checkstyle${checkstyle.version}pom.xml
Mavencom.fasterxml.jackson.core:jackson-databind${jackson.version}pom.xml
Mavencom.fasterxml.jackson.core:jackson-annotations${jackson-annotations.version}pom.xml
Mavencom.fasterxml.jackson.core:jackson-core${jackson.version}pom.xml
Mavencom.fasterxml.jackson.dataformat:jackson-dataformat-smile${jackson.version}pom.xml
Mavencom.fasterxml.jackson.dataformat:jackson-dataformat-cbor${jackson.version}pom.xml
Mavencom.fasterxml.jackson.dataformat:jackson-dataformat-yaml${jackson.version}pom.xml
Mavencom.fasterxml.jackson.datatype:jackson-datatype-jsr310${jackson.version}pom.xml
Mavenorg.jetbrains:annotations${jetbrains.annotations.version}pom.xml
Mavenorg.testcontainers:testcontainers-bom${testcontainers.version}pom.xml
Mavenorg.apache.commons:commons-compress${commons.compress.version}pom.xml
Mavencommons-codec:commons-codec${commons.codec.version}pom.xml
All dependencies 73

Full resolved dependency set from the GitHub dependency graph: 34 direct and 39 indirect (transitive) packages. The transitive closure is complete when the repository commits a lockfile.

RegistryPackageVersionRelation
Mavencom.cosium.code:google-java-format6.2direct
Mavencom.fasterxml.jackson.core:jackson-annotations—direct
Mavencom.fasterxml.jackson.core:jackson-annotations2.22direct
Mavencom.fasterxml.jackson.core:jackson-core—direct
Mavencom.fasterxml.jackson.core:jackson-core2.22.0direct
Mavencom.fasterxml.jackson.core:jackson-databind—direct
Mavencom.fasterxml.jackson.core:jackson-databind2.22.0direct
Mavencom.fasterxml.jackson.dataformat:jackson-dataformat-cbor2.22.0direct
Mavencom.fasterxml.jackson.dataformat:jackson-dataformat-smile2.22.0direct
Mavencom.fasterxml.jackson.dataformat:jackson-dataformat-yaml2.22.0direct
Mavencom.fasterxml.jackson.datatype:jackson-datatype-jsr3102.22.0direct
Mavencom.github.ben-manes.caffeine:caffeine3.3.1direct
Mavencom.github.crawler-commons:crawler-commons1.6direct
Mavencom.google.guava:guava—direct
Mavencom.ibm.icu:icu4j78.3direct
Mavencom.puppycrawl.tools:checkstyle14.3.0direct
Mavencom.rometools:rome2.1.0direct
Mavencom.squareup.okhttp3:okhttp5.5.0direct
Mavencom.squareup.okhttp3:okhttp-brotli5.5.0direct
Mavencom.squareup.okhttp3:okhttp-zstd5.5.0direct
Mavencommons-cli:commons-cli1.11.0direct
Mavencommons-codec:commons-codec1.23.0direct
Mavenorg.apache.commons:commons-compress—direct
Mavenorg.apache.commons:commons-compress1.28.0direct
Mavenorg.apache.commons:commons-lang33.21.0direct
Mavenorg.apache.httpcomponents:httpclient4.5.14direct
Mavenorg.apache.storm:storm-client—direct
Mavenorg.apache.storm:storm-client3.1.0direct
Mavenorg.apache.tika:tika-core—direct
Mavenorg.jetbrains:annotations26.1.0direct
Mavenorg.jsoup:jsoup1.23.2direct
Mavenorg.testcontainers:testcontainers-bom1.21.4direct
Mavenorg.yaml:snakeyaml2.7direct
Mavenxerces:xercesImpl2.12.2direct
Mavencom.cosium.code:git-code-format-maven-plugin6.2indirect
Mavencom.digitalpebble.stormcrawler:storm-crawler-core—indirect
Mavende.thetaphi:forbiddenapis3.11indirect
Mavenorg.apache.maven.plugins:maven-assembly-plugin—indirect
Mavenorg.apache.maven.plugins:maven-checkstyle-plugin3.6.0indirect
Mavenorg.apache.maven.plugins:maven-compiler-plugin—indirect
Mavenorg.apache.maven.plugins:maven-compiler-plugin3.16.0indirect
Mavenorg.apache.maven.plugins:maven-compiler-plugin3.2indirect
Mavenorg.apache.maven.plugins:maven-enforcer-plugin3.6.3indirect
Mavenorg.apache.maven.plugins:maven-jar-plugin—indirect
Mavenorg.apache.maven.plugins:maven-jar-plugin3.5.1indirect
Mavenorg.apache.maven.plugins:maven-javadoc-plugin—indirect
Mavenorg.apache.maven.plugins:maven-javadoc-plugin3.12.0indirect
Mavenorg.apache.maven.plugins:maven-remote-resources-plugin—indirect
Mavenorg.apache.maven.plugins:maven-resources-plugin3.5.0indirect
Mavenorg.apache.maven.plugins:maven-shade-plugin1.3.3indirect
Mavenorg.apache.maven.plugins:maven-surefire-plugin3.6.0indirect
Mavenorg.apache.rat:apache-rat-plugin0.18indirect
Mavenorg.apache.storm:flux-core1.2.3indirect
Mavenorg.apache.storm:storm-core1.2.3indirect
Mavenorg.asciidoctor:asciidoctor-maven-plugin3.2.0indirect
Mavenorg.awaitility:awaitility—indirect
Mavenorg.awaitility:awaitility4.3.0indirect
Mavenorg.codehaus.mojo:exec-maven-plugin1.3.2indirect
Mavenorg.codehaus.mojo:license-maven-plugin—indirect
Mavenorg.codehaus.mojo:license-maven-plugin2.7.1indirect
Mavenorg.ec4j.maven:editorconfig-maven-plugin0.2.0indirect
Mavenorg.jacoco:jacoco-maven-plugin—indirect
Mavenorg.jacoco:jacoco-maven-plugin0.8.15indirect
Mavenorg.junit.jupiter:junit-jupiter—indirect
Mavenorg.junit.jupiter:junit-jupiter6.1.3indirect
Mavenorg.junit.jupiter:junit-jupiter-api—indirect
Mavenorg.junit.jupiter:junit-jupiter-api6.1.3indirect
Mavenorg.mockito:mockito-core—indirect
Mavenorg.slf4j:slf4j-simple—indirect
Mavenorg.slf4j:slf4j-simple2.0.20indirect
Mavenorg.testcontainers:junit-jupiter—indirect
Mavenorg.testcontainers:junit-jupiter1.21.4indirect
Mavenorg.wiremock:wiremock3.13.2indirect
Dependency advisories 8

Installing maven:org.apache.stormcrawler:stormcrawler-core@3.7.0 pulls in 70 packages, direct and transitive: 8 carry known advisories, of which 2 are direct dependencies.

PackageVersionRelationSeverityAdvisoriesFixed in
io.netty:netty-handler4.2.12.Finalindirectcritical54.2.17.Final
org.bouncycastle:bcprov-jdk18on1.84indirectcritical22.73.12
com.fasterxml.jackson.core:jackson-databind2.22.0directhigh83.2.3
org.jsoup:jsoup1.22.2directhigh21.23.2
com.fasterxml.jackson.core:jackson-core2.22.0indirecthigh23.2.3
com.rabbitmq:amqp-client5.30.0indirecthigh105.36.1
io.netty:netty-codec-compression4.2.12.Finalindirecthigh24.2.16.Final
org.apache.logging.log4j:log4j-api2.26.0indirectlow12.26.1

An advisory means the version recorded in the dependency graph falls inside an advisory’s affected range. Reachability is not analysed, and the graph includes development and test pins — a finding may concern tooling rather than shipped software.

Raw JSON report machine-readable

Feedback

Spotted something off in this report, or have thoughts to share? Wrong measurements, missed tooling, ideas, questions — anything is welcome. Every message is read and gets a response.

The message is kept through sign-in.

Scores are signals, not warranties. They reflect publicly visible practices on GitHub — not a code audit, and not a security guarantee.

Missing data is excluded and weights renormalized, never scored as zero. Methodology is versioned and open: metrics v2.10.0, schema v0.34.0 — full methodology · metrics wiki.

How one result sits in the wider record: aggregate statistics — Maven.