Public record
Software health reportschema 0.34.0 · metrics 2.10.0 · 2026-10-19 16:20 UTC

scrapinghub / shub-workflow

PythonApache-2.0★ 14 stars⑂ 16 forkssince Sep 2018View on GitHub ↗
KindLibraryhow this is determined

scrapinghub/shub-workflow holds a health index of 63 out of 100, placing it in the Moderate band. It scores highest on Sustainability & Governance (65/100) and lowest on Community & Adoption (47/100). It was last updated today. A single contributor accounts for most of its recent work.

63
overall / 100
Moderate

Software health index

Metrics are grouped into weighted categories on one standardized 1–100 scale. Overall starts as their weighted mean, calibrated against the distribution of the public record so bands carry percentile meaning; when public evidence triggers the High-Risk Jurisdiction Policy, the rating is adjusted and receives an At Risk ceiling of 34.

63
Exceptional93-100The record's top tier (≈ top 5%); essentially all checked criteria met
Excellent80-92Strong across the board; minor gaps
Good65-79Healthy; gaps are limited and manageable
Moderate50-64Acceptable with notable gaps; review recommended
Weak35-49Material weaknesses across several areas
At Risk20-34Significant weaknesses; adoption warrants caution
Critical1-19Severe problems (abandoned, single-maintainer, no hygiene)
VitalityCommunity &AdoptionSustainability &GovernanceEngineeringQualitySecurityAI Readiness

Score profile

Each axis is a category. The shape matters more than the average — a healthy subject fills the whole shape, while a spike-and-crater profile means strength in one dimension is masking risk in another.

The weighted overall 59 is calibrated to 63 on the published index scale (record calibration 2026-08-02).

Ownership

ScrapinghubOrganization · verified domain
714 followers183 public repossince Mar 2011

This repository is backed by an organization — shared, accountable stewardship that can outlive any single maintainer.

Package ecosystems

RegistryPackageVersionDownloads / moVersionsLast publish
PyPIshub-workflow1.14.445,8993490 days ago

Metrics by category

Vitality

Is the project alive — is code being written and are releases shipping?

63Moderate · 21% of overall

Development activity

78Good
How it's scored
36/36Push recency — last push 0 days ago
14.5/36Commit cadence — 21/52 weeks with commits
18/18Commit volume — 110 commits in the last year
10/10OpenSSF Scorecard: Maintained — 16 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 10
Inputs used
commits_last_year110
human_commit_share1
days_since_last_push0
active_weeks_last_year21

Release discipline

40Weak
How it's scored
16.2/27Ships releases — 19 version tags (no GitHub releases)
0/36Release recency — latest release 2,059 days ago
19.8/27Release cadence — a release every ~80.2 days
0/10OpenSSF Scorecard: Signed-Releases — no data
Inputs used
releases_count19
latest_release_tag1.7.0
releases_from_tagsyes
days_since_latest_release2,059
mean_days_between_releases80.2
Excluded from scoring (no data or not applicable): OpenSSF Scorecard: Signed-Releases. Remaining weights renormalized.

Community & Adoption

Does the project have users, downloads, attention, and a welcoming setup for contributors?

47Weak · 17% of overall

Popularity & adoption

35Weak
How it's scored
18.1/60Stars — 14 stars
9.8/25Forks — 16 forks
6.8/15Watchers — 18 watchers
Inputs used
forks16
stars14
watchers18
growth_stateunverified
growth_factor_pct100
growth_unverified_reasonno_history

Community health

50Moderate
How it's scored
22.5/22.5README
22.5/22.5License — recognized license (Apache-2.0)
0/18CONTRIBUTING guide
0/13.5Code of conduct
0/7.2Issue template
0/6.3PR template
Inputs used
has_readmeyes
has_licenseyes
readme_badges0
has_contributingno
has_issue_templateno
has_code_of_conductno
readme_badge_services—
has_pull_request_templateno

Ecosystem adoption (downloads)

63Moderate
How it's scored
50.3/80Monthly downloads — 5,899 downloads/month across pypi
0/20Registry dependents — not reported by this ecosystem
Inputs used
packagesshub-workflow
dependents—
ecosystemspypi
total_downloads—
monthly_downloads5,899
unverified_packages_excluded—
Excluded from scoring (no data or not applicable): Registry dependents. Remaining weights renormalized.

Sustainability & Governance

Will the project survive its people — bus factor, responsiveness, who backs it, and package upkeep?

65Good · 23% of overall

Maintainer resilience (bus factor)

20At Risk
How it's scored
9/54Bus factor — 1 contributor(s) cover half of all commits
0.2/22.5Commit distribution — top contributor authored 99% of commits
8.1/13.5Contributor breadth — 6 contributors
3/10OpenSSF Scorecard: Contributors — project has 1 contributing companies or organizations -- score normalized to 3
Inputs used
bus_factor1
contributors_sampled6
top_contributor_share0.99

Issue & PR responsiveness

61Moderate
How it's scored
32.7/42Issue resolution — 78% of issues closed
20.1/30PR acceptance — 47/70 decided PRs merged
0/13Newcomer PR acceptance — no first-time contributor's PR decided in 30d
0/15OpenSSF Scorecard: Code-Review — Found 0/30 approved changesets -- score normalized to 0
Inputs used
merged_prs47
open_issues2
closed_issues7
prs_merged_7d0
prs_decided_7d0
prs_merged_30d0
prs_decided_30d0
issue_closed_ratio0.778
closed_unmerged_prs23
first_time_authors_30d0
first_time_prs_merged_30d0
first_time_prs_decided_30d0
Excluded from scoring (no data or not applicable): Newcomer PR acceptance. Remaining weights renormalized.

Ownership & stewardship

96Exceptional
How it's scored
30/30Ownership backing — organization-owned
20/20Verified domain
20.5/25Owner reach — 714 followers of scrapinghub
25/25Track record — 183 public repos, account ~15 yr old
Inputs used
followers714
owner_typeOrganization
is_verifiedyes
owner_loginscrapinghub
public_repos183
account_age_days5,682

Package maintenance

100Exceptional
How it's scored
25/25Published & resolvable — 1 package(s) on pypi
35/35Publish recency — latest publish 0 days ago
20/20Version history — 349 published versions
20/20Not deprecated — active, not deprecated or yanked
Inputs used
packagesshub-workflow
ecosystemspypi
any_deprecatedno
min_days_since_publish0

Engineering Quality

Are baseline engineering and documentation practices in place?

64Moderate · 19% of overall

Engineering practices

80Excellent
How it's scored
24/24CI workflows — 1 workflow(s)
24/24Tests present
16/16Linter config — pyproject.toml ([tool.black]), setup.cfg ([flake8])
0/9.6Pre-commit hooks
0/6.4.editorconfig
0/20OpenSSF Scorecard: CI-Tests — no data
Inputs used
has_ciyes
has_testsyes
has_editorconfigno
has_linter_configyes
has_precommit_configno
Excluded from scoring (no data or not applicable): OpenSSF Scorecard: CI-Tests. Remaining weights renormalized.

Documentation

40Weak
How it's scored
30/30README
0/25Documentation directory
0/15Documentation / homepage site
0/10Repository description
0/10Topics
10/10Wiki
Inputs used
topics—
has_wikiyes
homepage—
docs_site—
has_readmeyes
has_docs_dirno
has_descriptionno

Security

Are visible security and supply-chain practices strong, without unresolved high-risk jurisdiction exposure?

52Moderate · 16% of overall

Security posture

40Weak
How it's scored
7.5/7.5Binary-Artifacts — no binaries found in the repo
0/7.5Branch-Protection — branch protection not enabled on development/release branches
0/2.5CI-Tests — no data
0/2.5CII-Best-Practices — no effort to earn an OpenSSF best practices badge detected
0/7.5Code-Review — Found 0/30 approved changesets -- score normalized to 0
0.8/2.5Contributors — project has 1 contributing companies or organizations -- score normalized to 3
10/10Dangerous-Workflow — no dangerous workflow patterns detected
7.5/7.5Dependency-Update-Tool — update tool detected
0/5Fuzzing — project is not fuzzed
2.5/2.5License — license file detected
7.5/7.5Maintained — 16 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 10
0/5Packaging — no data
0/5Pinned-Dependencies — dependency not pinned by hash detected -- score normalized to 0
0/5SAST — no SAST tool detected
0/5Security-Policy — security policy file not detected
0/7.5Signed-Releases — no data
0/7.5Token-Permissions — detected GitHub workflow tokens with excessive permissions
0/7.5Vulnerabilities — 56 existing vulnerabilities detected
Inputs used
sourceopenssf_scorecard
checks_evaluated15
scorecard_versionv5.5.0
checks_inconclusive3
scorecard_aggregate4
Excluded from scoring (no data or not applicable): CI-Tests, Packaging, Signed-Releases. Remaining weights renormalized.

Dependency advisories

100Exceptional
How it's scored
35/35Direct dependencies free of known advisories — no direct dependency carries a known advisory
0/25Indirect dependencies free of known advisories — transitive set not separable from development and test dependencies in this scope
0/40No advisories left outstanding — no advisory carries a publication date
Inputs used
sourceosv
advisories105
affected_packages24
assessed_packages158
unassessed_packages12
affected_by_severitycritical 2, high 14, moderate 7, low 1
direct_affected_packages0
Excluded from scoring (no data or not applicable): Indirect dependencies free of known advisories, No advisories left outstanding. Remaining weights renormalized. Matched 158 resolved dependencies against OSV. 12 could not be assessed — no resolved version, an unsupported ecosystem, or beyond the reported package list. This repository publishes no package the index resolves, so the repository dependency graph was assessed instead. That graph mixes development and test pins with shipped dependencies, so only the declared runtime dependencies are scored; transitive findings are reported as context and excluded from the score. Reachability is not analyzed.

AI Readiness

How well is the repo equipped to be developed and maintained with AI coding agents? Carries a deliberately small weight (4%): agent tooling is a real maintenance signal, but a repository with none can still reach 100/100.

51Moderate · 4% of overall

Agent context & guidance

5Critical
How it's scored
0/45Agent instructions — no CLAUDE.md / AGENTS.md / editor rules
0/15Machine-readable docs (llms.txt)
4.8/40Legible commit history — 9 of 100 human commits state their intent (structured subject or explanatory body)
Inputs used
has_llms_txtno
llms_txt_url—
legible_history_share0.09
agent_instruction_files—
agent_instruction_max_bytes—

Verify loop (build / test / typecheck)

56Moderate
How it's scored
0/18One-command bootstrap
22/22Automated tests
11/11Lint / format config — pyproject.toml ([tool.black]), setup.cfg ([flake8])
11/11Static type checking — shub_workflow/py.typed
10/10Reproducible environment — lockfile
2/10Demonstrated agent practice — 1 of the last 100 commits agent-authored or agent-credited
0/8Automated maintenance — no automated dependency updates observed
0/10OpenSSF Scorecard: Pinned-Dependencies — dependency not pinned by hash detected -- score normalized to 0
Inputs used
has_nixno
has_testsyes
lockfilesPipfile.lock
has_dockerfileno
typed_languageno
bootstrap_files—
has_devcontainerno
has_linter_configyes
typecheck_configsshub_workflow/py.typed
agent_commit_share0.01
toolchain_manifests—
dependency_bot_commit_share0

Code legibility for models

80Excellent
How it's scored
27/45Type-checkable code — Python with type-check config (shub_workflow/py.typed)
53/55Manageable file sizes — 2/54 source files over 60KB
Inputs used
primary_languagePython
largest_source_bytes100,215
source_files_sampled54
oversized_source_files2

Machine-readable interfaces

100Exceptional
How it's scored
0/40API schema (OpenAPI/GraphQL/proto) — not applicable to this kind of software
0/20MCP server — not applicable to this kind of software
40/40Runnable examples — examples
Inputs used
example_dirsexamples
has_mcp_signalno
api_schema_files—
interfaces_expected_of—
Excluded from scoring (no data or not applicable): API schema (OpenAPI/GraphQL/proto), MCP server. Remaining weights renormalized.

Key facts

14GitHub stars
6contributors
110commits, last 12 months
0days since last push
19releases
1bus factor
2open issues
PyPIpackage ecosystems

Data collection warnings

  • Star history unavailable: GitHub GraphQL error: Resource not accessible by personal access token
  • deps.dev does not index pypi:shub-workflow@1.14.44; advisories assessed against the repository dependency graph instead

More detail

Star and fork history 0 ★ / 16 ⇿
0Stars
16Forks
19Releases

When each star and fork was added, collected from GitHub and bucketed by day. Cumulative growth sits directly above the daily additions it is made of, so the two read against each other: steady organic accretion looks nothing like an abrupt, short-lived burst. Where that difference is measurable, it is reported as growth authenticity.

03581013151512018-112022-082026-06
Major 0Minor 1Patch 18

Each point covers 7 days.

OpenSSF Scorecard 4.0 / 10
4.0aggregate

Independent, tool-agnostic security assessment from the open-source OpenSSF Scorecard. Each check rewards a security practice, not a specific vendor's tool. Checks Scorecard could not determine are marked n/a and excluded from the security score (never counted as zero).Scorecard v5.5.0 · 2026-10-19 16:20 UTC

10Binary-Artifactsno binaries found in the repo
0Branch-Protectionbranch protection not enabled on development/release branches
n/aCI-Testsno pull request found
0CII-Best-Practicesno effort to earn an OpenSSF best practices badge detected
0Code-ReviewFound 0/30 approved changesets -- score normalized to 0
3Contributorsproject has 1 contributing companies or organizations -- score normalized to 3
10Dangerous-Workflowno dangerous workflow patterns detected
10Dependency-Update-Toolupdate tool detected
0Fuzzingproject is not fuzzed
10Licenselicense file detected
10Maintained16 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 10
n/aPackagingpackaging workflow not detected
0Pinned-Dependenciesdependency not pinned by hash detected -- score normalized to 0
0SASTno SAST tool detected
0Security-Policysecurity policy file not detected
n/aSigned-Releasesno releases found
0Token-Permissionsdetected GitHub workflow tokens with excessive permissions
0Vulnerabilities56 existing vulnerabilities detected
All dependencies 170

Full resolved dependency set from the GitHub dependency graph: 0 direct and 170 indirect (transitive) packages. The transitive closure is complete when the repository commits a lockfile.

RegistryPackageVersionRelation
PyPIarrow1.3.0indirect
PyPIastroid3.3.5indirect
PyPIasttokens2.4.1indirect
PyPIattrs24.2.0indirect
PyPIautomat24.8.1indirect
PyPIbackports-tarfile1.2.0indirect
PyPIblack24.3.0indirect
PyPIblinker1.9.0indirect
PyPIbloom-filter22.0.0indirect
PyPIboto3—indirect
PyPIboto31.35.70indirect
PyPIbotocore1.35.70indirect
PyPIcachetools4.2.4indirect
PyPIcertifi2024.8.30indirect
PyPIcffi1.17.1indirect
PyPIcharset-normalizer3.4.0indirect
PyPIclick8.1.7indirect
PyPIcollection-scanner—indirect
PyPIcollection-scanner0.5.1indirect
PyPIconstantly23.10.4indirect
PyPIcoverage7.6.8indirect
PyPIcryptography43.0.3indirect
PyPIcssselect1.2.0indirect
PyPIdateparser1.2.0indirect
PyPIdecorator5.1.1indirect
PyPIdefusedxml0.7.1indirect
PyPIdill0.3.9indirect
PyPIdocopt0.6.2indirect
PyPIdocutils0.21.2indirect
PyPIexceptiongroup1.2.2indirect
PyPIexecuting2.1.0indirect
PyPIfilelock3.16.1indirect
PyPIflake87.1.1indirect
PyPIflake8-import-order0.18.2indirect
PyPIflask3.1.0indirect
PyPIfqdn1.5.1indirect
PyPIfsspec2024.10.0indirect
PyPIgoogle-api-core2.10.2indirect
PyPIgoogle-auth1.35.0indirect
PyPIgoogle-cloud-core1.7.3indirect
PyPIgoogle-cloud-storage1.38.0indirect
PyPIgoogle-crc32c1.6.0indirect
PyPIgoogle-resumable-media1.3.3indirect
PyPIgoogleapis-common-protos1.66.0indirect
PyPIgrip4.6.2indirect
PyPIhcf-backend—indirect
PyPIhyperlink21.0.0indirect
PyPIidna3.10indirect
PyPIimportlib-metadata8.5.0indirect
PyPIincremental24.7.2indirect
PyPIiniconfig2.0.0indirect
PyPIipython8.18.1indirect
PyPIisoduration20.11.0indirect
PyPIisort5.13.2indirect
PyPIitemadapter0.9.0indirect
PyPIitemloaders1.3.2indirect
PyPIitsdangerous2.2.0indirect
PyPIjaraco-classes3.4.0indirect
PyPIjaraco-context6.0.1indirect
PyPIjaraco-functools4.1.0indirect
PyPIjedi0.19.2indirect
PyPIjeepney0.8.0indirect
PyPIjinja2—indirect
PyPIjinja23.1.5indirect
PyPIjmespath—indirect
PyPIjmespath1.0.1indirect
PyPIjsonpointer3.0.0indirect
PyPIjsonschema4.23.0indirect
PyPIjsonschema-specifications2024.10.1indirect
PyPIkeyring25.5.0indirect
PyPIlxml5.3.0indirect
PyPImarkdown3.7indirect
PyPImarkdown-it-py3.0.0indirect
PyPImarkupsafe3.0.2indirect
PyPImatplotlib-inline0.1.7indirect
PyPImccabe0.7.0indirect
PyPImdurl0.1.2indirect
PyPImore-itertools10.5.0indirect
PyPImsgpack1.1.0indirect
PyPImypy1.13.0indirect
PyPImypy-extensions1.0.0indirect
PyPInh30.2.18indirect
PyPIpackaging24.2indirect
PyPIparsel1.9.1indirect
PyPIparso0.8.4indirect
PyPIpath-and-address2.0.1indirect
PyPIpathspec0.12.1indirect
PyPIpexpect4.9.0indirect
PyPIpkginfo1.10.0indirect
PyPIplatformdirs4.3.6indirect
PyPIpluggy1.5.0indirect
PyPIprettytable—indirect
PyPIprettytable3.12.0indirect
PyPIprompt-toolkit3.0.48indirect
PyPIprotego0.3.1indirect
PyPIprotobuf4.25.5indirect
PyPIptyprocess0.7.0indirect
PyPIpure-eval0.2.3indirect
PyPIpyasn10.6.1indirect
PyPIpyasn1-modules0.4.1indirect
PyPIpycodestyle2.12.1indirect
PyPIpycparser2.22indirect
PyPIpydispatcher2.0.7indirect
PyPIpyflakes3.2.0indirect
PyPIpygments2.18.0indirect
PyPIpylint3.3.1indirect
PyPIpyopenssl24.2.1indirect
PyPIpytest8.3.3indirect
PyPIpytest-cov6.0.0indirect
PyPIpython-dateutil2.9.0.post0indirect
PyPIpython-slugify8.0.4indirect
PyPIpytz2024.2indirect
PyPIpyyaml—indirect
PyPIpyyaml6.0indirect
PyPIqueuelib1.7.0indirect
PyPIreadme-renderer44.0indirect
PyPIreferencing0.35.1indirect
PyPIregex2024.11.6indirect
PyPIrequests2.32.3indirect
PyPIrequests-file2.1.0indirect
PyPIrequests-toolbelt1.0.0indirect
PyPIretrying1.3.4indirect
PyPIrfc3339-validator0.1.4indirect
PyPIrfc39862.0.0indirect
PyPIrfc39871.3.8indirect
PyPIrich13.9.4indirect
PyPIrpds-py0.21.0indirect
PyPIrsa4.9indirect
PyPIs3fs0.4.2indirect
PyPIs3transfer0.10.4indirect
PyPIscrapinghub—indirect
PyPIscrapinghub2.4.0indirect
PyPIscrapy—indirect
PyPIscrapy2.12.0indirect
PyPIsecretstorage3.3.3indirect
PyPIsentry-sdk2.19.0indirect
PyPIservice-identity24.2.0indirect
PyPIsetuptools75.6.0indirect
PyPIsix1.16.0indirect
PyPIslack-sdk3.33.4indirect
PyPIspidermon1.23.0indirect
PyPIsqlitedict2.1.0indirect
PyPIstack-data0.6.3indirect
PyPItenacity—indirect
PyPItenacity9.0.0indirect
PyPItext-unidecode1.3indirect
PyPItimelength—indirect
PyPItimelength3.0.0indirect
PyPItldextract5.1.3indirect
PyPItomli2.1.0indirect
PyPItomlkit0.13.2indirect
PyPItraitlets5.14.3indirect
PyPItwine5.1.1indirect
PyPItwisted24.10.0indirect
PyPItypes-dateparser1.2.0.20240420indirect
PyPItypes-python-dateutil2.9.0.20241003indirect
PyPItypes-pyyaml6.0.12.20240917indirect
PyPItypes-requests2.32.0.20241016indirect
PyPItypes-setuptools75.6.0.20241126indirect
PyPItyping-extensions—indirect
PyPItyping-extensions4.12.2indirect
PyPItzlocal5.2indirect
PyPIuri-template1.3.0indirect
PyPIurllib32.2.3indirect
PyPIw3lib2.2.1indirect
PyPIwcwidth0.2.13indirect
PyPIwebcolors24.11.1indirect
PyPIwerkzeug3.1.3indirect
PyPIzipp3.21.0indirect
PyPIzope-interface7.1.1indirect
Dependency advisories 24

This repository publishes no package the index resolves, so its own dependency graph was assessed — 158 packages, which also include development and test pins that never ship: 24 carry known advisories, of which 0 are direct. 12 could not be assessed — no resolved version, an unsupported ecosystem, or beyond the reported package list.

PackageVersionRelationSeverityAdvisoriesFixed in
black24.3.0indirectcritical326.3.1
pyopenssl24.2.1indirectcritical426.0.0
cryptography43.0.3indirecthigh1049.0.0
fsspec2024.10.0indirecthigh22026.6.0
jaraco-context6.0.1indirecthigh26.1.0
lxml5.3.0indirecthigh26.1.0
markdown3.7indirecthigh23.8.1
msgpack1.1.0indirecthigh21.2.1
protego0.3.1indirecthigh20.6.2
protobuf4.25.5indirecthigh46.33.5
pyasn10.6.1indirecthigh100.6.4
scrapy2.12.0indirecthigh82.17.0
setuptools75.6.0indirecthigh483.0.0
sqlitedict2.1.0indirecthigh2—
twisted24.10.0indirecthigh426.4.0rc2
urllib32.2.3indirecthigh162.8.0
filelock3.16.1indirectmoderate43.20.3
flask3.1.0indirectmoderate43.1.3
idna3.10indirectmoderate23.15
jinja23.1.5indirectmoderate23.1.6
pytest8.3.3indirectmoderate29.0.3
requests2.32.3indirectmoderate42.33.0
werkzeug3.1.3indirectmoderate83.1.9
pygments2.18.0indirectlow22.20.0

An advisory means the version recorded in the dependency graph falls inside an advisory’s affected range. Reachability is not analysed, and the graph includes development and test pins — a finding may concern tooling rather than shipped software.

Raw JSON report machine-readable

Feedback

Spotted something off in this report, or have thoughts to share? Wrong measurements, missed tooling, ideas, questions — anything is welcome. Every message is read and gets a response.

The message is kept through sign-in.

Related records

Inspected repositories sharing catalogue tags or ecosystems with scrapinghub/shub-workflow. Read them side by side →

100Arize-ai/phoenixAI Observability & EvaluationExceptional100optuna/optunaA hyperparameter optimization frameworkExceptional100numpy/numpyThe fundamental package for scientific computing with Python.Exceptional100aws/aws-sam-cliCLI tool to build, test, debug, and deploy Serverless applications using AWS SAMExceptional100apache/arrowApache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analyticsExceptional100onnx/onnxOpen standard for machine learning interoperabilityExceptional

Scores are signals, not warranties. They reflect publicly visible practices on GitHub — not a code audit, and not a security guarantee.

Missing data is excluded and weights renormalized, never scored as zero. Methodology is versioned and open: metrics v2.10.0, schema v0.34.0 — full methodology · metrics wiki.

How one result sits in the wider record: aggregate statistics — PyPI.