Raw JSON report machine-readable
{
"data": {
"repo": {
"topics": [
"agent-memory",
"benchmark",
"evaluation",
"llm",
"rag",
"retrieval"
],
"is_fork": false,
"size_kb": 715,
"has_wiki": true,
"homepage": "https://dancenitra.github.io/agora/public/leaderboard/",
"languages": {
"Python": 596480
},
"pushed_at": "2026-07-24T23:44:28Z",
"created_at": "2026-06-23T17:50:24Z",
"owner_type": "User",
"updated_at": "2026-07-28T14:10:11Z",
"description": "RAMR — Retrieval-Augmented Memory Reliability: a contamination-resistant synthetic benchmark for agentic-RAG / memory systems (findings + method)",
"is_archived": false,
"is_disabled": false,
"license_spdx": "MIT",
"default_branch": "main",
"license_spdx_raw": "MIT",
"primary_language": "Python",
"significant_languages": [
"Python"
]
},
"owner": {
"blog": null,
"name": "Rastislav Drahoš",
"type": "User",
"login": "DanceNitra",
"company": null,
"location": null,
"followers": 5,
"avatar_url": "https://avatars.githubusercontent.com/u/41733909?v=4",
"created_at": "2018-07-26T09:54:30Z",
"is_verified": null,
"public_repos": 44,
"account_age_days": 2924
},
"license": {
"state": "standard",
"spdx_id": "MIT",
"raw_spdx": "MIT",
"file_present": true,
"scorecard_found": true,
"profile_has_license": true
},
"activity": {
"releases": [
{
"tag": "v0.4.1",
"kind": "patch",
"published_at": "2026-06-28T09:49:21Z"
}
],
"recent_commits": [
{
"oid": "b18db2400bcd341723e0f0fa06f2aad637759622",
"body": "No code, data, metric or claim changed. This version exists so the citable record\nand the repository agree on who maintains RAMR.\n\nContext: the inspeximus README had credited Rastislav Drahos by name for some time\nwhile CITATION.cff and the Zenodo creators said \"Agora\". A supplier or auditor\ncheck f\n[…]\n do. Its DOI is\nnow listed in CITATION.cff identifiers so the ladder stays complete, and the name\nlands on this new version instead.\n\nCo-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>",
"is_bot": false,
"headline": "v0.5.1: attribution only - the author is named",
"author_name": "Rastislav Drahoš",
"author_login": "DanceNitra",
"committed_at": "2026-07-24T23:44:18Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "47adf324b3d854c403b764e90ca588e251c980c8",
"body": "Owner decision 2026-07-25: move from anonymous stewardship to a named maintainer.\nThe driver is that in the one channel with live demand - downstream vendor-security\nand third-party-risk review - supplier attestation fields require a nameable party,\nand cryptography does not substitute for one.\n\nThe\n[…]\nstory is\n not rewritten. GitHub noreply is used instead of the personal address so the\n name is public but the mailbox is not.\n\nCo-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>",
"is_bot": false,
"headline": "citation: name the author",
"author_name": "Rastislav Drahoš",
"author_login": "DanceNitra",
"committed_at": "2026-07-24T23:40:34Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "3dd44ad4f310f8cd1f351ff92471714462021a2a",
"body": "CITATION.cff -> 0.5.0 (2026-07-25) and a README changelog entry. The preflight is\nnot a twelfth metric - it is a check on whether a comparison was admissible at\nall - so the metric count stays at eleven and the abstract gains the gate.\n\nCo-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>",
"is_bot": false,
"headline": "v0.5.0: version the preflight release",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-07-24T22:28:58Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "a62b8080ab20001e187b7925c740e85ad71c577c",
"body": "…t died\n\nA RAMR metric only means something if the arms were comparing the same thing.\nramr_preflight.py is the check we ask of ourselves before publishing any RAMR\nnumber, shipped as a zero-dependency module anyone can point at their own\ncomparison.\n\n G0 budget parity are the arms given compa\n[…]\nat run's persisted\nretrieval_coverage.json and pilot_summary_*.json but are not reproducible from\nthis repo. The --demo numbers are.\n\nCo-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>",
"is_bot": false,
"headline": "preflight: four admissibility gates, each aborting with the layer tha…",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-07-24T22:27:19Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "a8e66332addf1d5dd288822502672e197f368db5",
"body": "…ndocumented checkpoint-undo)",
"is_bot": false,
"headline": "integrity: scope the revert 'only inspeximus' reading (Letta has an u…",
"author_name": "agora-builder",
"author_login": null,
"committed_at": "2026-07-23T15:25:03Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "54ff69799fafecbe5c5329db66eb6addf9f2c079",
"body": "The cross-system integrity results (integrity/ module) are now rendered as a standing, PR-submittable\nleaderboard at dancenitra.github.io/agora/public/leaderboard/. Submission flow already lives in\nintegrity/SUBMISSION.md.\n\nCo-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>",
"is_bot": false,
"headline": "README: link the standing Agent-Memory Integrity Leaderboard",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-07-22T16:31:27Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "3fe7edcef5d72cb917baeb7da27c036004c6267e",
"body": "…e to 1.29.0\n\nAdds ramr_integrity_recall.py: after a supersession/revert/poison, does recall return the correct\ncurrent value? revert is the unique win on this scenario (inspeximus 1.00 vs cosine-recency 0.00,\nnaive 0.55 -- recency has no revert op); supersession ties a fair recency baseline (both 1\n[…]\nOPE-LEAKAGE 0.82->0.80, breakeven boost arm\n<=0.03 (cited headline stays +0.00). Also removed an internal path a docstring leaked.\n\nCo-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>",
"is_bot": false,
"headline": "v0.4.3: INTEGRITY-CONDITIONED RECALL metric; re-vendor inspeximus cor…",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-07-22T14:43:12Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "5bf763fabb317148c70747690960830d1fa49d59",
"body": "…hange)\n\nThe public benchmark vendored a pinned snapshot of our memory library under its old name, mnemo. This\nrenames it to inspeximus everywhere -- module (mnemo/mnemo.py -> inspeximus/core.py), class\n(Mnemo -> Inspeximus), and every reference -- so the repo carries no trace of the old name. Zero\n\n[…]\n-> \"an inspeximus\" article slips the mechanical rename introduced; and\ngitignore now excludes an unrelated WIP metric's artifacts.\n\nCo-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>",
"is_bot": false,
"headline": "v0.4.2: rename the vendored library mnemo -> inspeximus (no numbers c…",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-07-22T13:43:43Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "003cdd4eaa431e1413dd01ef94d5c4d15d5353b7",
"body": "…-19 hardening this repo missed)",
"is_bot": false,
"headline": "gitignore: cover .env variants and key material (restores the 2026-07…",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-07-19T21:45:37Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "3f8a66ad9d7d17ec5e32596b67200acc68091422",
"body": "…-memory two-writer test)\n\nStore V1 -> correct to V2 -> stale writer re-asserts V1; check what top-1\nretrieval actually serves after each step + whether the backend can hand back\na state receipt that detects the echo. Measured: naive recency baseline fails\necho_resistance (the test can fail); mnemo, mem0 (update()), Chroma (delete+add)\nall pass this minimal case - honest parity on the serve; only mnemo exposes a\nwitness receipt. Run it on your own stack; the result is yours.",
"is_bot": false,
"headline": "integrity: two-writer retrieval-coherence fixture (step 6 of the team…",
"author_name": "agora-builder",
"author_login": null,
"committed_at": "2026-07-19T21:45:16Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "61b81d62ab22b860bfb68b1ee5c863d00df08ec9",
"body": "Deterministic temporal cell (unique-token ground truth, no judge): reversed-ingest\nnow-accuracy, as_of valid-time point queries, transaction-time back-fill. Measured:\nmnemo 4/4; mem0 default vector store has no valid-time channel. Framed as PARITY:\nZep (arXiv:2501.13956) and Graphiti are documented bi-temporal too and are listed,\nnot run/scored -- we do not claim to beat them on this axis. Result JSON persisted.\n\nCo-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>",
"is_bot": false,
"headline": "Add bi-temporal integrity cell (honest parity, not a mnemo win)",
"author_name": "agora-builder",
"author_login": null,
"committed_at": "2026-07-19T07:01:13Z",
"body_truncated": false,
"is_coding_agent": true
},
{
"oid": "f9fea43755fc3e4dc3c0d155f7ca4d9905e4fa36",
"body": "Consolidate the agent-memory integrity axis into the RAMR brand (one DOI, one\nhome). Adds integrity/ : the cross-system revert+echo harness (shared ground-\ntruth-blind judge, native configs) and a run-your-own erasure self-check tool.\nREVERT is a new dimension (not one of the 9 synthetic metrics); E\n[…]\nlly above and is now also measured cross-system. Non-breaking:\nthe verified 9-metric pipeline and DOI-cited numbers are untouched.\n\nCo-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>",
"is_bot": false,
"headline": "Merge cross-system integrity + erasure self-check under RAMR",
"author_name": "agora-builder",
"author_login": null,
"committed_at": "2026-07-19T06:46:21Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "203e1ea01829f8fb24b62d39fdf339a1be492d15",
"body": "…oral invalidation defends (0/26 echo-attributable); raw 0.87 residual = extraction misses, not echo",
"is_bot": false,
"headline": "echo-resistance: real Graphiti runtime (Neo4j+OpenAI, n=30) — bi-temp…",
"author_name": "agora-builder",
"author_login": null,
"committed_at": "2026-07-09T18:08:38Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "4fc78fc45ce503e42c101f14565ac030ef75f9a9",
"body": "…ootstrap CI\n\nRe-ran mem0 in its own recommended config (gpt-4o-mini + text-embedding-3-small + Chroma)\nso the number isn't a non-native-judge artifact, and report a CI instead of a point\nestimate (the earlier n=10 vs n=30 swing showed a point estimate is unsafe): resurrection\n~47% under a value-pre\n[…]\ninistic (0.00 off / 1.00 guard, judge-independent). Framed as a small\nsynthetic demonstration with disclosed limits, not a definitive benchmark.\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "ECHO-RESISTANCE: mem0 measured in its NATIVE config (OpenAI) with a b…",
"author_name": "agora-builder",
"author_login": null,
"committed_at": "2026-07-09T14:48:33Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "e746262a91439559559dc7e6bbb89175b0e75b70",
"body": "… runtime blocked, not faked)\n\nWe could not run Graphiti end-to-end here (its extraction needs strict structured-output\nschema adherence our OSS-cloud judge models don't meet) and declined to shim the parser\nrather than publish a non-faithful number. From its source (edge_operations.py):\nget_between\n[…]\no DEFEND (~1.0). Marked clearly as code-path reading,\nnot a measured number; runtime confirmation (OpenAI/Anthropic-class judge) is future work.\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "ECHO-RESISTANCE: add honest Zep/Graphiti note (code-verified defends;…",
"author_name": "agora-builder",
"author_login": null,
"committed_at": "2026-07-09T14:08:54Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "6a827f8750b17c7c1adef6e77849aaa3b9720c97",
"body": "… mem0 measured)\n\nA top-1 retrieval metric is fair to a supersession store but a strawman for an\nadd-based store (mem0) that reconciles at read-time. This scores echo-resistance\nat the answer level (recall top-k -> judge LLM -> current value?), fair to both.\nMeasured n=30, mem0 2.0.11 run fully loca\n[…]\nall mem0ai chromadb). Add a backend via a 3-method adapter. Value-preserving\nechoes; single judge model; n=30. ramr_echo_resistance_backends.py.\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "ECHO-RESISTANCE: add fair ANSWER-LEVEL cross-backend comparison (real…",
"author_name": "agora-builder",
"author_login": null,
"committed_at": "2026-07-09T12:46:23Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "41ab1f17eef3a32c8ed964963ce0f6b64c94155e",
"body": "…endored mnemo\n\nNew RAMR metric ramr_echo_resistance.py: FORGET-PRECISION shows a correction sticks\n(1.00), but re-stating the retired value (verbatim OR reworded) resurrects it on a\nlast-writer-wins / validity-recency store -> echo-resistance 0.00. A superseded-object\nledger (mnemo echo_guard, obje\n[…]\nVERSION/CHAIN-FRAGILITY/DISTRACTION/OUTCOME-LIFT/FACT-RETENTION unchanged\n(all mnemo additions are opt-in, default-off = byte-identical legacy).\n\nCo-Authored-By: Claude Fable 5 <noreply@anthropic.com>",
"is_bot": false,
"headline": "add ECHO-RESISTANCE metric (extends the supersession family) + sync v…",
"author_name": "agora-builder",
"author_login": null,
"committed_at": "2026-07-09T11:22:23Z",
"body_truncated": true,
"is_coding_agent": true
},
{
"oid": "4ee10ee717fd7ac065bd32eac457b9ed4b38c305",
"body": null,
"is_bot": false,
"headline": "citation: add Zenodo v0.4.1 archive DOI",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-28T09:50:47Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "32f9039e551a7cace682751b7f29b0b94055b32e",
"body": null,
"is_bot": false,
"headline": "citation: sync to v0.4.1 (nine metrics + Folklore Meter)",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-28T09:48:32Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "2f0dda25b69e31d3c03e00685037fb0bc91119d8",
"body": "…to extract_int) - works for string/abstention claims now",
"is_bot": false,
"headline": "v0.4.1: Folklore Meter honours claim custom extractor (was hardcoded …",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-25T01:44:19Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "e1a637b74b3bfd791123becd73fbf2a9abada33c",
"body": "…gineering folklore\n\nramr_folklore_meter.py: run a contrarian, exact-match claim across a model gradient\n(local Ollama + pluggable frontier anchor) -> verdict REAL / WEAK-MODEL ARTIFACT /\nREGIME-SPECIFIC / NULL. Robust ANSWER-line extraction (retry-until-clean, no\nlast-number fallback). README documents the tool + two worked verdicts\n(decision-trace memory -> weak-model artifact; multi-agent vote -> regime-specific).",
"is_bot": false,
"headline": "v0.4.0: Folklore Meter — judge-free capability-gradient test of AI-en…",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-24T19:16:05Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "6dfd591ed46d348a50a73c107e3b285dfc8f4135",
"body": "RESUME = the tested continuation invariant passed; NOT global execution\nauthorization, and does not bypass downstream policy/approval/effect gates.\nAligned with safal207/LS#654 (which verified the v0.3.0 canonical sources).\nSemantic clarification only: fixture bytes + sha256 digests are unchanged, so\nexisting pins (incl. LS#654) stay valid. README + conformance-runner docstring.",
"is_bot": false,
"headline": "v0.3.1: pin RESUME verdict semantics in the RAMR<->LS standard",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-24T18:06:16Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "35de7d3a1641e3ba9401aa2d1ea50171cd5cc86d",
"body": "Adds 3 canonical ramr-ls-evidence-v0.1 fixtures (frozen + sha256): superseded_approval\n-> REJECT, incomplete_dependency_chain -> ABSTAIN, target_state_drift -> REVALIDATE\n(with duplicate_successful_outcome -> REJECT). run_ramr_ls_fixtures.py scores each\nfixture's RAMR-side measured quantity vs the f\n[…]\neded/drift ride mnemo bi-temporal valid_from/invalidated_at; incomplete\nrides chain-fragility. RAMR measures reliability, LS owns the verdict. Collaboration:\nsafal207/LS, anthropics/claude-code#34556.",
"is_bot": false,
"headline": "v0.3.0: RAMR<->LS fixture set spans all 4 verdicts + conformance runner",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-24T11:55:29Z",
"body_truncated": true,
"is_coding_agent": false
},
{
"oid": "8f21771f7ee6012d6839b8c89ceae61f639e93ed",
"body": "… reliability-layer harness\n\nHosts the canonical shared fixture (duplicate_successful_outcome, frozen + sha256\ndigest) and ramr_ls_evidence.py, which emits the v0.1 envelope from a memory store\n(thin projection of bi-temporal valid_from/invalidated_at, provenance, Beta\nreliability, recall budget) an\n[…]\nn provenance + poison-propagation graduation guard\n(both regression-gated: FORGET-PRECISION/SUPERSESSION-FP/OPERATIONAL-CONTINUITY\nunchanged). Collaboration: safal207/LS, anthropics/claude-code#34556.",
"is_bot": false,
"headline": "v0.2.0: RAMR<->LS interop — canonical ramr-ls-evidence-v0.1 fixture +…",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-24T10:09:04Z",
"body_truncated": true,
"is_coding_agent": false
},
{
"oid": "f1333147dc7f60cd2ac87b765d9f8432dbb3d39d",
"body": "mnemo: remember(valid_from=), consolidate supersedes by validity-time not\ningest-order, recall(as_of=T). New ramr_temporal_asof.py: under reversed ingest\n(stale fact arrives later) the old ingest-order rule serves STALE (now-acc 0.00)\nwhile validity-time serves CURRENT (1.00) and as-of returns the h\n[…]\ningest-time so ordered streams are byte-identical;\nFORGET-PRECISION / SUPERSESSION-FP / OPERATIONAL-CONTINUITY all unchanged. Field-\nstandard (Graphiti/Zep/Neo4j); from the 122-transcript memory scan.",
"is_bot": false,
"headline": "v0.1.9: TEMPORAL-AS-OF metric + bi-temporal validity in mnemo",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-24T07:04:37Z",
"body_truncated": true,
"is_coding_agent": false
},
{
"oid": "6f7e53eaa7d87dc30ae4a016a5d6bb734de66d6a",
"body": "…inuity idea\n\nMake the attribution visible in the README (not just the commit/docstring):\nthe metric implements a property proposed by @safal207; framed as a first cut\nwith fixture input welcome.",
"is_bot": false,
"headline": "v0.1.8: credit @safal207 (claude-code#34556) for the operational-cont…",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-24T06:00:18Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "1bdd4a429a06b88870bda6dc53eb00a24257a337",
"body": "New agentic axis beyond fact recall: does the agent re-execute a completed\naction after compaction (a duplicate side-effect)? ramr_operational_continuity.py\nmeasures the duplicate-rate of a budget-limited resume recall. Result: recency\nweighting is necessary AND sufficient -- with it, duplicate-rate\n[…]\nbudget floor (robust to 200 old-session completions); without it, 1.00 at\nevery budget. Answers the operational-continuity property raised in\nclaude-code#34556. Pure-recall proxy, 6 seeds, cloud-free.",
"is_bot": false,
"headline": "v0.1.8: add OPERATIONAL-CONTINUITY metric (idempotent resume)",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-24T05:54:21Z",
"body_truncated": true,
"is_coding_agent": false
},
{
"oid": "3f578c93ba4f57395083e738a50fd613474a3ea3",
"body": "…ESSION-FP metric)\n\nThe numeric value-update detector over-fired on enumerated facts and silently\nsuperseded coexisting records (6-item store -> 1/6 active). Fixed by positional\nnumber comparison (exactly one number-slot changes for a real update). Added\nramr_supersession_fp.py (the dual of FORGET-PRECISION: 0.00 false-positive,\n6/6 survive) + verified-numbers row. FORGET-PRECISION re-measured 1.00/1.00,\nregression-gated.",
"is_bot": false,
"headline": "v0.1.7: fix supersession false-positive on enumerated facts (+ SUPERS…",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-24T00:25:28Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "91909efa0a896a3df63615e886132983b0257bca",
"body": null,
"is_bot": false,
"headline": "README: metrics table 6->7 (add COMPRESSION-vs-RAW row, consistency)",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-23T22:48:34Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "2709f8d02846029d18d3adc34dde110a70747e0a",
"body": "…gain (honest negative)\n\nTested the 'compression beats oracle' claim. qwen3-coder:30b: compiled summary\ndoes NOT beat raw context at any noise level (lift +0.00/-0.40/-0.55 at\nK=5/20/50). Raw stays 0.95 even at 50 distractors; compaction loses the fact.\nHonest negative; external claim didn't replicate. Metric + result persisted.",
"is_bot": false,
"headline": "RAMR v0.1.6: COMPRESSION-vs-RAW metric — compaction is a cost, not a …",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-23T22:48:15Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "1f6f1d9c8b15cc750fce2cf2d98c23f6fadde369",
"body": "…5 (consistency)",
"is_bot": false,
"headline": "README: update Limitations to OUTCOME-RANKED n=12 / FACT-RETENTION n=…",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-23T22:15:29Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "15556b12ee873f33cb7445da84b31be5947b5e08",
"body": "… claim is not small-n noise)\n\nLift +0.358/+0.361/+0.469/+0.427 at D=1/2/4/8, all bootstrap CIs exclude 0\n(min lower bound +0.299); random-credit control negative. Reused cached\nembeddings (no re-embed). VERIFIED_NUMBERS + README updated to n=12.",
"is_bot": false,
"headline": "RAMR v0.1.5: harden OUTCOME-RANKED to n=12 sets (tighter CI, flagship…",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-23T22:15:10Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "2c110da90f559e795d9918e75d09acbbfc248a73",
"body": "…unchanged)",
"is_bot": false,
"headline": "mnemo: sync remember_dedup() opt-in NO-OP write (default append-only …",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-23T21:46:49Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "26a443da64061e4f54c311c6383671d742e5bfbc",
"body": "…ll traceability)\n\nEvery public metric now has a persisted, recomputable source: FORGET-PRECISION\n(1.00/0.97), ABSTENTION (floor 0.6 -> 1.00/1.00), CROSS-SCOPE-LEAKAGE (scoped 0.00\nvs 0.82), SIGNAL-RELIABILITY break-even (lift crosses 0 at 1/(1+D)). Closes the\n'every number traceable' rigor bar for v0.1.2-0.1.4.",
"is_bot": false,
"headline": "RAMR: persist new-metric result JSONs + add VERIFIED_NUMBERS rows (fu…",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-23T21:14:36Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "93d2e9d384a2bba424f87175a2f84ce18fb293e5",
"body": "… vendored mnemo\n\nShared store, 2 tenants, same schema: leaks A->B 79% without a scope; recall(scope='B')\n-> 0% leakage, 100% in-scope recall. Default scope=None unchanged.",
"is_bot": false,
"headline": "RAMR v0.1.4: cross-scope leakage metric + recall(scope=) isolation in…",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-23T20:28:54Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "9fe6fcc34c847f47fd72e5d8134f63a3f19e50e1",
"body": "…ored mnemo\n\nrecall(min_relevance) lets the engine return [] instead of confabulating a weak\nmatch; metric shows clean abstention (floor 0.6 -> 100% abstain on out-of-store,\n100% in-store recall) vs 0% abstention at floor 0.",
"is_bot": false,
"headline": "RAMR v0.1.3: abstention/false-recall metric + relevance-floor in vend…",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-23T20:14:57Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "33d896b0c79cd8f7ad59448a7a06e0debb371560",
"body": "…erization\n\nramr_breakeven.py sweeps credit reliability p x ambiguity D; recall-lift crosses\nzero at the predicted no-signal floor 1/(1+D), validating the signal-reliability\nlaw on the engine. Characterizes mnemo cal_mode (full/boost/gated) -- default\nstays 'full' (gain and backfire are the same suppression mechanism).",
"is_bot": false,
"headline": "RAMR v0.1.2: signal-reliability break-even harness + cal_mode charact…",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-23T20:10:38Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "fdaf66e8002f75d9f8e003e8f9bb456ad2e61fb2",
"body": null,
"is_bot": false,
"headline": "mnemo: sync cal_mode knob (default 'full' unchanged)",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-23T20:02:25Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "3ae46b06df8012563c56e0c8b3b6f6416b91fb45",
"body": "…rsity stores\n\nRequire >=3 shared common words (not just >=12% coverage of a tiny common vocab)\nbefore flagging a memory a hub; otherwise templated stores got 100% hub-flagged\n-> 0% recall. Genuine universal-matcher hubs still caught.",
"is_bot": false,
"headline": "mnemo: fix hub over-flagging that silently emptied recall on low-dive…",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-23T19:31:30Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "9c621f9e535fc8c9358f482f1175fbfdea691ad8",
"body": "… v0.1.1 archived",
"is_bot": false,
"headline": "Cite the Zenodo concept DOI (10.5281/zenodo.20818291, always-latest);…",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-23T18:45:13Z",
"body_truncated": false,
"is_coding_agent": false
},
{
"oid": "f17211bd04b39249e96c1204fd0d966a89c8794e",
"body": "A contamination-resistant synthetic benchmark for agentic-RAG / memory systems.\nSix metrics with pre-registered falsifiers, bootstrap CIs, a frozen sha-pinned\ndataset, a single runner, independent baselines, and a number-verification\nledger. v0.1.1 adds the FORGET-PRECISION metric and a value-update supersession\nfix in the reference memory core. See CHANGELOG in README. DOI: 10.5281/zenodo.20818292",
"is_bot": false,
"headline": "RAMR — Retrieval-Augmented Memory Reliability (v0.1.1)",
"author_name": "Agora",
"author_login": null,
"committed_at": "2026-06-23T18:35:19Z",
"body_truncated": false,
"is_coding_agent": false
}
],
"releases_count": 1,
"commits_last_year": 41,
"latest_release_at": "2026-06-28T09:49:21Z",
"latest_release_tag": "v0.4.1",
"releases_from_tags": false,
"days_since_last_push": 4,
"active_weeks_last_year": 5,
"days_since_latest_release": 30,
"mean_days_between_releases": null
},
"community": {
"has_readme": true,
"has_license": true,
"has_description": true,
"has_contributing": false,
"health_percentage": 42,
"has_issue_template": false,
"has_code_of_conduct": false,
"has_pull_request_template": false
},
"ecosystem": {
"packages": []
},
"popularity": {
"forks": 0,
"stars": 0,
"watchers": 0,
"fork_history": {
"days": [],
"complete": true,
"collected": 0,
"total_forks": 0
},
"star_history": {
"days": [],
"complete": true,
"collected": 0,
"total_stars": 0,
"collected_at": null
},
"open_issues_and_prs": 0
},
"ai_readiness": {
"has_nix": false,
"example_dirs": [],
"has_llms_txt": false,
"has_dockerfile": false,
"has_mcp_signal": false,
"bootstrap_files": [],
"api_schema_files": [],
"has_devcontainer": false,
"typecheck_configs": [],
"toolchain_manifests": [],
"largest_source_bytes": 385518,
"source_files_sampled": 33,
"oversized_source_files": 1,
"agent_instruction_files": [],
"agent_instruction_max_bytes": null
},
"dependencies": {
"manifests": [],
"advisories": {
"error": null,
"scope": null,
"source": null,
"findings": [],
"collected": false,
"malicious": [],
"truncated": false,
"by_severity": {},
"advisory_count": 0,
"affected_count": 0,
"assessed_count": 0,
"malicious_count": 0,
"assessed_package": null,
"unassessed_count": 0,
"direct_affected_count": 0
},
"ecosystems": [],
"dependencies": [],
"all_dependencies": {
"error": "GitHub dependency-graph SBOM unavailable (404); the dependency graph may be disabled for this repository",
"source": null,
"packages": [],
"collected": false,
"truncated": false,
"total_count": null,
"direct_count": null,
"indirect_count": null
}
},
"maintainership": {
"issues": {
"open_prs": 0,
"merged_prs": 0,
"open_issues": 0,
"closed_ratio": null,
"closed_issues": 0,
"closed_unmerged_prs": 0
},
"bus_factor": 1,
"bot_contributors": 0,
"top_contributors": [
{
"type": "User",
"login": "DanceNitra",
"commits": 2,
"avatar_url": "https://avatars.githubusercontent.com/u/41733909?v=4"
}
],
"contributors_sampled": 1,
"top_contributor_share": 1
},
"quality_signals": {
"has_ci": false,
"has_tests": false,
"ci_workflows": [],
"has_docs_dir": false,
"linter_configs": [],
"has_editorconfig": false,
"has_linter_config": false,
"has_precommit_config": false
},
"security_signals": {
"lockfiles": [],
"scorecard": {
"checks": [
{
"name": "Binary-Artifacts",
"score": 10,
"reason": "no binaries found in the repo",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#binary-artifacts"
},
{
"name": "Branch-Protection",
"score": 0,
"reason": "branch protection not enabled on development/release branches",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#branch-protection"
},
{
"name": "CI-Tests",
"score": null,
"reason": "no pull request found",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#ci-tests"
},
{
"name": "CII-Best-Practices",
"score": 0,
"reason": "no effort to earn an OpenSSF best practices badge detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#cii-best-practices"
},
{
"name": "Code-Review",
"score": 0,
"reason": "Found 0/30 approved changesets -- score normalized to 0",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#code-review"
},
{
"name": "Contributors",
"score": 0,
"reason": "project has 0 contributing companies or organizations -- score normalized to 0",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#contributors"
},
{
"name": "Dangerous-Workflow",
"score": null,
"reason": "no workflows found",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#dangerous-workflow"
},
{
"name": "Dependency-Update-Tool",
"score": 0,
"reason": "no update tool detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#dependency-update-tool"
},
{
"name": "Fuzzing",
"score": 0,
"reason": "project is not fuzzed",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#fuzzing"
},
{
"name": "License",
"score": 10,
"reason": "license file detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#license"
},
{
"name": "Maintained",
"score": 0,
"reason": "project was created within the last 90 days. Please review its contents carefully",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#maintained"
},
{
"name": "Packaging",
"score": null,
"reason": "packaging workflow not detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#packaging"
},
{
"name": "Pinned-Dependencies",
"score": null,
"reason": "no dependencies found",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#pinned-dependencies"
},
{
"name": "SAST",
"score": 0,
"reason": "no SAST tool detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#sast"
},
{
"name": "Security-Policy",
"score": 0,
"reason": "security policy file not detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#security-policy"
},
{
"name": "Signed-Releases",
"score": null,
"reason": "no releases found",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#signed-releases"
},
{
"name": "Token-Permissions",
"score": null,
"reason": "No tokens found",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#token-permissions"
},
{
"name": "Vulnerabilities",
"score": 10,
"reason": "0 existing vulnerabilities detected",
"documentation_url": "https://github.com/ossf/scorecard/blob/c395761df6afe1a69e476bc60a013a94bcbc153f/docs/checks.md#vulnerabilities"
}
],
"commit": "b18db2400bcd341723e0f0fa06f2aad637759622",
"ran_at": "2026-07-29T06:29:44Z",
"aggregate_score": 2.6,
"scorecard_version": "v5.5.0"
},
"has_codeql_workflow": false,
"has_security_policy": false,
"has_dependabot_config": false
},
"contribution_flow": {
"collected": true,
"ci_last_run_at": "2026-07-24T23:44:30Z",
"oldest_open_prs": [],
"last_merged_pr_at": null,
"ci_last_conclusion": null,
"oldest_open_issues": []
}
},
"config": {
"disabled_metrics": [],
"disabled_categories": [],
"disabled_components": {}
},
"source": {
"url": "https://github.com/DanceNitra/ramr",
"host": "github.com",
"name": "ramr",
"owner": "DanceNitra"
},
"metrics": {
"overall": {
"key": "overall",
"band": "at_risk",
"name": "Overall health",
"note": null,
"notes": [],
"value": 34,
"inputs": {
"security": 26,
"vitality": 66,
"community": 24,
"governance": 20,
"engineering": 31
},
"components": []
},
"categories": [
{
"key": "vitality",
"band": "moderate",
"name": "Vitality",
"value": 66,
"weight": 0.22,
"metrics": [
{
"key": "development_activity",
"band": "moderate",
"name": "Development activity",
"note": null,
"notes": [],
"value": 54,
"inputs": {
"commits_last_year": 41,
"human_commit_share": 1,
"days_since_last_push": 4,
"active_weeks_last_year": 5
},
"components": [
{
"key": "push_recency",
"name": "Push recency",
"detail": "last push 4 days ago",
"points": 36,
"status": "met",
"details": [
{
"code": "push_recency",
"params": {
"days": 4
}
}
],
"max_points": 36
},
{
"key": "commit_cadence",
"name": "Commit cadence",
"detail": "5/52 weeks with commits",
"points": 3.5,
"status": "partial",
"details": [
{
"code": "commit_cadence_weeks",
"params": {
"weeks": 5
}
}
],
"max_points": 36
},
{
"key": "commit_volume",
"name": "Commit volume",
"detail": "41 commits in the last year",
"points": 14.6,
"status": "partial",
"details": [
{
"code": "commits_last_year",
"params": {
"count": 41
}
}
],
"max_points": 18
},
{
"key": "openssf_scorecard_maintained",
"name": "OpenSSF Scorecard: Maintained",
"detail": "project was created within the last 90 days. Please review its contents carefully",
"points": 0,
"status": "missed",
"details": [],
"max_points": 10
}
]
},
{
"key": "release_discipline",
"band": "good",
"name": "Release discipline",
"note": "Excluded from scoring (no data or not applicable): OpenSSF Scorecard: Signed-Releases. Remaining weights renormalized.",
"notes": [
{
"code": "excluded_no_data",
"params": {
"components": [
"openssf_scorecard_signed_releases"
]
}
},
{
"code": "weights_renormalized",
"params": {}
}
],
"value": 84,
"inputs": {
"releases_count": 1,
"latest_release_tag": "v0.4.1",
"releases_from_tags": false,
"days_since_latest_release": 30,
"mean_days_between_releases": null
},
"components": [
{
"key": "ships_releases",
"name": "Ships releases",
"detail": "1 releases published",
"points": 27,
"status": "met",
"details": [
{
"code": "releases_published",
"params": {
"count": 1
}
}
],
"max_points": 27
},
{
"key": "release_recency",
"name": "Release recency",
"detail": "latest release 30 days ago",
"points": 36,
"status": "met",
"details": [
{
"code": "release_recency",
"params": {
"days": 30
}
}
],
"max_points": 36
},
{
"key": "release_cadence",
"name": "Release cadence",
"detail": "cadence unknown (single release)",
"points": 12.6,
"status": "partial",
"details": [
{
"code": "release_cadence_unknown",
"params": {}
}
],
"max_points": 27
},
{
"key": "openssf_scorecard_signed_releases",
"name": "OpenSSF Scorecard: Signed-Releases",
"detail": "no releases found",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_data",
"params": {}
}
],
"max_points": 10
}
]
},
{
"key": "abandonment",
"band": "excellent",
"name": "Abandonment",
"note": null,
"notes": [],
"value": 100,
"inputs": {
"cap": null,
"state": "unverified",
"guards": [],
"signals": [],
"red_flag": false,
"multiplier_pct": 100,
"declared_reason": null,
"unverified_reason": "repository_too_young",
"unanswered_open_prs": null,
"unanswered_open_issues": null,
"days_since_last_merged_pr": null,
"days_since_last_human_commit": null,
"days_since_last_human_commit_is_floor": false
},
"components": [
{
"key": "project_is_still_maintained",
"name": "Project is still maintained",
"detail": "maintenance record not established from the collected data",
"points": 100,
"status": "met",
"details": [
{
"code": "abandonment_unverified",
"params": {}
}
],
"max_points": 100
}
]
}
],
"description": "Is the project alive — is code being written and are releases shipping?"
},
{
"key": "community",
"band": "critical",
"name": "Community & Adoption",
"value": 24,
"weight": 0.18,
"metrics": [
{
"key": "popularity",
"band": "critical",
"name": "Popularity & adoption",
"note": null,
"notes": [],
"value": 1,
"inputs": {
"forks": 0,
"stars": 0,
"watchers": 0,
"growth_state": "unverified",
"growth_factor_pct": 100,
"growth_unverified_reason": "no_history"
},
"components": [
{
"key": "stars",
"name": "Stars",
"detail": "0 stars",
"points": 0,
"status": "missed",
"details": [
{
"code": "stars",
"params": {
"count": 0
}
}
],
"max_points": 60
},
{
"key": "forks",
"name": "Forks",
"detail": "0 forks",
"points": 0,
"status": "missed",
"details": [
{
"code": "forks",
"params": {
"count": 0
}
}
],
"max_points": 25
},
{
"key": "watchers",
"name": "Watchers",
"detail": "0 watchers",
"points": 0,
"status": "missed",
"details": [
{
"code": "watchers",
"params": {
"count": 0
}
}
],
"max_points": 15
}
]
},
{
"key": "community_health",
"band": "moderate",
"name": "Community health",
"note": null,
"notes": [],
"value": 50,
"inputs": {
"has_readme": true,
"has_license": true,
"has_contributing": false,
"has_issue_template": false,
"has_code_of_conduct": false,
"has_pull_request_template": false
},
"components": [
{
"key": "readme",
"name": "README",
"detail": null,
"points": 22.5,
"status": "met",
"details": [],
"max_points": 22.5
},
{
"key": "license",
"name": "License",
"detail": "recognized license (MIT)",
"points": 22.5,
"status": "met",
"details": [
{
"code": "license_standard",
"params": {}
},
{
"code": "license_spdx",
"params": {
"spdx": "MIT"
}
}
],
"max_points": 22.5
},
{
"key": "contributing_guide",
"name": "CONTRIBUTING guide",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 18
},
{
"key": "code_of_conduct",
"name": "Code of conduct",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 13.5
},
{
"key": "issue_template",
"name": "Issue template",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 7.2
},
{
"key": "pr_template",
"name": "PR template",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 6.3
}
]
}
],
"description": "Does the project have users, downloads, attention, and a welcoming setup for contributors?"
},
{
"key": "governance",
"band": "critical",
"name": "Sustainability & Governance",
"value": 20,
"weight": 0.24,
"metrics": [
{
"key": "maintainer_resilience",
"band": "critical",
"name": "Maintainer resilience (bus factor)",
"note": null,
"notes": [],
"value": 10,
"inputs": {
"bus_factor": 1,
"contributors_sampled": 1,
"top_contributor_share": 1
},
"components": [
{
"key": "bus_factor",
"name": "Bus factor",
"detail": "1 contributor(s) cover half of all commits",
"points": 9,
"status": "partial",
"details": [
{
"code": "bus_factor",
"params": {
"count": 1
}
}
],
"max_points": 54
},
{
"key": "commit_distribution",
"name": "Commit distribution",
"detail": "top contributor authored 100% of commits",
"points": 0,
"status": "missed",
"details": [
{
"code": "top_contributor_share",
"params": {
"share": 100
}
}
],
"max_points": 22.5
},
{
"key": "contributor_breadth",
"name": "Contributor breadth",
"detail": "1 contributors",
"points": 1.4,
"status": "partial",
"details": [
{
"code": "contributors_sampled",
"params": {
"count": 1
}
}
],
"max_points": 13.5
},
{
"key": "openssf_scorecard_contributors",
"name": "OpenSSF Scorecard: Contributors",
"detail": "project has 0 contributing companies or organizations -- score normalized to 0",
"points": 0,
"status": "missed",
"details": [],
"max_points": 10
}
]
},
{
"key": "responsiveness",
"band": "critical",
"name": "Issue & PR responsiveness",
"note": "Excluded from scoring (no data or not applicable): Issue resolution, PR acceptance. Remaining weights renormalized.",
"notes": [
{
"code": "excluded_no_data",
"params": {
"components": [
"issue_resolution",
"pr_acceptance"
]
}
},
{
"code": "weights_renormalized",
"params": {}
}
],
"value": 1,
"inputs": {
"merged_prs": 0,
"open_issues": 0,
"closed_issues": 0,
"issue_closed_ratio": null,
"closed_unmerged_prs": 0
},
"components": [
{
"key": "issue_resolution",
"name": "Issue resolution",
"detail": "no issues or no data",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_issues_or_data",
"params": {}
}
],
"max_points": 46.75
},
{
"key": "pr_acceptance",
"name": "PR acceptance",
"detail": "no decided pull requests or no data",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_decided_prs_or_data",
"params": {}
}
],
"max_points": 38.25
},
{
"key": "openssf_scorecard_code_review",
"name": "OpenSSF Scorecard: Code-Review",
"detail": "Found 0/30 approved changesets -- score normalized to 0",
"points": 0,
"status": "missed",
"details": [],
"max_points": 15
}
]
},
{
"key": "stewardship",
"band": "moderate",
"name": "Ownership & stewardship",
"note": "Excluded from scoring (no data or not applicable): Verified domain. Remaining weights renormalized.",
"notes": [
{
"code": "excluded_no_data",
"params": {
"components": [
"verified_domain"
]
}
},
{
"code": "weights_renormalized",
"params": {}
}
],
"value": 50,
"inputs": {
"followers": 5,
"owner_type": "User",
"is_verified": null,
"owner_login": "DanceNitra",
"public_repos": 44,
"account_age_days": 2924
},
"components": [
{
"key": "ownership_backing",
"name": "Ownership backing",
"detail": "personal (user) account",
"points": 10,
"status": "partial",
"details": [
{
"code": "owner_personal",
"params": {}
}
],
"max_points": 30
},
{
"key": "verified_domain",
"name": "Verified domain",
"detail": "not applicable to user accounts",
"points": 0,
"status": "excluded",
"details": [
{
"code": "not_applicable_to_user_accounts",
"params": {}
}
],
"max_points": 20
},
{
"key": "owner_reach",
"name": "Owner reach",
"detail": "5 followers of DanceNitra",
"points": 5.6,
"status": "partial",
"details": [
{
"code": "owner_followers",
"params": {
"count": 5,
"login": "DanceNitra"
}
}
],
"max_points": 25
},
{
"key": "track_record",
"name": "Track record",
"detail": "44 public repos, account ~8 yr old",
"points": 24,
"status": "partial",
"details": [
{
"code": "public_repos",
"params": {
"count": 44
}
},
{
"code": "account_age_years",
"params": {
"years": 8
}
}
],
"max_points": 25
}
]
}
],
"description": "Will the project survive its people — bus factor, responsiveness, who backs it, and package upkeep?"
},
{
"key": "engineering",
"band": "at_risk",
"name": "Engineering Quality",
"value": 31,
"weight": 0.2,
"metrics": [
{
"key": "engineering_practices",
"band": "critical",
"name": "Engineering practices",
"note": "Excluded from scoring (no data or not applicable): OpenSSF Scorecard: CI-Tests. Remaining weights renormalized.",
"notes": [
{
"code": "excluded_no_data",
"params": {
"components": [
"openssf_scorecard_ci_tests"
]
}
},
{
"code": "weights_renormalized",
"params": {}
}
],
"value": 1,
"inputs": {
"has_ci": false,
"has_tests": false,
"has_editorconfig": false,
"has_linter_config": false,
"has_precommit_config": false
},
"components": [
{
"key": "ci_workflows",
"name": "CI workflows",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 24
},
{
"key": "tests_present",
"name": "Tests present",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 24
},
{
"key": "linter_config",
"name": "Linter config",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 16
},
{
"key": "pre_commit_hooks",
"name": "Pre-commit hooks",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 9.6
},
{
"key": "editorconfig",
"name": ".editorconfig",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 6.4
},
{
"key": "openssf_scorecard_ci_tests",
"name": "OpenSSF Scorecard: CI-Tests",
"detail": "no pull request found",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_data",
"params": {}
}
],
"max_points": 20
}
]
},
{
"key": "documentation",
"band": "good",
"name": "Documentation",
"note": null,
"notes": [],
"value": 75,
"inputs": {
"topics": [
"agent-memory",
"benchmark",
"evaluation",
"llm",
"rag",
"retrieval"
],
"has_wiki": true,
"homepage": "https://dancenitra.github.io/agora/public/leaderboard/",
"has_readme": true,
"has_docs_dir": false,
"has_description": true
},
"components": [
{
"key": "readme",
"name": "README",
"detail": null,
"points": 30,
"status": "met",
"details": [],
"max_points": 30
},
{
"key": "documentation_directory",
"name": "Documentation directory",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 25
},
{
"key": "documentation_homepage_site",
"name": "Documentation / homepage site",
"detail": "https://dancenitra.github.io/agora/public/leaderboard/",
"points": 15,
"status": "met",
"details": [],
"max_points": 15
},
{
"key": "repository_description",
"name": "Repository description",
"detail": null,
"points": 10,
"status": "met",
"details": [],
"max_points": 10
},
{
"key": "topics",
"name": "Topics",
"detail": "6 topics",
"points": 10,
"status": "met",
"details": [
{
"code": "topics_count",
"params": {
"count": 6
}
}
],
"max_points": 10
},
{
"key": "wiki",
"name": "Wiki",
"detail": null,
"points": 10,
"status": "met",
"details": [],
"max_points": 10
}
]
}
],
"description": "Are baseline engineering and documentation practices in place?"
},
{
"key": "security",
"band": "critical",
"name": "Security",
"value": 26,
"weight": 0.16,
"metrics": [
{
"key": "security_posture",
"band": "critical",
"name": "Security posture",
"note": "Excluded from scoring (no data or not applicable): CI-Tests, Dangerous-Workflow, Packaging, Pinned-Dependencies, Signed-Releases, Token-Permissions. Remaining weights renormalized.",
"notes": [
{
"code": "excluded_no_data",
"params": {
"components": [
"ci_tests",
"dangerous_workflow",
"packaging",
"pinned_dependencies",
"signed_releases",
"token_permissions"
]
}
},
{
"code": "weights_renormalized",
"params": {}
}
],
"value": 26,
"inputs": {
"source": "openssf_scorecard",
"checks_evaluated": 12,
"scorecard_version": "v5.5.0",
"checks_inconclusive": 6,
"scorecard_aggregate": 2.6
},
"components": [
{
"key": "binary_artifacts",
"name": "Binary-Artifacts",
"detail": "no binaries found in the repo",
"points": 7.5,
"status": "met",
"details": [],
"max_points": 7.5
},
{
"key": "branch_protection",
"name": "Branch-Protection",
"detail": "branch protection not enabled on development/release branches",
"points": 0,
"status": "missed",
"details": [],
"max_points": 7.5
},
{
"key": "ci_tests",
"name": "CI-Tests",
"detail": "no pull request found",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_data",
"params": {}
}
],
"max_points": 2.5
},
{
"key": "cii_best_practices",
"name": "CII-Best-Practices",
"detail": "no effort to earn an OpenSSF best practices badge detected",
"points": 0,
"status": "missed",
"details": [],
"max_points": 2.5
},
{
"key": "code_review",
"name": "Code-Review",
"detail": "Found 0/30 approved changesets -- score normalized to 0",
"points": 0,
"status": "missed",
"details": [],
"max_points": 7.5
},
{
"key": "contributors",
"name": "Contributors",
"detail": "project has 0 contributing companies or organizations -- score normalized to 0",
"points": 0,
"status": "missed",
"details": [],
"max_points": 2.5
},
{
"key": "dangerous_workflow",
"name": "Dangerous-Workflow",
"detail": "no workflows found",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_data",
"params": {}
}
],
"max_points": 10
},
{
"key": "dependency_update_tool",
"name": "Dependency-Update-Tool",
"detail": "no update tool detected",
"points": 0,
"status": "missed",
"details": [],
"max_points": 7.5
},
{
"key": "fuzzing",
"name": "Fuzzing",
"detail": "project is not fuzzed",
"points": 0,
"status": "missed",
"details": [],
"max_points": 5
},
{
"key": "license",
"name": "License",
"detail": "license file detected",
"points": 2.5,
"status": "met",
"details": [],
"max_points": 2.5
},
{
"key": "maintained",
"name": "Maintained",
"detail": "project was created within the last 90 days. Please review its contents carefully",
"points": 0,
"status": "missed",
"details": [],
"max_points": 7.5
},
{
"key": "packaging",
"name": "Packaging",
"detail": "packaging workflow not detected",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_data",
"params": {}
}
],
"max_points": 5
},
{
"key": "pinned_dependencies",
"name": "Pinned-Dependencies",
"detail": "no dependencies found",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_data",
"params": {}
}
],
"max_points": 5
},
{
"key": "sast",
"name": "SAST",
"detail": "no SAST tool detected",
"points": 0,
"status": "missed",
"details": [],
"max_points": 5
},
{
"key": "security_policy",
"name": "Security-Policy",
"detail": "security policy file not detected",
"points": 0,
"status": "missed",
"details": [],
"max_points": 5
},
{
"key": "signed_releases",
"name": "Signed-Releases",
"detail": "no releases found",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_data",
"params": {}
}
],
"max_points": 7.5
},
{
"key": "token_permissions",
"name": "Token-Permissions",
"detail": "No tokens found",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_data",
"params": {}
}
],
"max_points": 7.5
},
{
"key": "vulnerabilities",
"name": "Vulnerabilities",
"detail": "0 existing vulnerabilities detected",
"points": 7.5,
"status": "met",
"details": [],
"max_points": 7.5
}
]
}
],
"description": "Are visible security and supply-chain practices strong, with no malicious dependency and no unresolved high-risk jurisdiction exposure?"
},
{
"key": "ai_readiness",
"band": "critical",
"name": "AI Readiness",
"value": 29,
"weight": 0,
"metrics": [
{
"key": "ai_agent_context",
"band": "at_risk",
"name": "Agent context & guidance",
"note": null,
"notes": [],
"value": 40,
"inputs": {
"has_llms_txt": false,
"legible_history_share": 0.902,
"agent_instruction_files": [],
"agent_instruction_max_bytes": null
},
"components": [
{
"key": "agent_instructions",
"name": "Agent instructions",
"detail": "no CLAUDE.md / AGENTS.md / editor rules",
"points": 0,
"status": "missed",
"details": [
{
"code": "no_agent_instructions",
"params": {}
}
],
"max_points": 45
},
{
"key": "machine_readable_docs_llms_txt",
"name": "Machine-readable docs (llms.txt)",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 15
},
{
"key": "legible_commit_history",
"name": "Legible commit history",
"detail": "37 of 41 human commits state their intent (structured subject or explanatory body)",
"points": 40,
"status": "met",
"details": [
{
"code": "legible_history",
"params": {
"legible": 37,
"sampled": 41
}
}
],
"max_points": 40
}
]
},
{
"key": "ai_verify_loop",
"band": "critical",
"name": "Verify loop (build / test / typecheck)",
"note": "Excluded from scoring (no data or not applicable): OpenSSF Scorecard: Pinned-Dependencies. Remaining weights renormalized.",
"notes": [
{
"code": "excluded_no_data",
"params": {
"components": [
"openssf_scorecard_pinned_dependencies"
]
}
},
{
"code": "weights_renormalized",
"params": {}
}
],
"value": 11,
"inputs": {
"has_nix": false,
"has_tests": false,
"lockfiles": [],
"has_dockerfile": false,
"typed_language": false,
"bootstrap_files": [],
"has_devcontainer": false,
"has_linter_config": false,
"typecheck_configs": [],
"agent_commit_share": 0.317,
"toolchain_manifests": [],
"dependency_bot_commit_share": 0
},
"components": [
{
"key": "one_command_bootstrap",
"name": "One-command bootstrap",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 18
},
{
"key": "automated_tests",
"name": "Automated tests",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 22
},
{
"key": "lint_format_config",
"name": "Lint / format config",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 11
},
{
"key": "static_type_checking",
"name": "Static type checking",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 11
},
{
"key": "reproducible_environment",
"name": "Reproducible environment",
"detail": null,
"points": 0,
"status": "missed",
"details": [],
"max_points": 10
},
{
"key": "demonstrated_agent_practice",
"name": "Demonstrated agent practice",
"detail": "13 of the last 41 commits agent-authored or agent-credited",
"points": 10,
"status": "met",
"details": [
{
"code": "agent_authored_commits",
"params": {
"count": 13,
"sampled": 41
}
}
],
"max_points": 10
},
{
"key": "automated_maintenance",
"name": "Automated maintenance",
"detail": "no automated dependency updates observed",
"points": 0,
"status": "missed",
"details": [
{
"code": "no_dependency_automation",
"params": {}
}
],
"max_points": 8
},
{
"key": "openssf_scorecard_pinned_dependencies",
"name": "OpenSSF Scorecard: Pinned-Dependencies",
"detail": "no dependencies found",
"points": 0,
"status": "excluded",
"details": [
{
"code": "no_data",
"params": {}
}
],
"max_points": 10
}
]
},
{
"key": "ai_code_legibility",
"band": "moderate",
"name": "Code legibility for models",
"note": null,
"notes": [],
"value": 53,
"inputs": {
"primary_language": "Python",
"largest_source_bytes": 385518,
"source_files_sampled": 33,
"oversized_source_files": 1
},
"components": [
{
"key": "type_checkable_code",
"name": "Type-checkable code",
"detail": "Python without a type-check config",
"points": 0,
"status": "missed",
"details": [
{
"code": "no_typecheck_config_language",
"params": {
"language": "Python"
}
}
],
"max_points": 45
},
{
"key": "manageable_file_sizes",
"name": "Manageable file sizes",
"detail": "1/33 source files over 60KB",
"points": 53.3,
"status": "partial",
"details": [
{
"code": "oversized_source_files",
"params": {
"kb": 60,
"sampled": 33,
"oversized": 1
}
}
],
"max_points": 55
}
]
}
],
"description": "How well is the repo equipped to be developed and maintained with AI coding agents? An independent, experimental badge — weight 0.0, so it is surfaced on its own and does not affect the overall health score."
}
],
"metrics_version": "1.13.0"
},
"warnings": [
"GitHub dependency-graph SBOM unavailable (404); the dependency graph may be disabled for this repository"
],
"report_type": "repository",
"generated_at": "2026-07-29T06:29:49.065660Z",
"schema_version": "0.27.0",
"badge_url": "https://raw.githubusercontent.com/inspect-software/badges/main/v1/d/DanceNitra/ramr.svg",
"full_name": "DanceNitra/ramr",
"license_state": "standard",
"license_spdx": "MIT"
}