Abdessamad Derraz 33041b6bd1 feat: find a file by any hash, out of the search ...

Hashes, link lists, install commands, member tables and long reference
tables leave the site search: the index drops from 21.0 MB (4.88 MB
gzip) to 6.8 MB (1.33 MB gzip). Names and prose stay searchable.

files/?hash= takes a SHA1, MD5, CRC32 or SHA256 and reads one shard of
api/v1/lookup/ (about 22 KB gzip, was 675 KB) listing the collection
card, the platforms that declare the value and the profiles that check
it. files/?sha1= still opens the card, and a sha1- anchor missing from
a page is looked up there, so a card can move between pages.

Excluded blocks are section elements: the search plugin compares
elements by tag, so a div ended at the first nested div.

2026-10-22 12:46:40 +02:00

..

exporter

feat: find a file by any hash, out of the search

2026-10-22 12:46:40 +02:00

scraper

feat: read elec ports and per-system cores

2026-10-22 06:28:24 +02:00

__init__.py

docs: write prose without dashes or semicolons

2026-10-19 06:47:31 +02:00

artifacts.py

fix: hold the pipeline's fixed outputs for a run

2026-10-21 09:53:15 +02:00

auto_fetch.py

fix: accept downloads by cryptographic hash only

2026-10-21 10:04:20 +02:00

build_port.py

feat: add the RetroBIOS PortMaster port

2026-10-22 03:58:42 +02:00

bundled_only.py

chore: drop copies only an install provides

2026-10-20 10:17:08 +02:00

check_buildbot_system.py

docs: write prose without dashes or semicolons

2026-10-19 06:47:31 +02:00

check_freshness.py

chore: merge round 2 fixes (tooling)

2026-10-21 10:31:04 +02:00

check_release_assets.py

fix: load every script under the 3.9 floor

2026-10-21 09:53:34 +02:00

check_release.py

feat: ship the handheld port with each release

2026-10-22 03:58:45 +02:00

common.py

fix: count the Marathon data trees as game data

2026-10-22 11:54:03 +02:00

cross_reference.py

feat: place core files per handed system dir

2026-10-22 04:04:31 +02:00

crypto_verify.py

chore: merge round 2 fixes (tests)

2026-10-21 10:29:19 +02:00

dedup.py

chore: merge round 2 fixes (tests)

2026-10-21 10:29:19 +02:00

derivations.py

fix: transform each held content once

2026-10-21 09:56:53 +02:00

deterministic_zip.py

refactor: stream zip rebuild instead of buffering

2026-08-08 04:40:07 +02:00

diff_truth.py

fix: accept -p and -t in every tool

2026-10-21 10:11:22 +02:00

download.py

fix: the download bar fits the terminal

2026-10-20 04:43:12 +02:00

download.sh

fix: send GITHUB_TOKEN from download.sh

2026-10-21 10:00:44 +02:00

dumpcatalog.py

docs: write prose without dashes or semicolons

2026-10-19 06:47:31 +02:00

export_native.py

fix: skip platforms with no native list

2026-10-22 07:52:08 +02:00

fetch_site_images.py

chore: run site tools through run_cli

2026-10-22 12:46:34 +02:00

fileless_audit.py

feat: each citation names the code that asks

2026-10-20 05:52:13 +02:00

find_pinned_revision.py

docs: give every command-line option a help text

2026-10-19 04:23:34 +02:00

gamedata.py

feat: add a --no-game-data pack narrowing

2026-10-22 06:19:05 +02:00

generate_db.py

fix: drop names DraStic never opens

2026-10-21 12:44:33 +02:00

generate_pack.py

feat: add a --no-game-data pack narrowing

2026-10-22 06:19:05 +02:00

generate_readme.py

refactor: compute coverage once, index proofs

2026-10-22 12:23:26 +02:00

generate_site.py

feat: find a file by any hash, out of the search

2026-10-22 12:46:40 +02:00

generate_truth.py

fix: count data directory readers in truth

2026-10-21 11:07:40 +02:00

hashing.py

fix: check a forced rehash against the last one

2026-10-20 03:24:55 +02:00

identity.py

chore: drop copies only an install provides

2026-10-20 10:17:08 +02:00

largefiles.py

fix: ask the release only for registered names

2026-10-21 10:06:11 +02:00

launchers.py

chore: merge round 4 fixes (links)

2026-10-21 13:19:44 +02:00

list_platforms.py

fix: make maintainer tool output actionable

2026-10-21 04:42:01 +02:00

make_og_cards.py

chore: run site tools through run_cli

2026-10-22 12:46:34 +02:00

mame_ref_audit.py

feat: each citation names the code that asks

2026-10-20 05:52:13 +02:00

manifestselect.py

feat: accept platform system names in --system

2026-10-21 10:52:40 +02:00

migrate.py

fix: refuse abbreviated flags in every script

2026-10-18 05:30:58 +02:00

mkdocs_hooks.py

docs: write prose without dashes or semicolons

2026-10-19 06:47:31 +02:00

nativemode.py

docs: write prose without dashes or semicolons

2026-10-19 06:47:31 +02:00

packextras.py

feat: place core files per handed system dir

2026-10-22 04:04:31 +02:00

packpaths.py

fix: place libretro dolphin files where it reads

2026-10-16 14:03:17 +02:00

packreadme.py

feat: add minui, nextui and myminui platforms

2026-10-22 04:04:36 +02:00

packresolve.py

fix: count an uncached release asset as fetched

2026-10-21 10:50:03 +02:00

packverify.py

feat: add a --no-game-data pack narrowing

2026-10-22 06:19:05 +02:00

pipeline.py

chore: merge audit fixes (packrules)

2026-10-21 11:52:28 +02:00

profile_sync.py

fix: end profile history at a deleted namesake

2026-10-22 08:15:15 +02:00

provenance_report.py

feat: name the profile a missing dump would fill

2026-10-21 10:05:10 +02:00

refresh_data_dirs.py

chore: merge round 2 fixes (tooling)

2026-10-21 10:31:04 +02:00

refresh_stale.py

fix: fail freshness on unknown, name the refresher

2026-10-21 10:00:36 +02:00

region_audit.py

docs: write prose without dashes or semicolons

2026-10-19 06:47:31 +02:00

region.py

feat: accept ISO country codes for --region

2026-10-21 10:12:07 +02:00

release_notes.py

fix: match release packs by exact name

2026-10-21 09:51:55 +02:00

release_record.py

fix: match release packs by exact name

2026-10-21 09:51:55 +02:00

restore_large_files.py

docs: give every command-line option a help text

2026-10-19 04:23:34 +02:00

romset_recipes.py

fix: make maintainer tool output actionable

2026-10-21 04:42:01 +02:00

safeparse.py

docs: write prose without dashes or semicolons

2026-10-19 06:47:31 +02:00

sect233r1.py

chore: drop label comments across scripts

2026-10-21 10:06:39 +02:00

sitediagrams.py

chore: run site tools through run_cli

2026-10-22 12:46:34 +02:00

siteexports.py

docs: word removal candidates by what was searched

2026-10-20 20:00:54 +02:00

siteguides.py

feat: group platforms by the device they run on

2026-10-22 11:50:48 +02:00

siterender.py

feat: draw site images from data, host them

2026-10-22 11:45:47 +02:00

sitesources.py

chore: merge audit fixes (site)

2026-10-21 05:53:15 +02:00

sitewrite.py

feat: lay the site out as a reading funnel

2026-10-22 11:50:53 +02:00

slot.py

docs: no double hyphen used as a dash

2026-10-20 06:23:02 +02:00

slots.py

feat: place core files per handed system dir

2026-10-22 04:04:31 +02:00

sourceref.py

fix: read a source_ref role per part, prose too

2026-10-21 05:14:47 +02:00

split_pack.py

docs: write prose without dashes or semicolons

2026-10-19 06:47:31 +02:00

torrentzip.py

docs: write prose without dashes or semicolons

2026-10-19 06:47:31 +02:00

truth.py

fix: count data directory readers in truth

2026-10-21 11:07:40 +02:00

upstream.py

feat: file mame software lists and floppy samples

2026-10-21 12:24:37 +02:00

validate_pr.py

feat: name the folder of a profile-only file

2026-10-21 10:13:09 +02:00

validate_schemas.py

feat: find a file by any hash, out of the search

2026-10-22 12:46:40 +02:00

validate_site.py

feat: draw site images from data, host them

2026-10-22 11:45:47 +02:00

validation.py

fix: leave out core files the core refuses by size

2026-10-21 10:46:52 +02:00

verify.py

feat: settle entries by their system's cores

2026-10-22 06:30:56 +02:00

ziptools.py

fix: give atomic writes the umask mode

2026-10-21 06:09:55 +02:00