Commit Graph
3991 Commits
Author SHA1 Message Date
Abdessamad Derraz 79238c8f1d fix: read a gap report without its entry tally 2026-11-05 12:35:05 +01:00
Abdessamad Derraz e97539c683 chore: merge ide12.rom collection 2026-11-05 12:09:16 +01:00
Abdessamad Derraz 2c81e1a1af feat: watch the rom folder pins 2026-11-05 12:09:10 +01:00
Abdessamad Derraz c34ed4d2a1 feat: watch the game catalogs for new DATs 2026-11-05 12:06:04 +01:00
Abdessamad Derraz 673e70d791 feat: refuse an arcade index off its profile pin 2026-11-05 12:01:17 +01:00
Abdessamad Derraz f0afe6a6fb refactor: parse each source YAML once per run 2026-11-05 12:00:15 +01:00
Abdessamad Derraz 141042dd81 refactor: narrow the install list once per cores 2026-11-05 11:59:21 +01:00
Abdessamad Derraz 55b63dbc6e refactor: look up core file versions by slot 2026-11-05 11:58:10 +01:00
Abdessamad Derraz 5ef7a9fabf refactor: hash each profile entry once 2026-11-05 11:57:08 +01:00
Abdessamad Derraz 4fbc028e20 fix: refuse an offline run with no data cached 2026-11-05 11:54:47 +01:00
Abdessamad Derraz 8db1ee7743 feat: collect ep128emu ide12.rom
Extracted from the ep128emu ROM package (http://ep128.hu/Emu/ep128emu_roms-2.0.11.bin, sha256 775f65b4...0441) that installer/makecfg.cpp downloads, unpacked with Ep128Emu::decompressData from src/decompm2.cpp and split per the makecfg.cpp table. The ROM identifies as EPIDE version 1.2.
2026-11-05 11:53:31 +01:00
Abdessamad Derraz 6190f30d2d fix: account for every profile entry in gaps 2026-11-05 11:53:29 +01:00
Abdessamad Derraz 92ee0cf118 fix: align freshness details in one column 2026-11-05 11:49:45 +01:00
Abdessamad Derraz 651b1404db fix: skip the core-info row when offline 2026-11-05 11:49:31 +01:00
Abdessamad Derraz f195e714c4 fix: name a missing pack in the consistency step 2026-11-05 11:48:51 +01:00
Abdessamad Derraz f285c32d67 feat: validate every file of a folder 2026-11-05 11:48:31 +01:00
Abdessamad Derraz 7b6b22351a fix: show no digest for a file never read 2026-11-05 11:48:31 +01:00
Abdessamad Derraz 0c92fb6705 fix: suggest the closest data directory key 2026-11-05 11:46:30 +01:00
Abdessamad Derraz b79e551b88 fix: keep scratch paths out of pack probe records 2026-11-05 11:45:55 +01:00
Abdessamad Derraz 34319a56e2 chore: test the bundled rule on the collection 2026-11-05 11:40:56 +01:00
Abdessamad Derraz 28a8eec1c4 fix: skip scratch downloads in the restore scan 2026-11-05 11:40:17 +01:00
Abdessamad Derraz d38cd58036 feat: scrape recalbox rom folders per board
GitLab refused the hundred raw reads per IP. A GitLab directory is now
read from one archive request, else a shallow sparse git fetch, and the
cache keeps its file list so offline runs know what is absent.

Each board builds system.ini against its defconfig: a core whose package
the board does not enable is dropped (pisnes was the SNES default
everywhere), and a system with no core is not built. The row names the
default most boards share, board_defaults the others. A files: list
names whole files and is carried as files through the index and the
installer.

A folder no name resolves, run by a core of several machines, now holds
those machines: thomson, multivision and pcv2 had no fallback, so their
games got no file. Arcade-indexed cores keep naming files per set.
2026-11-04 16:48:34 +01:00
Abdessamad Derraz a05fc599d9 fix: read recalbox board sections as romfs does
board_cores walked only the plain [core.N] sections and replaced a board
section whole. romfs2 systemholder.py reads a slot present as
[core.N.<board>] alone (gb and gbc bsnes on x86_64) and each key from the
board section, then <key>.<board>, then the plain key. The committed
target lists are unchanged on all seven boards.
2026-11-04 16:48:34 +01:00
Abdessamad Derraz 9d3458d47a chore: merge generated page refresh 2026-11-04 05:54:14 +01:00
Abdessamad Derraz 33add072cb chore: merge installer page refresh 2026-11-04 05:52:02 +01:00
Abdessamad Derraz fa9fbbed9e fix: a cited module may be a package
python -m runs a package by its __main__.py: scripts.scraper.romfolders is one.
2026-11-04 05:51:40 +01:00
Abdessamad Derraz 8848f3e6f6 chore: merge tools page refresh 2026-11-04 05:49:49 +01:00
Abdessamad Derraz 058bb13884 docs: list pipeline step 4e
The games index step came in with main. The installer samples test now reads step 7 in the list form the pipeline steps test holds.
2026-11-04 05:45:29 +01:00
Abdessamad Derraz 0bd206da4d chore: merge main into Sony pages 2026-11-04 05:11:58 +01:00
Abdessamad Derraz 1077d77125 fix: reset console pages in the index tests
A Sony fixture split by console recorded its pages in the shared map, and the index tests that ran after it linked PlayStation to the split page. They now start from an empty map, and the fixture clears it when done.
2026-11-04 04:47:01 +01:00
Abdessamad Derraz 36788a3cac fix: hold the site tests to Sony console pages
Tests that built a maker's page with sections used Sony, which now gives each console a page: they use Sega, which keeps its sections. A Sony fixture split by console leaked its recorded pages into the index tests that followed. Built-page checks read the cards on the console pages and the opening lines on the Sony summary.
2026-11-04 04:21:26 +01:00
Abdessamad Derraz 531edaa1ad feat: give every Sony console its own page
A section shares its page's search fields, and "playstation 3 bios" found the PlayStation page before the Sony page that held the PS3. CONSOLE_PAGES splits Sony by console whatever the size. The search gate now expects the PlayStation 3 page in the top two for that query, the order of words being something Pagefind does not weigh, and the page first for "ps3 bios".
2026-11-04 03:55:07 +01:00
Abdessamad Derraz fd7dd0efe5 fix: games tools write whole files, name options
The games importers wrote through fixed .part names, the new options had
no help text, and romfolders stopped on the first setup the offline cache
lacked. RetroArch's rom folder map is regenerated from its source spec
(path null, as the schema says). The installer's Python 3.8 job imports
the games tests without pyyaml, so the region rules load lazily.
2026-11-03 22:46:17 +01:00
Abdessamad Derraz af2e930d32 chore: merge games on card installer mode 2026-11-03 21:06:04 +01:00
Abdessamad Derraz c75fd661e8 fix: read fbneo console sets by driver name
In a console folder an FBNeo set is looked up under its driver name
(msx_1942), the bare name being the arcade set's. A run given its list as
a file reads the games index from beside it or the cache only when
--for-games was not asked. The installer keeps to Python 3.8 syntax, and
the testing guide names test_install_games.
2026-11-03 19:12:42 +01:00
Abdessamad Derraz 8ba0a8c3f6 chore: merge main 2026-11-03 19:12:38 +01:00
Abdessamad Derraz 52fc01109e chore: regenerate manifests after the data merges
Same files per platform. The manifests catch up with the per-system MAME
filing, the platform system join and declared_in, and name sfiii2a.zip as
missing. The games index fallback sets and the installer page samples
follow.
2026-11-03 19:05:39 +01:00
Abdessamad Derraz 2e9175a8e9 feat: install for the games on the card
--for-games reads the card's rom folders through install/games/ and keeps
what the games need: per system what its default core reads, one region
where the content proves it (crc32 and size, a disc serial, a header the
core reads), an arcade set's BIOS parents. A game not recognised gets
every BIOS of its system and is named. --required-only keeps only what
starts. The plan and the line menu open on it when the card holds games,
everything one press away. A cache keeps what reading a card found.
2026-11-03 18:51:21 +01:00
Abdessamad Derraz ff1f94e473 feat: read 0.78 era arcade parents from code
mame2000, mame2003 and mame2003-plus carry a DAT their code moved past. Their parents and BIOS sets now come from src/driver.c and src/drivers/ at the pin, named by the src tree sha. The DAT is still read to report gaps. FBNeo DATs are read one namespace each, console sets keyed by driver. A BIOS with no dumped ROM is no longer listed.
2026-11-03 18:46:45 +01:00
Abdessamad Derraz f25062f84e feat: declare namcoc76 bios for mame2003
Tekken and Tekken 2 name namcoc76 as parent in namcos11.c at the pin. Each game also loads c76.bin as ROM_LOAD_OPTIONAL, so the archive is optional.
2026-11-03 18:46:40 +01:00
Abdessamad Derraz b69b33178b feat: publish board sets and sets with no bios
The games index now names, per arcade core, the game sets that load no
BIOS set and every BIOS set, so a set on a card the DAT does not know is
told apart from one that needs nothing. Each board default core of a rom
folder gets its own fallback set, and index.json maps every folder name
a setup uses to its systems, for a games folder on a computer.
2026-11-03 18:17:03 +01:00
Abdessamad Derraz 1271b338f4 fix: keep listxml machines larger than a read 2026-11-03 18:07:08 +01:00
Abdessamad Derraz d955e86a5b docs: list the games index test modules 2026-11-03 17:56:16 +01:00
Abdessamad Derraz c2ad67e4fa feat: publish the games index with install lists 2026-11-03 17:45:03 +01:00
Abdessamad Derraz eaf0fbdd19 chore: merge main 2026-11-03 17:37:46 +01:00
Abdessamad Derraz 1aa36258b2 feat: scrape the rom folders of each setup 2026-11-03 17:37:33 +01:00
Abdessamad Derraz 87354043c9 fix: tests follow joined sgb ids and ps3 search
nintendo-sgb and nintendo-super-game-boy are one id now, so the flat
declared-set test uses two ids no alias joins. The search weighs "3" as
nothing: "playstation 3 bios" is held to the top three results.
2026-11-03 17:36:00 +01:00
Abdessamad Derraz 249b189ec9 feat: index arcade sets by bios parent 2026-11-03 16:36:26 +01:00
Abdessamad Derraz dc337c893c feat: add region and per-game file rules 2026-11-03 16:36:26 +01:00
Abdessamad Derraz 8d8689c2e4 feat: import game catalogs and header rules 2026-11-03 16:36:22 +01:00