Abdessamad Derraz
3092d73122
fix: cross-reference checks data/ directories for false positives
...
_find_in_repo and _name_in_index now scan data/ in addition to
bios/ via database.json. Eliminates 129 false positives from
game data migrated to data/ (OpenTyrian, ScummVM, SDLPAL, Cave
Story, Syobon Action). True missing: 782 -> 653.
2026-03-28 17:31:22 +01:00
Abdessamad Derraz
3d5d5b601c
feat: mass BIOS collection (+1020 files, 7520 total)
...
Add ~1500 BIOS, firmware and game data files sourced from
24 parallel agents. Migrate game engine data (ScummVM,
SDLPAL, OpenTyrian, Cave Story, Syobon Action) from bios/
to data/ via _data_dirs.yml. Add Roland MT-32/CM-32L ROMs
to bios/Roland/. Upload large files (EDK2, SDLPAL, ScummVM,
arcade ZIPs, EasyRPG soundfont) to large-files release.
New coverage: QEMU firmware (67), PCem (137), VICE (53),
Cemu Wii U (58), shadPS4 (14), Amiga (24), MAME ZIPs (724),
O2EM voice (270), Azahar 3DS (4), EightyOne ZX81 (35),
Stella KidVid (14), XRoar (12), and 77 emulators total.
2026-03-28 16:51:43 +01:00
Abdessamad Derraz
7dc8428ac1
refactor: fix cross-reference archive grouping and path resolution
...
Group archived files by archive unit in find_undeclared_files instead
of reporting individual ROMs. Add path-based fallback for descriptive
names (e.g. "SeaBIOS (128 KB)" resolves via path: bios.bin). Update
_collect_extras to use archive name for pack resolution. Regenerate
database with new bios files. 6 new E2E tests covering archive
in_repo, missing archives, descriptive names, and pack extras.
2026-03-28 14:00:08 +01:00
Abdessamad Derraz
366695b764
Update README.md
2026-03-28 12:12:05 +01:00
Abdessamad Derraz
a5285a9fc0
feat: add ti83 v1.10 and doom2.wad, zero platform missing
...
TI-83 v1.10 ROM from TOSEC archive (sha1 verified).
DOOM II WAD from archive.org for prboom libretro core.
All platforms now at 0 missing files.
2026-03-28 11:40:06 +01:00
Abdessamad Derraz
1f65662fd2
feat: add ~110 missing bios files from archive.org and bizhawk
...
Sources: emularity_bios_v1, mame-bios-0.282, mame-bios-devices,
mame251, MAME216, bizhawk-firmware-2.11.0, neogeo_bios, retrobat.
Neo Geo: neogeo.zip upgraded 6 to 38 files, ngp.zip added.
Arcade: dsp1-4, jojoa/jojoba/jojobar1, fdsbios, decocass, neocdz.
Multi-platform: 3DO, Atari 7800/Lynx, C64, Channel F, ColecoVision,
Vectrex, Intellivision, GB/GBC/GBA, NDS, N64DD, SNES DSP/Satellaview,
PC Engine CD, PC-FX, SMS, Game Gear, Mega Drive, Mega-CD, Saturn STV,
Videopac, MSX, Amiga, ZX Spectrum, TI-83.
2026-03-28 10:26:30 +01:00
Abdessamad Derraz
2666ebd9b7
chore: regenerate readme and database timestamps
2026-03-28 09:24:01 +01:00
Abdessamad Derraz
5cbd461a97
docs: update readme and database for ground truth feature
2026-03-27 23:55:30 +01:00
Abdessamad Derraz
74f48b8881
Add emulator profiles and update docs
...
Add new emulator profiles (ares, BigPEmu, Eden, Model2, PrimeHack, Supermodel, Suyu, Xenia Canary, Yuzu) under emulators/*.yml with metadata, notes, file lists and exclusion/hle details. Update README counts (emulators/systems/files summary and auto-generated timestamp) and bump generated_at in database.json. Adjust mkdocs.yml navigation counts and add Yuzu entry to the Emulators nav.
2026-03-26 13:22:11 +01:00
Abdessamad Derraz
8ac64d6143
docs: add build guide and documentation site section to readme
...
Quick start commands for generating packs by platform, emulator, or
system. Documentation site section explains what users can find there.
2026-03-26 07:15:01 +01:00
Abdessamad Derraz
bbe4936cf2
feat: add 12 batocera standalone profiles, update 3 existing
...
New profiles: citron (Switch), clk (multi-system), demul (Hikaru),
eka2l1 (Symbian/N-Gage), gsplus (Apple IIGS), lexaloffle (PICO-8),
openmsx (MSX), ryujinx (Switch), shadps4 (PS4), tsugaru (FM Towns),
x16emu (Commander X16), xroar (Dragon/CoCo), zc210 (Zelda Classic).
Updated: amiberry, fsuae (standalone Amiga), ymir (Saturn standalone).
2026-03-26 07:01:16 +01:00
Abdessamad Derraz
3f676b75e8
feat: standalone emulator support for batocera and multi-platform name mapping
...
resolve_platform_cores() builds reverse index from profile cores: field,
fixing 17 name mismatches across Batocera, RetroBat, and Recalbox
(genesisplusgx, pce_fast, pcfx, vb, mame078plus, vice cores, etc.).
standalone_path field on file entries + standalone_cores on platform
YAMLs enable mode-aware pack generation. find_undeclared_files() uses
standalone_path for cores the platform runs standalone, filters by
mode: libretro/standalone per file.
batocera.yml gains standalone_cores (92 entries from configgen-defaults).
generate_readme.py dynamically lists platforms from registry.
3 profiles updated for standalone type/path (mame, hatari, mupen64plus_next).
78 E2E tests pass, pipeline verified.
2026-03-26 00:44:21 +01:00
Abdessamad Derraz
44dc946217
docs: add romm to platform references
2026-03-25 23:19:52 +01:00
Abdessamad Derraz
d2cc9b8f29
feat: add doom engine wad files, emulatorjs base config
2026-03-25 23:12:53 +01:00
Abdessamad Derraz
c61d40d8ef
docs: rewrite readme for clarity and discoverability
2026-03-25 17:18:43 +01:00
Abdessamad Derraz
38059e0fdf
chore: regenerate database, readme, mkdocs nav
2026-03-25 16:49:49 +01:00
Abdessamad Derraz
6e237e3b6d
chore: regenerate database, readme, mkdocs nav
2026-03-25 15:54:17 +01:00
Abdessamad Derraz
5529f8474a
chore: regenerate database and readme
2026-03-25 15:41:46 +01:00
Abdessamad Derraz
313637663a
docs: soften tone, explain methodology without dismissing other sources
2026-03-25 14:51:57 +01:00
Abdessamad Derraz
593466b655
feat: add methodology and ground truth narrative to readme and site
2026-03-25 14:50:09 +01:00
github-actions[bot]
1996135cd1
regenerate database and docs
2026-03-20 19:12:35 +00:00
github-actions[bot]
3a7050a8cb
regenerate database and docs
2026-03-20 12:10:56 +00:00
github-actions[bot]
16fd815099
regenerate database and docs
2026-03-19 22:32:31 +00:00
Abdessamad Derraz
6ee162f8fb
chore: add MAME and RetroDECK ROM sets
2026-03-19 23:26:49 +01:00
github-actions[bot]
4992af07e7
regenerate database and docs
2026-03-19 15:15:53 +00:00
github-actions[bot]
6c38a2aa6a
regenerate database and docs
2026-03-18 14:19:45 +00:00
Abdessamad Derraz
becd0efb33
fix: relative links in readme, commit pending changes
2026-03-18 11:28:58 +01:00
Abdessamad Derraz
21a50c992f
feat: slim readme + ci site deployment
...
README: 11141 -> 43 lines. Details on the MkDocs site.
generate_readme.py: 444 -> 164 lines. Slim coverage table only.
build.yml: adds mkdocs-material install, generate_site.py, gh-deploy.
Adds pages: write permission for GitHub Pages deployment.
2026-03-18 10:44:13 +01:00
github-actions[bot]
b0dad7dcf3
regenerate database and docs
2026-03-18 05:29:59 +00:00
github-actions[bot]
06ea19ee20
regenerate database and docs
2026-03-18 04:48:32 +00:00
Abdessamad Derraz
97a25b17ff
fix: CI restores large files before DB regen, fix coverage numbers
...
build.yml now downloads large-files release assets and copies them
to their bios/ paths (matched via .gitignore) before regenerating
the database. This fixes Batocera showing 675/680 instead of 679/680
on the remote (PS3UPDAT.PUP, dsi_nand.bin, PSVUPDAT.PUP were missing).
Local: Batocera 679/680, all others 100%.
2026-03-18 05:46:16 +01:00
github-actions[bot]
9a69b49eac
regenerate database and docs
2026-03-17 19:10:52 +00:00
github-actions[bot]
a38c86cf1e
regenerate database and docs
2026-03-17 16:53:26 +00:00
Abdessamad Derraz
e82a498124
feat: update sc3000 to basic iii v1.1, regenerate db and readme
...
Replace sc3000.rom with BASIC Level III v1.1 (Japan) from MAME 0.270+
software list (SHA1 737a06b3, closer to Batocera target).
Batocera 679/680, Recalbox 346/346, all others 100%.
2026-03-17 17:51:11 +01:00
github-actions[bot]
29d4c6e5b9
regenerate database and docs
2026-03-17 16:25:41 +00:00
Abdessamad Derraz
1257653c9b
feat: batocera 679/680, fix variant indexing, add hikaru + segaboot
...
Fix variant name indexing: files in .variants/ now indexed under
canonical name (naomi2.zip instead of naomi2.zip.da79eca4).
Fix .zip detection for variant paths in verify.py.
Add composite MD5 matching in resolver for ZIP variants.
Add hikaru.zip (MAME 0.285, 6 ROMs) and segaboot.gcm (Triforce)
from archive.org. Both match Batocera expected MD5s.
Batocera 679/680 (1 untested: sc3000 private dump)
Recalbox 346/346 (100%)
2026-03-17 17:06:02 +01:00
Abdessamad Derraz
36a17b315a
feat: batocera 678/680, add 6 naomi2 roms from mame 0.278
...
Add missing NAOMI 2 ROMs (315-6146, 315-6215, sp5001/a/b, sp5002-a)
from MAME 0.278 non-merged set. Clean up naomi2 variant files.
Recalbox composite naomi2.zip kept as variant (.da79eca4).
Batocera 678/680 (2 untested: sc3000, triforce)
Recalbox 345/346 (1 untested: naomi2 composite mismatch)
2026-03-17 16:19:21 +01:00
Abdessamad Derraz
bb1855d3f7
feat: recalbox 346/346 via md5_composite, add mame variants
...
Add md5_composite() to verify.py replicating Recalbox Zip::Md5Composite
(sorted filenames, sequential content hash). Independent of ZIP
compression level, resolves all 9 MAME arcade untested entries.
Add Recalbox-specific MAME ZIP variants from Recalbox 10 pack.
Batocera 671/680 (9 untested MAME-specific), all others 100%.
2026-03-17 16:08:39 +01:00
Abdessamad Derraz
4bf62b8126
feat: fix enterprise zips, restore deleted files, add sms aliases
...
- Create ep64.zip/ep128.zip MAME sets from existing ROMs
- Restore Complex_4627v1.03.bin, N64DD IPL, PS2 SCPH-70004 files
(accidentally deleted by background agent)
- Add Xbox Complex_4627.bin alias for Batocera
- Add SMS BIOS aliases for RetroBat naming convention
All platforms at 0 missing:
Batocera 677/680, Recalbox 337/346, all others 100%
2026-03-17 15:44:12 +01:00
Abdessamad Derraz
5ab82a7898
refactor: security hardening + mame arcade bios updates
...
Security fixes:
- Zip-slip protection in _extract_zip_to_archive (sanitize paths)
- Hash verification for large file downloads (cache + post-download)
- Sanitize YAML destination fields against path traversal
- Size limit on ZIP entry reads (512MB cap, prevents zip bombs)
- Download size limits in auto_fetch (100MB cap)
- Reject hashless external downloads
- Sanitize filenames in place_file with basename()
MAME arcade updates from Batocera v38 pack:
- Updated naomi, naomi2, naomigd, awbios, airlbios, hod2bios, hikaru
- Old versions preserved in .variants/ for RetroBat compatibility
Batocera 675/680 (+9), all other platforms unchanged at 0 missing
2026-03-17 15:32:14 +01:00
Abdessamad Derraz
7ea649da7c
feat: emudeck 164/164, complete coverage all platforms
...
Add SCPH-1000R (PlayStation Classic JP) romJP.bin from archive.org
NAND dump. Last missing file across all 7 platforms.
All platforms at 0 missing:
RetroArch 398/398, Lakka 398/398, RetroPie 398/398
RetroBat 341/343 (2 untested)
Recalbox 336/346 (10 untested)
Batocera 589/680 (91 untested, MAME version diffs)
EmuDeck 164/164
2026-03-17 14:44:10 +01:00
Abdessamad Derraz
936cec07cd
feat: emudeck at 163/164, add mega cd + ps1_rom variants
...
Add 3 rare BIOS variants from TOSEC/archive.org:
- Mega CD v1.00s JP (a3ddcc8483) from Myrient TOSEC
- Sega CD Model 2 v2.00 US (310a9081d2) from Myrient TOSEC
- ps1_rom.bin 4MB PS3-extracted (fbb5f59ec3) from archive.org
EmuDeck: 163/164 (99.4%), 1 unknown hash remains (476d68a9)
All other platforms: 0 missing
2026-03-17 14:37:58 +01:00
Abdessamad Derraz
617f5a3654
feat: expand bios collection, emudeck at 97.6%
...
Add 36 new files from multiple sources:
- PSX rare variants (DTL-H2000, SCPH-5903 VCD, SCPH-7000/7000W, DTL-H1100)
- Sega Mega CD 9 region variants (EU/JP/US firmware revisions)
- Saturn HiSaturn GameNavi v1.03
- N64DD IPL (US/JP/DEV), PS2 SCPH-70004, Xbox Complex BIOS
- PPSSPP system pack, 3DS/Switch/Wii U keys, Nokia N-Gage
- Apple Macintosh mac755.chd
Platform coverage:
RetroArch 398/398 (100%)
Lakka 398/398 (100%)
RetroPie 398/398 (100%)
Batocera 589/680 (86.6%, 91 untested MAME versions)
Recalbox 336/346 (97.1%, 10 untested)
RetroBat 341/343 (99.4%, 2 untested)
EmuDeck 160/164 (97.6%, 4 missing rare dumps)
2026-03-17 14:15:33 +01:00
Abdessamad Derraz
29d475b8b7
feat: add emudeck platform support, 126/164 verified
2026-03-17 13:33:07 +01:00
Abdessamad Derraz
c13d3d13bf
feat: complete retrobat coverage, fix large file resolution, fix readme variants
2026-03-17 13:12:51 +01:00
github-actions[bot]
d834688593
regenerate database and docs
2026-03-17 12:06:43 +00:00
Abdessamad Derraz
0ffb8cbd0d
feat: complete retrobat coverage, fix large file resolution
2026-03-17 13:03:57 +01:00
github-actions[bot]
a443ba74e8
regenerate database and docs
2026-03-17 11:44:55 +00:00
github-actions[bot]
1218bc0bb8
regenerate database and docs
2026-03-17 11:35:56 +00:00
Abdessamad Derraz
e6ea0484a8
expand bios collection, retrobat at 93% coverage
2026-03-17 11:53:42 +01:00