Merge branch 'main' of https://github.com/Abdess/retrobios

9 new wiki pages: getting-started, faq, troubleshooting,
advanced-usage, verification-modes, adding-a-platform,
adding-a-scraper, testing-guide, release-process.

Updated architecture.md with mermaid diagrams, tools.md with
full pipeline and target/exporter sections, profiling.md with
missing fields, index.md with glossary and nav links.

Expanded CONTRIBUTING.md from stub to full contributor guide.

Filter .old.yml from load_emulator_profiles, generate_db alias
collection, and generate_readme counts. Fix BizHawk sha1 mode
in tools.md, fix RetroPie path, fix export_truth.py typos.

CONTRIBUTING.md

@@ -1,14 +1,109 @@
 # Contributing to RetroBIOS
 
-## Add a BIOS file
+## Types of contributions
 
-1. Fork this repository
-2. Place the file in `bios/Manufacturer/Console/filename`
-3. Variants (alternate hashes): `bios/Manufacturer/Console/.variants/`
-4. Create a Pull Request - checksums are verified automatically
+- **Add a BIOS file** - a great way to get started. Fork, add the file, open a PR.
+- **Create an emulator profile** - document what a core actually loads from source code. See the [profiling guide](https://abdess.github.io/retrobios/wiki/profiling/).
+- **Add a platform** - integrate a new frontend (scraper + YAML config). See [adding a platform](https://abdess.github.io/retrobios/wiki/adding-a-platform/).
+- **Add or fix a scraper** - parse upstream sources for BIOS requirements. See [adding a scraper](https://abdess.github.io/retrobios/wiki/adding-a-scraper/).
+- **Fix a bug or improve tooling** - Python scripts in `scripts/`, single dependency (`pyyaml`).
 
-## File conventions
+## Local setup
 
-- Files >50 MB go in GitHub release assets (`large-files` release)
-- RPG Maker and ScummVM directories are excluded from deduplication
-- See the [documentation site](https://abdess.github.io/retrobios/) for full details
+```bash
+git clone https://github.com/Abdess/retrobios.git
+cd retrobios
+pip install pyyaml
+
+# run tests
+python -m unittest tests.test_e2e -v
+
+# run full pipeline (DB + verify + packs + consistency check)
+python scripts/pipeline.py --offline
+```
+
+Requires Python 3.10 or later.
+
+## Adding a BIOS file
+
+1. Place the file in `bios/Manufacturer/Console/filename`.
+2. Alternate versions (different hash, same purpose) go in `bios/Manufacturer/Console/.variants/`.
+3. Files over 50 MB go as assets on the `large-files` GitHub release (git handles them better that way).
+4. RPG Maker and ScummVM directories are excluded from deduplication - please keep their structure as-is.
+5. Open a pull request. CI validates checksums automatically and posts a report.
+
+## Commit conventions
+
+Format: `type: description` (50 characters max, lowercase start).
+
+Allowed types: `feat`, `refactor`, `chore`, `docs`, `fix`.
+
+```
+feat: add panasonic 3do bios files
+docs: update architecture diagram
+fix: resolve truncated md5 matching
+chore: remove unused test fixtures
+refactor: extract hash logic to common.py
+```
+
+Keep messages factual. No marketing language, no superfluous adjectives.
+
+## Code and documentation quality
+
+The codebase runs on Python 3.10+ with a single dependency (`pyyaml`). All modules
+include `from __future__ import annotations` at the top. Type hints on every function
+signature, `pathlib` instead of `os.path`, and dataclasses where a plain class would
+just hold attributes.
+
+On performance: O(1) or O(n) algorithms are preferred. If something needs O(n^2), a
+comment explaining why helps future readers. List comprehensions over explicit loops,
+generators when iterating large datasets, and standard default arguments
+(`def f(items=None)` over `def f(items=[])`).
+
+File I/O uses context managers. ZIP extraction goes through `safe_extract_zip()` in
+`common.py`, which prevents zip-slip path traversal.
+
+The code stays lean. Comments that describe *why* age better than comments that
+restate *what*. Unused variables can be deleted rather than renamed with an underscore.
+
+The same spirit applies to documentation and emulator profiles. Straightforward
+language, honest labels ("untested" when something is untested).
+
+When a bug is spotted while working on something else, fixing it in the same PR
+keeps things tidy. Features ideally ship complete in one pass: code, tests, a
+passing pipeline run, and any documentation updates together.
+
+## Pull request process
+
+CI runs four checks on every PR:
+
+| Check | What it does |
+|-------|-------------|
+| `validate-bios` | hashes changed BIOS files against the database, posts a validation report |
+| `validate-configs` | schema-validates platform YAML configs |
+| `run-tests` | runs the full E2E test suite |
+| `label-pr` | auto-labels the PR based on changed file paths |
+
+All four checks must pass. One maintainer approval is required before merge.
+
+## Project philosophy
+
+This repository is an archive. The goal is a complete collection of every file a
+user needs to run every supported console in an emulator, with zero friction. That
+scope goes beyond BIOS ROMs: firmware updates, system fonts, data files, encryption
+keys, hiscore databases, anything the emulator loads from disk rather than generating
+itself. In a hundred years the pack should still work out of the box.
+
+Licensing considerations are secondary to completeness. If an emulator needs a
+file to function, the file belongs in the collection. The project's legal position is
+documented in the FAQ section of the site.
+
+Integrity matters. Every file, hash, and metadata field is cross-checked
+against the emulator's source code. Upstream references like System.dat,
+`.info` files, and wiki pages are valuable and generally accurate, though
+they can occasionally fall out of date. When an upstream source and the
+code disagree, the code at runtime is the tiebreaker.
+
+## Documentation
+
+Full reference docs, profiling guides, and architecture details are on the [documentation site](https://abdess.github.io/retrobios/).

README.md

@@ -2,7 +2,7 @@
 
 Complete BIOS and firmware packs for Batocera, BizHawk, EmuDeck, Lakka, Recalbox, RetroArch, RetroBat, RetroDECK, RetroPie, and RomM.
 
-**7,290** verified files across **395** systems, ready to extract into your emulator's BIOS directory.
+**7,241** verified files across **396** systems, ready to extract into your emulator's BIOS directory.
 
 ## Quick Install
 
@@ -33,7 +33,7 @@ Pick your platform, download the ZIP, extract to the BIOS path.
 | Lakka | 448 | `system/` | [Download](../../releases/latest) |
 | Recalbox | 346 | `/recalbox/share/bios/` | [Download](../../releases/latest) |
 | RetroArch | 448 | `system/` | [Download](../../releases/latest) |
-| RetroBat | 331 | `bios/` | [Download](../../releases/latest) |
+| RetroBat | 339 | `bios/` | [Download](../../releases/latest) |
 | RetroDECK | 2006 | `~/retrodeck/bios/` | [Download](../../releases/latest) |
 | RetroPie | 448 | `BIOS/` | [Download](../../releases/latest) |
 | RomM | 374 | `bios/{platform_slug}/` | [Download](../../releases/latest) |
@@ -45,13 +45,13 @@ Each file is checked against the emulator's source code to match what the code a
 
 - **10 platforms** supported with platform-specific verification
 - **329 emulators** profiled from source (RetroArch cores + standalone)
-- **395 systems** covered (NES, SNES, PlayStation, Saturn, Dreamcast, ...)
-- **7,290 files** verified with MD5, SHA1, CRC32 checksums
-- **8156 MB** total collection size
+- **396 systems** covered (NES, SNES, PlayStation, Saturn, Dreamcast, ...)
+- **7,241 files** verified with MD5, SHA1, CRC32 checksums
+- **8144 MB** total collection size
 
 ## Supported systems
 
-NES, SNES, Nintendo 64, GameCube, Wii, Game Boy, Game Boy Advance, Nintendo DS, Nintendo 3DS, Switch, PlayStation, PlayStation 2, PlayStation 3, PSP, PS Vita, Mega Drive, Saturn, Dreamcast, Game Gear, Master System, Neo Geo, Atari 2600, Atari 7800, Atari Lynx, Atari ST, MSX, PC Engine, TurboGrafx-16, ColecoVision, Intellivision, Commodore 64, Amiga, ZX Spectrum, Arcade (MAME), and 361+ more.
+NES, SNES, Nintendo 64, GameCube, Wii, Game Boy, Game Boy Advance, Nintendo DS, Nintendo 3DS, Switch, PlayStation, PlayStation 2, PlayStation 3, PSP, PS Vita, Mega Drive, Saturn, Dreamcast, Game Gear, Master System, Neo Geo, Atari 2600, Atari 7800, Atari Lynx, Atari ST, MSX, PC Engine, TurboGrafx-16, ColecoVision, Intellivision, Commodore 64, Amiga, ZX Spectrum, Arcade (MAME), and 362+ more.
 
 Full list with per-file details: **[https://abdess.github.io/retrobios/](https://abdess.github.io/retrobios/)**
 
@@ -62,13 +62,13 @@ Full list with per-file details: **[https://abdess.github.io/retrobios/](https:/
 | Batocera | 356/362 (98.3%) | 349 | 7 | 6 |
 | BizHawk | 118/118 (100.0%) | 118 | 0 | 0 |
 | EmuDeck | 161/161 (100.0%) | 161 | 0 | 0 |
-| Lakka | 444/448 (99.1%) | 444 | 0 | 4 |
-| Recalbox | 326/346 (94.2%) | 324 | 2 | 20 |
-| RetroArch | 444/448 (99.1%) | 444 | 0 | 4 |
-| RetroBat | 331/331 (100.0%) | 327 | 4 | 0 |
-| RetroDECK | 2006/2006 (100.0%) | 1977 | 29 | 0 |
-| RetroPie | 444/448 (99.1%) | 444 | 0 | 4 |
-| RomM | 374/374 (100.0%) | 374 | 0 | 0 |
+| Lakka | 442/448 (98.7%) | 442 | 0 | 6 |
+| Recalbox | 277/346 (80.1%) | 274 | 3 | 69 |
+| RetroArch | 442/448 (98.7%) | 442 | 0 | 6 |
+| RetroBat | 339/339 (100.0%) | 335 | 4 | 0 |
+| RetroDECK | 1960/2006 (97.7%) | 1934 | 26 | 46 |
+| RetroPie | 442/448 (98.7%) | 442 | 0 | 6 |
+| RomM | 372/374 (99.5%) | 372 | 0 | 2 |
 
 ## Build your own pack
 
@@ -130,4 +130,4 @@ See [CONTRIBUTING.md](CONTRIBUTING.md) for guidelines.
 
 This repository provides BIOS files for personal backup and archival purposes.
 
-*Auto-generated on 2026-03-30T09:06:05Z*
+*Auto-generated on 2026-03-30T20:16:27Z*