mirror of
https://github.com/Abdess/retroarch_system.git
synced 2026-11-01 07:33:45 -06:00
Abdessamad Derraz
087e5b4d73
Each emulator with records gets a Tested block: claim, result, method, computer, core build and the permalink of its record at the pin. A Measurements page filters every test in the browser from the compact index, and the Data page lists measurements.sqlite with its tables. One SQLite file per emulator is linked from its page. wiki/measurements.md says how a test runs, held to the Start here budgets. Both workflows fetch the pinned commit alone with git before the build, and the deploy fails without it.
48 lines
1.6 KiB
Markdown
48 lines
1.6 KiB
Markdown
---
|
|
level: reference
|
|
order: 70
|
|
group: Data
|
|
terms: measurement, benchmark, tested, core probe, real conditions, method
|
|
---
|
|
|
|
# How emulators are tested
|
|
|
|
Some pages say what an emulator does with a file. Where we ran it to check,
|
|
the emulator's page shows a **Tested** block. Every result is on the
|
|
[Measurements](../measurements.md) page.
|
|
|
|
## What a test does
|
|
|
|
- A script runs the emulator with no window and no sound.
|
|
- It starts a game or a disc and presses buttons at set frames.
|
|
- It runs again for each version of one file, such as a BIOS. Nothing else changes.
|
|
- It compares what the emulator showed, played or saved, by fingerprint (a hash).
|
|
- Each version runs at least twice, each time from a fresh start.
|
|
|
|
## What a result says
|
|
|
|
- **same**: the file changed nothing that was compared.
|
|
- **differs**: some versions of the file changed it.
|
|
- **inconclusive**: two runs of one version did not match, so no answer is given.
|
|
- **measured**: a speed test, given as time per frame.
|
|
|
|
## What a result keeps
|
|
|
|
Each result names its method, the computer it ran on and the exact build of
|
|
the emulator. Its inputs are kept by fingerprint. A result holds for that
|
|
build and those inputs only.
|
|
|
|
A speed figure depends on the computer and how busy it was. It is never
|
|
shown without them.
|
|
|
|
## Where results are kept
|
|
|
|
Each result is a full record in the
|
|
[retrobios-measurements](https://github.com/Abdess/retrobios-measurements)
|
|
project. A record is never changed once added. A new run is added beside it,
|
|
and a correction names the record it replaces.
|
|
|
|
The results so far ran on these computers:
|
|
|
|
<!-- measurements-hosts -->
|