Stereo

Calibration Quality Gates

Depth is reconstructed from the camera calibration, so a bad calibration poisons the depth and every solve built on it — quietly, and without ever failing outright. Two gates sit upstream of processing to catch that: one when the calibration is solved, one when a take is about to consume it. Neither gate deletes anything. Both pause and wait for you.

Where the gates sit

Calibrate
Detect Corners
->
Select Frames
->
Solve
->
Gate 1Validation RMS
↓
Then a take
Preflightdiscover calibration
->
Gate 2Footage diagnostics
->
Generate Depth
->
Solve + Export

Gate 1 judges the calibration on its own terms: is this a self-consistent solve of the checkerboard take? Gate 2 judges it against the take that wants to use it: does this calibration actually describe the two cameras as they were when this footage was shot? A calibration can pass the first and fail the second — that is the whole point of having both.

Gate 1 — Out-of-sample validation RMS

When a Calibration job finishes, the solve is scored on frames it was not solved from. Its own solve error is not used for the verdict: a calibration built from a handful of convenient frames can drive its training error down while describing the rig badly, so ranking by training error rewards exactly the overfit solves the gate exists to catch. Out-of-sample error does not have that blind spot.

A checkerboard take as one HMC camera sees it - a hand slowly tilting and turning an 11 x 16 board while it stays in focus and fills most of the frame
A checkerboard take as the HMC sees it. Slow, in-focus board movement across the frame leaves plenty of sharp frames for the solve and for out-of-sample validation
Max RMS Error (px)
Default 1.0 - Advanced -> Calibration Quality Gates
Upper bound on validation reprojection error, in pixels. Above it, the calibration is set aside and the job pauses as Poor Calibration. This is our convention — Epic ships no equivalent default.
Reading the number. Healthy solves cluster tightly: on a reference HMC rig, downstream quality was flat across validation RMS 0.6-1.1 px — depth coverage and solve jitter were indistinguishable between them. Quality falls off a knee above that, and by 2.4 px the damage is plain (noticeably lower depth coverage, markedly worse jitter, depth scale drifting off true). Treat anything past roughly 2.4 as a failed solve to be reshot or re-selected, not tuned around. Because the healthy band is flat, chasing a lower RMS below ~1.0 buys nothing; a gate at 0.5 would reject even a good rig's best achievable solve.
A bad calibration never fails loudly. Even a deliberately overfit solve completes, exports, and produces animation. Quality decays gradually rather than breaking, which is why the gate is the only place a poor calibration gets stopped — there is no downstream error to catch it.

Gate 2 — The footage diagnostics gate

Before a depth-family (Stereo, Depth, Other) or Identity take uses its calibration, the calibration is scored against a sample of that take's own footage on Epic's 0-1 diagnostics scale. The check runs at preflight, ahead of depth generation, and its result is cached for the session.

Epic's Calibration Diagnostics tab: the two HMC camera views A and B of a performance take side by side, Mean Error and RMS Error readouts, a Detect Features button, and the assigned Camera Calibration asset below
The same check, run by hand: Epic's Calibration Diagnostics scores a calibration against a take's own footage. Gate 2 runs it for you at preflight
Min Score
Default 0.5 - Advanced -> Calibration Quality Gates
Minimum diagnostics score for the discovered calibration on this take. Below it, the take pauses as Poor Calibration before any depth is generated.

This score is a structural check, not a quality ranking. It answers one question: can this calibration relate the two camera views of this footage at all? It reliably catches calibrations that are structurally wrong — a wrong-route or broken solve scores around 0.2 — but it cannot tell a good calibration from a slightly worse one, and will happily score a mediocre solve a hair above a better one. Leave it as a safety net; tightening it will not buy finer discrimination, it will only start rejecting healthy takes.

What a low score actually means

  • The wrong grid take. The discovered calibration belongs to a different rig configuration or a different shoot day than this take.
  • The cameras moved. The HMC was adjusted, knocked, or re-mounted between the calibration take and this performance — the solved geometry no longer describes the rig.
  • The wrong actor folder. Discovery walked up into a shared parent and found a neighbouring actor's calibration. Keeping each shoot under one actor folder prevents this.
  • No stereo features matched at all. A distinct message from a merely low score — usually swapped or mismatched camera views, or footage the calibration cannot possibly correspond to.
If the diagnostics check cannot run in your environment, it does not block: the job logs that the check was skipped and proceeds. The gate is only ever a reason to pause, never a reason to fail.

Capture provenance on a failed verdict

For takes ingested in-editor, the plugin reads the camera serials and record time that the capture unit wrote into the source .mov headers, for both this take and the grid take the calibration was solved from, and caches them in takecache.json. Provenance changes the wording of a failed verdict, never the verdict. The status message then says one of:

  • Recorded on different cameras - the grid describes another helmet. Link the right unit's calibration; do not accept it.
  • Recorded <time> after/before this take - the same helmet changed in between (re-seated, lights or filters, mount moved). Shoot a grid in the same block. Under 10 minutes apart, timing is ruled out - check the grid take itself.
  • Timecode was not jammed - informational; the unit was not synced, often a sign it was reset.
  • No camera or timing sentence - provenance is unknown (ingested outside the editor, or the source files moved). Nothing is guessed.

After a failure, up to 6 other calibrations under /Game/CaptureManager/Imports (rejected ones skipped) are scored on this take's footage. The message names the best alternative - the highest score that beats the failed one, which does not mean it clears Min Score. Link it only if its score passes and its rig matches the take's.

The job log gets a [Preflight] Provenance: line on every verdict (rig, cameras, record time, clip, timecode for take and grid, then same or different cameras, time between them, shoot day) and one [Preflight] Alternative calibration ... line per alternative scored.

When a job pauses

Job Queue: a MetaHumanGrid take typed Calibration and Done, two DNAPose takes typed Identity - one Failed, one blocked on Poor Calibration
A take paused on Poor Calibration — the queue keeps running everything else while it waits for a trustworthy solve

Both gates produce the same blocked status — Poor Calibration — but from different places, and they clear differently:

FlavorWhat happened, and how it clears
Over-threshold solve
Calibration job
The calibration solved but exceeded Max RMS Error. The asset is unlinked from the take and added to the rejected list, and its artifact is marked Partial. The job's status message reports both the solve and validation RMS against the threshold. Clears by Accept Calibration Anyway — which relinks the asset, marks the job Done and wakes its dependents — or by a better re-solve, which un-rejects the path automatically.
Footage mismatch
Performance take
The discovered calibration scored below Min Score on this take's footage. Nothing is rejected — the calibration may be perfectly good for other takes. Clears by linking a different calibration, re-running calibration (the take requeues automatically once a better one exists), or Accept Calibration Anyway, which records the decision on the take and lets it proceed with the calibration it already has.
Dependent jobs wait rather than consume a suspect solve. A paused calibration does not release its takes, and a rejected calibration is invisible to every discovery lookup — already-linked, capture parent folder, take folder, sibling takes, and one level up all skip it. The queue keeps running everything else; the blocked takes requeue on their own the moment a trustworthy calibration appears.

Accept Anyway is available from the queue's right-click menu whenever a selected job is paused on quality, and accepts multiple selected jobs at once. It is a deliberate override, recorded durably — the accepted decision survives requeues and manifest reloads.

Board override and presets

Most quality failures are really detection failures: the board dimensions were wrong, so the frames that survived selection were the ones that happened to fit a wrong model. By default the plugin assumes Epic's shipped board — 11 x 16 squares at 0.75 cm, measured in squares, not inner corners — and auto-detects the pattern per take.

Override default board
Default off
Turn on for a non-Epic board. Your board width, height, and square size are then pinned verbatim — only those dimensions and their swapped orientation are tried, and auto-detection never writes back over them.
Square Size (cm) Inert unless the override is on — with it off, Epic's 0.75 cm is assumed regardless of what the field shows. Square size cannot be measured from footage, and a wrong value silently scales the stereo baseline and therefore all reconstructed depth, so measure your printed board rather than trusting the spec sheet.
Board presets Save a named board (dimensions plus square size) from the Generate Stereo Calibration dialog and switch between them per shoot. Presets exist only in that dialog, and its preset section appears only while the override is on. No presets ship by default — a new one starts at Epic's board.
Symptoms that point at the board rather than the gates: calibration that scans forever and produces nothing (wrong dimensions, nothing detects), or a clean-looking solve whose depth comes out at visibly the wrong scale (wrong square size). Blurry-frame rejection is not a setting: sharpness tuning runs automatically on every solve.

Related