Action labels
Histogram
64×48×3 · K context frames + 1-hot action
Conditional UNet (DDPM)
input = [ noisy xt ‖ K context frames ] → conv ↓ ↓ ↑ ↑ with skip links
action one-hot + sin(t) embedding → FiLM-ish shift at every scale
predicts ε · cosine schedule T=1000 · context noise augmentation · 10% action dropout (CFG)
Loss
Preview: context · target · prediction
←/→ turn · ↑/↓ walk · Shift+↑/↓ run · Space attack · no key = NOOP
Neural-only loop
Hallucination drift
Best Reality Detectors
- Loading…
Explain like I'm an imp
1. A bot plays a real raycaster and we record (last K frames, action) → next frame.
2. A diffusion model learns to remove noise from the next frame, given the past frames and what button you pressed.
3. In Dream Mode the real engine is OFF. We start from pure static, denoise it over several steps into a frame, push it into the context, and repeat — the game is pure hallucination, steered by you.
4. Errors pile up ("drift"). Context noise augmentation in training teaches the model to tolerate its own mush.