The Lab / latest run, Nov 7 2026

Two models, one night. Both perfect.

On Nov 7 two AI models built the same three apps on the same RTX 3090. Both scored 32 out of 32. qwen38-27b finished in 25 minutes and needed one retry. Qwen3.8 Flash Next, a model about six times its size squeezed into a 2-bit build, took 31 minutes and passed every app on its first try.

Every attempt, in order

Bar length is time. Numbers are minutes.

qwen38-27b, 2×RTX 3060, Oct 284 attempts / 69 min7.09.135.5 failed 6 checks17.4KanbanSand simDungeon
qwen38-27b, RTX 3090 at 420 W, Nov 16 attempts / 66 min3.35.14.220.6 failed 6 checks18.4 failed 6 checks14.1KanbanSand simDungeon
Flash Next, RTX 3090 unlocked, Nov 73 attempts / 30.5 min4.719.36.5KanbanSand simDungeon
qwen38-27b, RTX 3090 unlocked, Nov 74 attempts / 25.4 min3.78.25.18.5KanbanSand simDungeon
Every attempt as a table
SetupAppAttemptResultMinutesFailed checks
qwen38-27b, 2×RTX 3060Kanban1Passed7.0none
qwen38-27b, 2×RTX 3060Sand sim1Passed9.1none
qwen38-27b, 2×RTX 3060Dungeon1Failed35.5moves, walls_block, exit_reachable, enemies, damage, game_over
qwen38-27b, 2×RTX 3060Dungeon2Passed17.4none
qwen38-27b, RTX 3090 at 420 WKanban1Passed3.3none
qwen38-27b, RTX 3090 at 420 WSand sim1Failed5.1walls_hold
qwen38-27b, RTX 3090 at 420 WSand sim2Passed4.2none
qwen38-27b, RTX 3090 at 420 WDungeon1Failed20.6moves, walls_block, exit_reachable, enemies, damage, game_over
qwen38-27b, RTX 3090 at 420 WDungeon2Failed18.4moves, walls_block, exit_reachable, enemies, damage, game_over
qwen38-27b, RTX 3090 at 420 WDungeon3Passed14.1none
Flash Next, RTX 3090 unlockedKanban1Passed4.7none
Flash Next, RTX 3090 unlockedSand sim1Passed19.3none
Flash Next, RTX 3090 unlockedDungeon1Passed6.5none
qwen38-27b, RTX 3090 unlockedKanban1Failed3.7drag
qwen38-27b, RTX 3090 unlockedKanban2Passed8.2none
qwen38-27b, RTX 3090 unlockedSand sim1Passed5.1none
qwen38-27b, RTX 3090 unlockedDungeon1Passed8.5none

Watch it

These are clips of the actual apps the model wrote.

qwen38-27b, RTX 3090 unlocked, Nov 73 apps

Kanban

10/10. Passed on the second attempt, 11.8 min

Sand sim

11/11. Passed on the first attempt, 5.1 min

Dungeon

11/11. Passed on the first attempt, 8.5 min

Flash Next, RTX 3090 unlocked, Nov 73 apps

Kanban

10/10. Passed on the first attempt, 4.7 min

Sand sim

11/11. Passed on the first attempt, 19.3 min

Dungeon

11/11. Passed on the first attempt, 6.5 min

qwen38-27b, RTX 3090 at 420 W, Nov 13 apps

Kanban

10/10. Passed on the first attempt, 3.3 min

Sand sim

11/11. Passed on the second attempt, 9.3 min

Dungeon

11/11. Passed on the third attempt, 53.1 min

qwen38-27b, 2×RTX 3060, Oct 283 apps

Kanban

10/10. Passed on the first attempt, 7.0 min

Sand sim

11/11. Passed on the first attempt, 9.1 min

Dungeon

11/11. Passed on the second attempt, 52.9 min

The numbers

Setupqwen38-27b, 2×RTX 30602×RTX 3060 12 GB, Ryzen 7 5800X, 48 GB DDR4 Full specsqwen38-27b, RTX 3090 at 420 WRTX 3090 24 GB at 420 W, Ryzen 7 5800X, 48 GB DDR4 Full specsFlash Next, RTX 3090 unlockedRTX 3090 24 GB at 420 W with the FP16 unlock, Ryzen 7 5800X, 48 GB DDR4 Full specsqwen38-27b, RTX 3090 unlockedRTX 3090 24 GB at 420 W with the FP16 unlock, Ryzen 7 5800X, 48 GB DDR4 Full specs
Score32/3232/3232/3232/32
Attempts4634
Total time69 min66 min30.5 min25.4 min
Generation speed16.2 tok/s33.5 tok/snot recorded41.0 tok/s
Prompt speed268 tok/s703 tok/snot recorded690 tok/s
Tokens generated64,921124,85137,88854,218
MotherboardB450M DS3H WIFIB450M DS3H WIFIB450M DS3H WIFIB450M DS3H WIFI

Speeds are token-weighted averages from the server's timing lines in each run.

What this doesn't prove

Each setup has one run, and neither set a fixed seed. Randomness is the likely reason for the extra attempts, but that's not proven.

Flash Next ran through Strata, which doesn't log speeds, so its speed rows say not recorded. It is a 2-bit build with most of its weights in system RAM.

The same model took 66 minutes on Nov 1 and 25 on Nov 7. Retries and context size swing a lot from run to run, so one night's order isn't a ranking.

The same six Dungeon checks failed every time it failed. I haven't dug into why yet. It could be a repeated model mistake or a problem in my checker.

The FP16 unlock

On Nov 5 the 3090 got the FP16-accumulate unlock: gpu-unlock, an open-source kernel module by Zagitta (v2.0.0). GeForce cards run some tensor-core math at a reduced rate, and the module lifts that.

These are quick synthetic tests, run once each (n=1), on the same card before and after. They are not the app-building bench.

Show the unlock results

Matrix math, TFLOPS (n=1)

PrecisionLocked (Nov 4)Unlocked (Nov 5)Change
FP16, FP32 accumulate77.5125.3+62%
FP16, FP16 accumulate139.0129.2−7%
BF1677.8126.5+63%
TF3240.267.2+67%
FP3228.226.3−7%
  • The two rows that went down 7% both ran at the card's power limit (420 W; plain FP32 drew 412 W). Why they dropped hasn't been tested.
  • Image generation (SDXL, 1024×1024, 25 steps): 5.3 to 5.6 seconds with BF16, the same as FP16 with FP16 accumulate. There is no locked number to compare with. n=1.
  • Text generation (qwen38-27b, GGUF): 45.5 tok/s. No gain was expected, since that work is limited by memory speed, not math. n=1.

App-building bench, unlocked vs locked (n=1)

On the night of Nov 5 the unlocked card ran the agentic part of the bench once. The server command and binary, sampling and test code were the same as the Nov 1 run. The card drew about 417 W against its 420 W limit, at 1800 MHz.

3090 at 420 W (Nov 1)3090 unlocked (Nov 5)
Score32/3232/32
Attempts (Kanban, sand-sim, dungeon)1, 2, 31, 1, 2
Total time66.0 min47.0 min
Kanban3.3 min, 5 turns13.4 min, 19 turns
Sand-sim9.3 min, 15 turns6.4 min, 10 turns
Dungeon53.1 min, 61 turns25.3 min, 37 turns
Generation speed33.5 tok/s38.1 tok/s
Prompt speed703 tok/s710 tok/s
Tokens generated124,85198,378
Peak context (dungeon)133,18472,559
  • Most of the 19 minutes saved came from needing 4 attempts instead of 6, not from a faster card.
  • Prompt speed didn't change. Generation was 14% faster, but this run's contexts were about half as deep, and generation slows as context grows. So the gain can't be credited to the unlock. The synthetic tests above showed no text-generation gain either.
  • One run per setup (n=1). Kanban took 4 times longer this time (19 turns vs 5) on its first attempt, with the same settings. Runs vary that much, so one run each can't separate a setup change from chance.
  • The first dungeon attempt failed the same six checks again: 4 of 4 failed dungeon attempts, across three runs, failed exactly the same ones.

Energy and cost per token (bench load)

At $0.1227 per kWh. The GPU figures come from the card's own energy counters. The circuit figures come from a power meter on the whole circuit, one reading a minute. Costs are per million generated tokens.

3090 at 420 W (Nov 1)3090 unlocked (Nov 5)
GPU energy, whole run432.6 Wh (avg 399 W)301.0 Wh (avg 393 W)
GPU cost, whole run$0.053$0.037
GPU, per 1M generated tokens3,465 Wh, $0.433,059 Wh, $0.38
Whole circuit, average during the run699 W615 W
Whole circuit, per 1M generated tokens$0.76$0.60
  • These are bench-load numbers: full draw for the whole run. Normal chat use spends more time idle, so it costs more per token.
  • Energy per token was 12% lower on the unlocked run at about the same draw, but most of that is the same catch as above: shallower contexts give more tokens per second.
  • The circuit wasn't idle before the Nov 1 run, so the two circuit figures aren't a clean comparison.

Full specs for this setup

Tweak log

  1. Nov 7, 3090 unlockedSame-night comparison. qwen38-27b 32/32 in 25 min, Qwen3.8 Flash Next 32/32 in 31 min.
  2. Nov 5, 3090 unlockedFP16-accumulate unlock (gpu-unlock) on the 3090. Synthetic results and one bench run are up.
  3. Nov 1, 3090 at 420 WValid run. 32/32 after 6 attempts, in 66 minutes.
  4. Nov 1, 3090 at 150 WThrown out. An old boot setting capped the card at 210 MHz.
  5. Oct 28, 2×3060Baseline. 32/32 after 4 attempts, in 69 minutes.