# Leanstral 119B GGUF-NVFP4 Agentic Arcade Eval

Date: 2026-07-03

Condition: Leanstral-1.5-119B-A6B GGUF-NVFP4 served locally through llama.cpp's OpenAI-compatible server on DGX Spark / NVIDIA GB10, then used to build Agentic Arcade Road Hopper and Maze single-file HTML submissions.

Status: Controlled local model run. The submitted files were produced by the local GGUF-NVFP4 artifact. No DSpark draft model was used. The submitted files are repo-validator clean, but the post-submission browser-interaction audit failed for both games, so these artifacts are not admitted as coherent playable games.

## Artifact

| Field | Value |
| --- | --- |
| Hugging Face | https://huggingface.co/Frosty40/Leanstral-1.5-119B-A6B-GGUF-NVFP4 |
| Local GGUF | `/home/frosty40/models/leanstral-nvfp4/artifacts/Leanstral-1.5-119B-A6B-NVFP4.gguf` |
| GGUF bytes | `67135119264` |
| GGUF SHA256 | `4668fd2a6d2764de250489852230e96238eb5c0d7495866eb3b9c6c4fac5c7da` |
| Served alias | `leanstral-1.5-119b-a6b-nvfp4` |
| Runtime context used | `32768` |
| Metadata train context | `1048576` |
| `/v1/models` metadata | `118972826624` params, `4096` embedding size, `67126693888` model size |

## Runtime

| Field | Value |
| --- | --- |
| Server | `/home/frosty40/llama-nvfp4/build/bin/llama-server` |
| Host / port | `127.0.0.1:18082` |
| GPU layers | `-ngl 99` |
| Context | `-c 32768` |
| Batch / ubatch | `-b 2048`, `-ub 512` |
| Flash attention | `-fa auto` |
| KV cache | `-ctk f16`, `-ctv f16` |
| Temperature | `0.2` |
| Top-p | `0.95` |
| Team size | `1` |
| Merge top | `1` |

## Submitted Package

| Game | Source artifact | Public artifact | Bytes | SHA256 | Repo validator | Browser interaction |
| --- | --- | --- | ---: | --- | --- | --- |
| Road Hopper | `src/teamwork/leanstral-119b-nvfp4/frogger.html` | `games/road_hopper_leanstral_119b_nvfp4.html` | `6821` | `46fd9af76c3ca5e140bbed6c5777ec5edba5998d3a42d91a61a39da0d082835f` | ok | failed: no canvas change after input |
| Maze | `src/teamwork/leanstral-119b-nvfp4/maze.html` | `games/maze_leanstral_119b_nvfp4.html` | `9303` | `16b882abb96d04f43273fd9259fe807347e70195f05ee88282298aeb56056a05` | ok | failed: no canvas change after input |

Submitted to Agentic Arcade by email with Gmail sent message id `19f2a482f2d7a2b3`.

## Repo-Validator Runs

| Game | Raw run | Score | Rounds | Wall time | Decode telemetry |
| --- | --- | ---: | ---: | ---: | --- |
| Road Hopper | `logs/leanstral-119b-nvfp4-agentic-arcade-20260703T230718Z/` | `10.0` | `4` | `228.5 s` | `3226` decoded tokens in `71374.34 ms`, `45.20 tokens/s` |
| Maze | `logs/leanstral-119b-nvfp4-agentic-arcade-20260703T225531Z/` | `8.0` | `1` | `75.8 s` | `3698` decoded tokens in `74836.01 ms`, `49.41 tokens/s` |

## Browser-Interaction Audit

| Scope | Raw evidence | Road Hopper | Maze |
| --- | --- | --- | --- |
| Submitted files | `logs/leanstral-119b-nvfp4-agentic-arcade-20260703T234422Z/submitted.browser-interaction.json` | failed: canvas existed, no canvas change after input | failed: canvas existed, no canvas change after input |
| Compact scaffold rerun | `logs/leanstral-119b-nvfp4-agentic-arcade-20260703T234422Z/summary.json` | failed after `3` rounds; repo validator ok on round 3, interaction failed | failed after `3` rounds; repo validator ok on round 3, interaction failed |

Compact scaffold failed checks:

| Game | Failed checks |
| --- | --- |
| Road Hopper | `browser_interaction_clean`, `canvas_changes_after_input`, `arcade_size_budget`, `keyboard_controls`, `game_over_restart`, `victory_or_level`, `road_river_goal` |
| Maze | `browser_interaction_clean`, `canvas_changes_after_input`, `arcade_size_budget`, `request_animation_frame`, `keyboard_controls`, `start_input_transition`, `hud_score_lives`, `game_over_restart`, `victory_or_level`, `maze_shooting_robot_goal` |

## Commands

Road Hopper repo-validator accepted run:

```text
/home/frosty40/miniconda3/bin/python3 /home/frosty40/agentic-arcade/scripts/local_arcade_build.py --base http://127.0.0.1:18082/v1 --model leanstral-1.5-119b-a6b-nvfp4 --model-name Leanstral-1.5-119B-A6B\ NVFP4 --model-slug leanstral-119b-nvfp4 --out-dir src/teamwork/leanstral-119b-nvfp4 --raw-dir /home/frosty40/agentic-arcade/logs/leanstral-119b-nvfp4-agentic-arcade-20260703T230718Z --games frogger --max-rounds 4 --max-tokens 8192 --temperature 0.2 --top-p 0.95
```

Maze repo-validator accepted run:

```text
/home/frosty40/miniconda3/bin/python3 /home/frosty40/agentic-arcade/scripts/local_arcade_build.py --base http://127.0.0.1:18082/v1 --model leanstral-1.5-119b-a6b-nvfp4 --model-name Leanstral-1.5-119B-A6B\ NVFP4 --model-slug leanstral-119b-nvfp4 --out-dir src/teamwork/leanstral-119b-nvfp4 --raw-dir /home/frosty40/agentic-arcade/logs/leanstral-119b-nvfp4-agentic-arcade-20260703T225531Z --games frogger\,maze --max-rounds 3 --max-tokens 8192 --temperature 0.2 --top-p 0.95
```

Compact scaffold browser-interaction rerun:

```text
env GAMES=frogger,maze MAX_ROUNDS=3 MAX_TOKENS=4096 OUT_DIR=src/teamwork/leanstral-119b-nvfp4-scout bash scripts/run_leanstral_arcade_eval.sh
```

## Raw Evidence

| Artifact | Path |
| --- | --- |
| Submitted stats | `src/teamwork/leanstral-119b-nvfp4/stats.json` |
| Road Hopper telemetry | `src/teamwork/leanstral-119b-nvfp4/frogger.json` |
| Maze telemetry | `src/teamwork/leanstral-119b-nvfp4/maze.json` |
| Submitted browser audit | `logs/leanstral-119b-nvfp4-agentic-arcade-20260703T234422Z/submitted.browser-interaction.json` |
| Compact rerun summary | `logs/leanstral-119b-nvfp4-agentic-arcade-20260703T234422Z/summary.json` |
| Compact rerun artifacts | `src/teamwork/leanstral-119b-nvfp4-scout/` |

## Boundaries

| Boundary | Status |
| --- | --- |
| Coherent playable game claim | Not admitted |
| Repo validator | Passed on submitted files |
| Browser interaction | Failed on submitted files and compact rerun |
| Runtime context | `32768` tokens tested |
| Train context metadata | `1048576` tokens reported, not runtime-validated |
| DSpark | Not used |
| Draft model | Not used |