Skip to content

Simplified 2048, but reliably reaches 65k#474

Merged
jsuarez5341 merged 49 commits into
PufferAI:4.0from
kywch:s2048-puf4
Jan 24, 2026
Merged

Simplified 2048, but reliably reaches 65k#474
jsuarez5341 merged 49 commits into
PufferAI:4.0from
kywch:s2048-puf4

Conversation

@kywch

@kywch kywch commented Jan 24, 2026

Copy link
Copy Markdown
Contributor

Inspired by @drubinstein 's recent 2048 simplification, I did -- so 300 less lines of code in 2048.h for better perf.

  • Used @drubinstein 's grid only obs, and value/pos embedding encoder
  • Removed heuristic/snake rewards completely, and endgame training
  • Simplified scaffolding curriculum
  • Prepared for 131k tiles
  • And, fixed wrong done signals.

Wandb curves:

Evaluation (this is one of the best runs. Perf changes from seed to seed, but hits 65k reliably):

    Num episodes: 95611
    Max tile avg: 40980.9
    Episode length -- Avg: 26792.1, Max: 37442.2
    Merge score -- Avg: 779238.6, Max: 997571.8
    Reached 32768 prob: 84.88 %
    Reached 65536 prob: 33.96 %
    Reached 131072 prob: 0.00 %   

Git commits are weird, but changed files are included here.

@jsuarez5341 jsuarez5341 merged commit f0bfbd1 into PufferAI:4.0 Jan 24, 2026
0 of 12 checks passed
crthpl pushed a commit to crthpl/PufferLib that referenced this pull request Jun 3, 2026
Simplified 2048, but reliably reaches 65k
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants