Add a cell-cache executor for batched generation - #22234

Draft

kiymetakdemir wants to merge 3 commits into

pytorch:add-runnerfrom

kiymetakdemir:cell-executor-pr

Commits on Aug 27, 2026

Add a cell-cache executor for batched generation
kiymetakdemir
committed
3e31cf1

Commits on Aug 28, 2026

Address review: build the cache from the program, add a start hook
kiymetakdemir
committed
ef6400a

Commits on Aug 29, 2026

Address review: build the cache from the program, read the backend from it
kiymetakdemir
committed
cb15008