nightly-bisect/b: [AutoSP] Honor seq_dim when AutoSP shards inputs (#8720)
Split from #8457 . Problem prepare_autosp_inputs() takes a seq_dim argument, but only passes it to mark_dynamic . …
What moved
Split from #8457 . Problem prepare_autosp_inputs() takes a seq_dim argument, but only passes it to mark_dynamic . The AutoSP graph passes ignore it: pass_shard_seq_dim and shard_tensor_node always read the sequence length from shape[1] and slice dimension 1. …
Why it matters
Filed as a public note from DeepSpeed, 2026-10-11. The desk tags this brief LLM / Hardware.
On the record
- Filed from the DeepSpeed official GitHub releases feed on 2026-10-11.
- Primary source host: github.com.
- Problem prepare_autosp_inputs() takes a seq_dim argument, but only passes it to mark_dynamic .
Primary source
github.com
github.com
Desk
Logged as brief 108
Logged as brief 108
Cite this brief
nightly-bisect/b: [AutoSP] Honor seq_dim when AutoSP shards inputs (#8720) (DeepSpeed, 2026-10-11) — https://labledgerdesk.pages.dev/b/2026/10/11/nightly-bisect-b-autosp-honor-seq-dim-when-autosp-shards-inputs-8720/