Notes

SGLang fixes cached continuations after constrained speculative decoding

SGLang 0.5.22 fixes a correctness bug that could make hybrid linear models resume from the wrong cached recurrent state when speculative decoding and structured output were combined. The October 19 r…

Notes

vLLM fixes context errors caused by oversized output limits

vLLM 0.32.0 fixes a context-window bug that could reject valid prompts when clients requested large output limits. Generation is now capped at the space actually left after the prompt. The merged PR…