Notes

vLLM fixes context errors caused by oversized output limits

vLLM 0.32.0 fixes a context-window bug that could reject valid prompts when clients requested large output limits. Generation is now capped at the space actually left after the prompt. The merged PR…