Skip to content

Commit 538e2be

Browse files
committed
[Bugfix] fix referencing uninitialized tokenizer when using multiple step scheduling with skip tokenizer init option
1 parent 18016a5 commit 538e2be

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/engine/output_processor/multi_step.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -173,7 +173,7 @@ def _process_seq_outputs(self, seq: Sequence,
173173
# generates a fixed number of tokens without evaluating stopping
174174
# conditions within the block. This can cause an eos token to be
175175
# unintentionally ignored.
176-
if not sampling_params.ignore_eos:
176+
if not sampling_params.ignore_eos and self.detokenizer:
177177
eos_token_id = self.get_tokenizer_for_seq(seq).eos_token_id
178178
# Avoiding .index calls as exception throwing in the happy path
179179
# is expensive.

0 commit comments

Comments
 (0)