Skip to content

[Voxtral TTS] Support voxtral tts cfg_alpha sampling params via temperature#2243

Draft
y123456y78 wants to merge 20 commits intovllm-project:mainfrom
y123456y78:chenyo/voxtral-tts-sampling-params
Draft

[Voxtral TTS] Support voxtral tts cfg_alpha sampling params via temperature#2243
y123456y78 wants to merge 20 commits intovllm-project:mainfrom
y123456y78:chenyo/voxtral-tts-sampling-params

Conversation

@y123456y78
Copy link
Copy Markdown
Contributor

@y123456y78 y123456y78 commented Mar 26, 2026

Purpose

  • Support voxtral tts cfg_alpha sampling params via temperature
  • Add corresponding unit test
  • Clean up cuda graph & cuda graph test code a bit

Testing Plan

pytest -s -v \
  tests/model_executor/stage_input_processors/test_voxtral_tts_async_chunk.py \
  tests/model_executor/models/voxtral_tts/test_cuda_graph_acoustic_transformer.py \
  tests/model_executor/models/voxtral_tts/test_audio_tokenizer_parsing.py \
  tests/e2e/online_serving/test_voxtral_tts.py \
  tests/model_executor/models/voxtral_tts/test_text_preprocess.py \
  tests/e2e/offline_inference/test_voxtral_tts.py

Result

Uploading image.png…

Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
@y123456y78 y123456y78 force-pushed the chenyo/voxtral-tts-sampling-params branch from ea989bd to 03f3d9b Compare March 26, 2026 22:57
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
@y123456y78 y123456y78 changed the title [Voxtral TTS] Support voxtral tts cfg_alpha sampling params [Voxtral TTS] Support voxtral tts cfg_alpha sampling params via temperature Mar 27, 2026
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
Signed-off-by: Chen-Yo Sun <chenyo.sun@mistral.ai>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant