Skip to content

Bugged out qwen models #241

@Cdingram

Description

@Cdingram

Has anyone else noticed template issues with some qwen 3 variants. These two for example qwen3 1.7B and qwen3-2507 both error for me on the second message if jinja is set to true in the completion options. The non thinking version of qwen3-2507 works fine.

The error is something like "Value is not callable: null at row 48, column 85" and then shows some line of code about stripping think tags.

I'm pretty sure it isn't actually this library but I'm trying to rule out something here vs llama.cpp vs the GGUF provider.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions