Skip to content

Set max tokens to enable usage of bigger models #176

@sh1ftred

Description

@sh1ftred

Issue Description

We need to configure the max tokens parameter to enable the usage of larger AI models in the chat application.

Problem

Currently, the chat app may have a max tokens limit that restricts the use of bigger models. Larger models often require higher token limits to function effectively and provide better responses.

Requirements

  • Review and update the max tokens configuration
  • Ensure the limit is sufficient for larger models
  • Test with various model sizes to confirm compatibility

Expected Outcome

The chat app should be able to utilize bigger models without token limit restrictions, providing users with access to more powerful AI capabilities.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions