Skip to content

Persist llm token consumption in db and log refusals #1228

@JannikStreek

Description

@JannikStreek

Proposed feature
Currently, the limits for token consumption only work within the running process. If the app crashes, monitoring will start again at 0. If the limit is hit, the error message should display a better fitting error than "an error occured".

Move token consumption in a settings table that is persisted.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions