It would be great to extend Archestra's budgeting system to support more granular cost controls, similar to what teams might be used to with tools like LiteLLM. Instead of just setting limits at the team or org level for specific models, we could allow admins to set budgets per-user, per-virtual-key, and establish a global "all models" budget.
It would be great to extend Archestra's budgeting system to support more granular cost controls, similar to what teams might be used to with tools like LiteLLM. Instead of just setting limits at the team or org level for specific models, we could allow admins to set budgets per-user, per-virtual-key, and establish a global "all models" budget.