Skip to content

Navigation Menu

Appearance settings

View all features
- BY COMPANY SIZE
  Enterprises
  Small and medium teams
  Startups
  Nonprofits
- BY USE CASE
  App Modernization
  DevSecOps
  DevOps
  CI/CD
  View all use cases
- BY INDUSTRY
  Healthcare
  Financial services
  Manufacturing
  Government
  View all industries
View all solutions
- EXPLORE BY TOPIC
  AI
  Software Development
  DevOps
  Security
  View all topics
- EXPLORE BY TYPE
  Customer stories
  Events & webinars
  Ebooks & reports
  Business insights
  GitHub Skills
- SUPPORT & SERVICES
  Documentation
  Customer support
  Community forum
  Trust center
  Partners
View all resources
- COMMUNITY
  GitHub SponsorsFund open source developers
- PROGRAMS
  Security Lab
  Maintainer Community
  Accelerator
  GitHub Stars
  Archive Program
- REPOSITORIES
  Topics
  Trending
  Collections
- ENTERPRISE SOLUTIONS
  Enterprise platformAI-powered developer platform
- AVAILABLE ADD-ONS
  GitHub Advanced SecurityEnterprise-grade security features
  Copilot for BusinessEnterprise-grade AI features
  Premium SupportEnterprise-grade 24/7 support
Pricing

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

Appearance settings

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

BasedHardware / omi Public

Notifications You must be signed in to change notification settings
Fork 1.8k
Star 11k

Code
Issues 476
Pull requests 82
Discussions
Actions
Projects
Security and quality
Insights

Additional navigation options

Code
Issues
Pull requests
Discussions
Actions
Projects
Security and quality
Insights

Add provider-agnostic Model QoS profiles (#6831)#6832

Open

beastoin wants to merge 72 commits intomainBasedHardware/omi:mainfrom

fix/llm-qos-tiers-6831BasedHardware/omi:fix/llm-qos-tiers-6831Copy head branch name to clipboard

Conversation Commits72 (72)Checks Files changed

Open

Add provider-agnostic Model QoS profiles (#6831)#6832
beastoin wants to merge 72 commits intomainfrom
fix/llm-qos-tiers-6831

Commits

Commits on Apr 19, 2026

Add QoS tier system for LLM model selection (#6831)

beastoin
and
claude
committed
Wire conversation processing to QoS tiers (#6831)

beastoin
and
claude
committed
Wire knowledge graph extraction to QoS tiers (#6831)

beastoin
and
claude
committed
Wire memory extraction to QoS tiers (#6831)

beastoin
and
claude
committed
Add tests for QoS tier system (#6831)

beastoin
and
claude
committed
Fix conv_events tier key and restore prompt_cache_key (#6831)

beastoin
and
claude
committed
Trim _FEATURE_TIER_DEFAULTS to wired features only (#6831)

beastoin
and
claude
committed
Update stale test to verify QoS tier callsites (#6831)

beastoin
and
claude
committed
Rename to Omi QoS and add model-safe cache_key param (#6831)

beastoin
and
claude
committed
Use get_llm cache_key param for model-safe cache routing (#6831)

beastoin
and
claude
committed
Rename test to test_omi_qos_tiers and add cache key safety tests (#6831)

beastoin
and
claude
committed
Update test.sh for renamed test_omi_qos_tiers.py (#6831)

beastoin
and
claude
committed
Remove unused model globals: llm_large, llm_large_stream, llm_high_stream, llm_agent (#6831)

beastoin
and
claude
committed
Update prompt caching test for Omi QoS tier system (#6831)

beastoin
and
claude
committed
Update prompt cache tests for model globals cleanup (#6831)

beastoin
and
claude
committed
Fix action item date validation tests for Omi QoS (#6831)

beastoin
and
claude
committed
Fix NameError in test_prompt_cache_integration.py (#6831)

beastoin
and
claude
committed
Add coverage for all 11 QoS callsites + _get_or_create_llm behavioral tests (#6831)
beastoin
committed
Add _get_or_create_llm behavioral tests for cache miss path (#6831)
beastoin
committed
Strengthen _get_or_create_llm tests: verify extra_body kwargs via constructor capture (#6831)
beastoin
committed
Rework Omi QoS to provider-agnostic Model QoS profiles (#6831)

beastoin
and
claude
committed
Update tests for provider-agnostic Model QoS profiles (#6831)

beastoin
and
claude
committed
Fix medium profile regression, cache poisoning, and provider guard (#6831)

beastoin
and
claude
committed
Wire persona.py through Model QoS get_llm() (#6831)

beastoin
and
claude
committed
Wire generate_2025.py through Model QoS get_llm('wrapped_analysis') (#6831)

beastoin
and
claude
committed
Wire perplexity_tools.py through Model QoS get_model('web_search') (#6831)

beastoin
and
claude
committed
Update QoS tests for medium profile fix and provider safety guard (#6831)

beastoin
and
claude
committed
Fix test_prompt_caching regex for renamed _get_or_create_openai_llm (#6831)

beastoin
and
claude
committed
Fix generate_persona_intro_message to use get_llm instead of llm_medium_experiment (#6831)

beastoin
and
claude
committed
Wire chat.py through Model QoS get_llm() (#6831)

beastoin
and
claude
committed
Wire goals.py through Model QoS get_llm() (#6831)

beastoin
and
claude
committed
Wire notifications.py through Model QoS get_llm('notifications') (#6831)

beastoin
and
claude
committed
Wire followup.py through Model QoS get_llm('followup') (#6831)

beastoin
and
claude
committed
Wire app_generator.py through Model QoS get_llm() (#6831)

beastoin
and
claude
committed
Wire trends.py through Model QoS get_llm('trends') (#6831)

beastoin
and
claude
committed
Wire onboarding.py through Model QoS get_llm('onboarding') (#6831)

beastoin
and
claude
committed
Simplify Model QoS to 2 profiles (premium/max) + add 7 new features

beastoin
and
claude
committed
Wire remaining conversation_processing.py callsites through QoS

beastoin
and
claude
committed
Wire memories.py learnings extractor through QoS

beastoin
and
claude
committed
Remove unused llm_mini import from knowledge_graph.py

beastoin
and
claude
committed
Wire proactive_notification.py through QoS system

beastoin
and
claude
committed
Wire external_integrations.py through QoS system

beastoin
and
claude
committed
Wire graph.py chat streaming through QoS system

beastoin
and
claude
committed
Wire chat session title generation through QoS get_llm('session_titles')

beastoin
and
claude
committed
Wire app integration prompt through QoS get_llm('app_integration')

beastoin
and
claude
committed
Wire app integration utility through QoS get_llm('app_integration')

beastoin
and
claude
committed
Update QoS tests for 2-profile system (premium/max) with 33 features

beastoin
and
claude
committed
Update callsite coverage tests for expanded QoS wiring (16 callsites)

beastoin
and
claude
committed
Split conv_apps into conv_app_result/conv_app_select for backward compat + add env override provider validation

beastoin
and
claude
committed
Use conv_app_result and conv_app_select features for backward-compatible model routing

beastoin
and
claude
committed
Add get_llm and parser stubs to prompt cache integration test

beastoin
and
claude
committed
Update QoS tests for conv_app_result/conv_app_select split

beastoin
and
claude
committed
Update callsite tests for conv_app_result/conv_app_select split

beastoin
and
claude
committed
Add hard provider validation in get_llm() — reject cross-provider env overrides

beastoin
and
claude
committed
Add tests for cross-provider env override rejection

beastoin
and
claude
committed
Add profile selection tests + expanded callsite coverage for all 17 wired files

beastoin
and
claude
committed
Strengthen callsite coverage: exhaustive feature key + count assertions for all 17 files

beastoin
and
claude
committed
Add goals_advice callsite assertion to complete coverage

beastoin
and
claude
committed
Optimize max profile: 10→5 model variants, eliminate OpenRouter, ~55-65% cost savings
beastoin
committed
Update QoS tests for optimized max profile and dynamic provider detection
beastoin
committed
Add override warning, runtime routing, and OpenRouter temperature tests
beastoin
committed
Fix temperature test to verify get_llm applies OpenRouter config

beastoin
and
claude
committed
Set premium profile to current production models

beastoin
and
claude
committed
Update tests for production model profiles

beastoin
and
claude
committed
Premium=cost-saving optimized, Max=quality upgrade to latest models

beastoin
and
claude
committed
Update tests for premium=optimized, max=quality-upgrade profiles

beastoin
and
claude
committed
Correct tier assignment: max=production+5.4, premium=cost-optimized

beastoin
and
claude
committed
Update tests for corrected tier assignment

beastoin
and
claude
committed
Add L1 integration test with real LLM API calls for all 34 QoS features

beastoin
and
claude
committed
Set premium as default profile, replace deprecated OpenRouter models

beastoin
and
claude
committed
Update unit tests for premium default and direct API persona models

beastoin
and
claude
committed
Update L1 integration test for premium profile (41/41 PASS)

beastoin
and
claude
committed

Footer

© 2026 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Community
Docs
Contact

You can’t perform that action at this time.