Discussions

• 2 You must be logged in to vote

  💡

  Standardize a Protocol for Prefill/Decode Disaggregated Serving

  yangligt2 started Sep 25, 2025 in Ideas

  

  

  

  

  5
• 2 You must be logged in to vote

  💡

  Model Redirect and Traffic Splitting within an Inference Pool

  zetxqx started Oct 9, 2025 in Ideas

  

  

  1
• 1 You must be logged in to vote

  💡

  Release cadence post-v1.0.0

  kfswain started Aug 28, 2025 in Ideas

  

  

  1
• 2 You must be logged in to vote

  💬

  How should implementations handle backendRef.TargetPort

  robscott started Jun 4, 2025 in General

  

  

  

  

  6
• 1 You must be logged in to vote

  💡

  Consider backend augmentation vs new backend type

  howardjohn started Mar 17, 2025 in Ideas

  

  

  

  

  11
• 1 You must be logged in to vote

  💬

  InferenceModel CRD - using the .metadata.name field instead of having .spec.modelName field

  nirrozenbaum started May 25, 2025 in General

  

  

  1
• 1 You must be logged in to vote

  💡

  EPP Multi-tenancy

  sriumcp started Apr 22, 2025 in Ideas

  

  

  7
• 2 You must be logged in to vote

  💡

  Effective Model Server State Probing in EPP

  liu-cong started Apr 10, 2025 in Ideas

  

  

  1
• 4 You must be logged in to vote

  💡

  Handling P/D disagg serving

  kfswain started Mar 28, 2025 in Ideas

  

  

  1
• 2 You must be logged in to vote

  💬

  Criticality Discussion/ Improvements

  kfswain started Jan 21, 2025 in General

  

  

  

  

  6
• 1 You must be logged in to vote

  📣

  v0.2.0

  kfswain announced Mar 13, 2025 in Announcements

  

  

  0
• 1 You must be logged in to vote

  📣

  v0.2.0-rc

  kfswain announced Mar 6, 2025 in Announcements

  

  

  0
• 1 You must be logged in to vote

  💡

  make "model" attribute name configurable in request body

  xzhaosg started Feb 27, 2025 in Ideas

  

  

  0
• 3 You must be logged in to vote

  📣

  v0.1.0

  kfswain announced Feb 6, 2025 in Announcements

  

  

  0
• 2 You must be logged in to vote

  💡

  Follow Conventional Commits for Commit Messages

  danehans started Feb 6, 2025 in Ideas

  

  

  0
• 2 You must be logged in to vote

  💬

  Large scale LoRA serving

  joerunde started Jan 30, 2025 in General

  

  

  1
• 2 You must be logged in to vote

  📣

  Welcome to gateway-api-inference-extension Discussions!

  kfswain announced Jan 30, 2025 in Announcements

  

  

  0