You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The "Verify proposed changes and document sync_models deviations" step
was hitting its 15-minute timeout mid-run (Claude still executing when
GitHub killed it), so the job failed and no bot-issue PR was created.
- Raise timeout-minutes 15 -> 30.
- Switch --model claude-opus-4-6 -> claude-sonnet-5 (faster).
- Trim the task (the turn/token sinks):
- step 4: focus on the field(s) that caused the bail instead of
exhaustively re-verifying every field of a complete spec.
- step 6: cross-check only the fields being added/changed against
sync_models, and look the model up directly instead of fetching +
scanning the whole multi-MB LiteLLM catalog.
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
1. Read the unsupported issue numbers file, then process each listed issue independently.
299
299
2. For each issue, read its initial result file and original issue body. Use the resolver message to identify exactly which field(s) caused the bail. Focus your research on those fields first.
300
300
3. Fetch the official source URLs already listed in the issue first. Search additional official provider docs or APIs only if the listed sources don't provide the missing field.
301
-
4. For each model in the issue, build the most complete verified spec you can, not just the missing field. Verify all fields that official sources support:
301
+
4. For each model in the issue, focus on the field(s) that caused the bail (identified in step 2). Fill in additional fields only when the official source you are already reading readily provides them — do not open extra sources or spend turns exhaustively re-verifying fields that are unlikely to be wrong. Fields to consider, bail field(s) first:
302
302
- `format`, `flavor`, `displayName`
303
303
- `parent` when official sources explicitly document a relationship to a stable base alias and that parent model id exists in `model_list.json` — patterns include: dated snapshot → stable alias (e.g. `claude-3-5-sonnet-20241022` → `claude-3-5-sonnet-latest`), `@NNN`/`-vN` versioned snapshots, location-scoped prefixes (`global.`, `us.`, `eu.`, `apac.`), and provider-documented tier variants (e.g. `:free`, `:nitro` on Together AI)
304
304
- `available_providers` and provider mapping
@@ -313,7 +313,7 @@ jobs:
313
313
- Always include `"global"` first if Google lists the model as available on the global endpoint, followed by per-region codes sorted alphabetically. Match the ordering used by existing vertex entries in `model_list.json`.
314
314
- If the model id is not listed on the Google docs page (e.g. preview-only or recently announced), check the model's product page or release notes for explicit region availability. If you still cannot find an official region list, omit `supported_regions` entirely and call this out in the `## Verification` section — do not invent regions.
315
315
- Do not copy `supported_regions` from sync_models; sync_models does not track Vertex regions accurately.
316
-
6. **Cross-check against sync_models**: Fetch the sync_models reference catalog at `https://raw.githubusercontent.com/BerriAI/litellm/refs/heads/main/litellm/model_prices_and_context_window_backup.json`. For each numeric field in your proposed spec (token limits, pricing), compare it against the sync_models value for the same model. In the `## Verification` section, for every field that differs from sync_models, you must:
316
+
6. **Cross-check against sync_models (only the fields you added or changed)**: For just the numeric field(s) you set or corrected in this fix — not the whole spec — compare against the sync_models value for the same model. Look the model up in the sync_models catalog (`https://raw.githubusercontent.com/BerriAI/litellm/refs/heads/main/litellm/model_prices_and_context_window_backup.json`) for those specific fields; do not scan or diff the entire file. In the `## Verification` section, for every changed field that differs from sync_models, you must:
317
317
- State the sync_models value explicitly
318
318
- State the official source URL that justifies the deviation
319
319
- Briefly explain why the official source should be preferred (e.g., sync_models lags, collapses aliases, or has an incorrect mapping)
0 commit comments