Skip to content

Fix ONNX CPU Spiking, Padding Infinite Loops & UI Guide - #289

Open
Casezy wants to merge 2 commits into
ramjke:masterfrom
Casezy:master
Open

Fix ONNX CPU Spiking, Padding Infinite Loops & UI Guide#289
Casezy wants to merge 2 commits into
ramjke:masterfrom
Casezy:master

Conversation

@Casezy

@Casezy Casezy commented Jun 15, 2026 •
edited
Loading

Copy link
Copy Markdown

This PR introduces massive stability, optimization, and feature additions for offline translation, AI translation, and UI improvements over several version iterations (v1.3 - v1.5).

?? Version 1.5 Updates: ONNX & CPU Optimizations

  1. ONNX Language Setup Guide: Added a built-in UI guide to help users install new language models.
  2. ONNX CPU Spiking Resolved: Forced IntraOpNumThreads=1 and InterOpNumThreads=1 to run ONNX on a single thread, greatly reducing CPU usage.
  3. Infinite Loop & Garbage Text Fix: Suppressed the pad token (54795) to prevent infinite decode loops in Greedy Search.
  4. Language Switch Detection: Properly dispose ONNX model sessions when switching language pairs.
  5. Resilient Model Downloads: Improved the model downloader by using .tmp files and atomic renaming to prevent corrupted models.

?? Version 1.4 Updates: New Translation Engines

  1. NVIDIA NIM Integration: Added support for NVIDIA NIM (NVIDIA Inference Microservices) as a translation engine.
  2. NVIDIA Riva Support: Integrated NVIDIA Riva for advanced AI-driven workflows.
  3. ONNX Offline Translation (Opus-MT): Integrated completely offline translation capabilities using ONNX CPU execution for HuggingFace opus-mt models, including an on-the-fly JSON patcher for Rust tokenizer incompatibilities.
  4. Configuration Save Crash: Fixed a major bug that caused the application to Force Close when exiting due to an unimplemented GetHashCode() in GamepadHotKeyInfo.cs.

?? Version 1.3 Updates: AI & UI Improvements

  1. AI Translator Integration: Added support for translating via Advanced AI Models (Gemini, OpenRouter, DeepSeek, ChatGPT/OpenAI compatible APIs).
  2. Local LibreTranslate Support: Fully integrated a completely offline, local LibreTranslate server support with an automatic lifecycle manager.
  3. Clear Chat Hotkey (ALT+C): A newly implemented global hotkey to instantly clear the chat bubble/translation screen.
  4. Proxy Error Fixes: Resolved persistent proxy errors that blocked connections to translators.
  5. UI & Stability: Restored Anti Double-Click on the "Run LibreTranslate" button and removed the highly unstable experimental Dark Theme.

Chaobs referenced this pull request in Chaobs/Translumo-LLM Jul 22, 2026
Chaob
fix(upstream): 合并上游 PR #290 拼写修复与 PR #295 Yandex SID 修复
8d78678 
- PR #290 拼写/标识符修正(纯 OCR/TTS/DeepL/HotKey/屏幕捕获子系统, 不影响 LLM 特性):
  * InstallOcrLanguageCapability / InstallTTSLanguageCapability 方法重命名(同步更新
    StagesFactory 两处调用)
  * exactMatching / targetLanguage / previousValue / _showSelectionAreaGamepadKey /
    _initialized 标识符更正
  * 注释拼写: parameters / constructor / SuppressFinalize
- PR #295 Yandex 翻译器修复(修复 SID 提取失败导致浏览器窗口反复弹出的问题):
  * RegexStorage.YandexSidRegex 改为小写 sid: 且加 RegexOptions.IgnoreCase(兼容大写)
  * YandexReaderProxy.ExtractSid 移除错误的分段反转逻辑, 直接返回匹配值
- PR #289 经核实其实际 diff 仅含 README + 新增二进制(ONNX离线/NVIDIA/LibreTranslate
  等新增功能, 本项目无 ONNX 离线特性), 且无 C# bug 修复代码, 故不适用, 未合并
- 构建 0 错误; Yandex SID 提取已用 .NET 正则实测验证(旧正则对小写 sid 失败,
  新正则成功且向后兼容大写 SID)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@Casezy