You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
- 🌐 **Multi-Scenario Coverage:** Extensive support for diverse domains including Agent, text, code, math, and multimodal tasks. 👉 [Explore Supported Scenarios](./docs/built_in_graders/overview.md)
93
-
- 🔄 **Holistic Agent Evaluation:** Beyond final outcomes, we assess the entire lifecycle—including trajectories, Memory, Reflection, and Tool Use. 👉 [Agent Lifecycle Evaluation](./docs/built_in_graders/agent_graders.md)
92
+
- 🌐 **Multi-Scenario Coverage:** Extensive support for diverse domains including Agent, text, code, math, and multimodal tasks. 👉 [Explore Supported Scenarios](https://modelscope.github.io/OpenJudge/built_in_graders/overview/)
93
+
- 🔄 **Holistic Agent Evaluation:** Beyond final outcomes, we assess the entire lifecycle—including trajectories, Memory, Reflection, and Tool Use. 👉 [Agent Lifecycle Evaluation](https://modelscope.github.io/OpenJudge/built_in_graders/agent_graders/)
94
94
- ✅ **Quality Assurance:** Every grader comes with benchmark datasets and pytest integration for validation. 👉 [View Benchmark Datasets](https://huggingface.co/datasets/agentscope-ai/OpenJudge)
95
95
96
96
97
97
### 🛠️ Flexible Grader Building Methods
98
98
Choose the build method that fits your requirements:
99
-
***Customization:** Easily extend or modify pre-defined graders to fit your specific needs. 👉 [Custom Grader Development Guide](./docs/building_graders/create_custom_graders.md)
100
-
***Data-Driven Rubrics:** Have a few examples but no clear rules? Use our tools to automatically generate white-box evaluation criteria (Rubrics) based on your data.👉 [Automatic Rubric Generation Tutorial](./docs/building_graders/generate_graders_from_data.md)
99
+
***Customization:** Easily extend or modify pre-defined graders to fit your specific needs. 👉 [Custom Grader Development Guide](https://modelscope.github.io/OpenJudge/building_graders/create_custom_graders/)
100
+
***Data-Driven Rubrics:** Have a few examples but no clear rules? Use our tools to automatically generate white-box evaluation criteria (Rubrics) based on your data.👉 [Automatic Rubric Generation Tutorial](https://modelscope.github.io/OpenJudge/building_graders/generate_graders_from_data/)
101
101
***Training Judge Models ( Coming Soon🚀):** For high-scale and specialized scenarios, we are developing the capability to train dedicated Judge models. Support for SFT, Bradley-Terry models, and Reinforcement Learning workflows is on the way to help you build high-performance, domain-specific graders.
102
102
103
103
@@ -122,7 +122,7 @@ We're actively building seamless connectors for mainstream observability platfor
122
122
pip install py-openjudge
123
123
```
124
124
125
-
> 💡 More installation methods can be found in the [Quickstart Guide](./docs/get_started/quickstart.md).
125
+
> 💡 More installation methods can be found in the [Quickstart Guide](https://modelscope.github.io/OpenJudge/get_started/quickstart/#installation).
126
126
127
127
---
128
128
@@ -156,7 +156,7 @@ if __name__ == "__main__":
156
156
asyncio.run(main())
157
157
```
158
158
159
-
> 📚 Complete Quickstart can be found in the [Quickstart Guide](./docs/get_started/quickstart.md).
159
+
> 📚 Complete Quickstart can be found in the [Quickstart Guide](https://modelscope.github.io/OpenJudge/get_started/quickstart/).
160
160
161
161
---
162
162
@@ -184,7 +184,7 @@ We love your input! We want to make contributing to OpenJudge as easy and transp
184
184
> **📝 Improving Docs** — Clearer explanations or better examples are always welcome
185
185
> **💡 Proposing Features** — Have ideas for new integrations? Let's discuss!
186
186
187
-
📖 See full [Contributing Guidelines](./docs/community/contributing.md) for coding standards and PR process.
187
+
📖 See full [Contributing Guidelines](https://modelscope.github.io/OpenJudge/community/contributing/) for coding standards and PR process.
188
188
189
189
---
190
190
@@ -204,7 +204,7 @@ pip install rm-gallery
204
204
205
205
We preserved the source code of **v0.1.7 (the latest v0.1.x release)** in the [`v0.1.7-legacy` branch](https://github.com/modelscope/OpenJudge/tree/v0.1.7-legacy).
206
206
207
-
-**Migrate to v0.2.0 (recommended)**: follow the **[Installation](#-installation)** section above, then walk through **[Quickstart](#-quickstart)** (or the full [Quickstart Guide](./docs/get_started/quickstart.md)) to update your imports / usage.
207
+
-**Migrate to v0.2.0 (recommended)**: follow the **[Installation](#-installation)** section above, then walk through **[Quickstart](#-quickstart)** (or the full [Quickstart Guide](https://modelscope.github.io/OpenJudge/get_started/quickstart/)) to update your imports / usage.
208
208
209
209
If you run into migration issues, please [open an issue](https://github.com/modelscope/OpenJudge/issues) with your minimal repro and current version.
0 commit comments