You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
-**Verified performance**: Achieved 71.47% on WebWalkerQA and 72.8% on GAIA (text-only subset), using purely `DeepSeek-V3` series models (without Claude or GPT).
24
+
-**Verified performance**: Achieved 71.47% on WebWalkerQA and 72.8% on GAIA (text-only subset), using purely `DeepSeek-V3` series models (without Claude or GPT), establishing a strong open-source starting point.
24
25
-**Open-source friendly & cost-aware**: Optimized for accessible, low-cost deployment without reliance on closed models.
25
-
-**Practical use cases**: Out-of-the-box support for tasks like CSV analysis, literature review, personal file organization, and podcast and video generation.
26
-
-**Flexible architecture**: Built on [openai-agents](https://github.com/openai/openai-agents-python), compatible with both `responses` and `chat.completions`APIs, supporting`DeepSeek`and`gpt-oss` models.
26
+
-**Practical use cases**: Out-of-the-box support for tasks like CSV analysis, literature review, personal file organization, and podcast and video generation (coming soon).
27
+
-**Flexible architecture**: Built on [openai-agents](https://github.com/openai/openai-agents-python), with extensible support for diverse model APIs (form`DeepSeek`to`gpt-oss`), tool integrations, and framework implementations.
27
28
-**Automation & simplicity**: YAML-based configs, auto agent generation, and streamlined setup reduce manual overhead.
28
29
29
30
## 🌟 Benchmark Performance
30
31
31
32
`Youtu-agent` is built on open-source models and lightweight tools, demonstrating strong results on challenging deep search and tool use benchmarks.
32
33
33
34
-**[WebWalkerQA](https://huggingface.co/datasets/callanwu/WebWalkerQA)**: Achieved 60.71% accuracy with `DeepSeek-V3-0324`, using new released `DeepSeek-V3.1` can further improve to 71.47%, setting a new SOTA performance.
34
-
-**[GAIA](https://gaia-benchmark-leaderboard.hf.space/)**: Achieved 72.8% accuracy on the text-only validation subset using `DeepSeek-V3-0324` (including models used within tools). We are actively extending evaluation to the full GAIA benchmark with multimodal tools, and conducting cross-framework experiments to ensure fair comparison, and will release the related code and data in the near future.
35
+
-**[GAIA](https://gaia-benchmark-leaderboard.hf.space/)**: Achieved 72.8% accuracy on the [text-only validation subset](https://github.com/sunnynexus/WebThinker/blob/main/data/GAIA/dev.json) using `DeepSeek-V3-0324` (including models used within tools). We are actively extending evaluation to the full GAIA benchmark with multimodal tools, and will release the trajectories in the near future. Stay tuned! ✨
@@ -70,6 +71,23 @@ Click on the images to view detailed videos.
70
71
</tr>
71
72
</table>
72
73
74
+
### 🤖 Automatic Agent Generation
75
+
76
+
A standout feature of `Youtu-agent` is its ability to **automatically generate agent configurations**. In other frameworks, defining a task-specific agent often requires writing code or carefully crafting prompts. In contrast, `Youtu-agent` uses simple YAML-based configs, which enables streamlined automation: a built-in "meta-agent" chats with you to capture requirements, then generates and saves the config automatically.
77
+
78
+
```bash
79
+
# Interactively clarify your requirements and auto-generate a config
For more detailed examples and advanced use-cases, please refer to the [`examples`](./examples) directory and our comprehensive documentation at [`docs/examples.md`](./docs/examples.md).
74
92
75
93
@@ -86,7 +104,7 @@ For more detailed examples and advanced use-cases, please refer to the [`example
86
104
### Core Features
87
105
-**Built on openai-agents**: Leveraging the foundation of [openai-agents](https://github.com/openai/openai-agents-python) SDK, our framework inherits streaming, tracing, and agent-loop capabilities, ensuring compatibility with both `responses` and `chat.completions` APIs for seamless adaptation to diverse models like [gpt-oss](https://github.com/openai/gpt-oss).
88
106
-**Fully asynchronous**: Enables high-performance and efficient execution, especially beneficial for evaluating benchmarks.
89
-
-**Tracing & analysis system**: Beyond OTEL, our `DBTracingProcessor` system provides in-depth analysis of tool calls and agent trajectories.
107
+
-**Tracing & analysis system**: Beyond OTEL, our `DBTracingProcessor` system provides in-depth analysis of tool calls and agent trajectories. (will be released soon)
90
108
91
109
### Automation
92
110
-**YAML based configuration**: Structured and easily manageable agent configurations.
@@ -105,7 +123,7 @@ For more detailed examples and advanced use-cases, please refer to the [`example
105
123
106
124
### For Agents Researchers & LLM Trainers
107
125
- A **simple yet powerful baseline** that is stronger than basic ReAct, serving as an excellent starting point for model training and ablation studies.
108
-
-**Built-in support for common benchmarks** and one-click evaluation scripts to streamline the experimental process.
126
+
-**One-click evaluation scripts** to streamline the experimental process and ensure consistent benchmarking.
109
127
110
128
### For Agent Application Developers
111
129
- A **proven and portable scaffolding** for building real-world agent applications.
@@ -125,6 +143,8 @@ For more detailed examples and advanced use-cases, please refer to the [`example
125
143
-**ContextManager**: A configurable module for managing the agent's context window.
126
144
-**Benchmark**: An encapsulated workflow for a specific dataset, including preprocessing, rollout, and judging logic.
127
145
146
+
For more design and implementation details, please refer to our [technical documentation](https://tencent.github.io/Youtu-agent/).
147
+
128
148
## 🚀 Getting Started
129
149
130
150
First, ensure you have completed the initial setup (clone repo, install dependencies).
0 commit comments