Scaling Verifiable Environments for Long-horizon Work Agents

LLM SFT Agent Agent Eval Benchmarks Autonomous Workflows
工作智能体需在数字工件上运行,以执行知识密集型的专业任务,因此需要能够支持长周期交互与可信验证的训练环境。然而,人工构建的环境工程开销巨大,严重制约了环境规模的扩展;而现有的合成方法又往往牺牲工作空间的复杂性、真实感或可追溯验证性。为弥合这一鸿沟,我们提出了 WorkForge——一种可扩展的合成框架,旨在基于真实世界资源构建具备可验证性的面向工作智能体的训练环境。该框架从专家工作流出发,首先识别出每一流程所依赖的资源、所需做出的决策以及最终产出的交付物;随后,自动检索相关的真实世界文件,并将其组织成结构化的工作空间。WorkForge 进一步对工作空间进行深度解析,从中提取关于其内容的具体、可检验的事实(factual anchors);这些事实锚点不仅确定了该工作空间所能支撑的任务类型,还明确定义了各类任务结果的验证方式。由此,WorkForge 直接依据这些事实锚点,自动生成每一项任务的指令说明、求解方案,以及配套的程序化验证器和语义验证器,确保所有验证过程均可回溯至工作空间中可观测、可证实的证据。此外,我们在 40 个专业领域内构建了共计 16,700 个可验证环境,其工作空间整体覆盖 60 种不同类型的文件。经该环境集训练后,Qwen3.5-35B-A3B-Base 模型在 GDPVal 指标上由 45.5 显著提升至 73.6,在 APEX Score 上亦由 5.0 大幅跃升至 21.3;同时,Qwen3.5-27B 模型亦展现出极具竞争力的性能,甚至超越多个强基线模型。我们的系统性分析充分验证了所提方法的有效性,并揭示出该方法在数据规模与交互周期两个维度上均表现出稳定且一致的可扩展性规律。
Work agents operate over digital artifacts to execute professional knowledge-intensive work, requiring training environments that support long-horizon interaction and trustworthy verification. However, hand-crafted environments incur prohibitive engineering overhead that prevents environment scaling, whereas synthesis methods sacrifice workspace complexity, realism, or grounded verifiability. To bridge this gap, we introduce WorkForge, a scalable synthesis framework for constructing verifiable work-agent environments from real-world resources. Starting from expert workflows, WorkForge first identifies the resources, decisions, and deliverables required by each workflow. It then retrieves relevant real-world files and organizes them into a workspace. WorkForge inspects the workspace to extract concrete, checkable facts about its content. These factual anchors fix which task types the workspace can support and how their outcomes can be verified. Therefore, WorkForge derives each task's instructions, solution plan, and complementary programmatic and semantic verifiers directly from these factual anchors, keeping verification traceable to observable workspace evidence. Furthermore, we construct 16.7K verifiable environments across 40 professional domains, with workspaces collectively covering 60 file types. Post-training Qwen3.5-35B-A3B-Base improves GDPVal from 45.5 to 73.6 and APEX Score from 5.0 to 21.3, while enabling Qwen3.5-27B to achieve highly competitive performance and outperform strong competitors. Our analyses confirm the efficacy of the proposed method and reveal consistent scaling behaviors across both data volume and interaction horizons.
许愿