Chinese Journal of Scientific and Technical Periodicals ›› 2026, Vol. 37 ›› Issue (1): 14-23. doi: 10.11946/cjstp.202512151569

Previous Articles     Next Articles

Explainable reviewer recommendation method for editorial decision support based on integration of large language model(LLM) and retrieval‑augmented generation(RAG)

HU Jinyu1()(), WANG Han1, ZHANG Ying2), ZHANG Qing1,*()()   

  1. 1)Zhejiang Lab,2880 West Wenyi Road,Yuhang District,Hangzhou 311100,China
    2)Zhejiang Gongshang University, 18 Xuezheng Street,Baiyang Subdistrict,Qiantang District Hangzhou 310018,China
  • Received:2025-12-15 Revised:2026-01-22 Online:2026-01-25 Published:2026-03-09
  • Contact: ZHANG Qing

基于大语言模型(LLM)与检索增强生成(RAG)融合机制的面向编辑辅助决策的可解释审稿人推荐方法

胡瑾瑜1()(), 王涵1, 张颖2), 张晴1,*()()   

  1. 1)之江实验室,浙江省杭州市余杭区文一西路2880号 311100
    2)浙江工商大学,浙江省杭州市钱塘区白杨街道学正街18号 310018
  • 通讯作者: 张晴
  • 作者简介:

    胡瑾瑜(ORCID: 0000-0003-2562-7304),博士,编辑,E-mail:

    王 涵,硕士研究生;

    张 颖,博士,教授。

    作者贡献声明: 胡瑾瑜:负责提出研究基本框架,设计并实施研究过程(包括开展实验与对比分析),完成论文的初稿撰写与修订工作,参与调查问卷的设计与执行; 王 涵:承担研究数据的采集与清洗,负责后台数据库的搭建,完成核心系统的开发工作; 张 颖:参与论文的修订与优化,提供研究过程中的指导建议; 张 晴:确定研究方向与论文框架,负责实验数据的分析与解释,参与论文的修订工作。

Abstract:

Purposes To address the limitations of existing reviewer recommendation methods in semantic matching accuracy and explainability, this paper designs and implements an intelligent reviewer recommendation system (IRRS) integrating a large language model (LLM) with retrieval-augmented generation (RAG). Methods Using papers published in 2025 in Intelligent Computing as the evaluation dataset, this study constructs an external knowledge base derived from Web of Science literature in computer science and related interdisciplinary fields and develops a dual-layer prompt framework to guide a large language model in generating candidate reviewers with high thematic alignment to the target manuscript. Findings The case-based comparison and evaluator assessments indicate that the proposed system outperforms the Scopus recommendation results in terms of thematic alignment and demonstrates strong explainability in its recommendation rationales. Conclusions The proposed LLM-RAG-based reviewer recommendation framework improves semantic matching and enhances the explainability of recommendation results. By integrating an external knowledge base with a dual-layer prompt design, the framework enables a flexible and scalable recommendation process without requiring modifications to the underlying model architecture. These findings suggest a practical pathway for incorporating large language models into scientific journal peer-review workflows.

Key words: Reviewer recommendation, Large language model, Retrieval-augmented generation, Semantic matching, Explainability, Editorial decision support

摘要:

目的 针对现有审稿人推荐方法在语义匹配精度与结果可解释性方面的不足,设计并实现了一种融合大语言模型(large language model, LLM)与检索增强生成(retrieval-augmented generation, RAG)的审稿人推荐系统(intelligent reviewer recommendation system, IRRS)。 方法 选取Intelligent Computing期刊2025年度已发表论文作为研究样本,构建基于计算机科学及相关交叉领域 WoS(Web of Science)文献的外部知识库,并设计双层提示词框架,引导LLM生成与稿件主题高度匹配的候选审稿人。 结果 案例对比与评审员评估结果表明,系统在主题契合度方面优于 Scopus推荐结果,并在推荐理由可解释性方面表现良好。 结论 基于LLM 与 RAG 融合框架构建的审稿人推荐方法在语义匹配精度与推荐结果可解释性方面均取得积极效果。该框架在不改变底层模型结构的前提下,通过外部知识库与提示词策略的协同设计,实现了可扩展、可配置的推荐机制,为大语言模型在科技期刊审稿人推荐场景中的应用提供了实现路径与方法参考。

关键词: 审稿人推荐, 大语言模型, 检索增强生成, 语义匹配, 可解释性, 编辑决策支持