中国科技期刊研究 ›› 2026, Vol. 37 ›› Issue (2): 193-200. doi: 10.11946/cjstp.202509241148

AIGC规制问题 上一篇    下一篇

大语言模型辅助中文期刊同行评审的实践路径探索

刘雪梅1,2)()(), 曾元祥2), 雷芳1), 董敏1), 杨竣铎1), 杜亮1),*()(), 刘伦旭3)   

  1. 1)四川大学华西临床医学院(华西医院)华西期刊社,四川省成都市武侯区国学巷37号 610041
    2)四川大学文学与新闻学院(出版学院),四川省成都市双流区川大路二段文科楼1区 610207
    3)四川大学华西临床医学院(华西医院)胸外科,四川省成都市武侯区国学巷37号 610041
  • 收稿日期:2025-09-24 修回日期:2025-11-05 出版日期:2026-02-25 发布日期:2026-04-01
  • 通讯作者: 杜亮
  • 作者简介:

    刘雪梅(ORCID:0000-0003-1234-1470),博士,编审,硕士研究生导师,E-mail:

    曾元祥,博士,副教授

    雷 芳,博士,编辑

    董 敏,硕士,编辑

    杨竣铎,硕士,助理工程师

    刘伦旭,博士,主任医师。

    刘雪梅:提出研究设想、撰写初稿并定稿; 曾元祥:修改论文大纲及语言表达; 雷 芳,董 敏:收集资料、修改论文; 杨竣铎:具体实施大语言模型本地私有化应用部署,修改论文; 杜 亮,刘伦旭:提出研究设想,修改论文。
  • 基金资助:
    四川大学出版学院共建“中国特色出版学研究”培育项目(GJCB202504)

Exploring practical pathways for large language model-assisted peer review in Chinese journals

LIU Xuemei1,2)()(), ZENG Yuanxiang2), LEI Fang1), DONG Min1), YANG Junduo1), DU Liang1)()(), LIU Lunxu3)   

  1. 1)West China Medical Journal Press,West China School of Medicine(West China Hospital),Sichuan University,37 GuoxueRoad,Wuhou District,Chengdu 610041,China
    2)School of Literature and Journalism (School of Publishing),Sichuan University,Area 1,Wenke Building,Section 2,Chuanda Road,Shuangliu District,Chengdu 610207,China
    3)Department of Thoracic Surgery,West China School of Medicine(West China Hospital),Sichuan University,37 GuoxueRoad,Wuhou District,Chengdu 610041,China
  • Received:2025-09-24 Revised:2025-11-05 Online:2026-02-25 Published:2026-04-01
  • Contact: DU Liang

摘要:

目的 探索中文期刊利用大语言模型(LLM)辅助同行评审的实践路径。 方法 检索Web of Science、Scopus、中国知网、万方数据库、预印本平台收集文献,总结LLM审稿可行性证据。综合权衡利弊后决定租用“移动云”虚拟服务器完成本地私有化部署LLM。采用本地私有化DeepSeek-r1回顾性评审10篇综述(5篇发表+5篇退稿),重复5次,与专家审稿结果进行对比。 结果 文献证据显示,LLM检查错误、遵循指南的能力与专家的能力相当,甚至更优,但其应用存在幻觉现象、数据安全与隐私泄露风险、透明性与可解释性不足等问题。中文期刊实践LLM同行评审路径包括本地私有化部署模型、构建个性化模型、探索模型工作规律、规范模型使用方法、规避伦理风险。本地私有化部署DeepSeek-r1对10篇综述的评审结论为小修或大修后发表,未提出拒绝结论,且稳定性不佳,批判性意见侧重于规范与方法;而专家侧重于临床诊疗细节。 结论 华西期刊社本地私有化部署同行评审模型实践路径切实可行,后续应从技术和伦理规范角度提升效能、降低风险。

关键词: 大语言模型, 同行评审, 私有化部署, 实践路径

Abstract:

Purposes To explore the potential of large language models (LLMs) in assisting peer review and to establish a pathway for their localized private deployment. Methods We conducted literature searches in Web of Science, Scopus, CNKI, Wanfang Data, and preprint platforms to combine evidence on the feasibility of using LLMs for manuscript review. After weighing the advantages and disadvantages, we decided to rent a virtual server from "Mobile Cloud" to achieve local and privatized deployment of an LLM. Using the locally deployed DeepSeek-R1 model, we performed a retrospective review of 10 review articles (5 published papers and 5 rejected papers), repeating the process five times for each manuscript, and compared the results with human reviews. Findings Literature evidence indicates that LLMs possess capabilities in error checking and guideline adherence comparable to humans; however, risks such as hallucinations, data security and privacy leakage, and insufficient transparency and explainability persist. The proposed pathway for Chinese journals to implement LLM-assisted peer review includes: local privatized model deployment, building personalized models, exploring model operational patterns, standardizing usage protocols, and mitigating ethical risks. The locally deployed DeepSeek-R1 recommended “accept after minor/major revision” for all 10 reviews, with no rejections, but exhibited poor stability across repeated trials. Its critical feedback focused primarily on formal and methodological aspects, whereas human reviewers emphasized clinical and diagnostic details. Conclusions The local privatized deployment of a peer review model at West China Journal Press proves to be a feasible practice. Future efforts should focus on enhancing efficacy and reducing risks through technological improvements and ethical-standard development.

Key words: Large language models, Peer review, Private model deployment, Practical pathway