中国科技期刊研究 ›› 2022, Vol. 33 ›› Issue (1): 113-121. doi: 10.11946/cjstp.202109100717

• 评论与分析 • 上一篇    下一篇

开放同行评议视角下学术论文同行评议得分与被引频次的关系

谢维熙(), 张光耀, 王贤文*()   

  1. 大连理工大学科学学与科技管理研究所暨WISE实验室,辽宁省大连市甘井子区凌工路2号 116024
  • 收稿日期:2021-09-10 修回日期:2021-11-09 出版日期:2022-01-15 发布日期:2022-01-15
  • 通讯作者: 王贤文 E-mail:wrsjcycdfdsnt@163.com;xianwenwang@dlut.edu.cn
  • 作者简介:谢维熙(ORCID:0000-0003-2330-7980),硕士研究生,E-mail: wrsjcycdfdsnt@163.com;|张光耀,博士研究生。
  • 基金资助:
    国家自然科学基金面上项目“地理与网络二维空间及其交互影响视角下的科学论文扩散研究”(71673038);国家自然科学基金面上项目“科学文献全景大数据下的研究热点及研究前沿探测”(71974029)

Relationship between peer review score and cited frequency of conference papers under the background of open peer review

XIE Weixi(), ZHANG Guangyao, WANG Xianwen*()   

  1. WISE Lab, Institute of Science of Science and S&T Management, Dalian University of Technology, 2 Linggong Road, Ganjingzi District, Dalian 116024, China
  • Received:2021-09-10 Revised:2021-11-09 Online:2022-01-15 Published:2022-01-15
  • Contact: WANG Xianwen E-mail:wrsjcycdfdsnt@163.com;xianwenwang@dlut.edu.cn

摘要:

【目的】 在开放同行评议的大背景下,探讨会议论文同行评议得分与其被引频次的关系,从而分析同行评议结果与传统文献计量指标在科研评价中的关系,为完善科研评价体系提供一定的参考。【方法】 基于OpenReview平台提供的ICLR会议论文的公开评审数据,将全部论文划分为口头报告、海报展示和拒收论文三类,运用文献计量和统计分析方法探究论文的同行评议得分与被引频次之间的关系。【结果】 三类论文在评审得分和被引频次方面均存在显著差异,同行评议得分与被引频次存在较显著的正相关性。【结论】 同行评议与传统文献计量指标在科研评价方面的一致性较高,但并非相互替代的关系,文献计量指标应是对同行评议的重要补充。科研评价体系应该是建立在定性同行评议的质量评价基础上,融合定量文献计量指标,形成一种主客观相结合的融合评价模式。

关键词: 论文评分, OpenReview, 被引频次, 开放同行评议

Abstract:

[Purposes] Under the background of open peer review, this paper discusses the relationship between the peer review score of conference papers and their cited frequency, and further analyzes the relationship between peer review results and traditional bibliometric indicators in scientific research evaluation, which is expected to provide a reference for improving scientific research evaluation system. [Methods] The public review data of International Conference on Learning Representations (ICLR) papers were retrieved from OpenReview, and the papers were classified into oral reports, poster presentations, and rejected papers. Then, bibliometric method and statistical method were employed to explore the relationship between the peer review score and cited frequency. [Findings] Both the review score and cited frequency were significantly different among the three types of papers, and the review score was highly correlated with cited frequency. [Conclusions] Peer review and traditional bibliometric indicators have high consistency in scientific research evaluation, but they are not substitutes for each other. Bibliometric indicators supplement peer review. Scientific research evaluation system should be based on the quality evaluation of qualitative peer review and integrate quantitative bibliometric indicators, thereby combining both subjective and objective assessment.

Key words: Paper scoring, OpenReview, Cited frequency, Open peer review