Abstract:

［Purposes］ The social impact of scientific papers involves multiple dimensions such as politics, economy, culture, and society. The aim is to establish a social impact evaluation system of scientific papers suitable for China's technology, society, and communication environment, which can provide a reference for the comprehensive evaluation of papers in scientific journals. ［Methods］ Referring to the Altmetrics concept, based on the understanding of the social impact of scientific papers, and combined with the characteristics of agricultural science papers, we invited 38 agricultural scholars and journal editors, and used the analytic hierarchy process to determine the weights of scientific papers in four dimensions, namely politics, economy, culture, and social communication and evaluation. These dimensions covered ten aspects including policy reference, achievement innovation (patents/standards/guidelines), scientific achievement appraisal, economic contribution, academic conferences, science popularization activities, authoritative news media reports, academic dissemination, social media dissemination, and social rewards, along with a total of 31 indicators. Thus, we preliminarily constructed an evaluation system for the social impact of agricultural science papers. Using this evaluation system, we evaluated the social impact of 284?scientific papers in the field of wheat breeding in agriculture by two authors with a G-index higher than 40. ［Findings］ The weights of indicators such as WeChat video account forwarding volume, database download volume, number of mentions in policy documents, WeChat likes, and national news media reports are relatively high. There are significant differences in the social impact among different papers. Among the 284 agricultural science papers, the highest social impact index is 561.3099, the lowest is 0.0591, and the average is 71.1597. The indicators in the social communication and evaluation dimension have relatively large values. The social impact index of the Chinese papers of the two authors is higher than that of their English papers. There is a certain positive correlation between social impact evaluation and traditional cited frequency, but there are also significant changes in ranking. ［Conclusions］ The studied agricultural science papers with high rankings in social impact indicators exhibit excellent performance in cultural exchange and academic and social communication. This evaluation system serves as a powerful supplement to the evaluation of academic impact and offers a reference for establishing a comprehensive scientific paper evaluation system.

Key words: Agricultural science paper, Social impact, Evaluation, Altmetrics

摘要：

【目的】科技论文的社会影响涉及政治、经济、文化和社会等维度。建立适用于我国科技、社会与传播环境的科技论文社会影响力评价体系，为科技期刊论文的全面评价提供参考。【方法】借鉴Altmetrics思想，基于对科技论文社会影响力的理解，结合农业科技论文的特点，邀请38位农业学者、期刊编辑，用层次分析法确定政治、经济、文化、社会传播与评价等4个维度，政策参考、成果创新（专利/标准/指南）、科技成果鉴定、经济贡献、学术会议、科普活动、权威新闻媒体报道、学术传播、社交媒体传播、社会奖励等10个层面的31个指标的权重，初步构建农业科技论文社会影响力评价体系。利用该评价体系，对2位G指数高于40作者的284篇农业领域小麦育种方向科技论文的社会影响力进行评价。【结果】微信视频号转发量、数据库下载量、政策文件提及、微信点赞量、国家级新闻媒体报道等指标的权重较高。不同论文的社会影响力存在显著差异，所研究论文中，社会影响力指数最高为561.3099，最低为0.0591，平均为71.1597，其中社会传播与评价维度指标数值较大。2位作者的中文论文社会影响力指数高于其英文论文的。社会影响力评价与传统被引频次存在一定正相关关系，但也存在位次上的显著变化。【结论】所研究的农业科技论文中，社会影响力指标排名高的论文在文化交流、学术与社会传播上表现优异。该评价体系是论文学术影响力评价的有力补充，为建立全面的科技论文评价体系提供参考。

关键词: 农业科技论文, 社会影响力, 评价, 替代计量学