Abstract. 

The paper tackles the problem of selecting candidates with expert knowledge in a particular field. We propose methods for assessing similarity based on citation graphs and topical similarity of documents retrieval methods to select experts. The paper also provides a methodology for assessing the accuracy of the proposed methods and the results of experiments that were carried out on a dataset of grant applications from the Russian Foundation for Basic Research. The experimental results show that the classical methods of citation graph comparison and deep learning provide similar results. In addition, similar document retrieval methods have higher accuracy in selecting experts than citation-based methods. The proposed methods can be used not only for selecting experts for the evaluation of  grant applications of scientific foundations but also for the assignment of reviewers for the analysis of any objects with text and citations. 

Keywords: 

expert selection, graph analysis, SimRank, DeepWalk, topically similar document retrieval 

PP. 51-60.

DOI 10.14357/20718632210405 

 

References

1. Kalmukov Y., Rachev B. 2010. Comparative analysis of existing methods and algorithms for automatic assignment of reviewers to papers. ArXiv preprint arXiv:1012.2019.

2. Rodriguez, M.A., Bollen, J.. 2008. An algorithm to determine peer-reviewers. In: Proceedings of the 17th ACM conference on Information and knowledge management, 319–328. ACM.

3. Li, X., Watanabe, T. 2013. Automatic paper-to-reviewer assignment, based on the matching degree of the reviewers. Procedia Comput. Sci. 22, 633–642.

4. Peng, H., Hu, H., Wang, K., Wang, X. 2017. Time-aware and topic-based reviewer assignment. In: Bao, Z., Trajcevski, G., Chang, L., Hua, W. (eds.) DASFAA 2017. LNCS, vol. 10179, pp. 145–157. Springer, Cham.

5. Li, Lina, Cuiping Li, Hong Chen, and Xiaoyong Du. 2013. “Mapreduce-Based SimRank Computation and Its Application in Social Recommender System.” In Big Data (Bigdata Congress), 2013 IEEE International Congress on, 133–40. IEEE.

6. Li, Pei, Zhixu Li, Hongyan Liu, Jun He, and Xiaoyong Du. 2009. “Using Link-Based Content Analysis to Measure Document Similarity Effectively.” In Advances in Data and Web Management, 455–67. Springer.

7. Williams, Kyle, Jian Wu, and C Lee Giles. 2014. “SimSeerX: A Similar Document Search Engine.” In Proceedings of the 2014 Acm Symposium on Document Engineering, 143–46. ACM.

8. Akcora, Cuneyt Gurcan, Barbara Carminati, and Elena Ferrari. 2013. “User Similarities on Social Networks.” Social Network Analysis and Mining 3 (3). Springer: 475–95.

9. Putra, Aghny Arisya, Rahmad Mahendra, Indra Budi, and Qorib Munajat. 2017. “Two-Steps Graph-Based Collaborative Filtering Using User and Item Similarities: Case Study of E-Commerce Recommender Systems.” In 2017 International Conference on Data and Software Engineering (Icodse), 1–6. IEEE.

10. Jeh, Glen, and Jennifer Widom. 2002. “SimRank: A Measure of Structural-Context Similarity.” In Proceedings of the Eighth Acm Sigkdd International Conference on Knowledge Discovery and Data Mining, 538–43. KDD ’02. New York, NY, USA: ACM.

11. Perozzi B., Al-Rfou R., Skiena S. 2014. Deepwalk: Online learning of social representations. Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining. 701–710.

12. Oseledets, Ivan, Ovchinnikov George, and Katrutsa Alexandr. 2017. “Fast, Memory-Efficient Low-Rank Approximation of Simrank.” Journal of Complex Networks 5 (1). Oxford University Press: 111–26.

13. Halko N., Martinsson P. G., Tropp J. A. 2011. Finding structure with randomness: Probabilistic algorithms for constructing approximate matrix decompositions. SIAM review. Vol. 53(2). 217-288.

14. Sochenkov, Ilya Vladimirovich, Denis Vladimirovich Zubarev, and Ilya Alexandrovich Tikhomirov. 2018. “Exploratory Patent Search.” Computer Science and Its Applications 12 (1). Russian Academy of Sciences, Department of Nanotechnology; Information Technologies: 89–94.

15. Osipov, G., et al. 2013. Relational-situational method for intelligent search and analysis of scientific publications. In: Proceedings of the Integrating IR Technologies for Professional Search Workshop, 57–64.

16. Shelmanov, A.O., Smirnov, I.V. 2014. Methods for semantic role labeling of Russian texts. In: Proceedings of International Conference Dialog on Computational Linguistics and Intellectual Technologies, vol. 13, no. 20, pp. 607–620.

17. Shvets, A., Devyatkin, D., Sochenkov, I., Tikhomirov, I., Popov, K., Yarygin, K. 2015. Detection of current research directions based on full-text clustering. In: 2015 Science and Information Conference (SAI), pp. 483–488. IEEE.