Can ChatGPT or Other AI Support Research Assessment?

Can ChatGPT or Other AI Support Research Assessment?
 

Professor Mike Thelwall
Information School, University of Sheffield
 

July 3, 2024 (Wednesday)
12:45 – 14:00
Room 408-410, Meng Wah Complex, HKU
Chair: Professor Chenwei Zhang

Abstract:
Research assessment is a labour-intensive part of the job of most academics, including for peer reviewing journal submissions or evaluating the quality of research produced by job applicants. As a result of the enormous amount of expert time consumed by this activity, there have been calls to automate as much of it as possible using artificial intelligence (AI). This talk reports a large scale experiment to assess whether traditional machine learning techniques could assess the quality of published journal articles with an acceptable degree of accuracy at the article and departmental levels. It also reports a short investigation into whether ChatGPT can write plausible and accurate reviewer reports on academic papers.

About the speaker:
Mike Thelwall is a Professor of Data Science in the Information School at the University of Sheffield in the UK. He primarily investigates quantitative methods to support research evaluation, including artificial intelligence, citation analysis and altmetrics. Mike has also developed a wide range of software and methods for gathering and analysing social web data. His books include Web indicators for research evaluation: A practical guide. He is an associate editor of the Journal of the Association for Information Science and Technology and sits on five other editorial boards.  
https://www.sheffield.ac.uk/is/people/academic/mike-thelwall 
 

~ All are welcome ~
For enquiries, please contact the Office of Research, Faculty of Education at hkchow@hku.hk