Research Funding as a Complex System: Can AI Predict What Peer Reviewers Will Flag as Weaknesses in Grant Applications?

We consider the peer-review process as a complex system that appears to defy predictive modelling. Noisy and inconsistent reviewer judgments create a well-documented “black box” problem for applicants, as wide variability in human evaluation makes it difficult for researchers to preemptively identify the weaknesses—both real and perceived—that might reduce an application’s competitiveness. Assuming that the peer review process to be a highly permeable, abstruse and unpredictable system, we explore the potential efficacy of intervention strategies. We investigate the potential of leveraging LLMs to “simulate” potential reviewer critiques and hypothesize that exposing applicants to a comprehensive analysis of potential application critiques ahead of submission might mitigate some of the effects of weak inter-rater reliability.

Monday, March 17th, 2025, 3 – 4:30 p.m. ET | University of Waterloo | DC 1302 (or virtual)

https://uwaterloo.ca/complexity-innovation/events/wici-speaker-series-research-funding-complex-system

Western Complex Systems Conference 2024

Western Complex Systems Conference 2024 explores the application of complexity theory and systems thinking across disciplines. Over vast diversity in academic fields, methodologies, and domain expertise, our common thread is curiosity about the ways that nonlinear dynamics and systemic thinking invite us to understand and respond to our world.

  • Thursday, March 28, 2024, 9:00 AM  – 12:30 PM ESTAttend in-person at Arthur and Sonia Labatt Health Sciences Building (1151 Huron Dr), Room 232, Western University (Canada)Attend virtually via Zoom WebinarHosted by the Complex Adaptive Systems (CAS) Lab at Western UniversityQuestions? Contact planning team at wcsc@groups.uwo.ca

See conference schedule and registration for more details. Registration is free.

Western Complex Systems Conference 2022 (March 30, 9AM-5PM EST)

Western Complex Systems Conference 2022 explores the application of complexity theory and systems thinking across disciplines. Over vast diversity in academic fields, methodologies, and domain expertise, our common thread is curiosity about the ways that nonlinear dynamics and systemic thinking invite us to understand and respond to our world.

Western University’s Complex Adaptive Systems Lab holds livestream Lightning Talks event

CAS Lab Lightning Talks (Winter Term 2021)

Monday, March 22, 4 PM – 5 PM

Streamed via YouTube Live at https://www.youtube.com/channel/UCxiHOFdmA5XFz7hUfim0zVg/live

Event page: http://www.events.westernu.ca/events/western/2021-03/cas-lab-lightning-talks.html

At this event, faculty and students from Western University’s Complex Adaptive Systems (CAS) Lab will share updates on various complex system research projects and lab initiatives undertaken this semester. (Lightning Talks are short 5- to 10-minute presentations, occurring in rapid succession.)

Dr. Sayra Cristancho (Associate Professor, Surgery / Schulich School of Medicine & Dentistry, Centre for Education Research & Innovation) – Using Swarm Intelligence to explore team adaptation

Dr. Slobodan Simonvic (Professor Emeritus amd Adjunct Professor, Civil and Environmental Engineering, Engineering) – Global Change Explorer (GCE): an interactive tool for investigating complexities of global change

Siobhan (Practicum Placement Fall 2020 and Winter 2021, School of Health Studies, Faculty of Health Science) – Using social networks to introduce new learners to complex system theory

Emma (Practicum Placement Fall 2020 and Winter 2021, School of Health Studies, Faculty of Health Science) – The case for integrating complex systems studies in undergraduate programs

Ameera (Practicum Placement Fall 2020 and Winter 2021, School of Health Studies, Faculty of Health Science) – Canada’s COVID-19 Response: Analyzing the Complexity of Public Health Interventions

Paige, Peter, Fionntan, Jonathan (Scholar’s Electives 4400Y CEL Fall 2020 and Winter 2021) – CAS Lab mapping results with Kumu.io (see introduction to the project at https://cas.uwo.ca/about/updates/2021/kumu-mapping-project-introduction.html)

Western University’s Complex Adaptive Systems (CAS) Lab is a network hub where researchers, staff, students, and collaborators studying complex adaptive systems can easily find one another across faculties and departments, learn from one another, and build upon one each other’s work. Find out more about the Complex Adaptive Systems (CAS) Lab at https://cas.uwo.ca/

Webinar: Mapping Canadian Complex Systems Scholarship

Waterloo Institute for Complexity and Innovation (WICI) is hosting a webinar on Wednesday, January 6th @ 2 p.m. with Jinelle Piereder, Mapping Canadian Complex Systems Scholarship: A Bibliometric and Network Analysis.

In this talk, Jinelle Piereder, PhD Candidate in Global Governance at Balsillie School of International Affairs, will draw out key insights from her forthcoming report—Mapping Canadian Complex Systems Scholarship: A Bibliometric and Network Analysis—including the thematic clusters of WICI member research, an evaluation of several bibliometric and network analysis tools, and the challenges around identifying (and measuring the impact of) complex systems research and scholars. Jinelle will also provide a tour of several interactive databases, reports, and maps so attendees can engage directly with the data and results of the project. This will also be an opportunity for participants/attendees to ask questions about the project results and discuss its recommendations to WICI.

Free registration via Webex

s
search
c
compose new post
r
reply
e
edit
t
go to top
j
go to the next post or comment
k
go to the previous post or comment
o
toggle comment visibility
esc
cancel edit post or comment