Research colloquium: Computational and experimental psycholinguistics (SS 2024)

General information

Time: Thursday, 15:45–17:15
Place: K2, M 11.01, conference room on the roof of the building. Take the elevator to the 10th floor, then the staircase on the right-hand side to the top floor.
Content: This course consists of two parts: In one stream, we will welcome guest speakers who will present their latest research in the area of incremental language comprehension (or some closely related topic). In the second stream, students will develop a proposal for their own experimental research study and we will provide them with short lectures on and demonstrations of the tools of the trade. These proposals could then later be implemented as MA thesis projects, but that decision is completely independent from this course.
Expected knowledge: Basic linguistic theory, especially syntax, semantics, pragmatics. Participants ideally should have taken my seminar Human Sentence Comprehension.
Objectives: Insights into the state of the art in research on incremental human sentence comprehension. Knowledge of the basic research methods used in this area.
Learning method: Research lectures, discussions, tutorials, and demonstrations.
Assessment: Research proposal, short summaries of research talks, participation in class.

Interaction

ILIAS: ILIAS will be used to share materials (among other things the background readings for the guest talks) and for the submission of assignments. Please sign up for the course on ILIAS (no password needed). Make sure that you have notifications turned on. To do this, visit the course page and select “Activate notifications” in the “Actions” menu at the top-right of the page. With notifications on, you will receive an e-mails when there is activity on the course page.
Forum: I will use the ILIAS forum to send out announcements. Students are invited to use the forum to ask questions and to discuss. To ensure that you don’t miss anything important, please activate notifications for the forum: Visit the forum, then select “Enable Notifications in this Forum” from the “Actions” menu at the top right of the page.
Class attendance: Weekly class attendance and participation is expected. If you can’t make on a particular date, please send me an e-mail ahead of time to inform me.
Study groups: I recommend that you form study groups. If you cannot participate in a course meeting, it’s your duty to review the information posted to ILIAS (if any) and find out about the meeting content from your classmates.
Office hours: On request, online or in-person.

Talk schedule

Everyone is welcome to attend the talks below.

Date Topic
18.04. TALK 1: Bernhard Angele (Nebrija University, Bournemouth University)
02.05. TALK 2: Michael Hahn (Saarland University)
TALK 3: Kate McCurdy (Saarland University)
  📚 Background reading: Hahn et al. (2022)
11.07. TALK 4: Jessie Nixon (University of Oldenburg)

Full schedule

Legend: Assignments are marked with 📚 and need to be submitted to the next non-talk session unless mentioned otherwise. In-class progress reports are marked with 📈.

Date Topic
11.04. Intro (for students)
  📚 Decide wheter you’d like to take this course. Sign up or deregister accordingly.
  📚 Activate ILIAS notifications. See Interaction for instructions.
  📚 Develop a research question for your project (for 25.04.2024).
18.04. TALK 1: Bernhard Angele (Nebrija University, Bournemouth University)
  📚 Write summary of Angele’s talk and submit here.
25.04. Research questions, and experimental design
  📈 Initial project ideas (informal, no presentation needed)
  📚 Read Hahn et al. (2022) in preparation for the guest talks and prepare questions.
02.05. TALK 2: Michael Hahn (Saarland University)
TALK 3: Kate McCurdy (Saarland University)
  📚 Write summary of Hahn’s talk and submit here.
  📚 Write summary of McCurdy’s talk and submit here.
  📚 Prepare a 3 min presentation on your finalized research idea (2 slides max.). Submit here.
09.05. Holiday (Ascension), no class
16.05. Stimulus design: target sentences, comprehension questions, fillers, control variables, and workflow
  📈 Project ideas
  📚 Prepare a 5 min presentation on your finalized stimuli (2 slides max. and spreadsheet). Submit here. (For 06.06.2024)
23.05. Whitsun week, no class
30.05. Holiday (Corpus Christi), no class
06.06. Latin-square design, randomization, counter-balancing
  📈 Stimuli
  📚
13.06. Implementation: Google forms, Soci Survey, PCIbex
  📈 Stimuli organized in ready-to-use lists
  📚
20.06. Data collection: crowdsourcing platforms, participants, consent, ethics
  📈 Implemented experiment
  📚
27.06. Data post-processing: Attention checks, outliers, cheaters, bots
  📈 Data collection plan
  📚
04.07. Data analysis: Means, bar plots, error bars
  📈 Pilot data and post-processing plan
  📚 Read Nixon (2020) in preparation for the guest talk and prepare questions.
11.07. TALK 4: Jessie Nixon (University of Oldenburg)
  📚 Write summary of Nixon’s talk and submit here.
18.07. Writing the report: Structure, style guide, writing workflow, tools

Topics

In this section, we will link materials for each of the topics.

Projects

3 ECTS:

  • Plan an experiment and prepare it up to (but not including) the data collection.
  • Write a “pre-registration” that reports all the details and the analysis plan.
  • Approx. 4 pages (not counting materials like stimuli, scripts, etc.)

6 ECTS:

  • As above, but also collect some pilot data and report the results.
  • Approx. 6 pages (not counting materials like stimuli, scripts, etc.)

Assessment

To pass the course:

  • Class attendance
  • Progress reports
  • Short summaries of research talks (~300 words)
  • Project report

Grade (if needed):

  • Project report

Guest speakers

Bernhard Angele (Nebrija University, Bournemouth University)

Title: Can we close the eye-movement gap in reading research by using lower sampling rates?
Abstract: Eye-movement research has revolutionized our understanding of reading, but the use of eye-tracking techniques is still limited to only a few countries in the world. Publication statistics from the last 25 years show that most publications on eye-movements during reading have authors based in Western countries. We argue that eye-tracking is the ideal technique for reading and language research in countries with limited resources, and that it is crucially important to not just study a small subset of languages, but that more needs to be done to make eye-tracking technology accessible for researchers in those countries. This includes evaluating to what extent cognitive processes during reading can be measured with less expensive eye-tracking devices. One such way may be to use devices with a lower sampling rate, which may be much less expensive than high-sampling rate eye-trackers. We present findings from a study that recorded readers’ eye movements during reading at different sampling rates. We show that it is possible to measure the classic effect of word frequency on fixation duration, reflecting ongoing processing during reading, even at sampling rates of 250 Hz and less.
Slides: Click here

Michael Hahn (Saarland University)

Title: A Model of Language Processing as Resource-Rational Sequence Prediction
Abstract: Psycholinguists have long studied humans’ difficulty in comprehending complex sentences as a window into the nature of human language processing. Prominent theoretical accounts assign central roles either to expectations about upcoming content, or to retrieval of past content from short-term memory. Each account is supported by a substantial body of evidence, and unifying them has proven challenging. We propose a unifying model based on resource-rational memory representations, which we scale to the rich statistical structure of language using large-scale text data and contemporary machine learning methods. The model makes fine-grained predictions sharply different from those of existing models, which we confirm in three behavioral experiments. Taken together, our work shows how general cognitive principles, implemented using machine learning, predict fine-grained patterns in human language comprehension that previous theories cannot account for.
Background reading: Hahn, M., Futrell, R., Levy, R., & Gibson, E. (2022). A resource-rational model of human processing of recursive linguistic structure. Proceedings of the National Academy of Sciences, 119(43). http://dx.doi.org/10.1073/pnas.2122602119
Bio: Michael Hahn is an Assistant Professor at Saarland University, Germany. He received his PhD from Stanford University in 2022. His research aims to uncover the computational principles underlying language processing, and their implications for Natural Language Processing. To this end, he combines behavioral experiments with information theory and contemporary machine learning. His research has been published in journals including PNAS, Psychological Review, and Cognition.

Kate McCurdy (Saarland University)

Title: Statistical Insensitivity in German Plural Generalization
Abstract: Speakers are highly sensitive to the statistical patterns that characterize their language, and use this distributional knowledge to both predict and produce novel linguistic sequences. This motivates some recent claims that complex patterns in inflectional morphology serve a functional purpose – speakers can use them to reduce uncertainty when producing novel inflected forms. But do speakers consistently use distributional information in this way?

We investigate how adult German speakers use their lexical knowledge when generalizing plural classes to unknown words. We focus on grammatical gender, a highly informative cue to plural class in the German noun lexicon, and sample information-thoretic properties of relevant lexical distributions to formalize three behavioral hypotheses: speakers may Maximize the statistical informativity of grammatical gender (optimal prediction), Mirror its informativity on a phonologically-constrained distribution (suboptimal prediction), or Ignore gender altogether. In three behavioral experiments, we show that nearly all speakers Ignore or at most Mirror gender in plural production, meaning they do not use this distributional knowledge to optimally reduce uncertainty.
Bio: Kate McCurdy is a postdoctoral researcher in the LaCoCo Lab at Saarland University. She received her PhD in 2024 from the University of Edinburgh School of Informatics.

Jessie Nixon (University of Oldenburg)

Title: Sounds surprising! How prediction and error can contribute to speech learning
Abstract: t.b.a.
Background reading: Nixon, J. S. (2020). Of mice and men: Speech sound acquisition as discriminative learning from prediction error, not just statistical tracking. Cognition, 197, 104081. http://dx.doi.org/10.1016/j.cognition.2019.104081