Dr. Titus von der Malsburg

Photo of Titus von der Malsburg

Dr. Titus von der Malsburg

I study how the human brain makes sense of language. How is each word that we hear or read integrated into the interpretation of the sentence so far? What sources of knowledge are recruited in this process? And how are they combined, especially when they are in conflict? To answer questions like these, I use advanced experimental and computational methods ranging from eye-tracking and event-related brain potentials to large-scale crowdsourcing and statistical modeling.

I am currently a visiting professor at the Department of Linguistics at the University of Potsdam and a research affiliate at MIT’s Department of Brain and Cognitive Science. Previously, I worked at UC San Diego and University of Oxford.

Download CV as PDF

Address:
Department of Linguistics
Campus Golm, House 14, room 2.36
Karl-Liebknecht-Straße 24-25
14476 Potsdam

News

[2018-09-27 Thu]
I will teach the two courses below in the coming winter term. Please sign up on Moodle if you want to participate.
  1. Foundations of Mathematics, Cognitive Systems MSc, CSFM1
  2. Eyetracking in Psycholinguistic Research, International MSc Program for Experimental and Clinical Linguistics, VM 2/MM6/MM7/MM5
[2018-09-10 Mon]
Our AMLaP 2018 posters (click for PDF):
MalsburgEtAl2018AMLaP.png LaurinavichyuteMalsburg2018AMLaP.png SchaeferEtAl2018AMLaP.png MorganEtAl2018AMLaP.png
[2018-08-14 Tue]
Preprint of our article on the processing of gendered pronouns during the 2016 US presidential race (available on PsyArXiv):

Blog

Publications

Click the button below to download an up-to-date BibTeX file containing all my publications. This file can be imported with common bibliography managers such as Zotero, Jabref, Mendeley, etc.

Download publications.bib

Manuscripts

von der Malsburg, T., Poppels, T., and Levy, R. P. (2018). Implicit gender bias in linguistic descriptions for expected events: The cases of the 2016 US and 2017 UK elections. Under review at Psychological Science. Preprint available at https://psyarxiv.com/n5ywr. [ DOI | http ]

Journal articles

Schotter, E., Leinenger, M., and von der Malsburg, T. (2018a). When your mind ignores what your eyes see: How forced fixations lead to comprehension illusions in reading. Psychonomic Bulletin & Review, 25(5):1884-1890. [ bib | DOI | .pdf ]
Schotter, E., von der Malsburg, T., and Leinenger, M. (2018b). Forced fixations, trans-saccadic integration, and word recognition: Evidence for a hybrid mechanism of saccade triggering in reading. Journal of Experimental Psychology: Learning, Memory, and Cognition. [ bib | http | .pdf ]
von der Malsburg, T. and Angele, B. (2016). False positives and other statistical errors in standard analyses of eye movements in reading. Journal of Memory and Language, 94:119-133. [ bib | DOI | http | .pdf ]
Metzner, P., von der Malsburg, T., Vasishth, S., and Rösler, F. (2016). The importance of reading naturally: Evidence from combined recordings of eye movements and electric brain potentials. Cognitive Science, 41(S6):1232–1263. [ bib | DOI ]
Metzner, P., von der Malsburg, T., Vasishth, S., and Rösler, F. (2015). Brain responses to world-knowledge violations: A comparison of stimulus- and fixation-triggered event-related potentials and neural oscillations. Journal of Cognitive Neuroscience, 27(5):1017-1028. [ bib | DOI | .pdf ]
von der Malsburg, T., Kliegl, R., and Vasishth, S. (2015). Determinants of scanpath regularity in reading. Cognitive Science, 39(7):1675-1703. [ bib | DOI | .pdf ]
Vasishth, S., von der Malsburg, T., and Engelmann, F. (2013). What eye movements can tell us about sentence comprehension. Wiley Interdisciplinary Reviews: Cognitive Science, 4(2):125-134. [ bib | DOI | .pdf ]
von der Malsburg, T. and Vasishth, S. (2013). Scanpaths reveal syntactic underspecification and reanalysis strategies. Language and Cognitive Processes, 28(10):1545-1578. [ bib | DOI | http ]
Marusch, T., von der Malsburg, T., Bastiaanse, R., and Burchert, F. (2012). Tense morphology in german agrammatism: The production of regular, irregular and mixed verbs. The Mental Lexicon, 7(3):351-380. [ bib | DOI | .pdf ]
von der Malsburg, T. and Vasishth, S. (2011). What is the scanpath signature of syntactic reanalysis? Journal of Memory and Language, 65(2):109-127. [ bib | DOI | .pdf ]

Conference articles

Marusch, T., von der Malsburg, T., Bastiaanse, R., and Burchert, F. (2013). Tempusmorphologie bei deutschen Agrammatikern: Die Sprachproduktion von regulären, irregulären und gemischten Verben. In Spektrum Patholinguistik, volume 6, pages 219-223, Potsdam, Germany. Universitätsverlag Potsdam. [ bib ]
Seit langem wird debattiert, wie reguläre und irreguläre Vergangenheitsformen repräsentiert und verarbeitet werden (Rumelhart & McClelland, 1986; Pinker & Prince, 1988). Das Dual- Mechanism-Modell (DMM; Pinker & Prince, 1988; Clahsen, 1999) nimmt an, dass reguläre und irreguläre Formen von zwei verschiedenen Mechanismen verarbeitet werden. Vertreter des Single-Mechanism Ansatzes gehen alternativ von einem einzigen Mechanismus aus, der sowohl der Verarbeitung von regulären als auch irregulären Verben dient.
von der Malsburg, T., Vasishth, S., and Kliegl, R. (2012). Scanpaths in reading are informative about sentence processing. In Michael Carl, P. B. and Choudhary, K. K., editors, Proceedings of the First Workshop on Eye-tracking and Natural Language Processing, pages 37-53, Mumbai, India. The COLING 2012 organizing committee. [ bib | .pdf ]
von der Malsburg, T., Baumann, T., and Schlangen, D. (2009). TELIDA: A package for manipulation and visualization of timed linguistic data. In Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 302-305, London, UK. Association for Computational Linguistics. [ bib | .pdf ]

Conference talks

Morgan, A., von der Malsburg, T., Ferreira, V., and Wittenberg, E. (2018). This is the structure that we wonder why anyone produces it: Resumptive pronouns in English hinder comprehension. In Pickering, M., Crocker, M., Hartsuiker, R., Ferreira, V., Branagan, H., and Mishra, R., editors, Proceedings of the 1th Architectures and Mechanisms for Language Processing Conference - Asia, Hyderabad, Telangana, India. University of Hyderabad. [ bib ]
von der Malsburg, T., Poppels, T., and Levy, R. (2017b). The president gave her inauguration speech. No, they didn’t! The interaction of explicit world knowledge, implicit gender stereotypes, and discourse expectations. In van Bergen, G. and Spenader, J., editors, Proceedings of Discourse Expectations: Theoretical, Experimental and Computational perspectives (DETEC 2017), Nijmegen, Netherlands. Max Planck Institute for Psycholinguistics, Max Planck Institute for Psycholinguistics. [ bib ]
Schotter, E., Leinenger, M., and von der Malsburg, T. (2017). Parafoveal and foveal information serve different purposes in reading: Parafoveal is used for saccade programming, foveal for comprehension. In Gibson, E., Blank, I., Fedorenko, E., Futrell, R., Kline, M., and Ryskin, R., editors, Proceedings of the 30th Annual CUNY Conference on Human Sentence Processing, Boston, MA, USA. Massachusetts Institute of Technology. [ bib ]
von der Malsburg, T., Poppels, T., and Levy, R. (2017c). The president will give her inauguration speech: Explicit belief and implicit expectations in language production and comprehension. In Gibson, E., Blank, I., Fedorenko, E., Futrell, R., Kline, M., and Ryskin, R., editors, Proceedings of the 30th Annual CUNY Conference on Human Sentence Processing, Boston, MA, USA. Massachusetts Institute of Technology. [ bib ]
von der Malsburg, T., Poppels, T., and Levy, R. (2017a). The president gave her inauguration speech: Explicit belief and implicit expectations in language production and comprehension. In Baptista, M. and Coetzee, A., editors, 91th Annual Meeting of the Linguistics Society of America, Austin, Texas. Linguistic Society of America. [ bib ]
Schotter, L., Leinenger, M., and von der Malsburg, T. (2016). Dissociating influences of parafoveal and foveal information on reading: Forced fixations and comprehension. In Maki, R., editor, Proceedings of the 21th Conference of the Psychonomic Scociety, Boston, Massachusetts. Psychonomic Society. [ bib ]
Angele, B. and von der Malsburg, T. (2016). Multiple comparisons and false positive rates in eye tracking studies of reading behaviour. In Bajo, M. T., editor, Proceedings of the International Meeting of the Psychonomic Society, page 112, Granada, Spain. Psychonomic Society. [ bib ]
Angele, B. and von der Malsburg, T. (2015b). Multiple comparisons and false positive rates in eye tracking studies of reading behavior. In Gomez, P. and Krenzer, W., editors, Proceedings of the Pre-Psychonomics Word Recognition Conference, Chicago, IL, USA. DePaul University, Chicago, DePaul University, Chicago. [ bib ]
von der Malsburg, T. and Angele, B. (2015). The rules of statistics make no exception for reading research: False positive rates in eyetracking studies of reading behavior. In Gatt, A. and Mitterer, H., editors, Proceedings of the 21th Architectures and Mechanisms for Language Processing Conference (AMLaP), Valetta, Malta. University of Malta. [ bib ]
Angele, B. and von der Malsburg, T. (2015a). False-positive rates in eyetracking studies with multiple dependent measures. In Perea, M., Vergara-Martínez, M., Rosa Martínez, E. M., Tejero, P., Roca Ruíz, J., Fajardo, I., Salmerón, L., and Abu Mallouh, R., editors, Proceedings of the 12th Symposium of Psycholinguistics, Valencia, Spain. Universitat de Valencia. [ bib ]
Metzner, P., von der Malsburg, T., Vasishth, S., and Rösler, F. (2014). The relationship between regressive saccades and the P600 effect: Evidence from concurrent eye movement and EEG recordings. In Patson, N., Speer, S., Squires, L., Turnbull, R., Wagner, L., and Walker, A., editors, Proceedings of the 27th Annual CUNY Conference on Human Sentence Processing, Columbus, OH, USA. Ohio State University. [ bib ]
Paape, D., Vasishth, S., and von der Malsburg, T. (2013). Local coherence and digging-in effects in german. In Ferreira, F., Almor, A., and den Ouden, D.-B., editors, Proceedings of the 26th Annual CUNY Conference on Human Sentence Processing, page 199, Columbia, SC, USA. University of South Carolina. [ bib ]
Metzner, P., von der Malsburg, T., Vasishth, S., and Rösler, F. (2013b). World-knowledge violations elicit different rhythmic brain activity in natural reading and serial presentation. In Frenck-Mestre, C., Alario, F.-X., Nguyen, N., Blache, P., and Meunier, C., editors, Proceedings of the 19th Architectures and Mechanisms for Language Processing Conference (AMLaP), page 32, Marseilles, France. Aix-Marseille Université. [ bib ]
Recent studies (Dimigen et al., JEP:G, 2011; Kretzschmar et al., NeuroReport, 2009) demonstrated the feasibility of investigating fixation-related potentials (FRPs) and that the results are similar to brain potentials recorded during rapid serial visual presentation (RSVP). We conducted an experiment to assess if this correspondence also holds for rhythmic brain activity. To pit our results against ults gained with RSVP, the experiment used sentences that are known to produce reliable effects both in the time domain and in the frequency domain (Hagoort, Science, 2004). Participants (N=48) read freely through true ('The Thames flows through London') and false statements ('The Hudson flows through London'). Hagoort et al. report an N400, a negative-going deflection in the ERP with a peak around 400 ms, as well as increased theta (4-7 Hz) and gamma (30-70 Hz) activity. During our experiment, participants' eye movements were monitored and their EEG was recorded from 32 electrodes and later evaluated contingent to the first fixation on the critical word. We analyzed the canonical eye-tracking measures with linear mixed-effects models and the EEG with cluster-permutation tests (Maris & Oostenveld, J Neurosci Methods, 2007) to control for multiple comparisons. As expected, we observed a negativity in the FRP with a centro-parietal distribution and a peak latency of approximately 400 ms. Also as expected, this N400 lined up with increased first fixation durations, gaze durations, and regression rates in the eye movement record (Dambacher & Kliegl, Brain Res, 2007). Crucially, fixation-related power spectra showed synchronization in the delta range (1-3 Hz) at central electrodes and desynchronization in the upper alpha range (11-13 Hz) at occipito-parietal sites relative to a pre-fixation baseline. None of these effects is reported by Hagoort et al. which suggests that fixation-related EEG changes are at least not fully comparable to those observed in RSVP. One reason for the diverging results could lie in different processing demands: In RSVP, readers must retrieve earlier parts of the sentence from working memory because they cannot make regressions. Increased theta activity reflects this more effortful memory access (Klimesch, Brain Res Rev, 1999). In natural reading, readers can easily move their eyes back to resolve the processing difficulty which facilitates memory access. Our findings question the comparability of results acquired with serial presentation vs. natural reading.
Metzner, P., von der Malsburg, T., Vasishth, S., and Rösler, F. (2013a). Oscillatory brain dynamics differ between natural reading and serial presentation. In Holmqvist, K., Mulvey, F., and Johansson, R., editors, Proceedings of the 17th European Conference on Eye Movements (ECEM), page 187, Lund, Sweden. Journal of Eye Movement Research. [ bib ]
Recent research (Dimigen et al., JEP:G, 2011; Kretzschmar et al., NeuroReport, 2009) shows that fixation-related potentials (FRPs) yield similar results as brain potentials recorded during rapid serial visual presentation (RSVP). We conducted an experiment to see if this correspondence also holds for oscillatory brain dynamics. Participants (N=48) read true ("The Thames flows through London") and false factual statements ("The Hudson flows through London"). Such violations are known to elicit an N400, a negative-going deflection with a peak around 400 ms, and increased theta and gamma activity (Hagoort, Science, 2004). As expected, we see an N400 in the FRP and increased fixation durations and regression rates in the eye movement record. Moreover, a cluster-permutation test (Maris & Oostenveld, J Neurosci Methods, 2007) for fixation-related power spectra shows synchronization in the delta range (1-3 Hz) and desynchronization in the upper alpha range (11-13 Hz) but no theta or gamma effects. This is at odds with prior findings and suggests that fixation-related oscillatory EEG changes are not fully comparable to those observed in RSVP. One reason for the diverging results may lie in different processing demands: In RSVP, readers must retrieve earlier parts of the sentence from memory because they cannot make regressions.
von der Malsburg, T., Vasishth, S., and Kliegl, R. (2013). Scanpaths in reading are tractable and informative. In Holmqvist, K., Mulvey, F., and Johansson, R., editors, Proceedings of the 17th European Conference on Eye Movements (ECEM), page 132, Lund, Sweden. Journal of Eye Movement Research. [ bib ]
Pioneering work in reading research has shown that scanpaths in reading can be informative about sentences processing (Frazier, Rayner, 1982). Nevertheless, scanpaths have not gained much traction in reading research. One reason for that may have been a lack of suitable analytical tools. Here, we summarize three recent studies in which we used a new scanpath measure to analyze gaze data from two experimental studies (von der Malsburg, Vasishth, 2011, 2012) and one corpus study (von der Malsburg, Kliegl, Vasishth, under revision). The experiments investigated how readers process temporarily ambiguous sentences. We showed that readers do not always commit to one of the alternative interpretations, and that readers with low working-memory capacity do so less often. Contrary to what was reported earlier, we found that reparsing instead of targeted repair is a common strategy to recover from incorrect interpretations. Interestingly, these results did not emerge in an analysis using traditional word-based eyetracking measures showing their limitations. In the corpus study, we demonstrated how syntax, oculomotor constraints, and age of reader jointly determine the regularity of scanpaths. We argue that, taken together, these results establish the scanpath as an informative and tractable object of investigation in reading research.
von der Malsburg, T., Vasishth, S., and Kliegl, R. (2012). Scanpaths in reading are informative about sentence processing. In Michael Carl, P. B. and Choudhary, K. K., editors, Proceedings of the First Workshop on Eye-tracking and Natural Language Processing, pages 37-53, Mumbai, India. The COLING 2012 organizing committee. [ bib | .pdf ]
von der Malsburg, T. and Vasishth, S. (2011). Strategies for dealing with attachment ambiguities in Spanish. In Proceedings of the 10th Symposium of Psycholinguistics, San Sebastián, Spain. Basque Center on Cognition, Brain and Language. [ bib ]
von der Malsburg, T. and Vasishth, S. (2010). Reanalysis strategies in temporarily ambiguous sentence - A scanpath analysis. In Bemis, D., Brennan, J., Dikker, S., Livitz, I., Marantz, A., McElree, B., Pylkkänen, L., and Rabagliati, H., editors, Proceedings of the 23th Annual CUNY Conference on Human Sentence Processing, page 32, New York City, NY, USA. New York University. [ bib ]
von der Malsburg, T. and Vasishth, S. (2009). Individual differences in scanpaths and reanalysis strategies while reading temporarily ambiguous sentences. In Liversedge, S., editor, Proceedings of the 15th European Conference on Eye Movements (ECEM), Southampton, UK. Journal of Eye Movement Research. [ bib ]

Conference posters

Laurinavichyute, A. and von der Malsburg, T. (2018c). Semantic attraction in sentence processing. In Knoeferle, P., editor, Proceedings of the 24th Architectures and Mechanisms for Language Processing Conference (AMLaP), Berlin, Germany. Humboldt Universität Berlin. [ bib | .pdf ]
von der Malsburg, T., Poppels, T., Boyce, V., and Levy, R. (2018). Gender-biases in language processing: Explicit beliefs about event outcomes vs. implicit linguistic expectations. In Knoeferle, P., editor, Proceedings of the 24th Architectures and Mechanisms for Language Processing Conference (AMLaP), Berlin, Germany. Humboldt Universität Berlin. [ bib | .pdf ]
Schäfer, R., von der Malsburg, T., and Lago, S. (2018). Agreement attraction in german SOV structures: An ERP study. In Knoeferle, P., editor, Proceedings of the 24th Architectures and Mechanisms for Language Processing Conference (AMLaP), Berlin, Germany. Humboldt Universität Berlin. [ bib | .pdf ]
Morgan, A., von der Malsburg, T., Ferreira, V., and Wittenberg, E. (2018a). English resumptive pronouns do not help the comprehender. In Knoeferle, P., editor, Proceedings of the 24th Architectures and Mechanisms for Language Processing Conference (AMLaP), Berlin, Germany. Humboldt Universität Berlin. [ bib | .pdf ]
Boyce, V., von der Malsburg, T., Poppels, T., and Levy, R. (2018). Implicit gender biases in the production and comprehension of pronominal references. In Ferreira, F., Henderson, J., Swaab, T., and Traxler, M., editors, Proceedings of the 31th Annual CUNY Conference on Human Sentence Processing, Davis, CA, USA. UC Davis. [ bib ]
Morgan, A., von der Malsburg, T., Ferreira, V., and Wittenberg, E. (2018b). This is the structure that we wonder why anyone produces it: Resumptive pronouns in English hinder comprehension. In Ferreira, F., Henderson, J., Swaab, T., and Traxler, M., editors, Proceedings of the 31th Annual CUNY Conference on Human Sentence Processing, Davis, CA, USA. UC Davis. [ bib ]
Stone, K., Vasishth, S., and von der Malsburg, T. (2018). Expectations and prediction in sentence comprehension: German particle verbs as a test case. In Ferreira, F., Henderson, J., Swaab, T., and Traxler, M., editors, Proceedings of the 31th Annual CUNY Conference on Human Sentence Processing, Davis, CA, USA. UC Davis. [ bib ]
Laurinavichyute, A. and von der Malsburg, T. (2018a). Agreement attraction in grammatical sentences. In Ferreira, F., Henderson, J., Swaab, T., and Traxler, M., editors, Proceedings of the 31th Annual CUNY Conference on Human Sentence Processing, Davis, CA, USA. UC Davis. [ bib ]
Laurinavichyute, A. and von der Malsburg, T. (2018b). Semantic attraction in sentence processing. In Ferreira, F., Henderson, J., Swaab, T., and Traxler, M., editors, Proceedings of the 31th Annual CUNY Conference on Human Sentence Processing, Davis, CA, USA. UC Davis. [ bib ]
Morgan, A., von der Malsburg, T., Ferreira, V., and Wittenberg, E. (2017). This is the structure that we wonder why anyone produces it: Resumptive pronouns in english help production but hinder comprehension. In Gibson, E., Blank, I., Fedorenko, E., Futrell, R., Kline, M., and Ryskin, R., editors, Proceedings of the 30th Annual CUNY Conference on Human Sentence Processing, Boston, MA, USA. Massachusetts Institute of Technology. [ bib ]
Morgan, A., von der Malsburg, T., Ferreira, V., and Wittenberg, E. (2016). Resumptive pronouns hinder sentence comprehension in english. In Carreiras, M., Mancini, S., Molinaro, N., Davidson, D., Caffarra, S., and Martin, C., editors, Proceedings of the 22th Architectures and Mechanisms for Language Processing Conference (AMLaP), page 98, Bilbao, Spain. Basque Center on Cognition, Brain and Language. [ bib | .pdf ]
von der Malsburg, T., Joseph, H., Troscianko, E., Kukkonen, K., and Nation, K. (2015a). The influence of foreshadowing metaphors in a crime story by Ian Fleming. In Gatt, A. and Mitterer, H., editors, Proceedings of the 21th Architectures and Mechanisms for Language Processing Conference (AMLaP), Valetta, Malta. University of Malta. [ bib ]
von der Malsburg, T., Vasishth, S., and Levy, R. (2015b). The impact of reading modality on sentence comprehension. In Gatt, A. and Mitterer, H., editors, Proceedings of the 21th Architectures and Mechanisms for Language Processing Conference (AMLaP), Valetta, Malta. University of Malta. [ bib ]
von der Malsburg, T., Vasishth, S., Metzner, P., and Levy, R. (2015c). How presentation modality influences reading comprehension. In Kaiser, E., Mintz, T., Pancheva, R., and Zevin, J., editors, Proceedings of the 28th Annual CUNY Conference on Human Sentence Processing, Los Angeles, CA, USA. University of Southern California. [ bib ]
von der Malsburg, T. and Angele, B. (2015). False-positive rates in eyetracking studies with multiple dependent measures. In Kaiser, E., Mintz, T., Pancheva, R., and Zevin, J., editors, Proceedings of the 28th Annual CUNY Conference on Human Sentence Processing, Los Angeles, CA, USA. University of Southern California. [ bib | .pdf ]
Angele, B. and von der Malsburg, T. (2015). False positives in standard analyses of eye movements in reading. In Ansorge, U., Ditye, T., Florack, A., and Leder, H., editors, Proceedings of the 18th European Conference on Eye Movements (ECEM), Vienna, Austria. Journal of Eye Movement Research. [ bib ]
Standard analyses of eye movements in reading test a set of canonical dependent measures calculated for multiple regions. Although the resulting multiple comparisons increase the rate of false positive results, it is accepted standard practice not to correct for that. We investigated false positives rates through computer simulations and tested how much statistical power has to be sacrificed to control them. In 100.000 iterations, we generated six realistic data sets of eye movements for a hypothetical experiment with typical parameters. The true effect sizes of the manipulation ranged from 0 ms to 40 ms. Four standard measures were analyzed using linear mixed models: first fixation duration, gaze duration, go-past time, and total viewing time. In the data sets with no true effect, the rate of false positives was 12.1%, i.e. much higher than the conventionally accepted 5%. A Bonferroni correction reduced false positives to 3.2% and was therefore slightly more conservative than required. The reduction in power due to the Bonferroni correction was moderate, e.g., from 90% to 75% for effect sizes of 5 ms. Contrary to conventional wisdom, the Bonferroni correction seems to be an appropriate tool for controlling false positives in reading experiments.
von der Malsburg, T., Metzner, P., Vasishth, S., and Rösler, F. (2014). Using co-registration of eye movements and event-related brain potentials to study the processing of anaphoric dependencies. In Patson, N., Speer, S., Squires, L., Turnbull, R., Wagner, L., and Walker, A., editors, Proceedings of the 27th Annual CUNY Conference on Human Sentence Processing, page 187, Columbus, OH, USA. Ohio State University. [ bib ]
Metzner, P., von der Malsburg, T., Vasishth, S., and Rösler, F. (2014a). Different coping strategies in sentence processing can be disentangled using coregistered eye movements and brain potentials. In Proceedings of the Sixth Annual Society for the Neurobiology of Language Conference, Amsterdam, Netherlands. Society for the Neurobiology of Language. [ bib ]
Metzner, P., von der Malsburg, T., Vasishth, S., and Rösler, F. (2014b). Recovering from syntactic and semantic violations: The relationship between eye movements and brain responses. In Corley, M., Rabagliati, H., Nieuwland, M., Sturt, P., Pickering, M., and Martin, A., editors, Proceedings of the 20th Architectures and Mechanisms for Language Processing Conference (AMLaP), page 101, Edinburgh, UK. University of Edinburgh. [ bib ]
Marusch, T., von der Malsburg, T., Bastiaanse, R., and Burchert, F. (2013). Tempusmorphologie bei deutschen Agrammatikern: Die Sprachproduktion von regulären, irregulären und gemischten Verben. In Spektrum Patholinguistik, volume 6, pages 219-223, Potsdam, Germany. Universitätsverlag Potsdam. [ bib ]
Seit langem wird debattiert, wie reguläre und irreguläre Vergangenheitsformen repräsentiert und verarbeitet werden (Rumelhart & McClelland, 1986; Pinker & Prince, 1988). Das Dual- Mechanism-Modell (DMM; Pinker & Prince, 1988; Clahsen, 1999) nimmt an, dass reguläre und irreguläre Formen von zwei verschiedenen Mechanismen verarbeitet werden. Vertreter des Single-Mechanism Ansatzes gehen alternativ von einem einzigen Mechanismus aus, der sowohl der Verarbeitung von regulären als auch irregulären Verben dient.
von der Malsburg, T., Metzner, P., Vasishth, S., and Rösler, F. (2013). Co-registration of eye movements and brain potentials as a tool for research on reading and language comprehension. In Holmqvist, K., Mulvey, F., and Johansson, R., editors, Proceedings of the 17th European Conference on Eye Movements (ECEM), page 462, Lund, Sweden. Journal of Eye Movement Research. [ bib ]
Recent research demonstrated the feasibility of analyzing fixation-related brain potentials (FRPs) recorded during natural reading (Kretzschmar et al., 2009; Dimigen et al., 2011). Two questions arise from these studies: (1) Are effects observed with fixation-triggered EEG signals comparable to those observed in standard RSVP designs? (2) Does the combined analysis of EEG and fixation data provide additional insights into reading and comprehension processes that are not available with either method alone? Both above-mentioned studies used material known to robustly elicit strong N400 effects. The present study (N=50) examined responses to a more subtle manipulation representative of common experimental designs: we manipulated the distance between anaphoric expressions (pronouns, verb ellipsis) and their antecedents. Differences were examined using a non-parametric Monte Carlo test (Maris & Oostenveld, 2007). Increased distance of the antecedent elicited an early frontocentral negativity in response to verb ellipses (88ms-134ms, p<0.001) and a negativity at frontocentral and parietal electrodes on the words following pronouns (98ms-186ms, p<0.001). We discuss these results in the context of earlier findings and argue that adopting FRP-methodology requires factoring in complex visuomotor contingencies that are not yet fully understood and that evoke ERP effects different from those seen in RSVP designs.
von der Malsburg, T., Kliegl, R., and Vasishth, S. (2012). Determinants of scanpath regularity in reading. In Bradley, D., Fernández, E., and Fodor, J. D., editors, Proceedings of the 25th Annual CUNY Conference on Human Sentence Processing, page 82, New York City, NY, USA. CUNY Graduate School and University Center. [ bib ]
Kobele, G., Lagrou, E., Engelmann, F., von der Malsburg, T., Musa, R., Gerth, S., van de Vijver, R., and Hale, J. (2012). Incremental processing difficulty in cross-serial and nested verb cluster. In Egidi, G., Hasson, U., Job, R., Vespignani, F., and Zamparelli, R., editors, Proceedings of the 18th Architectures and Mechanisms for Language Processing Conference (AMLaP), page 150, Trento, Italy. University of Trento. [ bib ]
von der Malsburg, T. and Vasishth, S. (2011). Eye-movement strategies for dealing with garden-path sentences. In Fernald, A., Frank, M. C., Jurafsky, D., Sag, I. A., and Wasow, T., editors, Proceedings of the 24th Annual CUNY Conference on Human Sentence Processing, pages 205-206, Stanford, CA, USA. Stanford University. [ bib ]
von der Malsburg, T., Kliegl, R., and Vasishth, S. (2011). A scanpath measure reveals effects of age of reader and syntactic complexity of sentences. In Vitu, F., Castet, E., and Goffart, L., editors, Proceedings of the 16th European Conference on Eye Movements (ECEM), page 254, Marseilles, France. Journal of Eye Movement Research. [ bib ]
Vasishth, S., Drenhaus, H., and von der Malsburg, T. (2010). Integration difficulty and expectation-based syntactic comprehension. In Bemis, D., Brennan, J., Dikker, S., Livitz, I., Marantz, A., McElree, B., Pylkkänen, L., and Rabagliati, H., editors, Proceedings of the 23th Annual CUNY Conference on Human Sentence Processing, page 111, New York City, NY, USA. New York University. [ bib ]
von der Malsburg, T. (2009). Choice of saccade detection algorithm has a considerable impact on eye tracking measures. In Liversedge, S., editor, Proceedings of the 15th European Conference on Eye Movements (ECEM), Southampton, UK. Journal of Eye Movement Research. [ bib ]
von der Malsburg, T. and Vasishth, S. (2009a). Analyzing spatio-temporal patterns in eye movements: A method and software. In Traxler, M. and Swaab, T., editors, Proceedings of the 22th Annual CUNY Conference on Human Sentence Processing, Davis, CA, USA. Univeristy of California, Davis. [ bib | .pdf ]
von der Malsburg, T. and Vasishth, S. (2009b). Readers use different strategies to recover from garden-paths. In Processings of the Summer School on Embodied Language Games and Construction Grammar, Cortona, Italy. Evolutionary Linguistics Association. [ bib ]
von der Malsburg, T. and Vasishth, S. (2008). A new method for analyzing eye movements in reading that is sensitive to spatial and temporal patterns in sequences of fixations. In Gordon, P., editor, Proceedings of the 21th Annual CUNY Conference on Human Sentence Processing, page 118, Chapel Hill, NC, USA. Univerity of North Caroline at Chapel Hill. [ bib | .pdf ]
von der Malsburg, T. and Vasishth, S. (2007). A time-sensitive similarity measure for scanpaths. In Kliegl, R. and Engbert, R., editors, Proceedings of the 14th European Conference on Eye Movements (ECEM), Potsdam, Germany. Journal of Eye Movement Research. [ bib | .pdf ]

Exhibitions and performances

See this video about a sound installation I created together with sound artist Christoph Illing.

Schurer, B. and von der Malsburg, T. (2017). Automatic reading (obfuscation). In Ribas, L. and Taveira, R., editors, Proceedings of the fifth conference on Computation, Communication, Aesthetics and X, Lisbon, Portugal. The xCoAx 2017 organizing committee. Eye-tracking and sound installation. [ bib | .pdf ]
During reading, we rapidly construct meaning from sequences of rather cryptic symbols. A multitude of processes are involved in making meaning happen, however, most of them are conveniently tucked away from the reader’s conscious experience allowing them to read effortlessly without having to worry about any of the practicalities such as where to place the gaze next and for how long. The present work reflects on the marvelous feat that is reading. In an experiment-like situation, we create a perceptual short-circuit that unlocks the otherwise unconcsious processes involved in reading. To this end, the test subject is exposed to a written libretto while a computer tracks their eye movements and translates them to sound in real time. The artistic implementation is based on parametric synthesis (“mapping”) and model-based sonification.
Illing, C. and von der Malsburg, T. (2015). Brain decomposition. Einraumhaus C/O, Mannheim, Germany. 17-26 Apr. 2015. Sound installation. [ bib | http ]
Illing, C. and von der Malsburg, T. (2014). Brain decompositions. Sound Dome of the Centre for Art and Media (ZKM), Karlsruhe, Germany. 13 Dec. 2014. Performance. [ bib | http ]
von der Malsburg, T. and Illing, C. (2014). Dem Gehirn zuhören. Wissenschaftsetage im Bildungsforum. Sound installation part of an exhibition about science in the state of Brandenburg. [ bib ]
von der Malsburg, T. and Illing, C. (2013). Decomposing electric brain potentials for audification on a matrix of speakers. In Verdicchio, M. and Carvalhais, M., editors, Proceedings of the first conference on Computation, Communication, Aesthetics and X, pages 305-307, Bergamo, Italy. The xCoAx 2013 organizing committee. Sound installation. [ bib | .pdf ]

Software

Scasim
An R package that implements our measure for scanpath similarity along with some tools for data prerocessing and visualization of scanpaths. The measure is described in von der Malsburg & Vasishth (JML, 2011).
Saccades
An R package for detecting saccades and fixations in raw eyetracking data. Implements the velocity-based algorithm proposed by Engbert & Kliegl (Vis Res, 2003).
edfR
An R package for reading EDF files generated by EyeLink eye-trackers.
helm-bibtex
A bibliography manager for Emacs.
TEDview
A program for visualizing discrete temporal data, e.g., events taking place in an incremental dialogue system. See von der Malsburg, Baumann, Schlangen (2009) for details.
py-span-task
A program for testing reading or operation span. Implements the recommendations given by Conway, Kane, Bunting, Hambrick, Wilhelm, & Engle (Psych Bull & Rev, 2005).