Jörgen Eriksson
Kristoffer Holmqvist
Mikael Graffner
Email: publicera@lub.lu.se
+46 (0)46 222 0326
Your most visited
- Sorry, this tool will only work with Javascript available.
Find Publications
Theses, dissertations and research publications (including journal articles, conference abstracts and books) from Lund University are collected in this database. Where possible, the option to download a full text document is available. It is also possible to search for Lund University student theses in the student theses database.
| Title | How we focus attention in picture viewing, picture description, and during mental imagery. |
| Author/s | Jana Holsanova |
| Department/s |
Cognitive Science
|
| Full-text | Full text is not available in this archive |
| Publication/Series | Bilder, Sehen, Denken. Zum Verhältnis von begrifflich-philosophischen und empirisch-psychologischen Ansätzen in der bildwissenschaftlichen Forschung |
| Publishing year | 2011 |
| Pages | 291 - 313 |
| Document type | Book chapter |
| Language | English |
| Publisher | Herbert von Halem Verlag: Köln. |
| Status | inpress |
| Editor | K. Sachs-Hombach, R. Totzke |
| Abstract English |
We cannot directly uncover the contents of our mind but we can come closer to cognitive processes via overt manifestations. I am interested in how speakers perceive, conceptualise and spontaneously describe complex pictures on higher levels of discourse and I use eye tracking methodology along with verbal protocols and a multimodal scoring method to study these mental processes. In the studies on picture viewing and picture description (Holsanova 2001, 2008), the combination of visual and verbal data revealed how picture objects are focused on and conceptualised at different levels of specificity and how objects’ location, activities and attributes are evaluated. We can witness a process of stepwise specification, evaluation, interpretation and re-conceptualisation of picture elements and of the picture as a whole. During their successive picture discovery, viewers describe not only scene-inherent objects with spatial proximity but also clustered elements distributed across the scene and create new mental groupings based on abstract concepts. The process of mental zooming in and out is documented, where concrete objects are re-fixated and viewed with another concept in mind. In sum, the comparison of visual and verbal foci in the process of picture viewing and picture description shows us the ways information is acquired and processed in the human mind. As the studies on mental imagery suggest (Johansson 2006 et al., Holsanova et al., forthc.), inner visualisations and mental images are important for speakers who describe pictures and visual scenes. When analysing attentional shifts in mental image inspection, a significant similarity was found between the eye movement patterns during picture viewing and those produced during picture description (when the picture was removed and the informants were looking at a white screen). The eye movements closely reflected the content and the spatial relations of the original picture, suggesting that the informants created a sort of mental image as an aid for their descriptions from memory. Eye movements were thus not dependent on a present visual scene but on a mental record of the scene. In addition, even verbal scene descriptions evoked mental images and elicited eye movements that reflect spatiality. In sum, picture viewing, picture description and mental imagery can be used as windows to the mind showing how language and vision, in concert, elucidate covert mental processes. |
| Subject |
Languages and Literatures Arts and Architecture Philosophy and Religion |
| Keywords | eye movement protocol, picture viewing, cognitive processes, mental imagery, verbal protocol, picture description |
| Project | Cognition, Communication and Learning |
Contact
"ReSearch for the Future"
Lund University's "ReSearch for the Future" magazine (Pdf, 10 Mb) presents a range of research from across the University.