Etikettarkiv: perception

Welcome again to Visual Studies – its 14th year at Åbo Akademi

Illustrating a theory about photography

An important statement of Visual Studies: From an exhibition by the artist Alfredo Jaar in 2013. Source: https://alfredojaar.net/projects/2013/

Hello! This is still the blog of the Visual Studies minor at Åbo Akademi University and I am still Fred Andersson, a Swedish art historian who has been running this business since it started in 2008. Recently I discussed the topic of blogs with some of my art history students – ”is there anyone who actually reads them anymore?”. Anyhow, we agreed that if you have a text-based blog, you probably write it mainly for your own sake, for testing ideas, using the blog as a ”sketch-pad” for more finished texts, probably also as a strategy to get rid of writing blocks. There are people who use Facebook and Instagram updates for similar reasons, sometimes posting full essays, but especially in the Smartphone mode the reading experience is not very pleasant. Let’s therefore continue with this Visual Studies blog. I guess I will still be the only one writing for it, and if you happen to be some people out there reading it, don’t hesitate to email me if you have questions or ideas (you’ll find my info in the ”Våra kurser/Our Courses” tab at this page). I had to disable the ”comments” function because of massive amounts of spam. All new entries will from now on be written in English, because over the years we have seen that to an increasing extent, exchange students are in majority among the participants of some of our courses.

A random example in Visual Studies: This image was ”made” a century ago in order to capture both the boys and the now demolished building in the background. The image ”tells us” about the situation of its making. Without text and archival information, it doesn’t tell much else. (Source: private.)

We have now, hopefully, left the COVID pandemic behind, and in the meantime the study structure at our faculty section KHF (Culture, History, Philosophy) at Åbo Akademi University has underwent some structural changes. It is, as yet, not very clear what consequences these may have for the future role of the Visual Studies subject. With continuous information work and ”marketing efforts”, for example the maintenance of this blog and the circulation of course information to mailing lists and in the Visual Studies Facebook group, I have been able to attract a sufficient number of students and to keep most of our courses running every year since 2008. However, due to other demanding tasks and the time-consuming adaptation to online teaching during the Pandemic, I have not been able to maintain these outreaching activities for the past two years, and the effects of this neglect are now clearly noticeable.

A small subject is always in a precarious position, especially at a small university with only one single individual (that is me) employed as full-time teacher and researcher of the subject. This single individual is probably even the only teacher in the whole of Finland: even though Visual Studies now exists at Tampere University also, the people there present the subject as a research network and don’t seem to offer any undergraduate courses (Tampere Visual Studies Lab, https://research.tuni.fi/visualstudieslab). Some other Finnish universities have courses in Visual Culture, which is not necessarily the same – I will soon explain why.

I have noticed that most students taking our courses are no longer aware of the existence of Visual Studies as a ”short minor” (in Swedish kort biämne) at our university, i.e. as a small program that you can choose as a parallel complement to your ”major” (in Swedish huvudämne). Some have found single courses that have been recommended as optional in other subjects or study units (in Swedish kurshelheter), others are probably interested in only certain specific aspects of Visual Studies (such as film studies), and many exchange students have realized that some of our courses are among the few in the humanities that are given in English. All this is well and good, but it is obviously time for a reminder that Visual Studies exists as a separate discipline at universities worldwide, and that there are certain reasons for its existence. These reasons are also the reasons why our courses look they way they do, and why they should preferably be taken in a certain order if you want to choose Visual Studies as your minor subject. (See the ”Våra kurser/Our Courses” tab.)

Visual Studies has an obvious connection to Art History – a much older subject that has been taught at European universities for at least 200 years. Most scholars who regard themselves as belonging to Visual Studies have a formal education as art historians, and most research groups or departments with ”Visual Studies” in their official names have been sub-sections or ”outgrowths” of departments of Art History. Because of its organizational connection to Art History, Visual Studies is typically regarded as the study of human visual culture – or more specifically as Visual Culture Studies. The difference with Art History is simply the word ”art” – Visual Culture is not limited to what we usually refer to as ”art” (for example objects exhibited at ”art galleries” or collected at ”art museums”). The history of visual culture is the history of how humankind has shaped its visual environment and developed means of visual symbolism and communication. When limited to Visual Culture Studies, research in Visual Studies normally focuses on aspects of human behavior that are dependent on culturally determined conventions and codes, the dominant research paradigm being that of cultural constructivism.

Reality: a cake moulded by language? (Source: freepik.com)

When taken to extremes, cultural constructivism tends to result in a rather limited worldview, according to which almost everything in life could be explained as dependent on language, culture and learned behavior. One case in point is the famous Sapir-Whorf hypothesis in linguistics, which states that our perception and our understanding of the world around us is shaped or ”moulded” by the terms and concepts available in our language, and not the other way around. In its strong version, which is today abandoned by most linguists, this hypothesis would potentially lead to such resasonings as this one: Let’s assume that a language has only three basic color terms, and that these are black, white and red. Then, its speakers would not be able to perceive other colors.

How are we to test if this conclusion is true? Indeed, there are still people who in their childhood only spoke a language with no other basic color terms than those mentioned – for exemple some languages spoken by indigenous groups in Australia. Today, they most probably speak English too. If, in their childhood, they were subjected to various psychological tests designed in order to determine whether they could see or not see what ”we” Westerners see, such tests would still beg the question of what it means to ”see” and to perceive. Do we have, ourselves, names for all chromatic nuances we can distinguish? Hardly so: we would then need thousands and thousands of colour terms, and be able to remember them and distinguish between them. There is no room in our verbal memory for such massive amounts of fine linguistic distinctions that only refer to color. The visual ability of distinguishing colour is evidently not dependent on the number of color terms in language. Paintings and other visual artifacts produced in cultures with limited color terminology is by no means less colorful and nuanced than in other cultures, and most probably a more developed terminology has never been needed for social interaction in the group. Similarly, the term brun in old French covered a range of nuances from brown to dark violet – there was not yet any need to attach those nuances to separate word labels.

Research in perception repeatedly demonstrates that seeing is both a biological mechanism and a social activity. When someone or something draws our attention to a detail in our environment we ”attend” to that detail and tend to neglect the rest. This is shown in a well known experiment, in which people watching a ballgame don’t notice the actor in a gorilla suit entering the scene, because they are busy counting the number of times the ball is passed (Watch here, https://youtu.be/vJG698U2Mvo). Thus, vision partly works in a ”top-down” fashion, as psychologists use to say, because we constantly move our eyes and activeley seach out what we want to see or what we expect to see.

But vision also works in the opposite, ”bottom-up” direction. Raw visual data is received by the photoreceptors in our eyes (or, more correctly, in the retinas of our eyes), and is processed for the extraction of only those features and contrasts that are necessay for perception. Vision is selective and active. The supposition that we would not ”see” things if we cannot ”name” them rests on a limited understanding of the relationship between sensation and meaning, or between raw perception and developed cognition.

Neuro-electrical excitation levels of responsive fields (with ON and OFF regions) when registering different points around a light/dark border. Responsive fields only partly overlapping the borders have the highest response levels (above and below zero level), resulting in the perception of a sharp contour. (Source: Thompson, Trosciano & Snowden, Basic Vision)

Actually, ”meaning”, in a wider sense than only ”verbally expressed meaning”, is generated already at the ”primitive” level of extraction of contours by the photoreceptors. As anyone who has ever tried to draw a picture of an object would know, there are no contours ”on” the object. There are only surfaces. Producing a drawing with contours is a process akin to how the organisation of photoreceptors in networks of ”responsive fields” is optimized for the registration of changes in light intensities in a perceived scene: the borders between lighter and darker regions are decoded as contours, from which higher functions in the brain can ”conclude” what kind of object or shape we are perceiving. After some 100 years of advanced neurological science we still know very little about how this actually works. Scientists surely know how visual features, such as size, placement, orientation, colour and movement are processed by specialized regions in the brain, and that these regions are all interconnected in a neural network of amazing complexity, but there is still no clear answer to how all these features and pieces of information are coordinated and understood as something we can point to and refer to with a term in language, for example ”a ball”, ”a cube” or ”a house”.

It seems that the more we study these matters, the less we know, and the more we will refrain from simplified generalizations such as ”there is nothing outside of language!” or ”everything is biology!” Sometimes, Visual Studies can provide space for sharing and comparing contributions from different disciplines: what do historians, sociologists, linguists, computer scentists, biologists have to say about the use of visual skills in their work, and how can their own research contribute to our knowledge about the visual? To the extent that this sharing and cooperation is not limited to the humanities, Visual Studies could then be defined as a more open and inclusive field than Visual Culture Studies, or as Visual Culture Studies without ”culturalist” bias. The same is true of the developments in interdisciplinary language studies, often involving pictures and ”visual thinking” also, that are known as cognitive linguistics and cognitive semiotics.

Our courses about Perception, Eye-Tracking and Comics

Hello!

Here at Åbo Akademi University in ”Swedish Finland” (svenskfinland) the sub-discipline of visual studies has existed for 12 years now, and this blog has been updated regularly or less regularly since 2012. It has been ha channel in which we inform about our courses but also about new research and new research questions in the highly interdisciplinary field of Visual studies. The current global COVID-19 situation in which almost everything we do here is done online, and in which neither students nor teachers are always even present in Finland, makes it convenient to continue this blog and to do it in English.

Basic book useful for all. Our textbook in the course Image Perception and Cognition, 2006 edition with Akiyoshi Kitaokas ”snakes”.

We always start the academic year in September and October with a course about the basic neurological and psychological principles of human vision. It is called Image Perception and Cognition and has been popular among our international exchange students during the years, as well as among students from the Åbo Akademi University (ÅAU) and the University of Turku (UTU) joint master program in biomedical visualization (BIMA). Until 2020, the course was also mandatory for all students who have chosen Visual studies as their minor/secondary subject. From this year the options will be more flexible: it is now possible to choose a more cultural/anthropological orientation and to exchange the Image Perception course for a course on visual sociology and anthropology which is usually given in April and May. However, this course is still given in Swedish only.

As another example of the wide range of disciplines and topics that can be included in courses and programs in Visual studies, this year our Image Perception course has been running at the same time as a course on the history and aesthetics of picturebooks for children. This latter course is given in Swedish by Maria Lassén-Seger, who is one of the main authorities today on culture and literature for children in the Swedish and Finland-Swedish academic community.

The Anthology Barnlitteraturanalyser (Children’s literature analyses) from 2008 with contributions by Elina Druker, Maria Lassén-Seger and others. See https://www.studentlitteratur.se/

A related topic is that of comics. From being a largely neglected and sometimes despised field for most of the 20th century (and seen as a threat to literacy and mental health by many proponents of ”high culture”), comics have started to aquire the status of the ”ninth art”, and the culture of comics has been researched from historical, cultural, folkloristic, literary, aesthetic, communicative and psychological perspectives. In psychology and psycho-linguistics, eye-tracking technology has proved useful in determining how we actually read comics (and how we read the many differents kinds of comics that exist) in comparision to how we read linear text.

Isn’t it therefore quite fitting that we should in November and December give one course about comics and another about the technology and methodology of eye-tracking? Some students with a psychological interest in comics could then follow both.

The setup we use for recordings and student projects in our eye-tracking lab. Eye-movements are measured with the infrared sensor SMI RED. Image source: https://www.researchgate.net/figure/Fig1-Hardware-setup-with-binocular-eye-tracker-SMI-RED-250_fig3_264388921

This year, however, the COVID-19 virus and the recently imposed heavier restrictions on mobility at campuses in Finland have put an end to this brilliant idea.

As our course Eye-Tracking Methodology in Visual Studies, which should have started with lab exercise in our eye-tracking test room in the beginning of November (week 45) cannot be given online for obvious reasons, it has to be cancelled. The decision is not ours. An explicit decision about cancelling the course has been issued from the Faculty board, and it now seems that similar decisions have been made at our Finnish-speaking neighbor university, the University of Turku (which harbors one of the most advanced eye-tracking labs in northern Europe).

However, we have objected that the decision does not confirm to the current COVID-19 recommendations of Åbo Akademi University  (se recent updatses HERE), which state that ”Exceptions will be made for certain courses which require presence, such as courses with laboratory sessions or internships.”

With this blog entry and with separate messages, we today inform all those who have registered for the course Eye-Tracking Methodology in Visual Studies about this situation.

Scott McCloud showing his definition of ”comics” in his own comic ”Understanding Comics” (1993)

Our course Comics: Cultural and Interdisciplinary Perspectives is, however, still open for registration in the Åbo Akademi ”Peppi” system and will start in a week from now, on Monday 26 Oct0ber. It is possible to register until the course starts. Please see our course page for more information: Våra kurser/Our courses.

The course is thematically conceived with three parts, each with a separate teacher. The first part, which deals with the character of comics as a visual medium, will be given by Mikael Andersson, deputy university teacher in Visual studies. See earlier text related to this part: ”Some words on the ’simplicity’ of comics” (October 2013).

The second part, with an approach to comics from the perspecitive of sociology and comparative literature, is usually given by Ralf Kauranen who has specialised in Finnish comics and comics production in his research, and who now works at the department of Finnish literature at the University of Turku. Kauranen has recently been responsible for the research project Comics and Migration: Belonging, Narration, Activism, financed by the Kone foundation: Comics and Migration homepage.

The third part, which deals with the connections of comics to folkloristic traditions and notions, and the role of comics in contemporary Fandom culture, will be given by Jacob Löfgren. He received his PhD in Folkloristics at Åbo Akademi University and is now affiliated with the Popular Culture Studies research node at Lund University in Sweden: Popular Culture Studies Node.

Tomorrow there will be an update here about a new book and doctoral thesis about alternative comics in Sweden: Kristina Arnerud Mejhammar’s Självsyn och världsbild i tecknade serier. Kristina defended her thesis at Uppsala University in Sweden on Friday, 18 October.

Visual studies and the body

From Sade Kahra’s installation Wear Your Fear – Cancer Collection at BioCity Turku. Copyright Sade Kahra 2018. Photo: Fred Andersson.

Visual studies belongs primarily to the ”humanistic disciplines” or ”the Arts”. To be active in Visual studies has often been a way to combine Art history with Comparative literature, Media or Film studies, Sociology, and even Linguistics and Psychology. However, the development of Image and Media technology takes place in the fields of Science, the fields of numbers and precise instruments. At least some knowledge of the natural sciences and of scientific methods is helpful if you want to understand the use and impact of images today. With our Visual studies intitiative at Åbo akademi, we try to break the comfort zone of our ”building” (Humanities and Languages) and to create dialogues with researchers from Computer Science, Psychology/Medicine, Bioscience and other natural sciences. One opportunity for such dialogues is our course Visuality and Visualization of Information (see Våra kurser / Our Courses).

Our role as ”humanists” is of course not to try to become matematicians or biologists, but to understand (critically) how Science alters our ideas and capabilities. Not the least when it comes to our bodies. Here in Turku, we have a lot to learn from the Bioimaging program at BioCity Turku. Recently, on August 23rd – 24th, BioCity arranged the international symposium Seeing the Invisible. Many artists, working with ”fine arts”, take inspiration from biotechnology and bioimaging. Part of our job as scholars of ”liberal arts” (history, criticism, and the like) is to comment upon their work.

Detail from Sade Kahra’s installation Wear Your Fear – Cancer Collection at BioCity Turku. Copyright Sade Kahra 2018. Photo: Fred Andersson.

For the Seeing the Invisible symposium, Turku artist Sade Kahra had installed textile objects from her project Wear your Fear – Cancer Collection in the BioCity entrance hall. The objects are white robes on which colourful images of cancer cells have been printed. These images have been produced by scientists who work with the advanced microscopy and visualization devices available at the Bioimaging program. The robes are held together by ribbons on which some background information about each case/image is printed, the information being only partly visible. Most robes are hanging suspended around one of the main staircases of the hall. This exhibition is on view for a month, until September 28th.

Until one realizes that the images printed on the robes actually represent cancer cells, they may only strike the viewer as exceedingly beautiful. Biomedical visualization techniques produce images which are aesthetically very appealing, which makes them increasingly popular and useful for creating curiosity. However there is a difference between curiosity and understanding. In the text which she has written for the exhibition Sade Kahra implies that most of us still interpret scientific images according to old expectations and conventions, whilst it is much harder to fathom the new possibilities and discoveries which these pictures actually make visible:

”Bioimaging is not about reproducing, but depicting reality with a specific meaning. For centuries our eye has been trained to look at images based on certain rules, with an image perception typical of our culture. Common man interprets and perceives the biomedical visualizations as traditional images and therefore, despite their testimonial value, they remain a composition of colors and abstraction.”

To print the images on cloth and to wear them on our bodies could be a way to reclaim the bodily and aesthetic experience in the abstract world of science: ”New technologies have formed medicine into an image science, but as in early physics, our internal microscopic elements are disconnected from all bodily and social contexts.” If this is so, then a more intimate relationship with Science and a deeper understanding of its images may help us identify more clearly the cultural habits and rules which usually condition how we see things. This is no doubt an important aim of Visual studies.

Perception, Imagology and Visualization this year

Professor Anthony Johnson

Professor Anthony Johnson

After the student’s texts last week, I will now publish some posts in English, due to our current courses in English and all the positive interest that we receive from exchange students!

On this Thursday two of our courses in Visual Studies will start, and both are given in English. The first one is simply called Image Perception and Cognition, and it explains the basics in current neurological and psychological knowledge about the human visual system. You will learn some anatomy of the brain and the mechanisms at different stages in its processing of visual information. It will be a mind-boggling and exciting journey, all the way from the ”simple” registration of light at the retina, up to the cognitive job of consciously interpreting what we see!

The second course to start this Thursday is very different from the first one, so this way you really have a chance to get a clue of how broad and open the field of Visual studies really is! It is a course in arts and literature, given by our professor in English language and literature, Anthony Johnson, whom you see a picture of here. He is a legendary lecturer, and a jazz musician too.

The subject of his course is not so far away from psychological concerns as one might believe, because it is really about Imagology – a research field created by scholars who want to understand the mental images we form, for example when we read a certain text. In some respect, imagology was founded almost 100 years ago, when the American journalist and scholar Walter Lippmann developed his theory on the stereotypes we use when we describe members of certain nations or groups.

Anthony’s course is called Cultural Imagology – An introduction, and because it is about cultural imagology, he will not only talk about national and social stereotypes but also about the way people conceive of literature, geography and music. In the first lecture this Thursday, he will however begin with defining what an image is, or could be.

For those of you registered in the Image Perception and Cognition course, I will give an introduction on this Thursday, September 5th at 2 PM, in the Arken building of human sciences and languages here in Turku, room E201 (Camera Obscura). Then there is a one hour pause, and at 4 PM Anthony Johnson’s lecture starts in the same room. It will last for two hours.

Maybe you are a biologist or a student of computer systems who is also interested in art and literature, or maybe you are a student of literature who wants to know how the brain works? Then you are welcome to attend both courses!

Screen-Ddump from looking at tissue layers in BioImageXD.

Screen-dump from looking at tissue layers in BioImageXD.

In October and November I will myself give a course on Comics together with Folkloristics and Sociology. Further information in English is here. At the end of January a fourth Visual Studies course in English starts. Its name is Visuality and Visualization of Information.

This course will really give rich opportunities of combining arts with knowledge of the brain, because it is about why certain design strategies are better than others. We will use a textbook by the American psychologist Colin Ware, who is currently one of the internationally most acclaimed scientists in the expanding field Visualization.

This is a field in which neurological research, which may seem technical and abstract to many, is really put to practise in the form of effective strategies for visualization. It could be of use for marketers and web designers, but not the least for students and scholars who want to communicate research visually. There is a joint Master’s program in Bioimaging between Åbo Akademi University and Turku University, and many of our perception students have been from there. The Turku Bioimaging center (se link at top right here) has generously given all of us an opportunity to see how modern visualization works. They have created the free image processing tool BioImageXD that anyone can download at the BioImageXD page.

After downloading and opening the program, you can experiment yourself with multi-layer microscope images that you download as a free sample package at the SourceForge download page (see links at the bottom of the BioImage XD download page). The image that I show here is from a session that me and one of my students had with the program. We noticed that the possibility of generating views in 3D really added a lot to the precision of the visualization. In the Visuality and Visualization of information course we will study both simple and complex visualizations, ranging from comic books to medicine and physics, and at the end you will have the opportunity to realize a new visualization yourself.

For more inspiration, see:

”Genes to Cognition” page with an interactive 3D brain (very good for training at the Image Perception and Cognition course)

A short text defining Imagology

A Vimeo lecture on visualization by Colin Ware

/

länkning pågår till intressant.se