Sunday, August 26, 2012

Colors can talk, too

Synesthesia--

a condition by which a stimulus can be perceived to be dipped into a melting pot of sensory triggers.

Or, as more formally defined by Eagleman and Goodale (in press), it is a "perceptual phenomenon in which stimuli can trigger experiences in non-stimulated sensory dimensions" (p.1). 

Basically, the stimulus not only plugs into its respective sense receptor (e.g. color and vision), but also triggers other senses (e.g. color and taste). 

There are several types of synesthesia (after all, there are a number of ways to mix and match our different sense receptors), but according to Eagleman and Goodale (in press), color synesthesia accounts for up to 95% of reported synesthesia experiences. I guess the color-related synesthete experiences are also better known because they are easier or more believably expressed in media. It might be because we can 'see' what they see thus making it more accessible and popular. 



I first encountered this term when I read A Mango-Shaped Space by Wendy Mass back in junior high. It's about a girl named Mia Winchell, who is a synesthete. The opening pages set up her dilemma--her unusual perception of colors had caused her to be labeled as a freak. Below are Mia's first thoughts when she found out that not everyone could see the colors like she did.  
How was this possible? Was everyone playing a trick on me? Of course numbers had colors. Were they also going to tell me that letters and sounds didn't have colors? That letter a wasn't yellow like a faded sunflower and screeching chalk didn't make red jagged lines in the air? (Mass, 2003, p. 3)
Even though she was labeled a freak, I seriously wanted to have synesthesia after reading that book. 

Please don't take drugs to simulate a synesthetic experience!!!!

Mia's synesthesia is what is called a grapheme-color synesthesia wherein words and numbers are associated with colors and these color perceptions are called photisms according to Flournoy (1893, as cited by Hupé, Bordier, & Dojat, 2011). 

According to previous studies and neuroimaging, when synesthetes see colors, the same area in the brain for color perception of non-synesthetes lights up. However, a study on 10 synesthetes by Hupé, Bordier, & Dojat (2011) has found that colors arising from a synesthetic experience do not light up this color area of the brain cortex that perceiving "real" colors does. The researchers give caution though, not to discount potential commonality between synesthetic colors and real colors that may be due to individual differences of the synesthetes or to the limited capability of the measuring instruments that are available.

So, does that mean that synesthetic colors cannot be the same as real colors? 

Well, not really

Weiss, Kalckert, and Fink conducted a study back in 2008 to test whether colors might trigger grapheme perception in grapheme-color synesthetes. After a careful selection process of words, the researchers asked the synesthetes to color the capital letters of the common high and low frequency words as well as other 'distractor letters' to closely match their respective synesthetic colors. They also colored each letter of the alphabet in the same manner. Each color-letter pair was then confirmed by the participant to be accurate.

In the task, a word fragment was presented which could either be completed by a letter for a high frequency word or that of a low frequency word. When the block for the missing letter was colored for the low frequency letter, synesthetes reported low-frequency words more than the high-frequency words, which would be expected if color was irrelevant. (This is the case of the non-synesthete control group).   

This study shows that the triggers for a synesthetic experience might be interchanged, emphasizing 'bidirectionality'. Of course, because the study was limited to a small sample of grapheme-color synesthetes, generalizability could be an issue. 

Nevertheless, isn't it interesting how colors could possibly talk? Imagine a synesthete going up to a painting and literally reading it (if by any chance it is coherent).


"Bright Picture" by Wassily Kandinsky (1913)


References

Eagleman, D. & Goodale, M. (in press). Why color synesthesia involves more than color. Trends in Cognitive Sciences. doi:10.1016/j.tics.2009.03.009
Hupé, J., Bordier, C., & Dojat, M. (2011). The neural bases of grapheme-color synesthesia are not localized in real color-sensitive areas. Cerebral Cortex. doi: 10.1093/cercor/bhr236
Kandinsky, W. (1913). Bright Picture [Painting]. The Solomon R. Guggenheim Museum, New York. Retrieved from http://www.wassilykandinsky.net/work-107.php
Mass, W. (2003). A Mango-Shaped Space. New York: Little, Brown and Company. 
Weiss, P., Kalckert, A., & Fink, G. (2008). Priming letters by colors: Evidence for the bidirectionality of grapheme-color synesthesia. Journal of Cognitive Neuroscience, 21, 2019-2026. Retrieved from http://daysyn.com/Weissetal2009.pdf
[Untitled image of A Mango-Shaped Space book cover] (n.d.). Retrieved August 26, 2012 from http://www.kdl.org/categories/685/books/1134



Extras!

More on synesthesia:


Other types of synesthesia

Gustatory-Color Synesthesia
It was years after I encountered the synesthesia concept again, this time in a movie. When Ratatouille was released in 2007, one scene I could readily recall was when Remy and Emile were scouring the garbage for something to eat. Remy found some strawberry and cheese and was teaching Emile to appreciate flavor. As he was explaining,  there were clips of colors and shapes dancing on a black screen which to me did capture what I would imagine the food items to be (and sound like).



Sound-Image Synesthesia
This is another video by Michel Gagné, the one who animated the Ratatouille clip above. This time, he illustrated his own synesthetic experience when he listened to this jazz piece.



References

Gagné, M. (2010, August 3). Sensology by Michel Gagné - HD 720P - Music by Paul Plimley and Barry Guy. Retrieved from http://www.youtube.com/watch?v=UVWKtXDvr04
Gagné, M. (2010, April 21). Taste visualization for Pixar's Ratatouille - Michel Gagné - 1080P. Retrieved August 26, 2012 from http://www.youtube.com/watch?v=xizttM_Cbuc
Bird, B. & Pinkava, J. (Directors). (2007). Ratatouille [Motion picture]. USA: Disney

No comments:

Post a Comment