Publications

Metatla O., Correia N. N., Martin F., Bryan-Kinns N., Stockman T., Tap the ShapeTones: Exploring the effects of crossmodal congruence in an audio-visual interface. To appear in the Proceedings of ACM SIGCHI 2016

Metatla O., Bryan-Kinns N., Stockman T., Martin F., Sonifications for Digital Audio Workstations: Reflections on a Participatory Design Approach To appear in the Proceedings of The 2015 International Conference on Auditory Displays, Graz, Austria.

Metatla O., Martin F., Stockman T., Bryan-Kinns N., Designing with and for people living with visual impairments: Audio-tactile mockups, audio diaries and participatory prototyping. Accepted CoDesign: International Journal of CoCreation in Design and the Arts.

Metatla O., Martin F., Stockman T., Bryan-Kinns N., Non-Visual Menu Navigation: the Effect of an Audio-Tactile Display. Proceedings of The 28th British HCI Conference, Southport, UK.

Metatla O., Martin F., Stockman T., Bryan-Kinns N., An Activity Patterns Approach to Cross-moda Interface Design. Proceedings of Sonic Information Design Workshop at the International Conference on Auditory Display, New York, USA.

Metatla O., Martin F., Stockman T., Bryan-Kinns N., Developing Methods and Techniques for the Design of Cross-modal Displays. Proceedings of EICS Engineering HCI 2014, The sixth ACM SIGCHI Symposium on Engineering Interactive Computing Systems, Rome , Italy.

Metatla O., Bryan-Kinns N., Stockman T., Martin F., Activity Theory as a Tool for Identifying Design Patterns in Cross-modal Collaborative Interaction. Proceedings of the 14th IFIP TC13 Conference on Human-Computer Interaction, Cape Town, South Africa.

Martin F., Metatla O., Bryan-Kinns N.,  Stockman T., The Cross Modal Observer Design Pattern, Technical Report ECSRR-16-01, Queen Mary University of London, 2016. [PDF]

Martin F., Metatla O., Bryan-Kinns N.,  Stockman T., The Lock Driven Awareness Design Pattern, Technical Report ECSRR-16-02, Queen Mary University of London, 2016. [PDF]

Proulx, M. J., Todorov, O., Taylor Aiken, A., \& de Sousa, A. A. (in press). Where am I? Who am I? The relation between spatial and social cognition in the built environment. Frontiers in Psychology.

Finnegan, D. J., Proulx, M. J., \& O’Neill, E. J. (in press). Correcting distance compression in audiovisual virtual reality environments. Proceedings of SIGCHI.

Esenkaya, T., \& Proulx, M. J. (in press). Crossmodal processing and sensory substitution: Is "seeing" with sound and touch a form of perception or cognition? Behavioral and Brain Sciences.

Proulx, M. J., Gwinnutt, J., Dell’Erba, S., Levy-Tzedek, S., de Sousa, A. A., \& Brown, D. J. (2016). Other ways of seeing: from behavior to neural mechanisms in the online “visual” control of action with sensory substitution. Restorative Neurology \& Neuroscience, 34, 29-44.

Brown, D. J., Simpson, A. J. S., \& Proulx, M.J. (2015). Auditory Scene Analysis and sonified visual images: Does consonance negatively impact on object formation when using complex sonified stimuli? Frontiers in Psychology, 6, 1522. doi: 10.3389/fpsyg.2015.01522

Pasqualotto, A., Kobanbay, B., \& Proulx, M. J. (2015). Neural stimulation has a long-term effect on foreign vocabulary acquisition. Neural Plasticity, 2015, 7. doi:10.1155/2015/671705.

Pasqualotto, A., \& Proulx, M.J. (2015). Two-dimensional rubber-hand illusion: The Dorian Gray hand illusion. Multisensory Research, 28, 101-110.

Brown, D. J., Simpson, A. J. R., \& Proulx, M. J. (2014). Visual objects in the auditory system via sensory substitution: How much information do we need? Multisensory Research, 27, 337-357. doi: 10.1163/22134808-00002462

de Sousa, A. A., \& Proulx, M. J. (2014). What can volumes reveal about human brain evolution? A framework for bridging behavioral, histometric and volumetric perspectives. Frontiers in Neuroanatomy, 8, 51. doi: 10.3389/fnana.2014.00051

Proulx, M. J., Brown, D., Pasqualotto, A., \& Meijer, P. (2014). Multisensory perceptual learning and sensory substitution. Neuroscience and Biobehavioral Reviews, 41, 16-25. doi: 10.1016/j.neubiorev.2012.11.017

Proulx, M. J., Ptito, M., \& Amedi, A. (2014). Multisensory integration, sensory substitution and visual rehabilitation. Neuroscience and Biobehavioral Reviews, 41, 1-2. doi: 10.1016/j.neubiorev.2014.03.004

Pasqualotto, A., Taya, S., \& Proulx, M. J. (2014). Sensory deprivation: Visual experience alters the mental number line. Behavioural Brain Research, 261, 110-113.

Pasqualotto, A. \& Proulx, M. J. (2014) Mechanisms of short-term false memory formation. The Journal of Neurobehavioral Sciences, 1, 3-8.

Brown, D. J., \& Proulx, M. J. (2013). Increased signal complexity improves the breadth of generalization in auditory perceptual learning. Neural Plasticity, 2013, 9. doi: 10.1155/2013/879047

Pasqualotto, A., \& Proulx, M. J. (2013). The study of blindness and technology can reveal the mechanisms of three-dimensional navigation. The Behavioral and Brain Sciences, 36(5), 559-560. doi: 10.1017/S0140525X13000496