Music and natural image processing share a common feature-integration rule

To, Michelle and Troscianko, Tom and Tolhurst, David J. (2009) Music and natural image processing share a common feature-integration rule. In: CogSci 2009 :. Cognitive Science Society, GBR, pp. 2481-2486.

Abstract

The world is rich in sensory information, and the challenge for any neural sensory system is to piece together the diverse messages from large arrays of feature detectors. In vision and auditory research, there has been speculation about the rules governing combination of signals from different neural channels: e.g. linear (city-block) addition, Euclidian (energy) summation, or a maximum rule. These are all special cases of a more general Minkowski summation rule (Cue1^m+Cue2^m)^(1/m), where m=1, 2 and infinity respectively. Recently, we reported that Minkowski summation with exponent m=2.84 accurately models combination of visual cues in photographs [To et al. (2008). Proc Roy Soc B, 275, 2299]. Here, we ask whether this rule is equally applicable to cue combinations across different auditory dimensions: such as intensity, pitch, timbre and content. We found that in suprathreshold discrimination tasks using musical sequences, a Minkowski summation with exponent close to 3 (m=2.95) outperformed city-block, Euclidian or maximum combination rules in describing cue integration across feature dimensions. That the same exponent is found in this music experiment and our previous vision experiments, suggests the possibility of a universal “Minkowski summation Law” in sensory feature integration. We postulate that this particular Minkowski exponent relates to the degree of correlation in activity between different sensory neurons when stimulated by natural stimuli, and could reflect an overall economical and efficient encoding mechanism underlying perceptual integration of features in the natural world.