(I got carried away. The following is probably unreasonably picky and uninteresting. Still…)
I found the Nature summary rather confusing, whereas the original article is pretty clear.
However, I tend to be wary of generalizations about language. Here’s a quote that seems to me to overstate its case:
“In language, context emerges from the mutually interacting meanings of words. As new words are successively added to a text or speech stream, context is built up by the repeated appearance of certain words or word combinations, by the emphasis on some classes of nouns and adjectives, by the choice of tense, etc. These elements progressively establish the situational framework defined by the message in all its details. Thus, linguistic context is a collective expression of the semantic contents of the message.” (Italics mine.)
Everything leading up to the last sentence is reasonable, but the last sentence is an over-simplification of real-world language, because it ignores extra-linguistic elements (physical situation, culture, etc.) in the linguistic context. One of the most difficult parts of translation is getting across those things that are implied by elements outside the language proper–especially cultural factors that may not be obvious to your target audience. On top of that, it ignores syntax altogether, as though we could equate “The dog bit the man”. and “The man bit the dog.”
Here’s another over-simplification:
“In language, words –or short combinations of words– stand for the units of semantic contents, with (almost) unequivocal correspondence with objects and concepts. Moreover, in the symbolic representation of language as a chain of characters, i.e. as a written text, words are separated by blank spaces and punctuation marks, which facilitates their identification –in particular, by automatic means.”
The boy apparently hasn’t spent much time in arguments on sci.lang and sci.lang.japan about just exactly what “word” should apply to–and about whether there is a single concept indicated by “word” that can be meaningfully applied to all languages–or even to any language. (A very simple way to make this point is that in English writing, “bookstore” is rendered as one word, while “grocery store” is written two words, but neither way of counting words is made unambiguously necessary by any facts about the structure of the English language.)
The statement about writing is just plain wrong. Even if we could say that Chinese languages have “words”, they are certainly not distinguished as such in the writing system. (Chinese characters equate to syllables, which do not consistently equate to anything that we can call words.)
Japanese can also be written with long strings of kana in which “words” are not distinguished graphically. In fact, I think it was R.H. Blythe who pointed out an entire paragraph from The Tale of Genji, written entirely in hiragana, which is so ambiguous in terms of word breaks that it can be read either as a description of the onset of Autumn, or as a description of the emotional effects of a romantic break-up–each interpretation reinforcing the mood of the other. (And done entirely on purpose, of course.) How shall we count words in such a piece of text? This may be an extreme example, but it does show that ambiguities exist.
So, context in language is much more subtle and ambiguous than is implied by subjecting it to word frequency counts. This is not to say that such analysis is not interesting, but only that it may not provide any deep revelations about the nature of language.
The application of the same style of analysis to music seems even less exciting, somehow. If language doesn’t really have a clear-cut natural unit (the word) to which such analysis can be usefully applied, music is even more lacking. I’m not sure that the final result cannot be summed up as simply, “We use context in judging sensory input.”