I have been arguing recently that meaning consists of intentionality and semanticity, where intentionality inheres in the relationship between the interlocutors (even if they are not face-to-face and synchronous) and semanticity inheres in the linguistic/cognitive system. Semanticity, in turn, consists of relationality and adhesion, where relationality is the relationships words have among themselves and adhesion inheres in the perceptual and motor linkages words have with the external world. In this view, meaning in LLMs is a matter of relationality.
I recently performed an experiment which bears on ChatGPT’s capacity to approximate intentional meaning in a conversation. In this case, a conversation between Duke Ellington and Leonard Bernstein. Back in 1966 the two had a conversation that was televised on station WTMJ-TV. Here’s the video clip:
I wrote a blog post where I included a clip of the conversation along with commentary and transcriptions of bits here and there. At about 05:53 Bernstein remarked to Ellington: “...you wrote symphonic jazz and I wrote jazz symphonies.” The two men then shook hands.
In my commentary I wrote that the actual assertion was not very meaningful, and that both men surely knew it, but that much was conveyed indirectly. That meaning derived from the fact that both men were, in effect, acting as representatives of two cultural traditions and so Bernstein’s remark, and Ellington’s acceptance, had the weight of a cultural negotiation.
I was curious about how much of that ChatGPT would be able to pick up. So I transcribed a bit of the conversation up to that point and asked the Chatster what was going on. Here’s that interaction. My prompts are in boldface while ChatGPT's responses are plain face (except for bolded topics on numbered lists).I’ve inserted some comments which I’ve aligned to the right-hand margin and highlighted thus. At the end of the interaction I have some general remarks about ChatGPT’s performance, including some remarks about ChatGPT’s lack of intuitive or tacit knowledge.
* * * * *
In 1966 Duke Ellington and Leonard Bernstein were interviewed on television. They were asked to talk about the state of music in America. I am going to give you part of that conversation, including the interviewer, and then I want to ask you about it.
Here’s the interview:
Leonard Bernstein: As a matter of fact there's tremendous diversity taking place. Diversification I should say because it's in the process of happening. But there has been a tremendous spread away from the metropolises to smaller cities to university campuses communities of various sorts and sizes.
I mean popularly referred to as the cultural explosion which is a word that occasions some dismay among the higher brow critics. But it's a thing that I am very proud of and happy to see happening because it's not a fake explosion. It's a real one and it's penetrating everywhere everywhere in the country.
Interviewer: Mr. Ellington how do you feel on the same point?
Duke Ellington: Well, I'm very happy to know that the american audience is maturing.
Inteviewer: And maturing you feel across the country.
Ellington: Oh yes.
Interviewer: What evidence do you find in your concerts of this?
Ellington: Well ours is a rather a separate one. It's in that, you know, everybody gets their own audience more or less. And because I was just spread over a long period you know. It's we find people who met when we were playing "Mood Indigo" at a prom, or the baby was born when "Caravan" came out or "Don't Get Around much Anymore," they were seeing husband after war, or something like. We cover a lot of different generations, you know, and so it's uh you just sort of automatically have an appraisal of the scene.
Bernstein: But wouldn't you say, Duke, that one of the great signs of this explosion I was talking about is that we really share the same audiences to a much greater extent than we used to. I mean, as you say, you have your own audience. Well that used to be true and I suppose our kind of music, if you could say such a thing, used to have its own audience. But now you can't tell them apart anymore. I mean the same kids and the same excited people who come to hear you, come to hear me and that's something new.
Ellington: What what I have been trying to, in the talking of, seeing and trying to de-categorize this American, it's American music I would say. Oh the stuff that we're in, anyway. And it's getting to the point now where the modern contemporary composer and the guy who's supposed to be a modern jazz composer, they all come out of the same conservatories.
Bernstein: Exactly.
Ellington: And it's very difficult to find a place to draw the line.
Bernstein: Well you were certainly one of the pioneers in that.
Ellington: Oh yeah, but i didn't come out of the conservatory.
Bernstein: No. but you one of the the first people who wrote so-called symphonic jazz.
Ellington: I had a conservatory in the capital theater.
Bernstein: That's right exactly. Sit there and listen to the symphony before the picture. Maybe that's really the difference between us. That you wrote symphonic jazz and I wrote jazz symphonies.
Ellington laughs. They shake hands.
This conversation between Duke Ellington and Leonard Bernstein offers valuable insights into the evolving landscape of American music during their time. Here's a breakdown of some key points:
1. Diversification and Cultural Explosion: Bernstein highlights the significant diversification happening in American music, particularly away from major cities and into smaller communities and campuses. This expansion, often termed a "cultural explosion," is viewed positively by both musicians.
2. Maturing Audience: Ellington expresses satisfaction with the maturation of the American audience, indicating a broadening appreciation for music across the country.
3. Shared Audiences: Bernstein observes that the lines between different genres of music are blurring, with audiences for jazz and classical music increasingly overlapping. This suggests a more unified appreciation for music regardless of genre distinctions.
4. De-categorization of American Music: Ellington emphasizes the emergence of a unified American musical identity, transcending traditional genre boundaries. He notes the difficulty in categorizing music into distinct genres, as contemporary composers and jazz musicians share similar backgrounds and influences.
5. Symphonic Jazz vs. Jazz Symphonies: Bernstein and Ellington playfully discuss their contributions to music, with Ellington credited as a pioneer of "symphonic jazz" and Bernstein likening his own compositions to "jazz symphonies." This exchange highlights the innovative approaches each artist brought to their respective styles.
Overall, the conversation reflects a period of significant change and artistic exploration in American music, with both Ellington and Bernstein contributing to its evolution in distinct yet interconnected ways.
That’s a decent summary of the things they talked about, but it completely misses the significance of Bernstein’s remark to Ellington. So I asked ChatGPT directly about that.