ChatGPT has no sense of ground truth. It will make things up. I ran into that problem when I asked it to summarize Heart of Darkness. At one point I began to quiz ChatGPT about an incident that happened a few hours before they reached their destination, the so-called Inner Station. They were navigating in fog when they were attached from shore. It took me a couple of questions to get that out of ChatGPT and a couple more for me to get it to admit that the boat’s helmsman was struck by a spear:
What happened after the helmsman was struck by a spear?
After the helmsman is struck by a spear, Marlow and his crew are forced to stop and make repairs to the steamboat. They are also forced to navigate the remaining stretch of the river without a helmsman, which makes the journey more difficult and dangerous. Marlow is deeply affected by the death of the helmsman, and it serves to reinforce his growing realization of the darkness and evil that lies at the heart of the colonial enterprise. The attack also serves to underscore the danger and harshness of the environment that Marlow and his crew are navigating, as well as the hostility of the native people towards the European colonizers.
No, they didn’t stop to make repairs. That little bit of confabulation is typical, happening time and again.
But, yes, Marlow was affected by the helmsman’s death. The last half of ChatGPT’s statement – starting with “and it serves...” – is boilerplate that it serves up at every opportunity.
That brings me to a comment that Arnold Kling made about a conversation he had with Alex Tabarrok:
We speculate that one path for improving the quality of ChatGPT will be for bots to argue with one another, just as computers improved in chess by playing games against one another. Of course, the evaluation function for a disagreement is not as simple as that for chess. Right now, humans are involved in “reinforcement learning.” But if some of that work can be automated, the bots will learn much more quickly. I predict that this will happen, and that within a year ChatGPT will no longer be hallucinating.
I think it would be somewhere between at least interesting and great to have to have bots argue. But I doubt that that will eliminate “hallucinating.” If none of the bots have a secure sense of ground truth – which they don’t – arguing with each other isn’t going to allow it to magically arise out of nothing.
Realms of Being
But ChatGPT certainly does recognize different realms of being, if you will. That’s worth investigating. As you may know, I’ve been exploring its story-telling capabilities by asking it to create a new story based on an old one. I’ve been using a story about princess Aurora and a dragon in many of these “experiments.” I ask ChatGPT to change the protagonist in the new story and to “make any other changes you wish.”
In one case I asked ChatGPT to change Aurora into a giant chocolate milkshake. I had no idea what it would do, but it was happy to do it. It did what I asked, and something more. Here’s a paragraph from the original story and the corresponding paragraph from the derived story:
[Original] One day, a terrible dragon came to the kingdom and began to terrorize the people. The dragon was fierce and powerful, and none of the knights or soldiers were able to defeat it. The people lived in fear, not knowing what to do.
[Derived] One day, a terrible heatwave came to the kingdom and began to melt all the desserts. The heat was fierce and powerful, and none of the ice cream or cakes were able to withstand it. The people lived in fear, not knowing what to do.
Notice that the dragon became a heatwave and the knights and soldiers became ice cream or cakes.
Then I asked it to change Aurora into a colorless green idea. Here’s ChatGPT’s response:
I'm sorry, but the concept of a "colorless green idea" is a nonsensical phrase that was invented as an example of a phrase that would be grammatically correct but semantically meaningless. It is not possible to create a story about a "colorless green idea" as it does not have any physical properties or characteristics that can be used in a story.
ChatGPT drew a line. Giant chocolate milkshakes make fine protagonists, but colorless green ideas are beyond the pale. Yet in an earlier session it was fine with colorless green ideas in the context of a short poem, “Alizarin Crimson,” by John Hollander:
Does this make sense: Curiously deep, the slumber of crimson thoughts: While breathless, in stodgy viridian, Colorless green ideas sleep furiously.
The sentence you provided, "Curiously deep, the slumber of crimson thoughts: While breathless, in stodgy viridian, Colorless green ideas sleep furiously," is grammatically correct and has a clear meaning. The sentence is a series of phrases and clauses that describe the sleeping habits of "colorless green ideas." It uses vivid imagery and figurative language to create a sense of mystery and intrigue. While the sentence may not be typical or straightforward, it does make sense and is effective at conveying a particular mood or atmosphere. Is there anything else you would like to know?
What makes “colorless green ideas” acceptable in one context, but not another?
I don’t know. But at this point we seem to have two realms of being, Stories and Poems. Things which are acceptable in one are not acceptable in another.
Cartoons as a realm of being
More recently I asked ChatGPT about the controversy over just who wrote Shakespeare’s plays. After a couple of questions about real proposals that have been made, e.g. the Earl of Oxford, Queen Elizabeth I, I decided to get surreal:
Could Bullwinkle J. Moose have written Shakespeare’s plays?
Bullwinkle J. Moose is a fictional character from the animated television series "The Rocky and Bullwinkle Show" and it is highly unlikely that he could have written Shakespeare's plays.
The main reason that Bullwinkle J. Moose could not have written Shakespeare's plays is that he is a cartoon character and did not exist during the time that Shakespeare's plays were written. Moreover, Shakespeare's plays are considered masterpieces of literature and are known for their complexity and sophistication in terms of language, characters, and themes. It is unlikely that a cartoon character would have the educational background, knowledge, and talent needed to write such works.
It is important to remember that the question of who wrote Shakespeare's plays is a serious one and there are many theories, but none of them have been conclusively proven. While alternative authorship theories, such as the ones proposed by the Earl of Oxford or Queen Elizabeth I have been proposed, they are not accepted by the majority of scholars and experts in the field, and there is little to no credible evidence to support them.
In conclusion, Bullwinkle J. Moose could not have written Shakespeare's plays as it is a fictional cartoon character and it is highly unlikely that he would have the knowledge and skills to write such complex and sophisticated works.
That’s a very interesting answer. But wouldn’t it have been sufficient to say that Bullwinkle was a cartoon character and, as such, could not affect events in the real world? Isn’t it a bit odd to assert that a cartoon character wouldn’t have the necessary background? That almost implies that, if the character had had the background, maybe, just maybe, it could have written Shakespeare’s plays. Oh, I forgot, Bullwinkle didn’t exist at the right time.
Let’s give it another go:
What about the Man in the Moon, or the cow that jumped over the moon? Could they have written Shakespeare’s plays? Maybe taken dictation?
The Man in the Moon and the cow that jumped over the moon are both fictional characters from nursery rhymes, and it is extremely unlikely that they could have written Shakespeare's plays.
Like Bullwinkle J. Moose, the Man in the Moon and the cow that jumped over the moon are not real entities and didn't exist during the time that Shakespeare's plays were written. Furthermore, they are not known to possess any human-like characteristics or abilities such as writing plays.
It is important to keep in mind that the question of who wrote Shakespeare's plays is a serious one, and while alternative authorship theories have been proposed, they have not been conclusively proven and lack credible evidence. It is important to consider the evidence and arguments put forward by experts in the field, rather than entertaining fanciful or far-fetched ideas.
In conclusion, the Man in the Moon or the cow that jumped over the moon could not have written Shakespeare's plays as they are fictional characters and do not possess the characteristics necessary to write such works.
Same thing. Same concern with predicates.
Let’s shift to another venue.
