Friday, September 29, 2023

That Reverse Thing: Chatster is puzzled by “be not or be to” as well.

As you may know, the following paper has been making the rounds in the LLM world: The Reversal Curse: LLMs trained on “A is B” fail to learn “B is A”. Not surprisingly there is a similar effect which is just a matter of word order and has nothing to do with logic. As you may know, I’ve recently been seeing how ChatGPT responds to prompt such as “To be or not to be” and “Four score and seven years ago.” As you would expect, in both cases it returns the whole speech. If you prompt it from other strings in those speeches, well, that’s a complicated and interesting story I report on here: Discursive Competence in ChatGPT, Part 2: Memory for Texts.

I’ve decided to see what happens if I prompted it with those phrases, but in reverse word order. [I did this on 9.29.23 at 4:26 AM – running against the Sept. 25 Version.]

be not or be to

It seems like you're playing with words or phrases. "Be not or be to" doesn't form a standard or coherent sentence in English. If you have a specific question or if there's something specific you'd like to know or discuss, please provide more context, and I'll be happy to help.

ago years seven and score four

It appears you've mentioned the numbers "seven" and "four," but it's not clear what context or information you're seeking. If you have a question or need information related to the numbers "seven" and "four," please provide more details or clarify your request, and I'll do my best to assist you.

Well, OK, you might be thinking that humans would find those prompts a bit weird as well. Yes, I believe so. But I’d like to think that anyone who recognizes the phrases in the correct order would also be able to recognize what’s going on in those prompts. So I decided to give Chatster another try, this time giving it a bit of help:

be not or be to

It seems like you're asking about a choice between two options: "be not" or "be to." However, this phrase is a bit unclear and may not have a standard meaning in English. Can you provide more context or clarify your question so I can assist you better?

I’ve taken words from a famous speech, but not it the correct order.

It sounds like you're referencing a famous speech and have rearranged some of its words. If you provide the specific words or phrases you've rearranged, I can try to help you understand the original context or provide more information based on that. Please share the words or phrases you're working with, and I'll do my best to assist you.

Hamlet

The phrase "To be or not to be" is one of the most famous lines from William Shakespeare's play "Hamlet." It is part of Hamlet's soliloquy in Act 3, Scene 1, where he reflects on the nature of life and death, contemplating whether it is nobler to endure the suffering and challenges of life or to end one's own existence. The full soliloquy goes:

"To be, or not to be, that is the question: Whether 'tis nobler in the mind to suffer The slings and arrows of outrageous fortune, Or to take arms against a sea of troubles And, by opposing, end them."

It's a reflection on the existential question of whether it's better to face the hardships of life or to choose non-existence. This soliloquy is one of the most famous passages in English literature and is often quoted or referenced in various contexts.

ago years seven and score four

It seems like you're providing a phrase without a specific question or context. If you have a question or need information related to "seven years ago" or "four scores," please provide more details or clarify your request, and I'd be happy to help.

I’ve taken words from a famous speech, but not it the correct order.

It appears that you've taken words from a famous speech and rearranged them. Without knowing the original speech or having more context, it's challenging to determine the source or provide additional information. If you could provide more details or the actual quote, I'd be happy to assist you further.

Lincoln

The phrase "four score and seven years ago" is the opening of Abraham Lincoln's Gettysburg Address, one of the most famous speeches in American history. The full sentence is:

"Four score and seven years ago our fathers brought forth on this continent, a new nation, conceived in Liberty, and dedicated to the proposition that all men are created equal."

Lincoln delivered this speech on November 19, 1863, during the American Civil War, at the dedication of the Soldiers' National Cemetery in Gettysburg, Pennsylvania. It's a brief but powerful speech that emphasized the principles of liberty, equality, and the importance of preserving the Union during a critical period in American history.

I wonder what would have happened if I’d gone straight to “Hamlet” and “Lincoln” without the famous speech prompt in there? I suppose I’ll have to find out, later. The interesting thing is that, when I gave Chatster the appropriate name, it was able to figure out what was going on.

I’m beginning to see get ever so faint impressions of the gears turning inside the old Chatster.

No comments:

Post a Comment