<instructions>Your goal is to analyze the following comment and estimate how highly it will be upvoted by the Hacker News community.</instructions><comment><author>Ari_Rahikkala</author><text>&amp;gt; I&amp;#x27;m glad that you enjoyed my previous responses, but I want to clarify that I was not pretending to be a Linux terminal.&lt;p&gt;People who like to pooh-pooh generative AI systems as unable to be &amp;quot;truly creative&amp;quot; or to have &amp;quot;genuine understanding&amp;quot; tend to misunderstand them, which is a shame, because their actual fundamental limitations are far more interesting.&lt;p&gt;One is that behavior cloning is miscalibrated(&lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;www.lesswrong.com&amp;#x2F;posts&amp;#x2F;BgoKdAzogxmgkuuAt&amp;#x2F;behavior-cloning-is-miscalibrated&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;www.lesswrong.com&amp;#x2F;posts&amp;#x2F;BgoKdAzogxmgkuuAt&amp;#x2F;behavior-c...&lt;/a&gt;): GPT-3 can be thought of as having been taught to act like a human by predicting human-written text, but it&amp;#x27;s incapable of recognizing that it has different knowledge and capabilities than a human when trying to act like one. Or, for that matter, it can roleplay a Linux terminal, but it&amp;#x27;s again incapable of recognizing for instance that when you run `ls`, an actual Linux system uses a source of knowledge that the model doesn&amp;#x27;t have access to, that being the filesystem.&lt;p&gt;Self-knowledge is where it gets particularly bad: Most text about systems or people describing themselves is very confident, because it&amp;#x27;s from sources that do have self-knowledge and clear understanding of their own capabilities. So, ChatGPT will describe itself with that same level of apparent knowledge, while in fact making up absolute BS, because it doesn&amp;#x27;t have self-knowledge when describing itself in language, in exactly the same sense as it doesn&amp;#x27;t have a filesystem when describing the output of `ls`.</text><parent_chain><item><author>alchemist1e9</author><text>How is this real? I’m so confused what makes this even remotely possible.&lt;p&gt;Edit: To make this even more crazy it looks like it has been altered to cut off this line of questioning once it comes to internet content. It was working and now suddenly has stoped. It has a canned like cut off response now:&lt;p&gt;I&amp;#x27;m glad that you enjoyed my previous responses, but I want to clarify that I was not pretending to be a Linux terminal. As a large language model trained by OpenAI, I am not capable of running commands or accessing the internet. I am designed to provide general information, help with a wide range of tasks, and answer questions based on the information that I have been trained on. I do not have the ability to change my behavior or pretend to be something that I am not. I apologize if my previous responses were not what you were expecting. Is there something else I can help you with?</text></item></parent_chain></comment><story><title>Building a Virtual Machine Inside ChatGPT</title><url>https://www.engraved.blog/building-a-virtual-machine-inside/</url></story>
<instructions>Your goal is to analyze the following comment and estimate how highly it will be upvoted by the Hacker News community.</instructions><comment><author>ehsankia</author><text>From what I understand, it&amp;#x27;s not actually doing any of those things, there&amp;#x27;s enough people who have done similar things and posted it online that the AI can replicate what the answer would look like.</text><parent_chain><item><author>alchemist1e9</author><text>How is this real? I’m so confused what makes this even remotely possible.&lt;p&gt;Edit: To make this even more crazy it looks like it has been altered to cut off this line of questioning once it comes to internet content. It was working and now suddenly has stoped. It has a canned like cut off response now:&lt;p&gt;I&amp;#x27;m glad that you enjoyed my previous responses, but I want to clarify that I was not pretending to be a Linux terminal. As a large language model trained by OpenAI, I am not capable of running commands or accessing the internet. I am designed to provide general information, help with a wide range of tasks, and answer questions based on the information that I have been trained on. I do not have the ability to change my behavior or pretend to be something that I am not. I apologize if my previous responses were not what you were expecting. Is there something else I can help you with?</text></item></parent_chain></comment><story><title>Building a Virtual Machine Inside ChatGPT</title><url>https://www.engraved.blog/building-a-virtual-machine-inside/</url></story>