<instructions>Your goal is to analyze the following comment and estimate how highly it will be upvoted by the Hacker News community.</instructions><comment><author>probably_wrong</author><text>The solution is to feed both the text and the summary back to ChatGPT and ask it to identify any inconsistencies.&lt;p&gt;If you repeat these steps over and over for enough iterations eventually you will run out of money and the problem will be moot anyway</text><parent_chain><item><author>ADeerAppeared</author><text>There&amp;#x27;s a fundamental problem with all these &amp;quot;summary&amp;quot; tasks, and it&amp;#x27;s obvious from the disclaimer that&amp;#x27;s on all these AI products: &amp;quot;AI can be wrong, you must verify this&amp;quot;.&lt;p&gt;A summary for which you must always read the un-summarized text &lt;i&gt;is useless as a summary&lt;/i&gt;, this should be obvious to literally everyone, yet AI developers stick their heads in the sand about it because RAG lets them pretend AI is more useful than it actually is.&lt;p&gt;RAG is useless, just fucking let it go and have AI stay in it&amp;#x27;s lane.</text></item></parent_chain></comment><story><title>When ChatGPT summarises, it does nothing of the kind</title><url>https://ea.rna.nl/2024/05/27/when-chatgpt-summarises-it-actually-does-nothing-of-the-kind/</url></story>
<instructions>Your goal is to analyze the following comment and estimate how highly it will be upvoted by the Hacker News community.</instructions><comment><author>qeternity</author><text>This is just a trust issue, which applies to pretty much any task where there is delegation.&lt;p&gt;If you ask an intern to summarize some text, you trust them to do a half decent job. You&amp;#x27;re not going to re-read the original text. The hiring process is meant to filter out bad interns.</text><parent_chain><item><author>ADeerAppeared</author><text>There&amp;#x27;s a fundamental problem with all these &amp;quot;summary&amp;quot; tasks, and it&amp;#x27;s obvious from the disclaimer that&amp;#x27;s on all these AI products: &amp;quot;AI can be wrong, you must verify this&amp;quot;.&lt;p&gt;A summary for which you must always read the un-summarized text &lt;i&gt;is useless as a summary&lt;/i&gt;, this should be obvious to literally everyone, yet AI developers stick their heads in the sand about it because RAG lets them pretend AI is more useful than it actually is.&lt;p&gt;RAG is useless, just fucking let it go and have AI stay in it&amp;#x27;s lane.</text></item></parent_chain></comment><story><title>When ChatGPT summarises, it does nothing of the kind</title><url>https://ea.rna.nl/2024/05/27/when-chatgpt-summarises-it-actually-does-nothing-of-the-kind/</url></story>