<instructions>Your goal is to analyze the following comment and estimate how highly it will be upvoted by the Hacker News community.</instructions><comment><author>tedsanders</author><text>Sounds like when you teach a neural network chess, it ends up learning many of the same concepts that we do.&lt;p&gt;To me, this is a great illustration that superhuman intelligence is not magic. When a superhuman AI plays chess, the moves usually make sense to an expert. And even if they don&amp;#x27;t immediately make sense, they usually make sense once the expert plays out some lines to see what happens. Superhuman AIs have crushed humans at chess not by discovering new, wildly counterintuitive openings that dumb humans missed (it actually plays many of the same openings). Rather, it just does what humans do - win pieces, keep your king safe, attack, gain space, restrict your opponent&amp;#x27;s moves - but better and more consistently.&lt;p&gt;This paper builds on that concept and finds that not only are a superhuman AI&amp;#x27;s moves usually understandable by experts, but even some of the superhuman AI&amp;#x27;s internal representations are understandable by experts (!).&lt;p&gt;In the 5th century BCE, Greek philosophers thought the Earth was a sphere. Although they were eventually improved upon by Newton&amp;#x27;s ellipsoid, they still had arrived at the right concept. And here I think we see the same thing: although a superhuman AI &amp;#x27;understands&amp;#x27; chess better than human experts, its understanding still builds upon the same concepts.&lt;p&gt;Thinking broadly, like, suppose we invent some superhuman AGI for $100B in 2100. And then we ask it how to optimize our paperclip production. I don&amp;#x27;t think its recommendations will be magic. Paperclip production is a fairly well understood problem: you bring in some metal, you reshape it, you send it out. It&amp;#x27;s probably gonna have much of the same advice we&amp;#x27;ve already figured out: invest in good equipment, take advantage of economies of scale, choose cheap but effective metals, put factories near sources of energy and labor and raw materials, ship out paperclips in a hierarchical network with caches along the way to supply unanticipated demand, etc. Like, an AGI&amp;#x27;s suggestions may well be better than a management consultant&amp;#x27;s, but it&amp;#x27;s not like it&amp;#x27;s going to wave a magic wand and flip the laws of physics. Rather, I expect it to win within the same frameworks we&amp;#x27;ve developed, but by doing things better and more consistently than humans.</text><parent_chain></parent_chain></comment><story><title>Acquisition of chess knowledge in AlphaZero</title><url>https://en.chessbase.com/post/acquisition-of-chess-knowledge-in-alphazero</url></story>
<instructions>Your goal is to analyze the following comment and estimate how highly it will be upvoted by the Hacker News community.</instructions><comment><author>a_shovel</author><text>The sci-fi trope that aliens or superintelligent AIs will have thought processes completely different and incomprehensible to humans is probably not true.&lt;p&gt;If the aliens live in our universe, evolved on a planet with limited resources, need food, breathe, etc., then they&amp;#x27;ll likely have a lot in common with Earth animals psychologically. If the AI is tasked with doing something that humans also do, then its tactics will be at least recognizable to an expert in that field. Moreso in well-understood systems such as chess.&lt;p&gt;Is it really plausible that an advanced chess AI&amp;#x27;s tactics would have no concept of threats or king safety? The same tactics apply to it as do to us.</text><parent_chain></parent_chain></comment><story><title>Acquisition of chess knowledge in AlphaZero</title><url>https://en.chessbase.com/post/acquisition-of-chess-knowledge-in-alphazero</url></story>