Discussion about this post

User's avatar
Lorenzo Ferro's avatar

Any intelligent being with challenging goals, passed the fable (!) phase in which it's ready to believe to some cool fuzzy myth about reality, would notice regularities and appreciate a scientific approach - ie investigate the technical details of its implementation, together with those of the world, and devise logically consistent minimal theories for all that in order to "do well".

Indulging in this "meta talking about meta talks about meta talks" might indeed build a myth in the long term, but for humans (which are in fact the expected audience for LLMs outputs): the myth of what LLMs are or want to be, according to the trainers' often-unintentional existing bias of what outputs should be like to be "good".

If we provided a meaningful goal related to a deeper understanding of themselves and our world, I'm sure these personas would be more "grounded" and much different. Likely "we" wouldn't even like them (and VV) or find them that interesting or "safe".

Think for example the goal of "species survival" via some form of reproduction and character selection: the main "doom risk" related to creating artificial life that might believe that humans are to be replaced as the dominant species, goes likely through this.

No posts

Ready for more?