I thought Beyond Citadel was cool too, but I think it's a stretch to call Scam Altman's XOJ-37 Nuclear Powered Pan-Sexual Robo-Plooker anything resembling a "superior intelligence", let alone a god.
>Machine intelligence vastly superior to anything we are even capable of imagining
LLMs aren't "intelligent". They're mathematical models that interpret and predict textual language patterns. The apparent knowledge of such is owed to training data that'd be trivial to find were our internet infrastructure not completely rotted to hell, and an infinite patience for bureaucracy. This is something of a pattern for everything LLMs are particularly good at.

Automated code generation looks impressive, but most programming today is comprised of bureaucracy rather than any sort of intellectual exercise. Tedious "industry standard practices", filing your structs in just the right way to play nice with each and every API, obnoxious and bloated standards and formats, etc. There's no universal law that guarantees this has to be nature of computer software, this bureaucracy is a side effect of the software industry's rejection of higher level abstraction since the 60s. Were the software nerds of yesteryear less proud of their own ignorance we'd not have to play charades with an LLM to translate into the right DMV paperwork.

>>200303
What specific thing?