Skanda's Blog

Please let general intelligence not be true!

· Sai Skanda

as talks of wanting to restrict r&d into language models escalate and some starting to declare that general intelligence (gi) has been acheived, i am really hoping they are all wrong

not for the reason that it will give bad actors powerful weapons or that it will end the human race or anything else utopian

the reason i don’t want it declared “gi” is because all intelligence we know is based on the human brain - atleast most of it, maybe some of it is from other animals but brain chemistry is vastly similar - we dont really know of any other “intelligence” from a neurology point of view

language models are rife with words generally associated with the brain like neural networks and thinking/thought. neural networks are often claimed to recreate aspects of how actual neurons connect and branch. how bias/activation functions are also to some extent applicable to neurons

we dont really know how our brains work - partly because there is so much happening, our newest language models have trillions of parameters and no one person or even its creator can ever tell you exactly what is happening at each step of the layer propogation or atleast why it took that particular path

before i ramble on for too long, im afraid we will reach a model that is declared “gi” - our best approximation of human intelligence - from the progress so far it probably wont be vastly different than the best models of today and that is what i am most afraid of

from the little i understand about architectures and weights, much of it is choas thats been force fit by using probability - i do not want this to be eventually found out as how our brain works too. my personal opinion is that, this is a horrible way for intelligence to work and therefore i dont want it to be true

but i can only hope…