It cannot be automated or systematized because neural networks are the tool you use to defeat systems like that. If there’s a defined, objective test, a neural network can train for/on that test and ‘learn’ to ace it. It’s just what they do.
The only way to test for ‘true’ intelligence would be to perfectly define it first, such that when the NN aced the test that would prove intelligence. That is, IF you could perfectly define intelligence, doing so would more or less give you all the tools you needed to create it.
All these people claiming we already have general AI or even anything like it have put the cart so far before the horse.
If a neural network can do it, then a neural network can do it… so we either have to accept that a neural network can be intelligent, or that no human can be intelligent.
If we accept that human NNs can be intelligent, then the only remaining question is how to compare a human NN to a machine NN.
Right now, the analysis of LLMs shows that they present: human-like categorization, super-human knowledge, and sub-human reasoning. So, depending on the measure, current LLMs can fall anywhere on the scale of “not AGI” to “AGI overlord”. It’s reasonable to expect larger models, with more multimodal training, to become fully “AGI overlord” by all measures in the very near future.
It cannot be automated or systematized because neural networks are the tool you use to defeat systems like that. If there’s a defined, objective test, a neural network can train for/on that test and ‘learn’ to ace it. It’s just what they do.
The only way to test for ‘true’ intelligence would be to perfectly define it first, such that when the NN aced the test that would prove intelligence. That is, IF you could perfectly define intelligence, doing so would more or less give you all the tools you needed to create it.
All these people claiming we already have general AI or even anything like it have put the cart so far before the horse.
If a neural network can do it, then a neural network can do it… so we either have to accept that a neural network can be intelligent, or that no human can be intelligent.
If we accept that human NNs can be intelligent, then the only remaining question is how to compare a human NN to a machine NN.
Right now, the analysis of LLMs shows that they present: human-like categorization, super-human knowledge, and sub-human reasoning. So, depending on the measure, current LLMs can fall anywhere on the scale of “not AGI” to “AGI overlord”. It’s reasonable to expect larger models, with more multimodal training, to become fully “AGI overlord” by all measures in the very near future.