(CTN News) – According tostudy, ChatGPT can solve problems at a level equal to or better undergraduate student.
When asked to solve reasoning problems that appear on intelligence tests or exams, such as the American college admission test, the SAT, researchers found that the GPT-3 large language model underpinning the chatbot performed about as well as US college undergraduates.
was tested by psychologists at the University of California, Los Angeles by converting images into a text format that the model could the model had never encountered such questions before, after converting the images to a text format that the model could process.
In a study of 40 UCLA undergraduates, the researchers found thatsolved 80% of the problems well above the average of just below 60% participants.
Furthermore, the researchers tasked the model with solving SAT “analogy” questions that they believe had not been published on the internet and, therefore, could not have been included in the large amount of data the model was trained on.
According to the UCLA team, the AI outperformed the average SAT score for college applicants.
The model performed poorly in another test. A passage of prose was matched with a short story conveying the same meaning.
This study found that GPT-3 performed worse than students, while GPT-4 – its improved successor – performed better.
Accordin to Taylor Webb, the lead author of the study, ChatGPT does not meet the standards of artificial general intelligence, or human intelligence.
There is no doubt that it isn’t a fully general intelligence at the level of humans. In a particular area, it has certainly made progress” said Webb, a UCLA postdoctoral researcher in the field of psychology.
The UCLA researchers added that without access to the inner workings ofwhich is developed by the San Francisco-based company OpenAI, they determine how the model’s reasoning abilities whether it has a human-like reasoning ability or is exhibiting a completely new kind of intelligence.
Themight be a human after all, said Keith Holyoak, a professor of psychology at UCLA. “However, people do not learn by ingesting the entire internet in a single sitting, so the training method is completely different,” he added.
In the end, it would be nice if we could find out if it’s really doing it like people do, or if it’s doing something brand new – a true artificial intelligence – which would just be amazing in and of itself.