HomeTechnologyThe new test for...

The new test for artificial intelligence is not a single AI model

Photo: 21cbr.com

These “thinking” models get a rating from 1% to 1.3%. No ordinary model gained more than 1%. A prize of $ 700 thousand was announced for the creators of the first five models approaching the test.

The Arc Prize Foundation Foundation has released a new test to test AI’s capabilities compared to a person called ARC -i-2 and announced a prize of $ 700 thousand to the creators of the first five models that will receive 85% or higher ratings in this test. The information has been published on the fund website.

Unlike other trials to check AI for specialized knowledge or the ultra-flow of answers that are impossible for humans, arc -i-2 uses tasks that are simple for humans, but difficult for AI. In trials, each task was resolved by at least two people for two attempts (or fewer) in a controlled study involving four hundred people, so each AI model also received two attempts.

Fund researchers have found that artificial intelligence systems are difficult to interpret the meaning of the symbols, which exceeds their visual species. Systems have tried to evaluate symmetry, reflect glass, transform and even recognize connecting elements, but cannot determine the meaning of the symbols themselves. Also, II is difficult to accomplish tasks that require simultaneous application of policies or the application of multiple policies that interact with each other. If the policies of the tasks should be changed depending on the context, contemporary artificial intelligence will not be able to cope with the task.

It should be noted that despite the fact that the two selected people in the test groups always pass the test completely, the average result is one person – 60%.

We reminded, earlier reported that China announced the creation of the first autonomous agent of the world AI.

Cloudflare created AI to deceive bots collecting information for AI

News from CORRESPONDENT.NET On the telegram and whatsapp. Subscribe to our channels https://t.me/KorresPondentNet and WhatsApp

Source: korrespondent

- A word from our sponsors -

Most Popular

LEAVE A REPLY

Please enter your comment!
Please enter your name here

More from Author

- A word from our sponsors -

Read Now

Lutsk shoulder – Spaces went to bending, and the posts are already 27 already 27

The mass shelling of Lutsk on the night of May 6 led to the death of a man-republics, which were unlocked by the body of a nine-story building who died from fragments. .in_text_content_22 {width: 300px; Height: 600px; } @Media (min-width: 600px) {.in_text_content_22 {width: 580px;...

The authorities of Kyiv showed how the reconstruction of the metro after the Russian attack (photo)

In Kyiv, about 70 specialists in various services KP "KYIV METRO" restore and repair traces and metro network, damaged by the combined air attack of racists on the night of June 6 at night on June 6. .in_text_content_22 {width: 300px; Height: 600px; } @Media...