))
Crowdsourced AI benchmarks have serious flaws, some experts say
Manage episode 478778302 series 3548939
Content provided by SpokenLayer. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by SpokenLayer or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://ppacc.player.fm/legal.
AI labs are increasingly relying on crowdsourced benchmarking platforms such as Chatbot Arena to probe the strengths and weaknesses of their latest models. But some experts say that there are serious problems with this approach from an ethical and academic perspective.
Learn more about your ad choices. Visit podcastchoices.com/adchoices
3374 episodes
Share
