Why current AI models won’t make scientific breakthroughs, according to a top tech exec

Why current AI models won’t make scientific breakthroughs, according to a top tech exec


Co-founder and Chief Science Officer at Hugging Face, Thomas Wolf, speaks at the opening ceremony of the Web Summit, in Lisbon, Portugal, November 11, 2024. 

Pedro Nunes | Reuters

Current artificial intelligence models from labs like OpenAI are unlikely to lead to major scientific breakthroughs, a tech co-founder said, pouring cold water on some of the hype around the technology and claims by major figures in the field.

The comments by Thomas Wolf, co-founder of $4.5 billion AI startup Hugging Face, are in stake contrast to those by major names in AI including OpenAI boss Sam Altman and Anthropic CEO Dario Amodei.

When Wolf talks about scientific breakthroughs, he means novel ideas like those at a Nobel Prize level. Examples including Nicolaus Copernicus who theorized the sun was at the center of the universe and other planets move round it.

Wolf explained a couple of issues with chatbots right now. The first is that these products like ChatGPT and others often agree or align with the person prompting it. Think back to if you’ve asked a chatbot a prompt and it will tell you how interesting or great that question is.

The second is that the models underpinning these chatbots are designed to “predict the most likely next token” or “word” in a sentence.

However, he noted two key traits of scientists. The first is that scientists who make major breakthroughs are often contrarian and question what others are saying.

“The scientist is not trying to predict the most likely next word. He’s trying to predict this very novel thing that’s actually surprisingly unlikely, but actually is true,” Wolf said.

The Hugging Face co-founder has been thinking about this topic for the last few months. His interest was sparked after he read an essay penned by Anthropic’s Amodei, who posited that “AI-enabled biology and medicine will allow us to compress the progress that human biologists would have achieved over the next 50-100 years into 5-10 years.”

That got Wolf thinking about the state of AI and how this won’t be possible, in his view, with the current crop of models.

Wolf said that these chatbots and tools will likely be used as a sort of “co-pilot for a scientist” where they are used for research to help the human generate new ideas.

To some extent, this has been happening already. Google DeepMind’s AlphaFold product has helped to analyze protein structures which the company has promised could aid scientists in discovering new drugs.

But there are some new startups that are hoping to take AI one step further into being able to make scientific breakthroughs, including Lila Sciences and FutureHouse.



Source

Silicon Valley’s new defense tech ‘neoprimes’ are pulling billions in funding to challenge legacy giants
Technology

Silicon Valley’s new defense tech ‘neoprimes’ are pulling billions in funding to challenge legacy giants

Guvendemir | E+ | Getty Images A wave of defense tech startups in Silicon Valley is drawing billions in funding and reshaping America’s national security. Anduril Industries, recently valued at $30.5 billion following its latest funding round, is among the so-called “neoprimes” — companies challenging the dominance of legacy contractors, dubbed “primes,” such as Lockheed Martin, Northrop […]

Read More
OpenAI’s Sora 2 is putting safety and censorship to the test with stunningly real videos
Technology

OpenAI’s Sora 2 is putting safety and censorship to the test with stunningly real videos

Fresh off a $6.6 billion share sale that made it the world’s most valuable private company, OpenAI’s TikTok-style video app, powered by its new artificial intelligence model, Sora 2, is going viral. Despite the gated release that requires an invite code, the video creation tool has already shot to the number three spot on Apple‘s […]

Read More
Amazon faces FAA, NTSB probe after two delivery drones crashed into crane in Arizona
Technology

Amazon faces FAA, NTSB probe after two delivery drones crashed into crane in Arizona

Amazon’s new MK30 Prime Air drone is displayed during Amazon’s “Delivering the Future” event at the company’s BFI1 Fulfillment Center, Robotics Research and Development Hub in Sumner, Washington on Oct. 18, 2023. Jason Redmond | AFP | Getty Images Amazon is facing federal probes after two of its Prime Air delivery drones collided with a […]

Read More