Why current AI models won’t make scientific breakthroughs, according to a top tech exec

Why current AI models won’t make scientific breakthroughs, according to a top tech exec


Co-founder and Chief Science Officer at Hugging Face, Thomas Wolf, speaks at the opening ceremony of the Web Summit, in Lisbon, Portugal, November 11, 2024. 

Pedro Nunes | Reuters

Current artificial intelligence models from labs like OpenAI are unlikely to lead to major scientific breakthroughs, a tech co-founder said, pouring cold water on some of the hype around the technology and claims by major figures in the field.

The comments by Thomas Wolf, co-founder of $4.5 billion AI startup Hugging Face, are in stake contrast to those by major names in AI including OpenAI boss Sam Altman and Anthropic CEO Dario Amodei.

When Wolf talks about scientific breakthroughs, he means novel ideas like those at a Nobel Prize level. Examples including Nicolaus Copernicus who theorized the sun was at the center of the universe and other planets move round it.

Wolf explained a couple of issues with chatbots right now. The first is that these products like ChatGPT and others often agree or align with the person prompting it. Think back to if you’ve asked a chatbot a prompt and it will tell you how interesting or great that question is.

The second is that the models underpinning these chatbots are designed to “predict the most likely next token” or “word” in a sentence.

However, he noted two key traits of scientists. The first is that scientists who make major breakthroughs are often contrarian and question what others are saying.

“The scientist is not trying to predict the most likely next word. He’s trying to predict this very novel thing that’s actually surprisingly unlikely, but actually is true,” Wolf said.

The Hugging Face co-founder has been thinking about this topic for the last few months. His interest was sparked after he read an essay penned by Anthropic’s Amodei, who posited that “AI-enabled biology and medicine will allow us to compress the progress that human biologists would have achieved over the next 50-100 years into 5-10 years.”

That got Wolf thinking about the state of AI and how this won’t be possible, in his view, with the current crop of models.

Wolf said that these chatbots and tools will likely be used as a sort of “co-pilot for a scientist” where they are used for research to help the human generate new ideas.

To some extent, this has been happening already. Google DeepMind’s AlphaFold product has helped to analyze protein structures which the company has promised could aid scientists in discovering new drugs.

But there are some new startups that are hoping to take AI one step further into being able to make scientific breakthroughs, including Lila Sciences and FutureHouse.



Source

Corporate travel and expense software firm Navan shares sink by double-digits in first trade after  billion Nasdaq IPO
Technology

Corporate travel and expense software firm Navan shares sink by double-digits in first trade after $6 billion Nasdaq IPO

Corporate travel and expense management platform Navan fell by as much as 15% in its first trading day on the Nasdaq under the ticker symbol “NAVN” after its successful initial public offering. The Navan IPO, which priced on Wednesday night, valued the business-to-business software vendor at $6.2 billion, raising $923 million and with shares settling […]

Read More
Apple reports fourth quarter earnings after the bell
Technology

Apple reports fourth quarter earnings after the bell

FILE PHOTO: Formula One F1 – United States Grand Prix – Circuit of the Americas, Austin, Texas, U.S. – October 23, 2022 Tim Cook waves the chequered flag to the race winner Red Bull’s Max Verstappen. Mike Segar | Reuters Apple reports fiscal fourth quarter earnings on Thursday after the bell. The fourth quarter, which […]

Read More
Meta stock drops 10% as heightened AI spending overshadows strong third-quarter results
Technology

Meta stock drops 10% as heightened AI spending overshadows strong third-quarter results

Meta’s CEO Mark Zuckerberg attends the Senate Judiciary Committee hearing on online child sexual exploitation at the U.S. Capitol, in Washington, U.S., January 31, 2024.  Nathan Howard | Reuters Meta Platforms‘ stock dropped more than 10% Thursday as skepticism about the payoff from its aggressive artificial intelligence spending plans overshadowed strong results. The social media […]

Read More