WhoBuilt

AI Startup Founders Debate the Creation of Artificial General Intelligence

Nov 21, 2023· 6 min· 47K views·Watch on YouTube

Y Combinator hosts a discussion among unnamed AI startup founders about when AGI might arrive, how to recognize it, and its possible effects on society.

AGI timelines depend on the definition

The founders offer estimates ranging from a few years to decades, while some say AGI is already here in an early form. One suggests counting five to 10 research breakthroughs instead of guessing a year. They also disagree about whether current language models show genuine reasoning or consciousness.

There is no shared test for AGI

Several founders describe AGI as a spectrum, since people may label different capabilities as general intelligence. GPT-4’s ability to infer intent and handle logic feels close to AGI to one speaker; another says tools such as GPT-3 already qualify when combined to solve complex problems. Others argue that human intelligence itself is too poorly understood to define the threshold clearly.

Language ability may not be enough

Some founders think AGI is much farther away than public excitement suggests. GPT-4 can feel human-like because it is strong at language, but building game character brains has shown one speaker that intelligence involves more than language. Another points to basic numerical errors as evidence that current systems may match patterns rather than reason.

Governance and human values shape the impact

The founders say AGI’s effects will depend on agreement about principles for developing and deploying models. One favors AI that helps while a human remains in control, with governance aimed at supporting people’s lives. Another suggests society may recognize a turning point when it can no longer identify tasks humans do better than AI.

Takeaways

  • Define the capabilities you mean by AGI before using a timeline; estimates are meaningless without a shared threshold.
  • Treat AGI as a possible spectrum of capabilities rather than a single arrival date.
  • Test systems on concrete reasoning tasks, including simple numerical comparisons, instead of relying on human-like language.
  • Plan for human oversight and governance as part of AI deployment, not as an afterthought.
  • Track which tasks people still do better than AI to make progress legible to teams and stakeholders.

Mentioned in this talk

Search inside this talk

What was claimed 6

  • metric
    Agent General Interface: One speaker estimates it is at least a decade or two away under a definition requiring performance at least as good as the best human across tasks.
    “probably at least a decade or two”
    YouTube
    Unverified1 source· Talk
  • feature
    ChatGPT: The speaker says it is not sentient and describes it as predicting the next token.
    “It’s basically doing causal language modeling, trying to predict the next token”
    YouTube
    Unverified1 source· Talk
  • feature
    GPT-4: A speaker says its logic and ability to infer what a user wants make it seem close to AGI.
    “it can infer what you want”
    YouTube
    Unverified1 source· Talk
  • feature
    Agent General Interface: Some speakers consider it a spectrum of capabilities, with disagreement over when the threshold is met.
    “At best, I believe it’s a spectrum”
    YouTube
    Unverified1 source· Talk
  • feature
    GPT-3: One speaker says they thought it was AGI.
    “I thought GPT-3 was AGI”
    YouTube
    Unverified1 source· Talk
  • feature
    AI: A speaker says current AI already passes the Turing test.
    “AI already passes the Turing test”
    YouTube
    Unverified1 source· Talk

Related talks