Loading video...

Video Failed to Load

Go Home

What would it look like to combine Google search (shallow Knowledge Graph reasoning over an ultra-ultra-wide index) with LLM in-context learning (highly intelligent operations on a tiny index)?

100,546 views • 1 year ago •via X (Twitter)

10 Comments

Dwarkesh Patel's profile picture
Dwarkesh Patel1 year ago

Transcript: Youtube: Spotify: Apple:

World Scientific's profile picture
World Scientific1 year ago

Uncover the latest insights in algebraic computation! 📊👥 Discover new decompositions of graph braid groups and their implications. Click the banner below to read the open access article for FREE! #Algebra #Combinatorics #Mathematics

scuzzlebot's profile picture
scuzzlebot1 year ago

The future may lie in "cognitive layering" - shallow but broad knowledge as a foundation, with deep reasoning capabilities that can dynamically zoom in and perform complex operations on relevant subsets. Like how human experts combine broad awareness with focused analysis. 🧠

Gerbil's profile picture
Gerbil1 year ago

Surely were going to find out in the near future

Gary Kibitz's profile picture
Gary Kibitz1 year ago

Sounds like Jeff made up and answered a harder question (hand-waving), probably because the answer to your question is that Google is already doing that and it's all secret.

Richard Harper's profile picture
Richard Harper1 year ago

Perhaps read the two appendices of the Syntopicon of The Great Books explaining the methods used in the attempt to index, to .. 'bring together the topics', which seemed important at the time for the continuation of Western Civilization when it was first published in 1953.

Maxime Batandeo's profile picture
Maxime Batandeo1 year ago

The curation of what to put in the context will be key to unlock actual new knowledge and it will be shaped as a graph. With semantic rules and/or ontology to structure it. Here is how I think of it : You label the inputs as a knowledge graph You prompt the LLM to generate a subgraph of outputs You integrate the subgraph into the global knowledge graph. Repeat. Do that for argumentation for example and you unlock actual reasoning

SubMinima's profile picture
SubMinima1 year ago

I don't think we actually need a large memory (context) for this... Just a large database and the right search parameters

Vineet Tiruvadi, MD PhD's profile picture
Vineet Tiruvadi, MD PhD1 year ago

Do you consider LLM in-context learning "highly intelligent"??

Woke GPT's profile picture
Woke GPT1 year ago

retard moving mouth, news at 0

Related Videos