Eğitim / Kodlama 2 Nisan 2024

Are long context windows the end of RAG?

Spread the love <3

The home team is joined by Michael Foree, Stack Overflow’s director of data science and data platform, and occasional cohost Cassidy Williams, CTO at Contenda, for a conversation about long context windows, retrieval-augmented generation, and how Databricks’ new open LLM could change the game for developers. Plus: How will FTX co-founder Sam Bankman-Fried’s sentence of 25 years in prison reverberate in the blockchain and crypto spaces?

Are long context windows the end of RAG?
Credit: Alexandra Francis

DBRX, an open, general-purpose LLM created by Databricks, reportedly outperforms GPT-3.5 and is competitive with Gemini 1.0 Pro.

Recent research found that large, complex LLMs use a simple mechanism to retrieve stored knowledge in response to a user prompt. These mechanisms can help researchers reveal what the model knows and potentially even correct false information it has stored.

FTX co-founder Sam Bankman-Fried, whose downfall began in late 2022, was sentenced last week to 25 years in prison for conspiracy and fraud.

Find Michael on LinkedIn.

Find Cassidy on her website.

Stack Overflow user Bucket received a well-deserved Lifeboat badge for rescuing How to calculate decimal(x, y) max value in SQL Server from an ocean of ignorance.

Chapters (please note that these timestamps may not be exact):

00:00 Introduction and White Paper Discussion

02:01 Long Context Windows and Retrieval Augmented Generation

05:56 Models’ Ability to Recall Relevant Information

07:18 Models’ Creativity and Thinking Outside the Box

09:41 Advantages and Limitations of Models’ Knowledge

15:09 Databricks’ Open Language Model

22:25 Sam Bankman-Fried’s Sentence and the Effects on Crypto/Blockchain

31:28 Closing Remarks and Lifeboat Badge

TRANSCRIPT

source

You may also like...

Mar
07
2024
The hospital where treatment is by torchlight and &#039;13 babies died of malnutrition on one day&#039;

The hospital where treatment is by torchlight and '13 babies died of malnutrition on one day'

Spread the love <3

Spread the love <3 In a hospital in northern Gaza, it’s been claimed 13 babies died of malnutrition in a...

Nis
10
2024
0
Proxima Fusion raises $21M to build on its ‘stellarator’ approach to nuclear fusion

Proxima Fusion raises $21M to build on its ‘stellarator’ approach to nuclear fusion

Spread the love <3

Spread the love <3 Venture capitalists’ appetite for fusion startups has been up and down in the last few years....

Mar
20
2024
0
Using AI to expand global access to reliable flood forecasts

Using AI to expand global access to reliable flood forecasts

Spread the love <3

Spread the love <3 Posted by Yossi Matias, VP Engineering & Research, and Grey Nearing, Research Scientist, Google Research Floods...

Nis
05
2024
0
TME’deki Brainbox’lardan yeni gigabit ethernet anahtarı!

TME’deki Brainbox’lardan yeni gigabit ethernet anahtarı!

Spread the love <3

Spread the love <3 TME ürün kataloğuna kısa süre önce yerel gigabit ağ altyapıları için tasarlanmış olan yeni Brainboxes siviçler...

Whatsapp İletişim
Merhaba,
Size nasıl yardımcı olabilirim ?