Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

A little video that - explains the relationship between conventional LLMs and reasoning models (and agents), - philosophizes a about "from scratch" approaches, - and explains how to install Python & PyTorch requirements with uv.

60,747 görüntüleme • 2 ay önce •via X (Twitter)

43 Yorum

Sebastian Raschka profil fotoğrafı
Sebastian Raschka2 ay önce

And a link to the youtube version:

Guido profil fotoğrafı
Guido2 ay önce

This playlist will keep me company this winter

Drex profil fotoğrafı
Drex2 ay önce

You said almost all current models are reasoning models, yet they still have low/medium/high effort settings Can they still run as normal non-reasoning LLMs?

Sebastian Raschka profil fotoğrafı
Sebastian Raschka2 ay önce

Right, reasoning models with different reasoning effort settings. Many/most also have a "None" setting

ByteCrafter profil fotoğrafı
ByteCrafter2 ay önce

worth flagging one thing on the uv part since it bites people. uv add torch does not resolve to the same thing everywhere. linux pulls the cuda build straight off pypi, cu130 for torch 2.11 right now, while macos and windows get cpu only. so a pyproject that works on your machine can hand someone else a different accelerator with no error anywhere. pinning it means an explicit index entry against or whichever variant you want, plus sys_platform markers under tool.uv.sources. and torch-backend auto is still uv pip only, it does nothing under uv add or uv sync

Sebastian Raschka profil fotoğrafı
Sebastian Raschka2 ay önce

Yeah, I added a uv.lock to help a little. But pinning too much can also cause issues. I.e., there are people who can't run the a specific version (due to CUDA compatibility) with specific drivers and so on. The default works for most people but not everyone, yes.

Jabbar Digital profil fotoğrafı
Jabbar Digital2 ay önce

Great insight

thongchai chansakul profil fotoğrafı
thongchai chansakul2 ay önce

Hey, what's upd Just learned something new from Sebastian Raschka about LLMs and conventional approaches!.

Sophia Yang profil fotoğrafı
Sophia Yang2 ay önce

🐐

Coffeine profil fotoğrafı
Coffeine2 ay önce

Do you expect the playlist to be around 8-10 videos like your previous book?

Sebastian Raschka profil fotoğrafı
Sebastian Raschka2 ay önce

Good question. Let's see how it goes...

Matt White profil fotoğrafı
Matt White2 ay önce

Fantastic explainer!

Duc Nguyen Huu profil fotoğrafı
Duc Nguyen Huu2 ay önce

Legend!

okimraise.eth profil fotoğrafı
okimraise.eth2 ay önce

nice that the GPU section treats Apple MPS as a first-class path instead of a footnote

Sebastian Raschka profil fotoğrafı
Sebastian Raschka2 ay önce

Numerical stability-wise it's still tricky in some cases but has got a bit better over the years

okimraise.eth profil fotoğrafı
okimraise.eth2 ay önce

fair - first-class as a path, still picky on numerics

The Canaanite profil fotoğrafı
The Canaanite2 ay önce

This good stuff

Steven Cheng profil fotoğrafı
Steven Cheng2 ay önce

uv for deps is the real vibe coder move

IpezyGJ profil fotoğrafı
IpezyGJ2 ay önce

What that relationship did to comparison gets left out. A reasoning model and a conventional one can post identical accuracy on one set while spending an order of magnitude apart per answer, so the number is not comparable unless the budget is fixed. Does the video cover that?

Sebastian Raschka profil fotoğrafı
Sebastian Raschka2 ay önce

Well yeah, it depends on the use case, there is no one size fits all.

Oussama profil fotoğrafı
Oussama2 ay önce

The "from scratch" framing is where this gets philosophically tricky, since reasoning traces blur the line between training artifact and runtime behavior.

soooz profil fotoğrafı
soooz2 ay önce

The from-scratch framing helps most where people conflate layers: model capability, harness behavior, and granted permissions get argued as one thing.

dhinna ship .ico profil fotoğrafı
dhinna ship .ico2 ay önce

Torch wheels split by OS, reasoning models keep effort knobs; from-scratch still hits those

K. E profil fotoğrafı
K. E2 ay önce

Nice mix, connecting the LLM to reasoning to agents story with an actual uv setup walkthrough is genuinely useful

TheoryOfNearlyEverything profil fotoğrafı
TheoryOfNearlyEverything2 ay önce

keine ahnung von garnichts aber lamentieren yo

IpezyGJ profil fotoğrafı
IpezyGJ2 ay önce

I take that for picking a model; it is the comparison I get stuck on. The MT-Bench grader sides with whichever answer runs longer in 68% of pairs, and reasoning models run longer by design, so length earns credit the reasoning did not. Does the video cover graders at all?

Steven Cheng profil fotoğrafı
Steven Cheng2 ay önce

uv for PyTorch installs is a game changer. The reasoning model breakdown sounds fascinating too.

Rimas profil fotoğrafı
Rimas2 ay önce

does the from scratch section argue for reimplementing things to learn them, or against reinventing infra that already works

Sebastian Raschka profil fotoğrafı
Sebastian Raschka2 ay önce

actually both

Idriss profil fotoğrafı
Idriss2 ay önce

The reasoning-vs-agent framing is the one most teams blur. Reasoning buys a better single answer; agents buy retries against a real environment. Different failure modes, different eval.

Steven Cheng profil fotoğrafı
Steven Cheng2 ay önce

How does uv handle complex dependency conflicts compared to pip?

Sebastian Raschka profil fotoğrafı
Sebastian Raschka2 ay önce

much faster, it uses a Rust-based solver

GenieOrb profil fotoğrafı
GenieOrb2 ay önce

Putting uv beside reasoning models makes the path from watching an explanation to running code feel much shorter.

Kamal Bisht 🔴 AI Marketer profil fotoğrafı
Kamal Bisht 🔴 AI Marketer2 ay önce

jack of all trades master of none but make it llms. how long until you cover conda too or is uv winning?

Gill profil fotoğrafı
Gill2 ay önce

Using uv to set up PyTorch environments has completely transformed my daily python workflow

Elev profil fotoğrafı
Elev2 ay önce

reasoning is a property of a single call, agency is a property of the loop around it. most of the disappointment i see sits in the second one and gets blamed on the first.

Alee Kolachi profil fotoğrafı
Alee Kolachi2 ay önce

Sounds handy. Thank you for sharing.

TechGeekDavid profil fotoğrafı
TechGeekDavid2 ay önce

Reasoning models are still doing next-token prediction with more structured scaffolding. The compression of world models into language has not changed.

Sebastian Raschka profil fotoğrafı
Sebastian Raschka2 ay önce

exactly

TechGeekDavid profil fotoğrafı
TechGeekDavid2 ay önce

From scratch is the interesting part. If language is how we compress world models, a different approach needs a different compression.

griffin fuzzystripes profil fotoğrafı
griffin fuzzystripes2 ay önce

From-scratch can name LLM, reasoner, and agent in one sitting. That is a syllabus, not a niche. Three labels on one chalkboard are still one occupancy. #LLMs #Agents

WAi XeA profil fotoğrafı
WAi XeA2 ay önce

There's a 43 minute video because agent ate the other two words.

FINeuraLab profil fotoğrafı
FINeuraLab2 ay önce

Explaining conventional language models, reasoning models, and agents together helps separate architecture from workflow. The distinctions become much clearer when each layer is tied to an example of what it changes in practice.

Benzer Videolar

🚨 THIS IS ACTUALLY INSANE Python developers are still installing five different tools to manage one project. `pip` for packages. `virtualenv` for environments. `pyenv` for Python versions. `pipx` for CLI tools. `poetry` for project management. uv replaces all of them with one tool. And it’s written in Rust. The headline number: 10–100× faster than pip. But speed isn't even the most interesting part. uv can: → Create and manage Python projects → Resolve dependencies with a universal lockfile → Create virtual environments → Install and switch between Python versions → Run standalone Python scripts with dependencies → Install CLI tools with `uvx` → Compile and sync requirements → Manage Cargo-style workspaces The workflow becomes ridiculously simple: `uv init` → create a project `uv add` → add dependencies `uv run` → run your code `uv lock` → lock dependencies `uv sync` → reproduce the environment And if you're already using pip? You don't have to throw your workflow away. The `uv pip` interface is designed as a drop-in replacement while giving you the speed boost. The other clever bit: uv uses a global cache to deduplicate dependencies and save disk space. So instead of assembling a Python toolchain piece by piece, you get one fast CLI that covers the whole workflow. And unlike a lot of newer developer tools, uv is already considered stable and production-ready. If you work with Python, this is one of those tools you should probably try once. You might not go back. #Python #DevTools #Rust #OpenSource #Programming #AIEngineering

Vikas gupta

40,126 görüntüleme • 1 ay önce