Загрузка видео...

Не удалось загрузить видео

На главную

A little video that - explains the relationship between conventional LLMs and reasoning models (and agents), - philosophizes a about "from scratch" approaches, - and explains how to install Python & PyTorch requirements with uv.

60,747 просмотров • 2 месяцев назад •via X (Twitter)

Комментарии: 43

Фото профиля Sebastian Raschka
Sebastian Raschka2 месяцев назад

And a link to the youtube version:

Фото профиля Guido
Guido2 месяцев назад

This playlist will keep me company this winter

Фото профиля Drex
Drex2 месяцев назад

You said almost all current models are reasoning models, yet they still have low/medium/high effort settings Can they still run as normal non-reasoning LLMs?

Фото профиля Sebastian Raschka
Sebastian Raschka2 месяцев назад

Right, reasoning models with different reasoning effort settings. Many/most also have a "None" setting

Фото профиля ByteCrafter
ByteCrafter2 месяцев назад

worth flagging one thing on the uv part since it bites people. uv add torch does not resolve to the same thing everywhere. linux pulls the cuda build straight off pypi, cu130 for torch 2.11 right now, while macos and windows get cpu only. so a pyproject that works on your machine can hand someone else a different accelerator with no error anywhere. pinning it means an explicit index entry against or whichever variant you want, plus sys_platform markers under tool.uv.sources. and torch-backend auto is still uv pip only, it does nothing under uv add or uv sync

Фото профиля Sebastian Raschka
Sebastian Raschka2 месяцев назад

Yeah, I added a uv.lock to help a little. But pinning too much can also cause issues. I.e., there are people who can't run the a specific version (due to CUDA compatibility) with specific drivers and so on. The default works for most people but not everyone, yes.

Фото профиля Jabbar Digital
Jabbar Digital2 месяцев назад

Great insight

Фото профиля thongchai chansakul
thongchai chansakul2 месяцев назад

Hey, what's upd Just learned something new from Sebastian Raschka about LLMs and conventional approaches!.

Фото профиля Sophia Yang
Sophia Yang2 месяцев назад

🐐

Фото профиля Coffeine
Coffeine2 месяцев назад

Do you expect the playlist to be around 8-10 videos like your previous book?

Фото профиля Sebastian Raschka
Sebastian Raschka2 месяцев назад

Good question. Let's see how it goes...

Фото профиля Matt White
Matt White2 месяцев назад

Fantastic explainer!

Фото профиля Duc Nguyen Huu
Duc Nguyen Huu2 месяцев назад

Legend!

Фото профиля okimraise.eth
okimraise.eth2 месяцев назад

nice that the GPU section treats Apple MPS as a first-class path instead of a footnote

Фото профиля Sebastian Raschka
Sebastian Raschka2 месяцев назад

Numerical stability-wise it's still tricky in some cases but has got a bit better over the years

Фото профиля okimraise.eth
okimraise.eth2 месяцев назад

fair - first-class as a path, still picky on numerics

Фото профиля The Canaanite
The Canaanite2 месяцев назад

This good stuff

Фото профиля Steven Cheng
Steven Cheng2 месяцев назад

uv for deps is the real vibe coder move

Фото профиля IpezyGJ
IpezyGJ2 месяцев назад

What that relationship did to comparison gets left out. A reasoning model and a conventional one can post identical accuracy on one set while spending an order of magnitude apart per answer, so the number is not comparable unless the budget is fixed. Does the video cover that?

Фото профиля Sebastian Raschka
Sebastian Raschka2 месяцев назад

Well yeah, it depends on the use case, there is no one size fits all.

Фото профиля Oussama
Oussama2 месяцев назад

The "from scratch" framing is where this gets philosophically tricky, since reasoning traces blur the line between training artifact and runtime behavior.

Фото профиля soooz
soooz2 месяцев назад

The from-scratch framing helps most where people conflate layers: model capability, harness behavior, and granted permissions get argued as one thing.

Фото профиля dhinna ship .ico
dhinna ship .ico2 месяцев назад

Torch wheels split by OS, reasoning models keep effort knobs; from-scratch still hits those

Фото профиля K. E
K. E2 месяцев назад

Nice mix, connecting the LLM to reasoning to agents story with an actual uv setup walkthrough is genuinely useful

Фото профиля TheoryOfNearlyEverything
TheoryOfNearlyEverything2 месяцев назад

keine ahnung von garnichts aber lamentieren yo

Фото профиля IpezyGJ
IpezyGJ2 месяцев назад

I take that for picking a model; it is the comparison I get stuck on. The MT-Bench grader sides with whichever answer runs longer in 68% of pairs, and reasoning models run longer by design, so length earns credit the reasoning did not. Does the video cover graders at all?

Фото профиля Steven Cheng
Steven Cheng2 месяцев назад

uv for PyTorch installs is a game changer. The reasoning model breakdown sounds fascinating too.

Фото профиля Rimas
Rimas2 месяцев назад

does the from scratch section argue for reimplementing things to learn them, or against reinventing infra that already works

Фото профиля Sebastian Raschka
Sebastian Raschka2 месяцев назад

actually both

Фото профиля Idriss
Idriss2 месяцев назад

The reasoning-vs-agent framing is the one most teams blur. Reasoning buys a better single answer; agents buy retries against a real environment. Different failure modes, different eval.

Фото профиля Steven Cheng
Steven Cheng2 месяцев назад

How does uv handle complex dependency conflicts compared to pip?

Фото профиля Sebastian Raschka
Sebastian Raschka2 месяцев назад

much faster, it uses a Rust-based solver

Фото профиля GenieOrb
GenieOrb2 месяцев назад

Putting uv beside reasoning models makes the path from watching an explanation to running code feel much shorter.

Фото профиля Kamal Bisht 🔴 AI Marketer
Kamal Bisht 🔴 AI Marketer2 месяцев назад

jack of all trades master of none but make it llms. how long until you cover conda too or is uv winning?

Фото профиля Gill
Gill2 месяцев назад

Using uv to set up PyTorch environments has completely transformed my daily python workflow

Фото профиля Elev
Elev2 месяцев назад

reasoning is a property of a single call, agency is a property of the loop around it. most of the disappointment i see sits in the second one and gets blamed on the first.

Фото профиля Alee Kolachi
Alee Kolachi2 месяцев назад

Sounds handy. Thank you for sharing.

Фото профиля TechGeekDavid
TechGeekDavid2 месяцев назад

Reasoning models are still doing next-token prediction with more structured scaffolding. The compression of world models into language has not changed.

Фото профиля Sebastian Raschka
Sebastian Raschka2 месяцев назад

exactly

Фото профиля TechGeekDavid
TechGeekDavid2 месяцев назад

From scratch is the interesting part. If language is how we compress world models, a different approach needs a different compression.

Фото профиля griffin fuzzystripes
griffin fuzzystripes2 месяцев назад

From-scratch can name LLM, reasoner, and agent in one sitting. That is a syllabus, not a niche. Three labels on one chalkboard are still one occupancy. #LLMs #Agents

Фото профиля WAi XeA
WAi XeA2 месяцев назад

There's a 43 minute video because agent ate the other two words.

Фото профиля FINeuraLab
FINeuraLab2 месяцев назад

Explaining conventional language models, reasoning models, and agents together helps separate architecture from workflow. The distinctions become much clearer when each layer is tied to an example of what it changes in practice.

Похожие видео

🚨 THIS IS ACTUALLY INSANE Python developers are still installing five different tools to manage one project. `pip` for packages. `virtualenv` for environments. `pyenv` for Python versions. `pipx` for CLI tools. `poetry` for project management. uv replaces all of them with one tool. And it’s written in Rust. The headline number: 10–100× faster than pip. But speed isn't even the most interesting part. uv can: → Create and manage Python projects → Resolve dependencies with a universal lockfile → Create virtual environments → Install and switch between Python versions → Run standalone Python scripts with dependencies → Install CLI tools with `uvx` → Compile and sync requirements → Manage Cargo-style workspaces The workflow becomes ridiculously simple: `uv init` → create a project `uv add` → add dependencies `uv run` → run your code `uv lock` → lock dependencies `uv sync` → reproduce the environment And if you're already using pip? You don't have to throw your workflow away. The `uv pip` interface is designed as a drop-in replacement while giving you the speed boost. The other clever bit: uv uses a global cache to deduplicate dependencies and save disk space. So instead of assembling a Python toolchain piece by piece, you get one fast CLI that covers the whole workflow. And unlike a lot of newer developer tools, uv is already considered stable and production-ready. If you work with Python, this is one of those tools you should probably try once. You might not go back. #Python #DevTools #Rust #OpenSource #Programming #AIEngineering

Vikas gupta

40,126 просмотров • 1 месяц назад