正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Deterministic inference: getting the exact same output every time you run an LLM with identical inputs. Try it yourself: Powered by EigenAI

nader dabit

187,550 subscribers

29,335 次观看 • 10 个月前 •via X (Twitter)

教育科学技术

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

#M5StackNew 🎊 The LLM630 Compute Kit is an #AI large language model (#LLM) inference development kit, powered by the #Axera #AX630C SoC with a 3.2 TOPs NPU, it delivers efficient AI inference for tasks like computer vision (CV) and LLM processing.

#M5StackNew 🎊 The LLM630 Compute Kit is an #AI large language model (#LLM) inference development kit, powered by the #Axera #AX630C SoC with a 3.2 TOPs NPU, it delivers efficient AI inference for tasks like computer vision (CV) and LLM processing.

M5Stack

16,859 次观看 • 1 年前

Introducing Summaries! Now, every Exa result can come with an LLM-generated summary, or an answer to any question you specify. Try it for yourself!

Introducing Summaries! Now, every Exa result can come with an LLM-generated summary, or an answer to any question you specify. Try it for yourself!

Exa

20,419 次观看 • 2 年前

We've built the best in house observability for Stagehand 🔭 Get inference time, token usage, LLM output, and more on the new dashboard. No more black box, see everything behind the scenes. See for yourself, get started with npx create-browser-app 🤘

We've built the best in house observability for Stagehand 🔭 Get inference time, token usage, LLM output, and more on the new dashboard. No more black box, see everything behind the scenes. See for yourself, get started with npx create-browser-app 🤘

Stagehand

10,887 次观看 • 1 年前

Let's (ab)use an LLM API with excessive agency to delete Carlos' user account! (sorry Carlos!) Try it yourself here:

Let's (ab)use an LLM API with excessive agency to delete Carlos' user account! (sorry Carlos!) Try it yourself here:

Web Security Academy

12,646 次观看 • 8 个月前

This is a very clever idea to use an LLM with your SQL data. SQL + AI has been tried before, but one of the best parts of this solution is getting the same exact OpenAI's completion API. In other words: You are now talking to an LLM that knows everything about your database and you don't even notice it! I recorded a 2-min video to show you how it works. Thanks to the team for the collaboration, listening to my feedback, and helping me understand what they built. Go to to try this yourself.

This is a very clever idea to use an LLM with your SQL data. SQL + AI has been tried before, but one of the best parts of this solution is getting the same exact OpenAI's completion API. In other words: You are now talking to an LLM that knows everything about your database and you don't even notice it! I recorded a 2-min video to show you how it works. Thanks to the team for the collaboration, listening to my feedback, and helping me understand what they built. Go to to try this yourself.

Santiago

230,551 次观看 • 2 年前

Introducing the most precise calculator in the world, powered by GPT-5.2 Try it yourself

Introducing the most precise calculator in the world, powered by GPT-5.2 Try it yourself

blanc

2,299,650 次观看 • 7 个月前

Introducing the most precise calculator in the world, powered by GPT-5.2 Try it yourself

Introducing the most precise calculator in the world, powered by GPT-5.2 Try it yourself

Ann Nguyen

24,088,507 次观看 • 9 个月前

Right now, I have a few dozen tools to automate my life. Every single thing that I do more than once every week is now a tool: either a Claude Code skill, a scheduled workflow, or an application. • I spend the time doing this once. • I schedule it. • I forget about it (or at least, try to) CREAO is one of the platforms I've used extensively for building some of these automations. They are partnering with me on this post. They are one of the only platforms where you can go from a conversation to a scheduled agent that quickly. This is how it works: 1. You describe the problem you want to solve 2. CREAO's agent builds the logic and executes it 3. You can iterate with the agent to improve the solution 4. When you are done, you turn that solution into a mini app 5. You can schedule that app to run any time you need it Something important: These agents are deterministic. They don't use an LLM to generate answers, so they will always return the same output given the same input. This is critical: when you're automating something that runs every Monday at 9 am, you need it to return the same result every time, not a "creative" answer.

Right now, I have a few dozen tools to automate my life. Every single thing that I do more than once every week is now a tool: either a Claude Code skill, a scheduled workflow, or an application. • I spend the time doing this once. • I schedule it. • I forget about it (or at least, try to) CREAO is one of the platforms I've used extensively for building some of these automations. They are partnering with me on this post. They are one of the only platforms where you can go from a conversation to a scheduled agent that quickly. This is how it works: 1. You describe the problem you want to solve 2. CREAO's agent builds the logic and executes it 3. You can iterate with the agent to improve the solution 4. When you are done, you turn that solution into a mini app 5. You can schedule that app to run any time you need it Something important: These agents are deterministic. They don't use an LLM to generate answers, so they will always return the same output given the same input. This is critical: when you're automating something that runs every Monday at 9 am, you need it to return the same result every time, not a "creative" answer.

Santiago

13,727 次观看 • 6 个月前

Stop overpaying for every LLM call. 💸 The DigitalOcean Inference Router resolves intent in ~200ms and beats GPT-5.1 and Claude Sonnet 4.5 on routing accuracy. Powered by Rust, WASM, and purpose-built SLMs, it adds milliseconds, not seconds, to every request. 🌊

Stop overpaying for every LLM call. 💸 The DigitalOcean Inference Router resolves intent in ~200ms and beats GPT-5.1 and Claude Sonnet 4.5 on routing accuracy. Powered by Rust, WASM, and purpose-built SLMs, it adds milliseconds, not seconds, to every request. 🌊

DigitalOcean

19,853 次观看 • 4 个月前

Network related hitching / rubberband only on matchmaking servers. I no matter what i try, i can not fix it. Same console output every time the hitch happens. CS2 Fletcher Dunn

Network related hitching / rubberband only on matchmaking servers. I no matter what i try, i can not fix it. Same console output every time the hitch happens. CS2 Fletcher Dunn

elias

114,461 次观看 • 1 年前

The next iteration of Perplexity has arrived: Copilot, your interactive AI search companion. 🚀🤖 Perplexity Copilot guides your search experience with interactive inputs, leading you to a rich, personalized answer, powered by GPT-4. Try it for free at

The next iteration of Perplexity has arrived: Copilot, your interactive AI search companion. 🚀🤖 Perplexity Copilot guides your search experience with interactive inputs, leading you to a rich, personalized answer, powered by GPT-4. Try it for free at

Perplexity

1,300,047 次观看 • 3 年前

This is our second head-to-head test between Kling 3.0 and Seedance 2.0. This time, we pushed both models further, including dialogue-driven Sci-fi comedy shots and even a singing scene. Every single shot was generated using: • The exact same base image • The exact same prompt • No re-generate • No second attempt • No prompt refinements. What you see is the pure first output from each model under identical conditions. So… which one performs better? Seedance 2.0 generated by Ilham Setyawan on BytePlus

This is our second head-to-head test between Kling 3.0 and Seedance 2.0. This time, we pushed both models further, including dialogue-driven Sci-fi comedy shots and even a singing scene. Every single shot was generated using: • The exact same base image • The exact same prompt • No re-generate • No second attempt • No prompt refinements. What you see is the pure first output from each model under identical conditions. So… which one performs better? Seedance 2.0 generated by Ilham Setyawan on BytePlus

Dinda Prasetyo

196,658 次观看 • 7 个月前

Excited to share Quail, our new open source AI-SQL engine (a collab with Modal)! By planning queries and LLM inference together, it reaches 1B+ input tokens/min on one H100 for one query 😱🚀 AI-powered data operators create a new, interesting inference workload👇

Excited to share Quail, our new open source AI-SQL engine (a collab with Modal)! By planning queries and LLM inference together, it reaches 1B+ input tokens/min on one H100 for one query 😱🚀 AI-powered data operators create a new, interesting inference workload👇

Shreya Shankar

368,348 次观看 • 7 天前

When you prompt an LLM for code, you get one deterministic program. However, the LLM actually defines a distribution over many programs, and existing methods discard it‼️ PPoT uses this distribution to extract free performance and efficiency gains. 🧵👇

When you prompt an LLM for code, you get one deterministic program. However, the LLM actually defines a distribution over many programs, and existing methods discard it‼️ PPoT uses this distribution to extract free performance and efficiency gains. 🧵👇

Daniel Israel

12,123 次观看 • 4 个月前

Introducing News Analyst — a fully verifiable AI engine powered by EigenCloud suite > Uses EigenAI with wallet-signed grants. Temperature locked to zero with fixed entropy seeds. No hallucinations, only deterministic truth. > Every analysis is dispersed as a blob to EigenDA. No database—the state is stored across a validator set on Sepolia. > Generate a DA Commitment for every report. Reconstruct the entire analysis purely from the sharded network. > Sidecar architecture running via Dockerized EigenDA Proxy.

Introducing News Analyst — a fully verifiable AI engine powered by EigenCloud suite > Uses EigenAI with wallet-signed grants. Temperature locked to zero with fixed entropy seeds. No hallucinations, only deterministic truth. > Every analysis is dispersed as a blob to EigenDA. No database—the state is stored across a validator set on Sepolia. > Generate a DA Commitment for every report. Reconstruct the entire analysis purely from the sharded network. > Sidecar architecture running via Dockerized EigenDA Proxy.

Zeeshan

25,783 次观看 • 7 个月前

Getting arrested by every three-letter government agency at the exact same time and still walking out after a single phone call is the ultimate boss flex in movie history.

Getting arrested by every three-letter government agency at the exact same time and still walking out after a single phone call is the ultimate boss flex in movie history.

Every Movie Plug

59,305 次观看 • 2 个月前

No ETH? No BNB? FlexGas lets you pay gas fees with TWT, USDT, or USDC. ⚙️ Same-chain now, cross-chain coming soon 🔵 Live on @BNBChain & @Ethereum 🔐 Self-custody, always. Powered by EIP-7702 Try it yourself: 🧵

No ETH? No BNB? FlexGas lets you pay gas fees with TWT, USDT, or USDC. ⚙️ Same-chain now, cross-chain coming soon 🔵 Live on @BNBChain & @Ethereum 🔐 Self-custody, always. Powered by EIP-7702 Try it yourself: 🧵

Trust Wallet

15,470 次观看 • 1 年前