Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

We now run evals to help you know what AI models perform best to write Nuxt code.

Nuxt

104,239 subscribers

27,923 views • 3 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

"To build a great company, you need to write code and talk to users." - Florian Juengermann (co-founder of Listen Labs) "AI agents can now write code, so what becomes important is building the right thing and having the right feedback." "That's what we are building: telling the AI what to do, what to build, and being the tastemaker."

"To build a great company, you need to write code and talk to users." - Florian Juengermann (co-founder of Listen Labs) "AI agents can now write code, so what becomes important is building the right thing and having the right feedback." "That's what we are building: telling the AI what to do, what to build, and being the tastemaker."

TBPN

15,221 views • 1 year ago

We are opening up the beta of our new AI writing tool to Exclusive Models. If you're exclusive to JFF, try it out and let us know your thoughts. At our Anniversary Conference, lots of models said they needed help making their posts more creative. This is a tool to help models take what they write and help them make better posts. Does this replace a human? No! In fact, if you are an erotic writer, apply to be in our Business Directory so models can hire you to help them out!

Sensitive content

We are opening up the beta of our new AI writing tool to Exclusive Models. If you're exclusive to JFF, try it out and let us know your thoughts. At our Anniversary Conference, lots of models said they needed help making their posts more creative. This is a tool to help models take what they write and help them make better posts. Does this replace a human? No! In fact, if you are an erotic writer, apply to be in our Business Directory so models can hire you to help them out!

JustForFans

15,290 views • 3 years ago

prompting tip: How to write hybrid english & code prompts while building custom GPTs -Turn on code interpreter -"write code to ..." -Regenerate a few times until you get one you like -Copy paste it back into your prompt -tweak it to improve Now your ai can write consistent code Plus, you can add & combine with all sorts of english rules on top. Essentially adding english code logic "If the user asks for ..., then run this code" "If the user needs help with ..., use this code snippet and ask the user for all required information" Guess what thats a working if statement in english! if userAsksFor { // run this code } Prompts are code! English is a coding language Prompt-gramming is abstract coding

prompting tip: How to write hybrid english & code prompts while building custom GPTs -Turn on code interpreter -"write code to ..." -Regenerate a few times until you get one you like -Copy paste it back into your prompt -tweak it to improve Now your ai can write consistent code Plus, you can add & combine with all sorts of english rules on top. Essentially adding english code logic "If the user asks for ..., then run this code" "If the user needs help with ..., use this code snippet and ask the user for all required information" Guess what thats a working if statement in english! if userAsksFor { // run this code } Prompts are code! English is a coding language Prompt-gramming is abstract coding

Nick Dobos

117,034 views • 2 years ago

VS Code is adding new AI features every day to help you write code faster and better than ever. Here are a few favorites that I have that you should go try out right now. #vscode #githubcopilot

VS Code is adding new AI features every day to help you write code faster and better than ever. Here are a few favorites that I have that you should go try out right now. #vscode #githubcopilot

James Montemagno

24,772 views • 10 months ago

🚨 UNCANNY VALLEY: LEARNING TO CODE WON’T SAVE YOU Forget Python. If you don’t know how to think like an algorithm, Danks says the future will leave you behind. Dr. David Danks: “We need students to think computationally and algorithmically—but we don’t need them to write Python scripts.” In the world of AI, it’s not what you can code—it’s how you think that matters.

🚨 UNCANNY VALLEY: LEARNING TO CODE WON’T SAVE YOU Forget Python. If you don’t know how to think like an algorithm, Danks says the future will leave you behind. Dr. David Danks: “We need students to think computationally and algorithmically—but we don’t need them to write Python scripts.” In the world of AI, it’s not what you can code—it’s how you think that matters.

Mario Nawfal

85,486 views • 1 year ago

Evals 101: a new course from Braintrust. Everything you need to know about evals, and how to do them yourself. Module one: Why are evals important? - the six most common problems developers face when shipping AI applications - why traditional software thinking doesn't apply to AI - how evals can fix these problems

Evals 101: a new course from Braintrust. Everything you need to know about evals, and how to do them yourself. Module one: Why are evals important? - the six most common problems developers face when shipping AI applications - why traditional software thinking doesn't apply to AI - how evals can fix these problems

Braintrust

36,347 views • 1 month ago

Larry Ellison says AI is now writing Oracle's Code. "We just tell the model what we want the program to do, and then the AI comes up with a step-by-step process to actually do it. We don't write the procedure, we declare our intent"

Larry Ellison says AI is now writing Oracle's Code. "We just tell the model what we want the program to do, and then the AI comes up with a step-by-step process to actually do it. We don't write the procedure, we declare our intent"

Rohan Paul

67,569 views • 1 month ago

Earlier today we released local development for Kaggle Benchmarks. 🚀 You can now write, validate and run AI evaluation tasks directly from your preferred dev environment — VSCode, Antigravity, Claude Code, and more. Go from idea to working eval using natural language with the write-kaggle-benchmarks skill.

Earlier today we released local development for Kaggle Benchmarks. 🚀 You can now write, validate and run AI evaluation tasks directly from your preferred dev environment — VSCode, Antigravity, Claude Code, and more. Go from idea to working eval using natural language with the write-kaggle-benchmarks skill.

Kaggle

16,240 views • 14 days ago

The LLM Data Company creates tooling to write, version, and execute evals for models and agents. They help you measure performance and define rewards for reinforcement learning. Congrats on the launch, Daanish Khazi, Gavin Bains, and Joey Besgen!

The LLM Data Company creates tooling to write, version, and execute evals for models and agents. They help you measure performance and define rewards for reinforcement learning. Congrats on the launch, Daanish Khazi, Gavin Bains, and Joey Besgen!

Y Combinator

17,131 views • 1 year ago

Respan Launch Week, Day 2: Evals Evals are one of the hardest parts of building AI applications. It is not because teams cannot run them. It is because they are hard to structure, hard to compare, and even harder to improve over time. So teams end up guessing. Did this prompt actually get better? Is this model really an improvement? We built Evals in Respan to make this systematic. You define: - what you want to test, such as prompts, models, or configs - the dataset, from production logs or test cases - the evaluators, whether LLM, code, human, or a mix Then you run experiments and compare results side by side. Same inputs. Same evaluation. Clear answers. No more guessing. Start running your first eval.

Respan Launch Week, Day 2: Evals Evals are one of the hardest parts of building AI applications. It is not because teams cannot run them. It is because they are hard to structure, hard to compare, and even harder to improve over time. So teams end up guessing. Did this prompt actually get better? Is this model really an improvement? We built Evals in Respan to make this systematic. You define: - what you want to test, such as prompts, models, or configs - the dataset, from production logs or test cases - the evaluators, whether LLM, code, human, or a mix Then you run experiments and compare results side by side. Same inputs. Same evaluation. Clear answers. No more guessing. Start running your first eval.

Respan

127,602 views • 1 month ago

Create datasets, run evals, and even train models directly in Cursor with the Hugging Face plugin. Here's Ben Burtenshaw to show you how:

Create datasets, run evals, and even train models directly in Cursor with the Hugging Face plugin. Here's Ben Burtenshaw to show you how:

edwin

17,119 views • 3 months ago

we built the first sane way to debug your agent locally. you can see your traces. codex/claude code can too. this lets them write evals and test your agents automatically. best part: it's completely free and open source. install with 1 line. (github below)

we built the first sane way to debug your agent locally. you can see your traces. codex/claude code can too. this lets them write evals and test your agents automatically. best part: it's completely free and open source. install with 1 line. (github below)

ben hylak

192,828 views • 1 month ago

🚀Introducing Code Arena: the next generation of live coding evals for frontier AI models. Built to test how models plan, scaffold, debug, and build real web apps step-by-step. Try Claude, GPT-5, GLM-4.6 and Gemini in Code Arena today!

🚀Introducing Code Arena: the next generation of live coding evals for frontier AI models. Built to test how models plan, scaffold, debug, and build real web apps step-by-step. Try Claude, GPT-5, GLM-4.6 and Gemini in Code Arena today!

Arena.ai

327,323 views • 7 months ago

Using AI to write a sonnet is entertaining. Using AI to help perform heart surgery is game-changing. On Possible, "godmother of AI" Fei-Fei Li talks about her team's quest to unlock spatial intelligence.

Using AI to write a sonnet is entertaining. Using AI to help perform heart surgery is game-changing. On Possible, "godmother of AI" Fei-Fei Li talks about her team's quest to unlock spatial intelligence.

Reid Hoffman

40,120 views • 1 year ago

Holy moly Never seen someone being that bullish for AI developement as Dario Amodei: - There's just an exponential just like we had an exponential with Moore's law - I think the models are just going to get more and more capable at everything - I've had internal people at Anthropic say, "I don't write any code anymore. I don't write I don't open up an editor and write code. I just let Claude code write the first draft and and all I do is edit it. - What what we're going to see in the future is just like we've going to be seen in the past except more so - the models are just going to get more and more intellectually capable and you know the the revenue is going to keep adding zeros. holy moly, Dario!

Holy moly Never seen someone being that bullish for AI developement as Dario Amodei: - There's just an exponential just like we had an exponential with Moore's law - I think the models are just going to get more and more capable at everything - I've had internal people at Anthropic say, "I don't write any code anymore. I don't write I don't open up an editor and write code. I just let Claude code write the first draft and and all I do is edit it. - What what we're going to see in the future is just like we've going to be seen in the past except more so - the models are just going to get more and more intellectually capable and you know the the revenue is going to keep adding zeros. holy moly, Dario!

Chubby♨️

77,711 views • 6 months ago

We beat Claude Code in our evals: 61% to 53%. Yes, evals are actually important haha And now we’re open-sourcing our entire codebase and launching an agent framework! Now you can build custom agents for your project and get better results 🔥

We beat Claude Code in our evals: 61% to 53%. Yes, evals are actually important haha And now we’re open-sourcing our entire codebase and launching an agent framework! Now you can build custom agents for your project and get better results 🔥

James Grugett

276,478 views • 9 months ago

📌Meet $AVM: The SuperComputer for AI Agents. The virtual machine that lets agents write, run, and verify code without human help (explained) 👇

📌Meet $AVM: The SuperComputer for AI Agents. The virtual machine that lets agents write, run, and verify code without human help (explained) 👇

AVM

42,451 views • 11 months ago

LLMs have given us a new way to generate code extremely effectively, but they haven't been able to help us run production until now. I sat down with Lightspeed's Sebastian Duesterhoeft to discuss exactly what Resolve AI has set out to solve. Lightspeed | Resolve AI

LLMs have given us a new way to generate code extremely effectively, but they haven't been able to help us run production until now. I sat down with Lightspeed's Sebastian Duesterhoeft to discuss exactly what Resolve AI has set out to solve. Lightspeed | Resolve AI

Spiros Xanthos

50,185 views • 4 months ago

What happens when you let AI models run a simulated society?

What happens when you let AI models run a simulated society?

Ronan Farrow

151,909 views • 23 days ago

Run Python with the Gemini API. Nikita Namjoshi shares how to use the Code Execution tool in AI Studio to solve math problems, perform data analysis, and use code-based reasoning.

Run Python with the Gemini API. Nikita Namjoshi shares how to use the Code Execution tool in AI Studio to solve math problems, perform data analysis, and use code-based reasoning.

Google AI Developers

16,481 views • 7 months ago