Загрузка видео...

Не удалось загрузить видео

На главную

We now run evals to help you know what AI models perform best to write Nuxt code.

nuxt_js's profile picture

Nuxt

104,260 subscribers

28,019 просмотров • 4 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

"To build a great company, you need to write code and talk to users." - Florian Juengermann (co-founder of Listen Labs) "AI agents can now write code, so what becomes important is building the right thing and having the right feedback." "That's what we are building: telling the AI what to do, what to build, and being the tastemaker."
1:09

"To build a great company, you need to write code and talk to users." - Florian Juengermann (co-founder of Listen Labs) "AI agents can now write code, so what becomes important is building the right thing and having the right feedback." "That's what we are building: telling the AI what to do, what to build, and being the tastemaker."

TBPN

15,291 просмотров • 1 год назад

What are the largest software engineering tasks AI can perform? To answer this, we built MirrorCode, our long-horizon SWE benchmark that lets AI code autonomously for days at a time. The best models complete some tasks we estimate would take human engineers several weeks.
1:11

What are the largest software engineering tasks AI can perform? To answer this, we built MirrorCode, our long-horizon SWE benchmark that lets AI code autonomously for days at a time. The best models complete some tasks we estimate would take human engineers several weeks.

Epoch AI

66,956 просмотров • 18 дней назад

We are opening up the beta of our new AI writing tool to Exclusive Models. If you're exclusive to JFF, try it out and let us know your thoughts. At our Anniversary Conference, lots of models said they needed help making their posts more creative. This is a tool to help models take what they write and help them make better posts. Does this replace a human? No! In fact, if you are an erotic writer, apply to be in our Business Directory so models can hire you to help them out!
1:09

Sensitive content

We are opening up the beta of our new AI writing tool to Exclusive Models. If you're exclusive to JFF, try it out and let us know your thoughts. At our Anniversary Conference, lots of models said they needed help making their posts more creative. This is a tool to help models take what they write and help them make better posts. Does this replace a human? No! In fact, if you are an erotic writer, apply to be in our Business Directory so models can hire you to help them out!

JustForFans

15,325 просмотров • 3 лет назад

prompting tip: How to write hybrid english & code prompts while building custom GPTs -Turn on code interpreter -"write code to ..." -Regenerate a few times until you get one you like -Copy paste it back into your prompt -tweak it to improve Now your ai can write consistent code Plus, you can add & combine with all sorts of english rules on top. Essentially adding english code logic "If the user asks for ..., then run this code" "If the user needs help with ..., use this code snippet and ask the user for all required information" Guess what thats a working if statement in english! if userAsksFor { // run this code } Prompts are code! English is a coding language Prompt-gramming is abstract coding
0:57

prompting tip: How to write hybrid english & code prompts while building custom GPTs -Turn on code interpreter -"write code to ..." -Regenerate a few times until you get one you like -Copy paste it back into your prompt -tweak it to improve Now your ai can write consistent code Plus, you can add & combine with all sorts of english rules on top. Essentially adding english code logic "If the user asks for ..., then run this code" "If the user needs help with ..., use this code snippet and ask the user for all required information" Guess what thats a working if statement in english! if userAsksFor { // run this code } Prompts are code! English is a coding language Prompt-gramming is abstract coding

Nick Dobos

117,034 просмотров • 2 лет назад

VS Code is adding new AI features every day to help you write code faster and better than ever. Here are a few favorites that I have that you should go try out right now. #vscode #githubcopilot
10:03

VS Code is adding new AI features every day to help you write code faster and better than ever. Here are a few favorites that I have that you should go try out right now. #vscode #githubcopilot

James Montemagno

24,772 просмотров • 11 месяцев назад

🚨 UNCANNY VALLEY: LEARNING TO CODE WON’T SAVE YOU Forget Python. If you don’t know how to think like an algorithm, Danks says the future will leave you behind. Dr. David Danks: “We need students to think computationally and algorithmically—but we don’t need them to write Python scripts.” In the world of AI, it’s not what you can code—it’s how you think that matters.
1:11

🚨 UNCANNY VALLEY: LEARNING TO CODE WON’T SAVE YOU Forget Python. If you don’t know how to think like an algorithm, Danks says the future will leave you behind. Dr. David Danks: “We need students to think computationally and algorithmically—but we don’t need them to write Python scripts.” In the world of AI, it’s not what you can code—it’s how you think that matters.

Mario Nawfal

85,486 просмотров • 1 год назад

Evals 101: a new course from Braintrust. Everything you need to know about evals, and how to do them yourself. Module one: Why are evals important? - the six most common problems developers face when shipping AI applications - why traditional software thinking doesn't apply to AI - how evals can fix these problems
1:51

Evals 101: a new course from Braintrust. Everything you need to know about evals, and how to do them yourself. Module one: Why are evals important? - the six most common problems developers face when shipping AI applications - why traditional software thinking doesn't apply to AI - how evals can fix these problems

Braintrust

36,347 просмотров • 2 месяцев назад

Larry Ellison says AI is now writing Oracle's Code. "We just tell the model what we want the program to do, and then the AI comes up with a step-by-step process to actually do it. We don't write the procedure, we declare our intent"
0:39

Larry Ellison says AI is now writing Oracle's Code. "We just tell the model what we want the program to do, and then the AI comes up with a step-by-step process to actually do it. We don't write the procedure, we declare our intent"

Rohan Paul

67,599 просмотров • 1 месяц назад

Earlier today we released local development for Kaggle Benchmarks. 🚀 You can now write, validate and run AI evaluation tasks directly from your preferred dev environment — VSCode, Antigravity, Claude Code, and more. Go from idea to working eval using natural language with the write-kaggle-benchmarks skill.
4:39

Earlier today we released local development for Kaggle Benchmarks. 🚀 You can now write, validate and run AI evaluation tasks directly from your preferred dev environment — VSCode, Antigravity, Claude Code, and more. Go from idea to working eval using natural language with the write-kaggle-benchmarks skill.

Kaggle

16,445 просмотров • 1 месяц назад

Create datasets, run evals, and even train models directly in Cursor with the Hugging Face plugin. Here's Ben Burtenshaw to show you how:
1:53

Create datasets, run evals, and even train models directly in Cursor with the Hugging Face plugin. Here's Ben Burtenshaw to show you how:

edwin

17,119 просмотров • 4 месяцев назад

The LLM Data Company creates tooling to write, version, and execute evals for models and agents. They help you measure performance and define rewards for reinforcement learning. Congrats on the launch, Daanish Khazi, Gavin Bains, and Joey Besgen!
2:19

The LLM Data Company creates tooling to write, version, and execute evals for models and agents. They help you measure performance and define rewards for reinforcement learning. Congrats on the launch, Daanish Khazi, Gavin Bains, and Joey Besgen!

Y Combinator

17,143 просмотров • 1 год назад

Respan Launch Week, Day 2: Evals Evals are one of the hardest parts of building AI applications. It is not because teams cannot run them. It is because they are hard to structure, hard to compare, and even harder to improve over time. So teams end up guessing. Did this prompt actually get better? Is this model really an improvement? We built Evals in Respan to make this systematic. You define: - what you want to test, such as prompts, models, or configs - the dataset, from production logs or test cases - the evaluators, whether LLM, code, human, or a mix Then you run experiments and compare results side by side. Same inputs. Same evaluation. Clear answers. No more guessing. Start running your first eval.
2:13

Respan Launch Week, Day 2: Evals Evals are one of the hardest parts of building AI applications. It is not because teams cannot run them. It is because they are hard to structure, hard to compare, and even harder to improve over time. So teams end up guessing. Did this prompt actually get better? Is this model really an improvement? We built Evals in Respan to make this systematic. You define: - what you want to test, such as prompts, models, or configs - the dataset, from production logs or test cases - the evaluators, whether LLM, code, human, or a mix Then you run experiments and compare results side by side. Same inputs. Same evaluation. Clear answers. No more guessing. Start running your first eval.

Respan

127,602 просмотров • 2 месяцев назад

we built the first sane way to debug your agent locally. you can see your traces. codex/claude code can too. this lets them write evals and test your agents automatically. best part: it's completely free and open source. install with 1 line. (github below)
0:22

we built the first sane way to debug your agent locally. you can see your traces. codex/claude code can too. this lets them write evals and test your agents automatically. best part: it's completely free and open source. install with 1 line. (github below)

ben hylak

193,654 просмотров • 2 месяцев назад

Using AI to write a sonnet is entertaining. Using AI to help perform heart surgery is game-changing. On Possible, "godmother of AI" Fei-Fei Li talks about her team's quest to unlock spatial intelligence.
1:11

Using AI to write a sonnet is entertaining. Using AI to help perform heart surgery is game-changing. On Possible, "godmother of AI" Fei-Fei Li talks about her team's quest to unlock spatial intelligence.

Reid Hoffman

40,120 просмотров • 1 год назад

Holy moly Never seen someone being that bullish for AI developement as Dario Amodei: - There's just an exponential just like we had an exponential with Moore's law - I think the models are just going to get more and more capable at everything - I've had internal people at Anthropic say, "I don't write any code anymore. I don't write I don't open up an editor and write code. I just let Claude code write the first draft and and all I do is edit it. - What what we're going to see in the future is just like we've going to be seen in the past except more so - the models are just going to get more and more intellectually capable and you know the the revenue is going to keep adding zeros. holy moly, Dario!
1:06

Holy moly Never seen someone being that bullish for AI developement as Dario Amodei: - There's just an exponential just like we had an exponential with Moore's law - I think the models are just going to get more and more capable at everything - I've had internal people at Anthropic say, "I don't write any code anymore. I don't write I don't open up an editor and write code. I just let Claude code write the first draft and and all I do is edit it. - What what we're going to see in the future is just like we've going to be seen in the past except more so - the models are just going to get more and more intellectually capable and you know the the revenue is going to keep adding zeros. holy moly, Dario!

Chubby♨️

77,711 просмотров • 7 месяцев назад

We beat Claude Code in our evals: 61% to 53%. Yes, evals are actually important haha And now we’re open-sourcing our entire codebase and launching an agent framework! Now you can build custom agents for your project and get better results 🔥
5:42

We beat Claude Code in our evals: 61% to 53%. Yes, evals are actually important haha And now we’re open-sourcing our entire codebase and launching an agent framework! Now you can build custom agents for your project and get better results 🔥

James Grugett

276,625 просмотров • 10 месяцев назад

🚀Introducing Code Arena: the next generation of live coding evals for frontier AI models. Built to test how models plan, scaffold, debug, and build real web apps step-by-step. Try Claude, GPT-5, GLM-4.6 and Gemini in Code Arena today!
0:56

🚀Introducing Code Arena: the next generation of live coding evals for frontier AI models. Built to test how models plan, scaffold, debug, and build real web apps step-by-step. Try Claude, GPT-5, GLM-4.6 and Gemini in Code Arena today!

Arena.ai

328,087 просмотров • 8 месяцев назад

LLMs have given us a new way to generate code extremely effectively, but they haven't been able to help us run production until now. I sat down with Lightspeed's Sebastian Duesterhoeft to discuss exactly what Resolve AI has set out to solve. Lightspeed | Resolve AI
0:55

LLMs have given us a new way to generate code extremely effectively, but they haven't been able to help us run production until now. I sat down with Lightspeed's Sebastian Duesterhoeft to discuss exactly what Resolve AI has set out to solve. Lightspeed | Resolve AI

Spiros Xanthos

50,185 просмотров • 5 месяцев назад

📌Meet $AVM: The SuperComputer for AI Agents. The virtual machine that lets agents write, run, and verify code without human help (explained) 👇
1:21

📌Meet $AVM: The SuperComputer for AI Agents. The virtual machine that lets agents write, run, and verify code without human help (explained) 👇

AVM

42,451 просмотров • 1 год назад

Run Python with the Gemini API. Nikita Namjoshi shares how to use the Code Execution tool in AI Studio to solve math problems, perform data analysis, and use code-based reasoning.
4:48

Run Python with the Gemini API. Nikita Namjoshi shares how to use the Code Execution tool in AI Studio to solve math problems, perform data analysis, and use code-based reasoning.

Google AI Developers

16,481 просмотров • 8 месяцев назад