正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

1. Meta’s open-sourced multisensory model Meta is back (again!) with yet another exciting open-source project. Introducing ImageBind, a new AI research model that understands and combines text, audio, visual, movement, thermal, AND depth data.

Rowan Cheung

590,862 subscribers

173,984 次观看 • 3 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

12 条评论

Rowan Cheung 的头像

Rowan Cheung3 年前

Massive announcements in the world of AI today from Meta, Humane, IBM and Wendy's. Plus, scientists found a new way of using AI to detect the early onset of Parkinson's. Here's the rundown on everything you need to know:

Rowan Cheung 的头像

Rowan Cheung3 年前

The integration of multiple data types unlocks new possibilities, including: -Multimodal search capabilities -Embedding-space arithmetic -Converting audio to image generation HUGE for multimedia search, VR, and robotics.

Rowan Cheung 的头像

Rowan Cheung3 年前

2. Humane’s wearable AI device Humane revealed a wearable AI device designed to replace smartphones at a recent TED event. It appears as a tiny black puck that slips into your pocket, takes over your phone, and employs AI to update you on your day.

Rowan Cheung 的头像

Rowan Cheung3 年前

Co-founder Imran Chaudhri demonstrated its features, including: -Projecting caller information onto his hand -Suggesting nearby shopping options -Translating sentences -Summing up emails and messages -Giving dietary recommendations Full demo:

Rowan Cheung 的头像

Rowan Cheung3 年前

3. IBM launches an AI platform for enterprises IBM's recently announced to replace 7,800 jobs with AI. Now, the company unveiled Watsonx- a new AI platform designed to assist businesses in creating/utilizing AI models.

Rowan Cheung 的头像

Rowan Cheung3 年前

Watsonx stands out by offering pre-trained enterprise models at cost-effective infrastructure. It's clear they're going all in on AI. The question remains: Can IBM keep pace with tech giants like Google, Meta, and Microsoft? Only time will tell.

Rowan Cheung 的头像

Rowan Cheung3 年前

4. Wendy’s AI drive-thru chatbot Wendy's is teaming up with Google to develop an AI chatbot that takes your drive-thru orders. The "Wendy's FreshAI" will be first tested in a Columbus, Ohio, restaurant in June.

Rowan Cheung 的头像

Rowan Cheung3 年前

Google is customizing its LLM to understand specific Wendy's terminology, such as "Frosty" and "JBC." Wendy’s says AI will not replace human workers (yet). Instead, employees will monitor the AI-powered drive-thru and assist customers as needed.

Rowan Cheung 的头像

Rowan Cheung3 年前

5. Using AI to detect early Parkinson's Scientists from UNSW Sydney and Boston University have developed CRANK-MS, which could detect Parkinson's disease before the onset of symptoms.

Rowan Cheung 的头像

Rowan Cheung3 年前

Published in ACS Central Science, the study analyzed biomarkers in bodily fluids using neural networks. CRANK-MS showed 96% accuracy in detecting Parkinson's. Researchers also found correlations between certain metabolites and Parkinson's, which could help future studies.

Rowan Cheung 的头像

Rowan Cheung3 年前

If you enjoyed this rundown, you'll love my newsletter. Subscribe, and you'll never miss a thing in the world of AI ever again. 140k+ have joined and stayed:

Rowan Cheung 的头像

Rowan Cheung3 年前

That's it for today's news in the world of AI. I do these rundowns daily, so follow me @rowancheung for more. Also, feel free to like + retweet the tweet below to show your support ❤️

相关视频

Apple just released and open-sourced FastVLM! FastVLM is a lightning-fast vision-language model that combines rapid image and text understanding with efficient on-device performance. 100% Open Source

Apple just released and open-sourced FastVLM! FastVLM is a lightning-fast vision-language model that combines rapid image and text understanding with efficient on-device performance. 100% Open Source

Sumanth

43,704 次观看 • 10 个月前

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:

AI at Meta

94,330 次观看 • 1 年前

Introducing Project Stera by FPV Labs, an open data infra for embodied AI research. Project Stera includes Stera-10M, with 10M+ frames of long-horizon data with persistent state tracking, and an open-source pipeline that converts raw data into training-ready formats.

Introducing Project Stera by FPV Labs, an open data infra for embodied AI research. Project Stera includes Stera-10M, with 10M+ frames of long-horizon data with persistent state tracking, and an open-source pipeline that converts raw data into training-ready formats.

FPV Labs

15,025 次观看 • 2 个月前

Meet MoshiVis🎙️🖼️, the first open-source real-time speech model that can talk about images! It sees, understands, and talks about images — naturally, and out loud. Voice interaction with a compact model endowed with visual understanding opens up new applications, from audio description for the visual impaired to visual access to information. Try it out 👉 Blog post 👉

Meet MoshiVis🎙️🖼️, the first open-source real-time speech model that can talk about images! It sees, understands, and talks about images — naturally, and out loud. Voice interaction with a compact model endowed with visual understanding opens up new applications, from audio description for the visual impaired to visual access to information. Try it out 👉 Blog post 👉

kyutai

47,949 次观看 • 1 年前

This is a big day. Meta is open-sourcing AudioCraft. You can now generate incredible music and sounds with a single prompt. It includes the most performant Generative AI Model (audio) on the market, the "Llama" of Audio. The research framework contains the weights and code of these models: ▸ MusicGen: controllable text-to-music model. ▸ AudioGen: text-to-sound model. ▸ EnCodec: high fidelity neural audio codec. ▸ Multi Band Diffusion: An EnCodec compatible decoder using diffusion. This is going to tremendously speed up audio research 👏

This is a big day. Meta is open-sourcing AudioCraft. You can now generate incredible music and sounds with a single prompt. It includes the most performant Generative AI Model (audio) on the market, the "Llama" of Audio. The research framework contains the weights and code of these models: ▸ MusicGen: controllable text-to-music model. ▸ AudioGen: text-to-sound model. ▸ EnCodec: high fidelity neural audio codec. ▸ Multi Band Diffusion: An EnCodec compatible decoder using diffusion. This is going to tremendously speed up audio research 👏

Lior Alexander

231,608 次观看 • 3 年前

China's DeepSeek is back with a brand new flagship AI model, a year after its open source model upended Silicon Valley. Tom Mackenzie explains

Bloomberg

27,567 次观看 • 2 个月前

Finally! A Text-to-SQL tool that actually works! Vanna is an open-source RAG framework for complex Text-to-SQL generation. It manages dynamic data and allows custom RAG model training for greater accuracy. 100% open-source.

Finally! A Text-to-SQL tool that actually works! Vanna is an open-source RAG framework for complex Text-to-SQL generation. It manages dynamic data and allows custom RAG model training for greater accuracy. 100% open-source.

Akshay 🚀

168,600 次观看 • 1 年前

🔉 Introducing SAM Audio, the first unified model that isolates any sound from complex audio mixtures using text, visual, or span prompts. We’re sharing SAM Audio with the community, along with a perception encoder model, benchmarks and research papers, to empower others to explore new forms of expression and build applications that were previously out of reach. 🔗 Learn more:

🔉 Introducing SAM Audio, the first unified model that isolates any sound from complex audio mixtures using text, visual, or span prompts. We’re sharing SAM Audio with the community, along with a perception encoder model, benchmarks and research papers, to empower others to explore new forms of expression and build applications that were previously out of reach. 🔗 Learn more:

AI at Meta

1,250,483 次观看 • 7 个月前

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.

Akshay 🚀

66,088 次观看 • 6 个月前

🔥 another win for open source AI SNOWFLAKE ARCTIC: 1] Mixture of Experts model with 128 (!) experts 2] open weights, open code 3] Company is sharing "cookbook" and data and teaching people how to build their own world class MoE models. 4] very cheap model to train (16x times less than Llama 3)

🔥 another win for open source AI SNOWFLAKE ARCTIC: 1] Mixture of Experts model with 128 (!) experts 2] open weights, open code 3] Company is sharing "cookbook" and data and teaching people how to build their own world class MoE models. 4] very cheap model to train (16x times less than Llama 3)

Wes Roth

10,239 次观看 • 2 年前

1/5 🚀 Thrilled to open-source OSCAR 🤖 — an action-conditioned world model for robotics, led by the visiting student in my group Zhuoyuan Wu! It generalizes across different robot embodiments with precise action controllability. All trained on a single GH200 GPU, and outperforms existing open-sourced baselines, which have larger model capacity and need more compute. Everything is public, including training data. 📄 Paper: 🌐 Project: 💻 Code: 🤗 Robot data: 🤗 Human data: 🤗 Weights: #Robotics #WorldModels #AI #OpenSource

1/5 🚀 Thrilled to open-source OSCAR 🤖 — an action-conditioned world model for robotics, led by the visiting student in my group Zhuoyuan Wu! It generalizes across different robot embodiments with precise action controllability. All trained on a single GH200 GPU, and outperforms existing open-sourced baselines, which have larger model capacity and need more compute. Everything is public, including training data. 📄 Paper: 🌐 Project: 💻 Code: 🤗 Robot data: 🤗 Human data: 🤗 Weights: #Robotics #WorldModels #AI #OpenSource

Jun Gao

104,175 次观看 • 1 个月前

This is Microsoft SandDance. originally a closed-source project that was later open-sourced. It lets you visually explore and understand data with smooth, animated transitions between multiple views.

This is Microsoft SandDance. originally a closed-source project that was later open-sourced. It lets you visually explore and understand data with smooth, animated transitions between multiple views.

Dilum Sanjaya

189,479 次观看 • 8 个月前

Unitree G1 Open Source Dataset In order to promote the development of the global embodied AI industry, the Unitree G1 robot operation data set is open sourced, adapted to a variety of open source solutions, and continuously updated: Open source data collection: Open source learning algorithms: Open source datasets and models: #AI #Teleoperation #OpenSourceDataset #Unitree #EmbodiedAI #Humanoid #DataCollection #AGI

Unitree G1 Open Source Dataset In order to promote the development of the global embodied AI industry, the Unitree G1 robot operation data set is open sourced, adapted to a variety of open source solutions, and continuously updated: Open source data collection: Open source learning algorithms: Open source datasets and models: #AI #Teleoperation #OpenSourceDataset #Unitree #EmbodiedAI #Humanoid #DataCollection #AGI

Unitree

148,860 次观看 • 1 年前

Introducing a Text-to-API AI ⚙️ Turn any website into an API with 's /extract. Just describe your API in plain text and get an endpoint you can hit. Another great open-source project by !

Introducing a Text-to-API AI ⚙️ Turn any website into an API with 's /extract. Just describe your API in plain text and get an endpoint you can hit. Another great open-source project by !

Caleb Peffer (Hiring!)

262,812 次观看 • 1 年前

Introducing Ψ₀ ( — an open foundation model for universal humanoid loco-manipulation. 🏆 Outperforms GR00T N1.6 by 40%+ overall success rate 📉 Uses only ~10% of the pre-training data 📦 Fully open-source: model, data, code, and deployment pipeline 1/10

Introducing Ψ₀ ( — an open foundation model for universal humanoid loco-manipulation. 🏆 Outperforms GR00T N1.6 by 40%+ overall success rate 📉 Uses only ~10% of the pre-training data 📦 Fully open-source: model, data, code, and deployment pipeline 1/10

Yue Wang

20,173 次观看 • 4 个月前

Smart Turn v2: open source, native audio turn detection in 14 languages. New checkpoint of the open source, open data, open training code, semantic VAD model on Hugging Face, fal, and Pipecat AI. - 3x faster inference (12ms on an L40) - 14 languages (13 more than v1, which was english-only) - New synthetic data set `chirp_3_all` with ~163k audio samples - 99% accuracy on held out `human_5_all` test data Good turn detection is critical for voice agents. This model "understands" both semantic and audio patterns, and mitigates the voice AI trade-off between unwanted turn latency vs the agent interrupting people before they are finished speaking. Training scripts for both Modal and local training are in the repo. We want to make it as easy as possible to contribute to or customize this model! Here's a demo running the smart-turn model with default settings, aimed at generally hitting 400ms total turn detection time. You can tune things to be faster, too. You can help by contributing data, doing architecture expermints, or cleaning open source data! Keep reading ...

Smart Turn v2: open source, native audio turn detection in 14 languages. New checkpoint of the open source, open data, open training code, semantic VAD model on Hugging Face, fal, and Pipecat AI. - 3x faster inference (12ms on an L40) - 14 languages (13 more than v1, which was english-only) - New synthetic data set `chirp_3_all` with ~163k audio samples - 99% accuracy on held out `human_5_all` test data Good turn detection is critical for voice agents. This model "understands" both semantic and audio patterns, and mitigates the voice AI trade-off between unwanted turn latency vs the agent interrupting people before they are finished speaking. Training scripts for both Modal and local training are in the repo. We want to make it as easy as possible to contribute to or customize this model! Here's a demo running the smart-turn model with default settings, aimed at generally hitting 400ms total turn detection time. You can tune things to be faster, too. You can help by contributing data, doing architecture expermints, or cleaning open source data! Keep reading ...

kwindla

42,219 次观看 • 1 年前

Jensen Huang open-sourced NVIDIA's flagship AI model, its weights, its data, AND how they created it. "We open sourced the models," Huang says. "We open sourced the weights." "We open sourced the data." "We open sourced how we created it." Four layers of openness in one model release. "Open source is fundamentally necessary for many industries to join the AI revolution." "NVIDIA has the scale and the motivation to build and continue to build these AI models for as long as we shall live." The chip seller benefits when every model is open. NVIDIA is the chip seller. P.S. I made a playbook breaking down 100+ most powerful decision making mental models used by history's greatest thinkers. 5,000+ downloads. 113 five-star reviews. Grab a free copy here: If you're new here, follow GeniusThinking for content on the greatest minds in economics, psychology, and history. — Jensen Huang ( NVIDIA ), NVIDIA CEO, on Lex Fridman's ( Lex Fridman ) podcast

Jensen Huang open-sourced NVIDIA's flagship AI model, its weights, its data, AND how they created it. "We open sourced the models," Huang says. "We open sourced the weights." "We open sourced the data." "We open sourced how we created it." Four layers of openness in one model release. "Open source is fundamentally necessary for many industries to join the AI revolution." "NVIDIA has the scale and the motivation to build and continue to build these AI models for as long as we shall live." The chip seller benefits when every model is open. NVIDIA is the chip seller. P.S. I made a playbook breaking down 100+ most powerful decision making mental models used by history's greatest thinkers. 5,000+ downloads. 113 five-star reviews. Grab a free copy here: If you're new here, follow GeniusThinking for content on the greatest minds in economics, psychology, and history. — Jensen Huang ( NVIDIA ), NVIDIA CEO, on Lex Fridman's ( Lex Fridman ) podcast

GeniusThinking

14,769 次观看 • 1 个月前

1/ Text2Video was yesterday; Audio2Video is the new big thing! Following the huge success of their open-source text-to-video model, LTX Studio is following up with another massive release: Audio-to-Video. Here are some outstanding examples🧵

1/ Text2Video was yesterday; Audio2Video is the new big thing! Following the huge success of their open-source text-to-video model, LTX Studio is following up with another massive release: Audio-to-Video. Here are some outstanding examples🧵

Chubby♨️

28,330 次观看 • 5 个月前

How to train a model that actually understands both audio and text like Voxtral from Mistral AI? Here is a quick video walkthrough of the paper.

How to train a model that actually understands both audio and text like Voxtral from Mistral AI? Here is a quick video walkthrough of the paper.

Sophia Yang, Ph.D.

49,801 次观看 • 1 年前

Everyone is sleeping on this new OCR model! dots-ocr is a new 1.7B vision-language model that achieves SOTA performance on multilingual document parsing. - Supports 100+ languages - Works with both images and PDFs - Handles text, tables, formulas seamlessly 100% open-source.

Everyone is sleeping on this new OCR model! dots-ocr is a new 1.7B vision-language model that achieves SOTA performance on multilingual document parsing. - Supports 100+ languages - Works with both images and PDFs - Handles text, tables, formulas seamlessly 100% open-source.

Akshay 🚀

252,074 次观看 • 11 个月前