Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

1. Meta’s open-sourced multisensory model Meta is back (again!) with yet another exciting open-source project. Introducing ImageBind, a new AI research model that understands and combines text, audio, visual, movement, thermal, AND depth data.

Rowan Cheung

590,862 subscribers

173,984 Aufrufe • vor 3 Jahren •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

12 Kommentare

Profilbild von Rowan Cheung

Rowan Cheungvor 3 Jahren

Massive announcements in the world of AI today from Meta, Humane, IBM and Wendy's. Plus, scientists found a new way of using AI to detect the early onset of Parkinson's. Here's the rundown on everything you need to know:

Profilbild von Rowan Cheung

Rowan Cheungvor 3 Jahren

The integration of multiple data types unlocks new possibilities, including: -Multimodal search capabilities -Embedding-space arithmetic -Converting audio to image generation HUGE for multimedia search, VR, and robotics.

Profilbild von Rowan Cheung

Rowan Cheungvor 3 Jahren

2. Humane’s wearable AI device Humane revealed a wearable AI device designed to replace smartphones at a recent TED event. It appears as a tiny black puck that slips into your pocket, takes over your phone, and employs AI to update you on your day.

Profilbild von Rowan Cheung

Rowan Cheungvor 3 Jahren

Co-founder Imran Chaudhri demonstrated its features, including: -Projecting caller information onto his hand -Suggesting nearby shopping options -Translating sentences -Summing up emails and messages -Giving dietary recommendations Full demo:

Profilbild von Rowan Cheung

Rowan Cheungvor 3 Jahren

3. IBM launches an AI platform for enterprises IBM's recently announced to replace 7,800 jobs with AI. Now, the company unveiled Watsonx- a new AI platform designed to assist businesses in creating/utilizing AI models.

Profilbild von Rowan Cheung

Rowan Cheungvor 3 Jahren

Watsonx stands out by offering pre-trained enterprise models at cost-effective infrastructure. It's clear they're going all in on AI. The question remains: Can IBM keep pace with tech giants like Google, Meta, and Microsoft? Only time will tell.

Profilbild von Rowan Cheung

Rowan Cheungvor 3 Jahren

4. Wendy’s AI drive-thru chatbot Wendy's is teaming up with Google to develop an AI chatbot that takes your drive-thru orders. The "Wendy's FreshAI" will be first tested in a Columbus, Ohio, restaurant in June.

Profilbild von Rowan Cheung

Rowan Cheungvor 3 Jahren

Google is customizing its LLM to understand specific Wendy's terminology, such as "Frosty" and "JBC." Wendy’s says AI will not replace human workers (yet). Instead, employees will monitor the AI-powered drive-thru and assist customers as needed.

Profilbild von Rowan Cheung

Rowan Cheungvor 3 Jahren

5. Using AI to detect early Parkinson's Scientists from UNSW Sydney and Boston University have developed CRANK-MS, which could detect Parkinson's disease before the onset of symptoms.

Profilbild von Rowan Cheung

Rowan Cheungvor 3 Jahren

Published in ACS Central Science, the study analyzed biomarkers in bodily fluids using neural networks. CRANK-MS showed 96% accuracy in detecting Parkinson's. Researchers also found correlations between certain metabolites and Parkinson's, which could help future studies.

Profilbild von Rowan Cheung

Rowan Cheungvor 3 Jahren

If you enjoyed this rundown, you'll love my newsletter. Subscribe, and you'll never miss a thing in the world of AI ever again. 140k+ have joined and stayed:

Profilbild von Rowan Cheung

Rowan Cheungvor 3 Jahren

That's it for today's news in the world of AI. I do these rundowns daily, so follow me @rowancheung for more. Also, feel free to like + retweet the tweet below to show your support ❤️

Ähnliche Videos

Apple just released and open-sourced FastVLM! FastVLM is a lightning-fast vision-language model that combines rapid image and text understanding with efficient on-device performance. 100% Open Source

Apple just released and open-sourced FastVLM! FastVLM is a lightning-fast vision-language model that combines rapid image and text understanding with efficient on-device performance. 100% Open Source

Sumanth

43,704 Aufrufe • vor 10 Monaten

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:

Introducing Meta Perception Language Model (PLM): an open & reproducible vision-language model tackling challenging visual tasks. Learn more about how PLM can help the open source community build more capable computer vision systems. Read the research paper, and download the code and dataset:

AI at Meta

94,330 Aufrufe • vor 1 Jahr

Introducing Open Deep Research 🔭 An open source AI Agent that reasons large amounts of web data extracted with Open source. Powered by the AI SDK

Introducing Open Deep Research 🔭 An open source AI Agent that reasons large amounts of web data extracted with Open source. Powered by the AI SDK

Nicolas Camara

215,028 Aufrufe • vor 1 Jahr

Introducing Project Stera by FPV Labs, an open data infra for embodied AI research. Project Stera includes Stera-10M, with 10M+ frames of long-horizon data with persistent state tracking, and an open-source pipeline that converts raw data into training-ready formats.

Introducing Project Stera by FPV Labs, an open data infra for embodied AI research. Project Stera includes Stera-10M, with 10M+ frames of long-horizon data with persistent state tracking, and an open-source pipeline that converts raw data into training-ready formats.

FPV Labs

14,981 Aufrufe • vor 1 Monat

Meet MoshiVis🎙️🖼️, the first open-source real-time speech model that can talk about images! It sees, understands, and talks about images — naturally, and out loud. Voice interaction with a compact model endowed with visual understanding opens up new applications, from audio description for the visual impaired to visual access to information. Try it out 👉 Blog post 👉

Meet MoshiVis🎙️🖼️, the first open-source real-time speech model that can talk about images! It sees, understands, and talks about images — naturally, and out loud. Voice interaction with a compact model endowed with visual understanding opens up new applications, from audio description for the visual impaired to visual access to information. Try it out 👉 Blog post 👉

kyutai

47,924 Aufrufe • vor 1 Jahr

China's DeepSeek is back with a brand new flagship AI model, a year after its open source model upended Silicon Valley. Tom Mackenzie explains

Bloomberg

27,567 Aufrufe • vor 2 Monaten

This is a big day. Meta is open-sourcing AudioCraft. You can now generate incredible music and sounds with a single prompt. It includes the most performant Generative AI Model (audio) on the market, the "Llama" of Audio. The research framework contains the weights and code of these models: ▸ MusicGen: controllable text-to-music model. ▸ AudioGen: text-to-sound model. ▸ EnCodec: high fidelity neural audio codec. ▸ Multi Band Diffusion: An EnCodec compatible decoder using diffusion. This is going to tremendously speed up audio research 👏

This is a big day. Meta is open-sourcing AudioCraft. You can now generate incredible music and sounds with a single prompt. It includes the most performant Generative AI Model (audio) on the market, the "Llama" of Audio. The research framework contains the weights and code of these models: ▸ MusicGen: controllable text-to-music model. ▸ AudioGen: text-to-sound model. ▸ EnCodec: high fidelity neural audio codec. ▸ Multi Band Diffusion: An EnCodec compatible decoder using diffusion. This is going to tremendously speed up audio research 👏

Lior Alexander

231,608 Aufrufe • vor 2 Jahren

Finally! A Text-to-SQL tool that actually works! Vanna is an open-source RAG framework for complex Text-to-SQL generation. It manages dynamic data and allows custom RAG model training for greater accuracy. 100% open-source.

Finally! A Text-to-SQL tool that actually works! Vanna is an open-source RAG framework for complex Text-to-SQL generation. It manages dynamic data and allows custom RAG model training for greater accuracy. 100% open-source.

Akshay 🚀

168,600 Aufrufe • vor 1 Jahr

🔉 Introducing SAM Audio, the first unified model that isolates any sound from complex audio mixtures using text, visual, or span prompts. We’re sharing SAM Audio with the community, along with a perception encoder model, benchmarks and research papers, to empower others to explore new forms of expression and build applications that were previously out of reach. 🔗 Learn more:

🔉 Introducing SAM Audio, the first unified model that isolates any sound from complex audio mixtures using text, visual, or span prompts. We’re sharing SAM Audio with the community, along with a perception encoder model, benchmarks and research papers, to empower others to explore new forms of expression and build applications that were previously out of reach. 🔗 Learn more:

AI at Meta

1,250,118 Aufrufe • vor 6 Monaten

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.

The first truly open-source audio-video model. LTX-2 is a DiT-based foundation model with all core video generation capabilities in one unified model. Designed to run locally on consumer GPUs. - text-to-video - image-to-video - and video-to-video modes 100% open-source.

Akshay 🚀

66,042 Aufrufe • vor 6 Monaten

🔥 another win for open source AI SNOWFLAKE ARCTIC: 1] Mixture of Experts model with 128 (!) experts 2] open weights, open code 3] Company is sharing "cookbook" and data and teaching people how to build their own world class MoE models. 4] very cheap model to train (16x times less than Llama 3)

🔥 another win for open source AI SNOWFLAKE ARCTIC: 1] Mixture of Experts model with 128 (!) experts 2] open weights, open code 3] Company is sharing "cookbook" and data and teaching people how to build their own world class MoE models. 4] very cheap model to train (16x times less than Llama 3)

Wes Roth

10,233 Aufrufe • vor 2 Jahren

New text and image to video generation AI model Open-Sora-Plan-v1.3.0

New text and image to video generation AI model Open-Sora-Plan-v1.3.0

AK

51,838 Aufrufe • vor 1 Jahr

Introducing zola a free, open-source, multi-model AI chat app. quick demo

Introducing zola a free, open-source, multi-model AI chat app. quick demo

Ibelick

148,650 Aufrufe • vor 1 Jahr

1/5 🚀 Thrilled to open-source OSCAR 🤖 — an action-conditioned world model for robotics, led by the visiting student in my group Zhuoyuan Wu! It generalizes across different robot embodiments with precise action controllability. All trained on a single GH200 GPU, and outperforms existing open-sourced baselines, which have larger model capacity and need more compute. Everything is public, including training data. 📄 Paper: 🌐 Project: 💻 Code: 🤗 Robot data: 🤗 Human data: 🤗 Weights: #Robotics #WorldModels #AI #OpenSource

1/5 🚀 Thrilled to open-source OSCAR 🤖 — an action-conditioned world model for robotics, led by the visiting student in my group Zhuoyuan Wu! It generalizes across different robot embodiments with precise action controllability. All trained on a single GH200 GPU, and outperforms existing open-sourced baselines, which have larger model capacity and need more compute. Everything is public, including training data. 📄 Paper: 🌐 Project: 💻 Code: 🤗 Robot data: 🤗 Human data: 🤗 Weights: #Robotics #WorldModels #AI #OpenSource

Jun Gao

103,890 Aufrufe • vor 1 Monat

This is Microsoft SandDance. originally a closed-source project that was later open-sourced. It lets you visually explore and understand data with smooth, animated transitions between multiple views.

This is Microsoft SandDance. originally a closed-source project that was later open-sourced. It lets you visually explore and understand data with smooth, animated transitions between multiple views.

Dilum Sanjaya

189,479 Aufrufe • vor 8 Monaten

Unitree G1 Open Source Dataset In order to promote the development of the global embodied AI industry, the Unitree G1 robot operation data set is open sourced, adapted to a variety of open source solutions, and continuously updated: Open source data collection: Open source learning algorithms: Open source datasets and models: #AI #Teleoperation #OpenSourceDataset #Unitree #EmbodiedAI #Humanoid #DataCollection #AGI

Unitree G1 Open Source Dataset In order to promote the development of the global embodied AI industry, the Unitree G1 robot operation data set is open sourced, adapted to a variety of open source solutions, and continuously updated: Open source data collection: Open source learning algorithms: Open source datasets and models: #AI #Teleoperation #OpenSourceDataset #Unitree #EmbodiedAI #Humanoid #DataCollection #AGI

Unitree

148,860 Aufrufe • vor 1 Jahr

Introducing a Text-to-API AI ⚙️ Turn any website into an API with 's /extract. Just describe your API in plain text and get an endpoint you can hit. Another great open-source project by !

Introducing a Text-to-API AI ⚙️ Turn any website into an API with 's /extract. Just describe your API in plain text and get an endpoint you can hit. Another great open-source project by !

Caleb Peffer (Hiring!)

262,695 Aufrufe • vor 1 Jahr

Introducing Ψ₀ ( — an open foundation model for universal humanoid loco-manipulation. 🏆 Outperforms GR00T N1.6 by 40%+ overall success rate 📉 Uses only ~10% of the pre-training data 📦 Fully open-source: model, data, code, and deployment pipeline 1/10

Introducing Ψ₀ ( — an open foundation model for universal humanoid loco-manipulation. 🏆 Outperforms GR00T N1.6 by 40%+ overall success rate 📉 Uses only ~10% of the pre-training data 📦 Fully open-source: model, data, code, and deployment pipeline 1/10

Yue Wang

19,516 Aufrufe • vor 3 Monaten

Smart Turn v2: open source, native audio turn detection in 14 languages. New checkpoint of the open source, open data, open training code, semantic VAD model on Hugging Face, fal, and Pipecat AI. - 3x faster inference (12ms on an L40) - 14 languages (13 more than v1, which was english-only) - New synthetic data set `chirp_3_all` with ~163k audio samples - 99% accuracy on held out `human_5_all` test data Good turn detection is critical for voice agents. This model "understands" both semantic and audio patterns, and mitigates the voice AI trade-off between unwanted turn latency vs the agent interrupting people before they are finished speaking. Training scripts for both Modal and local training are in the repo. We want to make it as easy as possible to contribute to or customize this model! Here's a demo running the smart-turn model with default settings, aimed at generally hitting 400ms total turn detection time. You can tune things to be faster, too. You can help by contributing data, doing architecture expermints, or cleaning open source data! Keep reading ...

Smart Turn v2: open source, native audio turn detection in 14 languages. New checkpoint of the open source, open data, open training code, semantic VAD model on Hugging Face, fal, and Pipecat AI. - 3x faster inference (12ms on an L40) - 14 languages (13 more than v1, which was english-only) - New synthetic data set `chirp_3_all` with ~163k audio samples - 99% accuracy on held out `human_5_all` test data Good turn detection is critical for voice agents. This model "understands" both semantic and audio patterns, and mitigates the voice AI trade-off between unwanted turn latency vs the agent interrupting people before they are finished speaking. Training scripts for both Modal and local training are in the repo. We want to make it as easy as possible to contribute to or customize this model! Here's a demo running the smart-turn model with default settings, aimed at generally hitting 400ms total turn detection time. You can tune things to be faster, too. You can help by contributing data, doing architecture expermints, or cleaning open source data! Keep reading ...

kwindla

42,219 Aufrufe • vor 11 Monaten

Jensen Huang open-sourced NVIDIA's flagship AI model, its weights, its data, AND how they created it. "We open sourced the models," Huang says. "We open sourced the weights." "We open sourced the data." "We open sourced how we created it." Four layers of openness in one model release. "Open source is fundamentally necessary for many industries to join the AI revolution." "NVIDIA has the scale and the motivation to build and continue to build these AI models for as long as we shall live." The chip seller benefits when every model is open. NVIDIA is the chip seller. P.S. I made a playbook breaking down 100+ most powerful decision making mental models used by history's greatest thinkers. 5,000+ downloads. 113 five-star reviews. Grab a free copy here: If you're new here, follow GeniusThinking for content on the greatest minds in economics, psychology, and history. — Jensen Huang ( NVIDIA ), NVIDIA CEO, on Lex Fridman's ( Lex Fridman ) podcast

Jensen Huang open-sourced NVIDIA's flagship AI model, its weights, its data, AND how they created it. "We open sourced the models," Huang says. "We open sourced the weights." "We open sourced the data." "We open sourced how we created it." Four layers of openness in one model release. "Open source is fundamentally necessary for many industries to join the AI revolution." "NVIDIA has the scale and the motivation to build and continue to build these AI models for as long as we shall live." The chip seller benefits when every model is open. NVIDIA is the chip seller. P.S. I made a playbook breaking down 100+ most powerful decision making mental models used by history's greatest thinkers. 5,000+ downloads. 113 five-star reviews. Grab a free copy here: If you're new here, follow GeniusThinking for content on the greatest minds in economics, psychology, and history. — Jensen Huang ( NVIDIA ), NVIDIA CEO, on Lex Fridman's ( Lex Fridman ) podcast

GeniusThinking

14,769 Aufrufe • vor 1 Monat