正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Skip the lengthy AI model training and 𝐝𝐞𝐭𝐞𝐜𝐭 (𝐚𝐥𝐦𝐨𝐬𝐭) 𝐞𝐯𝐞𝐫𝐲𝐭𝐡𝐢𝐧𝐠 for your Meta Quest app! 🚀 You asked for it. We built it! The most effortless 𝐙𝐞𝐫𝐨-𝐒𝐡𝐨𝐭 𝐎𝐛𝐣𝐞𝐜𝐭 𝐃𝐞𝐭𝐞𝐜𝐭𝐢𝐨𝐧 𝐊𝐢𝐭 - powered by Microsoft Florence-2, running on Unity and with 𝐌𝐞𝐭𝐚 𝐐𝐮𝐞𝐬𝐭 𝐂𝐚𝐦𝐞𝐫𝐚 𝐀𝐜𝐜𝐞𝐬𝐬 exclusive for XRAI HACKers! -... Zero training required, zero extra setup compared to local inference - Recognizes any object - ideal for unpredictable XR environments - Runs fast via NVIDIA cloud APIs - One of the fastest zero-shot detection solutions for XR - Easily adaptable for OCR, segmentation, and more - Covers 80-90% of typical hacker/prototyping use cases Detect objects instantly and speed up your build with this plug-and-play vision kit. 💥 👉 Apply now to XR AI Hack Cologne: 👉 Learn more about it during our Pre-Hack Online Workshop. Join Here: Huge thanks to the mastermind Lucas Martinic , XR Bootcamp and the 𝐒𝐞𝐧𝐬𝐀𝐈 team for making this kit ready for the XRAI Hack!show more

XR Bootcamp

3,991 subscribers

57,031 次观看 • 1 年前 •via X (Twitter)

科学技术教育

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Hi XR devs! Big day today. v83 of the Meta XR SDK is officially out and it includes something very special to me 🦙. For the past 6 months we’ve been building AI Inference Building Blocks, which you may have seen teased at Meta Connect 2025. Our goal: keep the simplicity of Building Blocks while giving you the freedom to plug in any AI provider or model you want to power you apps with AI. More details and a full step-by-step guide are coming soon. And stay tuned as two more iterations are already locked in for early next year with new capabilities and major performance and inference improvements like you've never seen on Meta Quest. 🚀 For now, learn more on the Meta Horizon OS Developer Center:

Hi XR devs! Big day today. v83 of the Meta XR SDK is officially out and it includes something very special to me 🦙. For the past 6 months we’ve been building AI Inference Building Blocks, which you may have seen teased at Meta Connect 2025. Our goal: keep the simplicity of Building Blocks while giving you the freedom to plug in any AI provider or model you want to power you apps with AI. More details and a full step-by-step guide are coming soon. And stay tuned as two more iterations are already locked in for early next year with new capabilities and major performance and inference improvements like you've never seen on Meta Quest. 🚀 For now, learn more on the Meta Horizon OS Developer Center:

Robi ᯅ

12,259 次观看 • 8 个月前

Hello everyone 👋 It is pretty excited to know that Unity released a new VR Multiplayer template 🚀🥳! This template integrates Unity Gaming Services, Netcode for GameObjects, and the XR Interaction Toolkit, enabling you to quickly launch your next social VR game. 📌 Key features include: 👉 XR Hands 1.4.1: Access hand tracking data from devices that support it. 👉 XR Interaction Toolkit v3.0.1: A high-level, component-based system for creating XR experiences, facilitating 3D and UI interactions from Unity input events. 👉 XR Plugin Management 4.4.1: Streamlines XR plug-in lifecycle management and offers a build-time UI through Unity Unified Settings. 👉 Netcode for GameObjects 1.8.1: Provides networking capabilities for GameObject and MonoBehaviour workflows. 👉 OpenXR 1.10.0: An open standard by Khronos that simplifies AR/VR development across various devices. ☁️ Unity Cloud Multiplayer Services: - Authentication 3.3.1: Offers anonymous and platform-specific authentication solutions. - Lobby 1.2.0: Facilitates player discovery and connection for various multiplayer scenarios. - Relay 1.6.0: Ensures secure player connectivity via a join code system, eliminating the need for third-party solutions or dedicated servers. - Vivox 16.0.0: Enhances multiplayer experiences with in-game voice and text chat capabilities. ℹ️ To access the template and additional documentation check out: #unity #multiplayer #xr

Hello everyone 👋 It is pretty excited to know that Unity released a new VR Multiplayer template 🚀🥳! This template integrates Unity Gaming Services, Netcode for GameObjects, and the XR Interaction Toolkit, enabling you to quickly launch your next social VR game. 📌 Key features include: 👉 XR Hands 1.4.1: Access hand tracking data from devices that support it. 👉 XR Interaction Toolkit v3.0.1: A high-level, component-based system for creating XR experiences, facilitating 3D and UI interactions from Unity input events. 👉 XR Plugin Management 4.4.1: Streamlines XR plug-in lifecycle management and offers a build-time UI through Unity Unified Settings. 👉 Netcode for GameObjects 1.8.1: Provides networking capabilities for GameObject and MonoBehaviour workflows. 👉 OpenXR 1.10.0: An open standard by Khronos that simplifies AR/VR development across various devices. ☁️ Unity Cloud Multiplayer Services: - Authentication 3.3.1: Offers anonymous and platform-specific authentication solutions. - Lobby 1.2.0: Facilitates player discovery and connection for various multiplayer scenarios. - Relay 1.6.0: Ensures secure player connectivity via a join code system, eliminating the need for third-party solutions or dedicated servers. - Vivox 16.0.0: Enhances multiplayer experiences with in-game voice and text chat capabilities. ℹ️ To access the template and additional documentation check out: #unity #multiplayer #xr

Dilmer

12,048 次观看 • 2 年前

📣 𝗖𝗮𝗹𝗹 𝗳𝗼𝗿 𝗿𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗶𝗻𝘀𝘁𝗶𝘁𝘂𝘁𝗶𝗼𝗻𝘀 𝗮𝗻𝗱 𝗰𝗼𝗿𝗽𝗼𝗿𝗮𝘁𝗲𝘀 with projects and use cases focusing on the intersection of XR+AI! With Meta's release of 𝗣𝗿𝗼𝗷𝗲𝗰𝘁 𝗔𝗿𝗶𝗮 𝗥𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗞𝗶𝘁, your innovators will work with XR Bootcamp, 𝗫𝗥 𝗣𝗿𝗼 𝗖𝗼𝗹𝗹𝗲𝗰𝘁𝗶𝘃𝗲 and xraihack's greatest minds who have already built over 𝟮𝟲 𝗔𝗜-𝗽𝗼𝘄𝗲𝗿𝗲𝗱 𝗫𝗥 𝗽𝗿𝗼𝗷𝗲𝗰𝘁𝘀 to date on various use cases and will get the chance to make use of this new kit. Retweet or comment below if you are interested! We are also planning to unlock funding opportunities for promising projects with the help of our regional partners. So many use cases to explore like embodied AI, contextualized AI, human-computer interaction (HCI), robotics, and more... There is no better time to start your first 100% context-aware projects or apps than today! More details about Meta Reality Labs announcement: Aria Research Kit includes: - Aria Glasses - Machine Perception Cloud Services - Client SDK and Companion app

📣 𝗖𝗮𝗹𝗹 𝗳𝗼𝗿 𝗿𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗶𝗻𝘀𝘁𝗶𝘁𝘂𝘁𝗶𝗼𝗻𝘀 𝗮𝗻𝗱 𝗰𝗼𝗿𝗽𝗼𝗿𝗮𝘁𝗲𝘀 with projects and use cases focusing on the intersection of XR+AI! With Meta's release of 𝗣𝗿𝗼𝗷𝗲𝗰𝘁 𝗔𝗿𝗶𝗮 𝗥𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗞𝗶𝘁, your innovators will work with XR Bootcamp, 𝗫𝗥 𝗣𝗿𝗼 𝗖𝗼𝗹𝗹𝗲𝗰𝘁𝗶𝘃𝗲 and xraihack's greatest minds who have already built over 𝟮𝟲 𝗔𝗜-𝗽𝗼𝘄𝗲𝗿𝗲𝗱 𝗫𝗥 𝗽𝗿𝗼𝗷𝗲𝗰𝘁𝘀 to date on various use cases and will get the chance to make use of this new kit. Retweet or comment below if you are interested! We are also planning to unlock funding opportunities for promising projects with the help of our regional partners. So many use cases to explore like embodied AI, contextualized AI, human-computer interaction (HCI), robotics, and more... There is no better time to start your first 100% context-aware projects or apps than today! More details about Meta Reality Labs announcement: Aria Research Kit includes: - Aria Glasses - Machine Perception Cloud Services - Client SDK and Companion app

XR Bootcamp

14,250 次观看 • 1 年前

This is how you build the next generation of AI applications. You need an idea, a good model architecture, and a great harness. That's what MUZIM did. It's an app that runs local multimodal and vision models offline to parse and index your images, videos, and documents frame by frame. • Super fast on-device processing • On-device video & image understanding • You can also bring your API keys for heavy reasoning • Your data stays where it is / nothing goes to the cloud You can do a couple of things with this: 1. Vibe searching for whatever you remember in photos or raw video clips. The app will jump straight to the exact frame and timestamp of the video. This is search as it should be. 2. Use local-running agents to perform tasks on your files. I show a couple of examples in my video. You can check it out here: Thanks to the MUZIM by OpenSoul team for showing me the tool and partnering with me on this post.

This is how you build the next generation of AI applications. You need an idea, a good model architecture, and a great harness. That's what MUZIM did. It's an app that runs local multimodal and vision models offline to parse and index your images, videos, and documents frame by frame. • Super fast on-device processing • On-device video & image understanding • You can also bring your API keys for heavy reasoning • Your data stays where it is / nothing goes to the cloud You can do a couple of things with this: 1. Vibe searching for whatever you remember in photos or raw video clips. The app will jump straight to the exact frame and timestamp of the video. This is search as it should be. 2. Use local-running agents to perform tasks on your files. I show a couple of examples in my video. You can check it out here: Thanks to the MUZIM by OpenSoul team for showing me the tool and partnering with me on this post.

Santiago

65,858 次观看 • 17 天前

Introducing Workshop: cloud + on-device agentic AI. And to celebrate, we're giving away $250k in Google Gemini AI credits. (details below). The future of AI work is neither cloud-based nor local. It's both. In Workshop Cloud, you can use agents powered by frontier models like Claude and/or open source models like Z.ai's GLM-5 to build internal tools, dashboards, and AI web apps. Or, breeze through tasks like managing your Google and Meta Ads. In Workshop Desktop, you can do all the same right on your computer, plus make desktop apps, mobile apps, and 3D creations. Our favorite part? You can power the full agent experience with local models like Qwen 3.5 family on your computer. Fully offline. 2026 is the year in which local models for agentic tasks will become viable for mainstream use. But the setup for tools like OpenClaw is like setting up Linux from scratch on your computer. Workshop Desktop is one-click to install on Windows, Mac, and Linux. It recommends which open source model you should use for your hardware and lets you download and run it right in the app. And its agent harness allows you to chat, create websites, build personal utilities, and analyze data. 100% offline. Or multitask with AI models in the cloud while running other agent threads locally. Start in Workshop Cloud when you want flexibility and speed. Download your project and continue in Workshop Desktop when you want local files, privacy, and/or better performance on large code bases. Publish from either. The agent tooling space is maturing and discerning users have come to expect a lot from their tools. We've packed Workshop with features to help you 10x your productivity. - Native support for skills - Autocompaction for seamless context management - Built-in AI for your apps - Dozens of connectors, like Google Drive, Big Query, and Supabase - dbt integration to ground your dashboards in your semantic layer - Native Github integration - Private app deployment - ... and more (+ we're shipping super fast) To access the free credit offer, RT this post and reply with "Workshop". Make sure you are following us so we can DM you the instructions to redeem. - First 100 to RT + comment get $500 in credits. - Everyone else gets up to $250 And thanks to our partners Modal, Google Gemini, and Z.ai!

Introducing Workshop: cloud + on-device agentic AI. And to celebrate, we're giving away $250k in Google Gemini AI credits. (details below). The future of AI work is neither cloud-based nor local. It's both. In Workshop Cloud, you can use agents powered by frontier models like Claude and/or open source models like Z.ai's GLM-5 to build internal tools, dashboards, and AI web apps. Or, breeze through tasks like managing your Google and Meta Ads. In Workshop Desktop, you can do all the same right on your computer, plus make desktop apps, mobile apps, and 3D creations. Our favorite part? You can power the full agent experience with local models like Qwen 3.5 family on your computer. Fully offline. 2026 is the year in which local models for agentic tasks will become viable for mainstream use. But the setup for tools like OpenClaw is like setting up Linux from scratch on your computer. Workshop Desktop is one-click to install on Windows, Mac, and Linux. It recommends which open source model you should use for your hardware and lets you download and run it right in the app. And its agent harness allows you to chat, create websites, build personal utilities, and analyze data. 100% offline. Or multitask with AI models in the cloud while running other agent threads locally. Start in Workshop Cloud when you want flexibility and speed. Download your project and continue in Workshop Desktop when you want local files, privacy, and/or better performance on large code bases. Publish from either. The agent tooling space is maturing and discerning users have come to expect a lot from their tools. We've packed Workshop with features to help you 10x your productivity. - Native support for skills - Autocompaction for seamless context management - Built-in AI for your apps - Dozens of connectors, like Google Drive, Big Query, and Supabase - dbt integration to ground your dashboards in your semantic layer - Native Github integration - Private app deployment - ... and more (+ we're shipping super fast) To access the free credit offer, RT this post and reply with "Workshop". Make sure you are following us so we can DM you the instructions to redeem. - First 100 to RT + comment get $500 in credits. - Everyone else gets up to $250 And thanks to our partners Modal, Google Gemini, and Z.ai!

Workshop AI

29,124 次观看 • 5 个月前

Big news! Our AI browser for SEO is now available for free to everyone on MacOS and Windows. SERP Lens is out of beta and is the go-to workspace for SEOs and their AI agents. Purpose-built for the work of search, the application runs on live web data and is ready for what comes next. Here are some of the reasons why you need to test it out now: • Built in agentic functions • Select your favorite frontier AI model • Utilize skills trained by top consultants • Connect any MCP server & GSC data • Beautifully designed interface For a short time only, you can test out the AI with complimentary credits within the “Pro” trial; then it's $39 p/mo for continued access (can use the browser + some VPN locations for free). Our dev team, led by Sam Underwood 🇬🇧, has done some incredible work here, so make sure to check it out now and let us know what you think! Take a look for yourself:

Big news! Our AI browser for SEO is now available for free to everyone on MacOS and Windows. SERP Lens is out of beta and is the go-to workspace for SEOs and their AI agents. Purpose-built for the work of search, the application runs on live web data and is ready for what comes next. Here are some of the reasons why you need to test it out now: • Built in agentic functions • Select your favorite frontier AI model • Utilize skills trained by top consultants • Connect any MCP server & GSC data • Beautifully designed interface For a short time only, you can test out the AI with complimentary credits within the “Pro” trial; then it's $39 p/mo for continued access (can use the browser + some VPN locations for free). Our dev team, led by Sam Underwood 🇬🇧, has done some incredible work here, so make sure to check it out now and let us know what you think! Take a look for yourself:

Brodie Clark

125,993 次观看 • 16 天前

Built something with the goal of not leaving anyone behind. Now need some testers for this soft-launch. Check it out at Build whatever you can think of. Don't have any ideas? Just talk with your new team. Designed to get you away from the screens, not glued to them. Works great on mobile. Full real world capabilities. The free tier is perfect for people looking to get into AI and learn what its all about. The 'Empir3 Bridge' is for more advanced users and can power the whole empir3 team with your AI subscriptions... Grok, Claude, OpenAI, Google, or your local LLM. Everything runs local making it TOS friendly. Make them all work together in that same session. Fully opensource on GitHub You can use it with or without empir3. Full MCP, just point your AI at that repo and it will set it up. MIT license. New features weekly. *limited space and time until providers give me more channels.

Built something with the goal of not leaving anyone behind. Now need some testers for this soft-launch. Check it out at Build whatever you can think of. Don't have any ideas? Just talk with your new team. Designed to get you away from the screens, not glued to them. Works great on mobile. Full real world capabilities. The free tier is perfect for people looking to get into AI and learn what its all about. The 'Empir3 Bridge' is for more advanced users and can power the whole empir3 team with your AI subscriptions... Grok, Claude, OpenAI, Google, or your local LLM. Everything runs local making it TOS friendly. Make them all work together in that same session. Fully opensource on GitHub You can use it with or without empir3. Full MCP, just point your AI at that repo and it will set it up. MIT license. New features weekly. *limited space and time until providers give me more channels.

Z®

42,637 次观看 • 27 天前

Introducing AI Avatar Videos 🚀 Hyperrealistic and expressive AI avatars that ACTUALLY WORK. Marketers trying to adopt AI for video are stuck in the loop: 1. Sees cool demo. 2. Tries the platform. 3. Output is far from useful. 4. Back to 1. NOT ANYMORE! Perfect lipsync. Expressive gestures. Hundreds of AI avatars you can choose from. Want to use your content to create endless variations? gotchu CreatorKit is now powered by our zero shot AI lipsync. WTF is zero shot AI, and why should you care? It means no more training videos. Just lipsync. It means no more minimum length. 5 sec vids work. It means no more hidden costs. Both time and $. If you've tried any AI video platform, you’ve been through all the above. Whether you’re cloning yourself for social or turning UGC footage into fresh ads, IT WORKS. Ready to see for yourself? Try CreatorKit and let me know how it goes!!

Kevin Natanzon

72,607 次观看 • 1 年前

Sam Altman recently said: “GPT-OSS has strong real-world performance comparable to o4-mini—and you can run it locally on your phone.” Many believed running a 20B-parameter model on mobile devices was still years away. At Nexa AI, we’ve built our foundation on deep on-device AI technology—turning that vision into reality. Today, GPT-OSS is running fully local on mobile devices through our app, Nexa Studio. Real performance on Snapdragon Gen 5: - 17 tokens/sec decoding speed - < 3 seconds Time-to-First-Token Developers can now use NexaSDK to build their own local AI apps powered by GPT-OSS. What this unlocks: - Real reasoning models running locally - The next wave of AI Agent use cases—without cloud limits - True data privacy: your data never leaves your device Appreciation to OpenAI Sam Altman Greg Brockman and the entire leadership team for pushing the boundaries of the open-source AI community. Thanks to Qualcomm for the partnership, and to Manoj Khilnani and Chun-Po (Jerry) Chang for the incredible collaboration.

Sam Altman recently said: “GPT-OSS has strong real-world performance comparable to o4-mini—and you can run it locally on your phone.” Many believed running a 20B-parameter model on mobile devices was still years away. At Nexa AI, we’ve built our foundation on deep on-device AI technology—turning that vision into reality. Today, GPT-OSS is running fully local on mobile devices through our app, Nexa Studio. Real performance on Snapdragon Gen 5: - 17 tokens/sec decoding speed - < 3 seconds Time-to-First-Token Developers can now use NexaSDK to build their own local AI apps powered by GPT-OSS. What this unlocks: - Real reasoning models running locally - The next wave of AI Agent use cases—without cloud limits - True data privacy: your data never leaves your device Appreciation to OpenAI Sam Altman Greg Brockman and the entire leadership team for pushing the boundaries of the open-source AI community. Thanks to Qualcomm for the partnership, and to Manoj Khilnani and Chun-Po (Jerry) Chang for the incredible collaboration.

NEXA AI

197,453 次观看 • 11 个月前

🚀 OpenLLM 0.6 is out providing fast inference speed! Check out our video comparing #OpenLLM and #Ollama handling concurrent requests on the Llama 3 8B model. Ollama is ideal for local LLM deployment, but it is not designed for high concurrency scenarios essential for deployments in the cloud, powering applications with a large number of users. OpenLLM enables you to run any open-source model as OpenAI-compatible endpoints with just a single command. It supports a broad array of models like Llama 3, Mistral, and Qwen 2, including those fine-tuned with proprietary datasets and quantized versions. Ready to speed up your AI deployments? See the OpenLLM repo #BentoML #OpenSource

🚀 OpenLLM 0.6 is out providing fast inference speed! Check out our video comparing #OpenLLM and #Ollama handling concurrent requests on the Llama 3 8B model. Ollama is ideal for local LLM deployment, but it is not designed for high concurrency scenarios essential for deployments in the cloud, powering applications with a large number of users. OpenLLM enables you to run any open-source model as OpenAI-compatible endpoints with just a single command. It supports a broad array of models like Llama 3, Mistral, and Qwen 2, including those fine-tuned with proprietary datasets and quantized versions. Ready to speed up your AI deployments? See the OpenLLM repo #BentoML #OpenSource

BentoML

18,798 次观看 • 2 年前

Thrilled to unveil what we've been cooking the last few weeks: the Gravity AI assistant. Local, free, owned by you. Now available for free on macOS -> GravityAI 🌠 Gravity ensures absolute privacy by keeping all conversations on your device. No compromises, your data is exclusively yours. Plus, with LLaVa and OCR, Gravity gains vision – just snap a screenshot, and it's ready to chat about anything on your screen. Everything has been built to optimize the power of Apple silicon: I used Mistral AI as a base LLM and a in-app instance of ollama. It is insanely fast. Gravity will continue to evolve from here. For example, we're working on speech recognition and speaker diarization to passively learn from your meetings and messages in the background, no integrations needed. Incredibly proud of our journey so far and a big shoutout to my co-founder Tye Daniel for grinding to make this happen (we were up till 4am making sure this ships today) We're hiring folks with talent and passion, and we welcome you to join us on this exciting journey!

Thrilled to unveil what we've been cooking the last few weeks: the Gravity AI assistant. Local, free, owned by you. Now available for free on macOS -> GravityAI 🌠 Gravity ensures absolute privacy by keeping all conversations on your device. No compromises, your data is exclusively yours. Plus, with LLaVa and OCR, Gravity gains vision – just snap a screenshot, and it's ready to chat about anything on your screen. Everything has been built to optimize the power of Apple silicon: I used Mistral AI as a base LLM and a in-app instance of ollama. It is insanely fast. Gravity will continue to evolve from here. For example, we're working on speech recognition and speaker diarization to passively learn from your meetings and messages in the background, no integrations needed. Incredibly proud of our journey so far and a big shoutout to my co-founder Tye Daniel for grinding to make this happen (we were up till 4am making sure this ships today) We're hiring folks with talent and passion, and we welcome you to join us on this exciting journey!

Sulaiman Khan Ghori

71,430 次观看 • 2 年前

Sure, you can vibe code but have you ever shipped so much with AI you literally break GitHub? That’s what Chintan Turakhia and the team at Coinbase 🛡️ did as they pushed the edge of engineering with AI. This week, Chintan and I chat about how to get 1000s of engineers cooking with AI in real, production scale environments. You’ll see - how to use Cursor to build a mini app to drive more cursor adoption - his video/voice -> Linear -> Claude process for speed running user feedback - a new model for eng leadership where there’s more code than meetings Bonus: we get his hack on finding great wines based on scribbled tasting notes. Thanks to our awesome sponsors 💼 WorkOS - Make your app enterprise ready today 🐶 Atlassian Rovo - AI that knows your business Watch now:

Sure, you can vibe code but have you ever shipped so much with AI you literally break GitHub? That’s what Chintan Turakhia and the team at Coinbase 🛡️ did as they pushed the edge of engineering with AI. This week, Chintan and I chat about how to get 1000s of engineers cooking with AI in real, production scale environments. You’ll see - how to use Cursor to build a mini app to drive more cursor adoption - his video/voice -> Linear -> Claude process for speed running user feedback - a new model for eng leadership where there’s more code than meetings Bonus: we get his hack on finding great wines based on scribbled tasting notes. Thanks to our awesome sponsors 💼 WorkOS - Make your app enterprise ready today 🐶 Atlassian Rovo - AI that knows your business Watch now:

claire vo 🖤

72,638 次观看 • 6 个月前

MolmoAct2 runs zero-shot on an SO-ARM101, no training required 🦾 Ai2 open Action Reasoning Model is now in LeRobot with the full lifecycle covered: fine-tuning (full or LoRA), evaluation, and real-robot deployment. It pairs a Molmo2-ER vision-language backbone with a flow-matching action expert to turn images, language, and proprioceptive state into action chunks. The best part: ready-made checkpoints ship with calibration correction baked in, so you can point it at your SO-100/101 and just watch it work. Inference fits in ~12GB at bf16, and LoRA fine-tuning runs on a single 24GB GPU. Big thanks to the Ai2 team for building this in the open.

MolmoAct2 runs zero-shot on an SO-ARM101, no training required 🦾 Ai2 open Action Reasoning Model is now in LeRobot with the full lifecycle covered: fine-tuning (full or LoRA), evaluation, and real-robot deployment. It pairs a Molmo2-ER vision-language backbone with a flow-matching action expert to turn images, language, and proprioceptive state into action chunks. The best part: ready-made checkpoints ship with calibration correction baked in, so you can point it at your SO-100/101 and just watch it work. Inference fits in ~12GB at bf16, and LoRA fine-tuning runs on a single 24GB GPU. Big thanks to the Ai2 team for building this in the open.

LeRobot

22,200 次观看 • 1 个月前

Tune Studio is an end-to-end platform for developing applications using Large Language Models. So far, I haven't seen any other platform like this one. You can do everything here: 1. You can curate your data. 2. Use the playground to play with different models and try your ideas. 3. Fine-tune an open-source model on your data. 4. Deploy the model when you are done. This is awesome for anyone building generative AI applications. You can use Tune Studio to work with any of the open-source models out there. They were one of the few companies to host Llama 2 and Llama 3 before anyone else. Here is a link to check it out: One of their main selling points is that Tune Studio scales! You don't have to worry about serving your model to lots of users. They also have built-in user management, authentication, on-prem support, user context management, and pretty much everything you need to build generative AI applications. Thanks to the Tune team for collaborating with me on this post. We are living through the best years of development tools for AI developers. The field is unstoppable.

Tune Studio is an end-to-end platform for developing applications using Large Language Models. So far, I haven't seen any other platform like this one. You can do everything here: 1. You can curate your data. 2. Use the playground to play with different models and try your ideas. 3. Fine-tune an open-source model on your data. 4. Deploy the model when you are done. This is awesome for anyone building generative AI applications. You can use Tune Studio to work with any of the open-source models out there. They were one of the few companies to host Llama 2 and Llama 3 before anyone else. Here is a link to check it out: One of their main selling points is that Tune Studio scales! You don't have to worry about serving your model to lots of users. They also have built-in user management, authentication, on-prem support, user context management, and pretty much everything you need to build generative AI applications. Thanks to the Tune team for collaborating with me on this post. We are living through the best years of development tools for AI developers. The field is unstoppable.

Santiago

39,101 次观看 • 2 年前

Here's a quick demo of an agentic loop running offline entirely on-device on Apple Watch Series 9. --- We have been spearheading small models and one of the biggest unlock it provides for consumer is having intelligence right at their fingertips, no cloud-round trip = faster, cheaper, private, more control. This also unlocks a whole suite of new use-cases with product specific models - or models built specifically for and shipped alongside an app. We now have full expertise on the entire on-device Apple Intelligence stack. We have pioneered training and running models with Apple native APIs on iPhones, Macs and Watches. Already working with Apple DR team and some of the biggest wearable brands exploring running AI on different form factors. If you're a team exploring this domain, we are here to help. Reach out -> follow Conscious Engines • Studio for consumer AI

Here's a quick demo of an agentic loop running offline entirely on-device on Apple Watch Series 9. --- We have been spearheading small models and one of the biggest unlock it provides for consumer is having intelligence right at their fingertips, no cloud-round trip = faster, cheaper, private, more control. This also unlocks a whole suite of new use-cases with product specific models - or models built specifically for and shipped alongside an app. We now have full expertise on the entire on-device Apple Intelligence stack. We have pioneered training and running models with Apple native APIs on iPhones, Macs and Watches. Already working with Apple DR team and some of the biggest wearable brands exploring running AI on different form factors. If you're a team exploring this domain, we are here to help. Reach out -> follow Conscious Engines • Studio for consumer AI

Kautuk | Conscious Engines

16,384 次观看 • 8 天前

📣 I talk a lot about Meta SDKs because I spend a lot of time with these tools. But also when someone asks me what VR/MR tools they can use for cross platform support, I recommend 𝗨𝗻𝗶𝘁𝘆’𝘀 𝗫𝗥 𝗧𝗼𝗼𝗹𝗸𝗶𝘁 which provides: - 𝗖𝗿𝗼𝘀𝘀-𝗽𝗹𝗮𝘁𝗳𝗼𝗿𝗺 𝘀𝘂𝗽𝗽𝗼𝗿𝘁: Meta Quest, OpenXR, Windows Mixed Reality, + more - 𝗜𝗻𝘁𝗲𝗿𝗮𝗰𝘁𝗶𝗼𝗻𝘀: Hover, select, grab - 𝗙𝗲𝗲𝗱𝗯𝗮𝗰𝗸: Haptic + visual tint/line for possible & active interactions - 𝗨𝗜: Canvas interaction via XR controllers - 𝗨𝘁𝗶𝗹𝗶𝘁𝗶𝗲𝘀: XR Origin support for stationary & room-scale VR - 𝗫𝗥 𝗛𝗮𝗻𝗱𝘀: this is an extended package to support more advanced hand tracking interactions 👉 Also, it supports 𝗔𝗥 𝗳𝗼𝗿 𝗺𝗼𝗯𝗶𝗹𝗲 𝗳𝗲𝗮𝘁𝘂𝗿𝗲𝘀 𝘁𝗵𝗿𝗼𝘂𝗴𝗵 𝗔𝗥 𝗙𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻, the features are: - 𝗔𝗥 𝗴𝗲𝘀𝘁𝘂𝗿𝗲 𝘀𝘆𝘀𝘁𝗲𝗺: Maps screen touches to Input System gesture events via TouchscreenGestureInputController - 𝗦𝗰𝗿𝗲𝗲𝗻-𝘀𝗽𝗮𝗰𝗲 𝗶𝗻𝗽𝘂𝘁: Feeds touch data into XRRayInteractor for AR interaction - 𝗔𝗥𝗧𝗿𝗮𝗻𝘀𝗳𝗼𝗿𝗺𝗲𝗿: Converts place, select, translate, rotate, scale gestures into object manipulation 👨‍💻 And to emulate your apps/games without physical devices I recommend the following: - 𝗫𝗥 𝗗𝗲𝘃𝗶𝗰𝗲 𝗦𝗶𝗺𝘂𝗹𝗮𝘁𝗼𝗿 for VR/MR to test your interactions - 𝗔𝗥 𝗙𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻 𝗥𝗲𝗺𝗼𝘁𝗲 𝟮.𝟬 for AR Foundation testing, this allows you to remotely test all the AR features by connecting the Unity editor to your physical device (iOS or Android) 💡 Are you using Unity’s XR Toolkit? ISDK? any other toolkit?

📣 I talk a lot about Meta SDKs because I spend a lot of time with these tools. But also when someone asks me what VR/MR tools they can use for cross platform support, I recommend 𝗨𝗻𝗶𝘁𝘆’𝘀 𝗫𝗥 𝗧𝗼𝗼𝗹𝗸𝗶𝘁 which provides: - 𝗖𝗿𝗼𝘀𝘀-𝗽𝗹𝗮𝘁𝗳𝗼𝗿𝗺 𝘀𝘂𝗽𝗽𝗼𝗿𝘁: Meta Quest, OpenXR, Windows Mixed Reality, + more - 𝗜𝗻𝘁𝗲𝗿𝗮𝗰𝘁𝗶𝗼𝗻𝘀: Hover, select, grab - 𝗙𝗲𝗲𝗱𝗯𝗮𝗰𝗸: Haptic + visual tint/line for possible & active interactions - 𝗨𝗜: Canvas interaction via XR controllers - 𝗨𝘁𝗶𝗹𝗶𝘁𝗶𝗲𝘀: XR Origin support for stationary & room-scale VR - 𝗫𝗥 𝗛𝗮𝗻𝗱𝘀: this is an extended package to support more advanced hand tracking interactions 👉 Also, it supports 𝗔𝗥 𝗳𝗼𝗿 𝗺𝗼𝗯𝗶𝗹𝗲 𝗳𝗲𝗮𝘁𝘂𝗿𝗲𝘀 𝘁𝗵𝗿𝗼𝘂𝗴𝗵 𝗔𝗥 𝗙𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻, the features are: - 𝗔𝗥 𝗴𝗲𝘀𝘁𝘂𝗿𝗲 𝘀𝘆𝘀𝘁𝗲𝗺: Maps screen touches to Input System gesture events via TouchscreenGestureInputController - 𝗦𝗰𝗿𝗲𝗲𝗻-𝘀𝗽𝗮𝗰𝗲 𝗶𝗻𝗽𝘂𝘁: Feeds touch data into XRRayInteractor for AR interaction - 𝗔𝗥𝗧𝗿𝗮𝗻𝘀𝗳𝗼𝗿𝗺𝗲𝗿: Converts place, select, translate, rotate, scale gestures into object manipulation 👨‍💻 And to emulate your apps/games without physical devices I recommend the following: - 𝗫𝗥 𝗗𝗲𝘃𝗶𝗰𝗲 𝗦𝗶𝗺𝘂𝗹𝗮𝘁𝗼𝗿 for VR/MR to test your interactions - 𝗔𝗥 𝗙𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻 𝗥𝗲𝗺𝗼𝘁𝗲 𝟮.𝟬 for AR Foundation testing, this allows you to remotely test all the AR features by connecting the Unity editor to your physical device (iOS or Android) 💡 Are you using Unity’s XR Toolkit? ISDK? any other toolkit?

Dilmer 👓

12,943 次观看 • 4 个月前

OpenClaw Memelord skill is officially live. You can now use Memelord's trending memes and video templates to: - Generate AI memes and videos (that are both funny and hyper-trending) - Edit captions for both memes and videos just by replying What can you do with this? The use cases for the OpenClaw Memelord skill are infinite: - Set a cron job cook up on-brand memes for your marketing team - Toss it in a n8n workflow for TikTok slideshows - Put your claw in a group chat with your community - Sync it with Polymarket's API to make new memes for new markets - Plug into NCAA data to make memes for March Madness - Link up with Quartr API to make new memes for quarterly reports - Connect to GitHub or Linear to market your new features A lot of people asked me "Why'd you raise $3M for a meme editor?" This is why. The future of memeing is agentic. We achieved Memetic General Intelligence internally earlier this year making hilarious AI memes. Now we can share it with the world. It's time to take your memes more seriously.

Jason Levin

30,693 次观看 • 5 个月前

Episode 5 of How I AI with some practical AI hacks for managers from hilary gridley, Head of Core Product at WHOOP. This one is all about feedback: how to scale it, how to make it specific, how to give it to AI tools. You’ll learn how to: - build rubrics for what “good” looks like - create GPTs to “think like you” and use them to scale quality feedback to your team - use prompting techniques to improve the insights you get from AI - improve your quality of writing and strategic thinking by bringing it all together Plus we gab about getting more women in AI, girly use cases for chatGPT, and whether or not getting invited to meetings is a good thing. Check it out in the links below 👇🔗 As always, a big thanks to our sponsors: 🔀 Orkes enterprise platform for genetic workflows ☑️ Vanta automate compliance and simplify security

Episode 5 of How I AI with some practical AI hacks for managers from hilary gridley, Head of Core Product at WHOOP. This one is all about feedback: how to scale it, how to make it specific, how to give it to AI tools. You’ll learn how to: - build rubrics for what “good” looks like - create GPTs to “think like you” and use them to scale quality feedback to your team - use prompting techniques to improve the insights you get from AI - improve your quality of writing and strategic thinking by bringing it all together Plus we gab about getting more women in AI, girly use cases for chatGPT, and whether or not getting invited to meetings is a good thing. Check it out in the links below 👇🔗 As always, a big thanks to our sponsors: 🔀 Orkes enterprise platform for genetic workflows ☑️ Vanta automate compliance and simplify security

claire vo 🖤

19,127 次观看 • 1 年前