Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Announcing: a new interactive tool for a quick and simple start of encoding or encoding: 🧠 fMRI, EEG, MEG, iEEG, spikes… preprocessing 💬 text 🔊 audio ▶️ video 🏞️ image… embeddings 📦 pip install neuralset 🔍 #NeuroAI #OpenSource

Jean-Rémi King

7,270 subscribers

10,218 views • 25 days ago •via X (Twitter)

#NeuroAI #OpenSource

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

"Cameras as Relative Positional Encoding" TLDR: comparison for conditioning transformers on cameras: token-level raymap, attention-level relative pose encodings, a (new) relative encoding Projective Positional Encoding -> camera frustums, (int|ext)insics for relative pos encoding

"Cameras as Relative Positional Encoding" TLDR: comparison for conditioning transformers on cameras: token-level raymap, attention-level relative pose encodings, a (new) relative encoding Projective Positional Encoding -> camera frustums, (int|ext)insics for relative pos encoding

Alexandre Morgand

17,795 views • 10 months ago

hey! we've built a new AI playground over at @cloudflare to demonstrate what can be achieved by chaining multi-modal models together. think — audio → text → image → text, or composing multiple LLMs together. here's a quick demo video!

hey! we've built a new AI playground over at @cloudflare to demonstrate what can be achieved by chaining multi-modal models together. think — audio → text → image → text, or composing multiple LLMs together. here's a quick demo video!

harley turan

70,692 views • 1 year ago

Announcing Genmo Video, a generative media platform with a new text-to-video model that can generate immersive live artwork from any prompt or any image. What will you create? 🎨▶️ Free public access: Discord: 👇1/n

Announcing Genmo Video, a generative media platform with a new text-to-video model that can generate immersive live artwork from any prompt or any image. What will you create? 🎨▶️ Free public access: Discord: 👇1/n

Genmo

94,638 views • 3 years ago

Ovi is out on Hugging Face Twin Backbone Cross-Modal Fusion for Audio-Video Generation Ovi is a veo-3 like, video+audio generation model that simultaneously generates both video and audio content from text or text+image inputs. Video+Audio Generation: Generate synchronized video and audio content simultaneously Flexible Input: Supports text-only or text+image conditioning 5-second Videos: Generates 5-second videos at 24 FPS, area of 720×720, at various aspect ratios (9:16, 16:9, 1:1, etc)

Ovi is out on Hugging Face Twin Backbone Cross-Modal Fusion for Audio-Video Generation Ovi is a veo-3 like, video+audio generation model that simultaneously generates both video and audio content from text or text+image inputs. Video+Audio Generation: Generate synchronized video and audio content simultaneously Flexible Input: Supports text-only or text+image conditioning 5-second Videos: Generates 5-second videos at 24 FPS, area of 720×720, at various aspect ratios (9:16, 16:9, 1:1, etc)

AK

23,082 views • 8 months ago

Today I’m proud to launch Context, a CLI and open-source corpus for the python ecosystem - 4M quality embeddings of the top 1218 Python Libraries. $ pip install fleet-context or download to get the entire python universe. Here’s why this is game-changing for both Devs and LLMs

Today I’m proud to launch Context, a CLI and open-source corpus for the python ecosystem - 4M quality embeddings of the top 1218 Python Libraries. $ pip install fleet-context or download to get the entire python universe. Here’s why this is game-changing for both Devs and LLMs

Nicolai Ouporov

310,590 views • 2 years ago

GM Encoding the Fibonacci Sequence Into Music ~Take a listen..

GM Encoding the Fibonacci Sequence Into Music ~Take a listen..

Tartaria

19,903 views • 11 months ago

ByteDance just unveiled HuMo, a unified framework for human-centric video generation. With HuMo you can: • Generate videos from text + image • Create audio-synced videos from text + audio • Combine text, image, and audio for maximum control • Preserve consistent subjects across frames • Achieve natural audio-visual synchronization This isn’t just another release , it’s a big step toward fully controllable, coherent, and cinematic AI video.

ByteDance just unveiled HuMo, a unified framework for human-centric video generation. With HuMo you can: • Generate videos from text + image • Create audio-synced videos from text + audio • Combine text, image, and audio for maximum control • Preserve consistent subjects across frames • Achieve natural audio-visual synchronization This isn’t just another release , it’s a big step toward fully controllable, coherent, and cinematic AI video.

DStudioproject

29,408 views • 8 months ago

[1/n] Do distinct large models admit a simple map that aligns their embedding spaces? We show that across multimodal contrastive models—trained on different data and architectures—an orthogonal map aligns image embeddings. Strikingly, the same map also aligns text embeddings.

[1/n] Do distinct large models admit a simple map that aligns their embedding spaces? We show that across multimodal contrastive models—trained on different data and architectures—an orthogonal map aligns image embeddings. Strikingly, the same map also aligns text embeddings.

Sharut Gupta

36,746 views • 3 months ago

Is this the future of the metaverse? This new generative AI tool creates text-to-space. You can now create interactive virtual experiences through simple prompts.

Is this the future of the metaverse? This new generative AI tool creates text-to-space. You can now create interactive virtual experiences through simple prompts.

Rowan Cheung

45,437 views • 3 years ago

This new AI image generator is impressive. You can now create an image based on a simple sketch and text prompt.

This new AI image generator is impressive. You can now create an image based on a simple sketch and text prompt.

Rowan Cheung

543,185 views • 3 years ago

Experimenting with the magic of open-source! Whisper for text translation, XTTS for audio, and Video-retalker for seamless mouth sync in a short video Its not perfect, but I think we're close with open source #buildinpublic #opensource

Experimenting with the magic of open-source! Whisper for text translation, XTTS for audio, and Video-retalker for seamless mouth sync in a short video Its not perfect, but I think we're close with open source #buildinpublic #opensource

Luis Catacora

80,941 views • 2 years ago

Introducing Poe Apps: a new, easy way to create and use visual interfaces into any combination of the 100+ text, image, video, and audio models on Poe. (1/5)

Introducing Poe Apps: a new, easy way to create and use visual interfaces into any combination of the 100+ text, image, video, and audio models on Poe. (1/5)

Poe

66,708 views • 1 year ago

jina-embeddings-v5-omni is here! Our first universal embedding model for text, images, audio, and video. Available in two sizes: small (1.57B, 1024-dim, 32K context) and nano (0.95B, 768-dim, 8K context). Both support Matryoshka truncation down to 32 dimensions. v5-omni is back-compatible: if you already use jina-embeddings-v5-text-small/nano, the existing text indexes work with v5-omni out of the box. Without reindexing the text, just index your multimodal content with v5-omni and start searching images, audio, and video.

jina-embeddings-v5-omni is here! Our first universal embedding model for text, images, audio, and video. Available in two sizes: small (1.57B, 1024-dim, 32K context) and nano (0.95B, 768-dim, 8K context). Both support Matryoshka truncation down to 32 dimensions. v5-omni is back-compatible: if you already use jina-embeddings-v5-text-small/nano, the existing text indexes work with v5-omni out of the box. Without reindexing the text, just index your multimodal content with v5-omni and start searching images, audio, and video.

Jina AI

131,556 views • 26 days ago

Introducing Marvis-TTS 🔥🚀 A new local-first TTS model Lucas Newman and I built for efficiency, accessibility, and real-time performance right on consumer devices like Apple Silicon, iPhones, iPads, and more. Traditional TTS models often demand full text inputs or sacrifice real-time capabilities, Marvis flips the script. It streams audio chunks as text is processed, creating a truly conversational experience. No more awkward pauses or unnatural breaks—Marvis handles the entire text context intelligently to deliver coherent, expressive speech. Get started today: > pip install -U mlx-audio

Introducing Marvis-TTS 🔥🚀 A new local-first TTS model Lucas Newman and I built for efficiency, accessibility, and real-time performance right on consumer devices like Apple Silicon, iPhones, iPads, and more. Traditional TTS models often demand full text inputs or sacrifice real-time capabilities, Marvis flips the script. It streams audio chunks as text is processed, creating a truly conversational experience. No more awkward pauses or unnatural breaks—Marvis handles the entire text context intelligently to deliver coherent, expressive speech. Get started today: > pip install -U mlx-audio

Prince Canuma

81,262 views • 9 months ago

Introducing the OpenHands CLI, a new coding CLI that: - Has top accuracy (similar to Claude Code) - Is completely open source, MIT licensed - Is model agnostic, use an API or bring your own - Is simple to install and run `pip install openhands-ai` and `openhands` (no Docker!)

Introducing the OpenHands CLI, a new coding CLI that: - Has top accuracy (similar to Claude Code) - Is completely open source, MIT licensed - Is model agnostic, use an API or bring your own - Is simple to install and run `pip install openhands-ai` and `openhands` (no Docker!)

OpenHands

308,759 views • 11 months ago

Apple FastVLM-7B Efficient Vision Encoding for Vision Language Models larger variants using Qwen2-7B LLM outperform recent works like Cambrian-1-8B while using a single image encoder with a 7.9x faster TTFT vibe coding a video captioning app with it in anycoder

Apple FastVLM-7B Efficient Vision Encoding for Vision Language Models larger variants using Qwen2-7B LLM outperform recent works like Cambrian-1-8B while using a single image encoder with a 7.9x faster TTFT vibe coding a video captioning app with it in anycoder

AK

60,588 views • 9 months ago

Announcing multi-story autonomous navigation. Out of the box on ANY robot. Single pip install. Open source.

Announcing multi-story autonomous navigation. Out of the box on ANY robot. Single pip install. Open source.

stash

89,871 views • 7 months ago

If this video triggers Pakistan , I suggest meditation, therapy, and a quick Google search 🔍 🧠💀 #IndiaIsAHinduNation

If this video triggers Pakistan , I suggest meditation, therapy, and a quick Google search 🔍 🧠💀 #IndiaIsAHinduNation

Hinduism_and_Science

269,199 views • 1 year ago