正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Splines instead of Gaussians 😉 Introducing Neural Spline Fields, which can see through occlusions! We learn to represent a stack of misaligned captures as a multi-layer image sandwich. Then you can extract your favorite layer to remove occlusions, reflections, or even your own shadows from the scene! Paper and... show more

Felix Heide

1,992 subscribers

137,371 次观看 • 2 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

10 条评论

Yun-Ta Tsai 的头像

Yun-Ta Tsai2 年前

Great work!

ELLIE X 的头像

ELLIE X2 年前

i feel like this feature would do numbers in dingboard @yacineMTB

Mark Kretschmann 的头像

Mark Kretschmann2 年前

this is nuts :)

Alex Nichol 的头像

Alex Nichol2 年前

I've always wanted to do something like this to see through grates! Super neat

Jonathan Craig 的头像

Jonathan Craig2 年前

Is this purely for 2-dimensional images, or is there a technique like this for higher dimensional spaces where some of the geometric information is obstructed from being "witnessable" directly by lower dimensional obstructions?

Ilya Sutskever's hairline 的头像

Ilya Sutskever's hairline2 年前

Technically speaking, everything is obstruction

PHBD 的头像

PHBD2 年前

The reflection reconstruction from burst is so cool, even more so than high quality occlusion removal imo.

Jb007 的头像

Jb0072 年前

Does this work with clothing? lol 😂

eren 的头像

eren2 年前

never seen something like this before. this is amazing

Ian Timotheos Pilon 的头像

Ian Timotheos Pilon2 年前

Cc @Scobleizer

相关视频

Code for Neural Spline Fields is out! We use burst image fusion to see through occlusions and remove reflections. We just released the code here: Comes with a fun set of notebooks and tutorials!

Code for Neural Spline Fields is out! We use burst image fusion to see through occlusions and remove reflections. We just released the code here: Comes with a fun set of notebooks and tutorials!

Felix Heide

19,134 次观看 • 2 年前

Implicit Neural Light Spheres lets you turn panoramic captures into dynamic wide FOV renders (with real-time rendering!). Instead of generating panoramas with image stitching, we use neural light spheres to jointly estimate the camera path and a high-resolution scene reconstruction to produce novel wide field-of-view projections of the environment. Code, data, and info: Amazing work with Ilya Chugunov, Amogh Joshi, Kiran Murthy, François Bleibel

Implicit Neural Light Spheres lets you turn panoramic captures into dynamic wide FOV renders (with real-time rendering!). Instead of generating panoramas with image stitching, we use neural light spheres to jointly estimate the camera path and a high-resolution scene reconstruction to produce novel wide field-of-view projections of the environment. Code, data, and info: Amazing work with Ilya Chugunov, Amogh Joshi, Kiran Murthy, François Bleibel

Felix Heide

10,301 次观看 • 2 年前

The Gondry Exercise: start with a single image and see how far and wide you can take it creatively. The starting image can be anything you want, as boring or complex as you wish. Then use Gen-4 to prompt for any combination of actions or changes to the scene. See how far you can go, and you will get a good measure of how much you need to exercise your creative mind.

The Gondry Exercise: start with a single image and see how far and wide you can take it creatively. The starting image can be anything you want, as boring or complex as you wish. Then use Gen-4 to prompt for any combination of actions or changes to the scene. See how far you can go, and you will get a good measure of how much you need to exercise your creative mind.

Cristóbal Valenzuela

15,622 次观看 • 1 年前

Don't talk directly to a model. You can make your application 10x more flexible by simply adding one intermediate layer between your code and the model. This is the simplest trick you can use to improve the architecture of whatever you are building.

Don't talk directly to a model. You can make your application 10x more flexible by simply adding one intermediate layer between your code and the model. This is the simplest trick you can use to improve the architecture of whatever you are building.

Santiago

88,884 次观看 • 6 个月前

New short course: Collaborative Writing and Coding with OpenAI Canvas! Explore new ways to write and code with OpenAI Canvas, a user-friendly interface that allows you to brainstorm, draft, and refine text and code in collaboration with ChatGPT. In the short course, created with OpenAI, and taught by , a research lead at OpenAI, you’ll learn to use Canvas to enhance your workflows. Canvas lets you go beyond simple chat interactions. It provides a side-by-side workspace where you and ChatGPT can edit and refine text or code collaboratively. This makes brainstorming, drafting, and iterating as you write feel more natural and effective. As the first major update to ChatGPT’s visual interface since its launch in 2022, Canvas gives a new, innovative approach to collaboration with AI. For instance, after writing the first version of your code, Canvas can review it and give suggestions for improvement. It can also help with debugging by adding logging, identifying problems to fix, and writing comments. In addition, you'll also learn what it takes to train the model for an interface like Canvas. In this video-only short course, you’ll: - Learn how to ask for in-line feedback and control the iteration of your work by directly editing selected areas of your text or code from the model’s output. - Learn how to access quick automation tools in a shortcut menu that allows you to modify your writing tone and length, enhance your code, and restore previous versions of your work. - Learn how to use Canvas as a research assistant tool with an example of asking the model to reason through the screenshot of a plot to write a research report, in which you can ask questions within the created report. - Ask the model to write Python code to replicate the graph seen on a screenshot image. - Go behind the scenes of how you can create a video game, such as Space Battleship, from scratch, edit it, and display it in one self-contained HTML file. - Get a real-world application example of creating a SQL database from the image of its architecture. - Understand the model training and design processes that power Canvas! Please sign up here:

New short course: Collaborative Writing and Coding with OpenAI Canvas! Explore new ways to write and code with OpenAI Canvas, a user-friendly interface that allows you to brainstorm, draft, and refine text and code in collaboration with ChatGPT. In the short course, created with OpenAI, and taught by , a research lead at OpenAI, you’ll learn to use Canvas to enhance your workflows. Canvas lets you go beyond simple chat interactions. It provides a side-by-side workspace where you and ChatGPT can edit and refine text or code collaboratively. This makes brainstorming, drafting, and iterating as you write feel more natural and effective. As the first major update to ChatGPT’s visual interface since its launch in 2022, Canvas gives a new, innovative approach to collaboration with AI. For instance, after writing the first version of your code, Canvas can review it and give suggestions for improvement. It can also help with debugging by adding logging, identifying problems to fix, and writing comments. In addition, you'll also learn what it takes to train the model for an interface like Canvas. In this video-only short course, you’ll: - Learn how to ask for in-line feedback and control the iteration of your work by directly editing selected areas of your text or code from the model’s output. - Learn how to access quick automation tools in a shortcut menu that allows you to modify your writing tone and length, enhance your code, and restore previous versions of your work. - Learn how to use Canvas as a research assistant tool with an example of asking the model to reason through the screenshot of a plot to write a research report, in which you can ask questions within the created report. - Ask the model to write Python code to replicate the graph seen on a screenshot image. - Go behind the scenes of how you can create a video game, such as Space Battleship, from scratch, edit it, and display it in one self-contained HTML file. - Get a real-world application example of creating a SQL database from the image of its architecture. - Understand the model training and design processes that power Canvas! Please sign up here:

Andrew Ng

128,180 次观看 • 1 年前

That’s a lot of master sync pairs! Take a screenshot and see if you can get your favorite! Be sure to follow Pokémon Masters EX and post using #SelectMasterSyncPair to enter our sweepstakes. You can even tag a friend to join in the fun to boost your chances of winning!

That’s a lot of master sync pairs! Take a screenshot and see if you can get your favorite! Be sure to follow Pokémon Masters EX and post using #SelectMasterSyncPair to enter our sweepstakes. You can even tag a friend to join in the fun to boost your chances of winning!

Pokémon Masters EX

71,868 次观看 • 1 个月前

🟢Substance Painter Tip With "Anchor Points" you can link layers together (e.g. use one layer as a mask for another), which makes workflows much faster. Example: You have a shadow layer and want to add an outline around it. Instead of repainting the outline every time you change the shadows, use an Anchor Point: 1. Add an Anchor Point to the shadow layer 2. Add a Fill Filter for the shadow outline layer 3. For the Fill grayscale, select the Anchor Point 4. Add a "Mask Outline" filter 5. If you paint new shadows now, the outline will adjust automatically!

🟢Substance Painter Tip With "Anchor Points" you can link layers together (e.g. use one layer as a mask for another), which makes workflows much faster. Example: You have a shadow layer and want to add an outline around it. Instead of repainting the outline every time you change the shadows, use an Anchor Point: 1. Add an Anchor Point to the shadow layer 2. Add a Fill Filter for the shadow outline layer 3. For the Fill grayscale, select the Anchor Point 4. Add a "Mask Outline" filter 5. If you paint new shadows now, the outline will adjust automatically!

Keeki | 3D Artist

38,950 次观看 • 4 个月前

"There's even more exciting technologies and coins out there. There's another one called Zano that allows anybody to create their own privacy tokens where nobody can see what's going on. Then there's a project called Confidential Layer ( Confidential Layer ), which is creating a bridge from $BTC, $BCH, and $ETH onto Zano, and when it's on Zano, you have very, very strong privacy with that as well." ~Roger Ver Learn more about Zano:

"There's even more exciting technologies and coins out there. There's another one called Zano that allows anybody to create their own privacy tokens where nobody can see what's going on. Then there's a project called Confidential Layer ( Confidential Layer ), which is creating a bridge from $BTC, $BCH, and $ETH onto Zano, and when it's on Zano, you have very, very strong privacy with that as well." ~Roger Ver Learn more about Zano:

Zano

407,435 次观看 • 1 年前

“Why do you look at the speck of sawdust in your brother’s eye and pay no attention to the plank in your own eye? How can you say to your brother, ‘Let me take the speck out of your eye,’ when all the time there is a plank in your own eye? You hypocrite, first take the plank out of your own eye, and then you will see clearly to remove the speck from your brother’s eye.”

“Why do you look at the speck of sawdust in your brother’s eye and pay no attention to the plank in your own eye? How can you say to your brother, ‘Let me take the speck out of your eye,’ when all the time there is a plank in your own eye? You hypocrite, first take the plank out of your own eye, and then you will see clearly to remove the speck from your brother’s eye.”

Michael Heise

104,726 次观看 • 8 个月前

Mentioned Dead As Disco was a banger. Did I mention you can upload tracks of your own choosing, set the BPM, and then vibe out to your favorite anime bangers?

Mentioned Dead As Disco was a banger. Did I mention you can upload tracks of your own choosing, set the BPM, and then vibe out to your favorite anime bangers?

FightinCowboy

27,080 次观看 • 5 个月前

Millions of people are trying out new workflows pairing Canva and AI assistants. The latest unlock? Whether you're coming from Gemini, Claude, ChatGPT, or Microsoft Copilot, you can use Canva's Magic Layers to unlock every visual element as a separate, editable layer to remix, refine, and make your own.

Millions of people are trying out new workflows pairing Canva and AI assistants. The latest unlock? Whether you're coming from Gemini, Claude, ChatGPT, or Microsoft Copilot, you can use Canva's Magic Layers to unlock every visual element as a separate, editable layer to remix, refine, and make your own.

Canva

38,823 次观看 • 3 个月前

As a Nigerian, Before You Travel All The Way To China To Buy Or Order Products For Your Business, Watch This Video And Learn From The Mistakes This Man Made. Sometimes, If You Don’t Have Enough Capital, Don’t Import Directly From China. Instead, Sourcing Products Through Trusted Distributors In Nigeria Can Save You a Lot Of Trouble, Reduce Your Risks, And Even Protect Your Business From Bankruptcy. Learn From Other People’s Mistakes Before You Make The Same Ones. 👀

As a Nigerian, Before You Travel All The Way To China To Buy Or Order Products For Your Business, Watch This Video And Learn From The Mistakes This Man Made. Sometimes, If You Don’t Have Enough Capital, Don’t Import Directly From China. Instead, Sourcing Products Through Trusted Distributors In Nigeria Can Save You a Lot Of Trouble, Reduce Your Risks, And Even Protect Your Business From Bankruptcy. Learn From Other People’s Mistakes Before You Make The Same Ones. 👀

Somto Okonkwo

166,718 次观看 • 1 个月前

$We got extremely good at extracting a scanned from layer by layer 📋 - from printed fields, overlaid text, handwriting, and reviewer annotations. For instance, on an annotated permit, our Extract agents can extract out both the original permit number but also any drawn/handwritten annotations on top. they're also grounded exactly in the source text. our agents reduce error rates by 2x+, at a small fraction of the price compared to using a frontier model. Our Extract v2.5 agents are SOTA in price/performance, and scanned forms are just one example. Come check it out! Extract v2.5: Available in LlamaParse:$

We got extremely good at extracting a scanned from layer by layer 📋 - from printed fields, overlaid text, handwriting, and reviewer annotations. For instance, on an annotated permit, our Extract agents can extract out both the original permit number but also any drawn/handwritten annotations on top. they're also grounded exactly in the source text. our agents reduce error rates by 2x+, at a small fraction of the price compared to using a frontier model. Our Extract v2.5 agents are SOTA in price/performance, and scanned forms are just one example. Come check it out! Extract v2.5: Available in LlamaParse:

Jerry Liu

11,136 次观看 • 3 天前

Image editors, video resizers, custom shaders… if you can think of it, you can now build it. Introducing Tools in Google Flow. Starting today, you can describe the tools you wish you had, and Google Flow will help build them for your workflows. Explore our Tools gallery for inspiration, including some from fellow creatives, share your own, or even remix existing Tools to fit your needs. Learn how to get started in the thread below #GoogleIO

Image editors, video resizers, custom shaders… if you can think of it, you can now build it. Introducing Tools in Google Flow. Starting today, you can describe the tools you wish you had, and Google Flow will help build them for your workflows. Explore our Tools gallery for inspiration, including some from fellow creatives, share your own, or even remix existing Tools to fit your needs. Learn how to get started in the thread below #GoogleIO

Google Flow

255,721 次观看 • 4 个月前

AI can write more code than any team can review by hand, and a pull request can look fine while hiding a security issue or missing a requirement. In our new short course, AI Code Review, built in collaboration with Qodo and taught by Nnenna 👩🏽‍💻✨, you'll learn the practices that make AI code review effective: review before you open a pull request, give the reviewer full context about your codebase, and triage findings by risk. Then you'll build your own review agent, from a context engine that finds the right code to a team of specialized reviewers. Enroll for free:

AI can write more code than any team can review by hand, and a pull request can look fine while hiding a security issue or missing a requirement. In our new short course, AI Code Review, built in collaboration with Qodo and taught by Nnenna 👩🏽‍💻✨, you'll learn the practices that make AI code review effective: review before you open a pull request, give the reviewer full context about your codebase, and triage findings by risk. Then you'll build your own review agent, from a context engine that finds the right code to a team of specialized reviewers. Enroll for free:

DeepLearning.AI

56,750 次观看 • 2 个月前

Agents are producing content and working across your daily tasks. But most of it remains in the chatbox, and the next person or agent needs to start over. With Filecoin warm storage, we are building the layer that agents can use to store and share with ease. Molly Mackinlay | momack gives a glimpse on what's coming from us to power your agents with a robust warm storage layer.

Agents are producing content and working across your daily tasks. But most of it remains in the chatbox, and the next person or agent needs to start over. With Filecoin warm storage, we are building the layer that agents can use to store and share with ease. Molly Mackinlay | momack gives a glimpse on what's coming from us to power your agents with a robust warm storage layer.

Filecoin

86,594 次观看 • 21 天前

Seeing the World through Your Eyes paper page: The reflective nature of the human eye is an underappreciated source of information about what the world around us looks like. By imaging the eyes of a moving person, we can collect multiple views of a scene outside the camera's direct line of sight through the reflections in the eyes. In this paper, we reconstruct a 3D scene beyond the camera's line of sight using portrait images containing eye reflections. This task is challenging due to 1) the difficulty of accurately estimating eye poses and 2) the entangled appearance of the eye iris and the scene reflections. Our method jointly refines the cornea poses, the radiance field depicting the scene, and the observer's eye iris texture. We further propose a simple regularization prior on the iris texture pattern to improve reconstruction quality. Through various experiments on synthetic and real-world captures featuring people with varied eye colors, we demonstrate the feasibility of our approach to recover 3D scenes using eye reflections.

Seeing the World through Your Eyes paper page: The reflective nature of the human eye is an underappreciated source of information about what the world around us looks like. By imaging the eyes of a moving person, we can collect multiple views of a scene outside the camera's direct line of sight through the reflections in the eyes. In this paper, we reconstruct a 3D scene beyond the camera's line of sight using portrait images containing eye reflections. This task is challenging due to 1) the difficulty of accurately estimating eye poses and 2) the entangled appearance of the eye iris and the scene reflections. Our method jointly refines the cornea poses, the radiance field depicting the scene, and the observer's eye iris texture. We further propose a simple regularization prior on the iris texture pattern to improve reconstruction quality. Through various experiments on synthetic and real-world captures featuring people with varied eye colors, we demonstrate the feasibility of our approach to recover 3D scenes using eye reflections.

AK

470,399 次观看 • 3 年前

After the last promotion, we knew we needed to do something exceptional to prove our love for Succinct. Introducing Prooforia a Succinct NFT marketplace made by @ChizaramCh (yeah, he did 80% of the work) and me. Here, you can list your art and digital assets, trade them, own them, and have a lot of fun. Try it We made this for you 👉 Succinct crashout zkDan

After the last promotion, we knew we needed to do something exceptional to prove our love for Succinct. Introducing Prooforia a Succinct NFT marketplace made by @ChizaramCh (yeah, he did 80% of the work) and me. Here, you can list your art and digital assets, trade them, own them, and have a lot of fun. Try it We made this for you 👉 Succinct crashout zkDan

Jason 🟡

17,466 次观看 • 1 年前

We built LobsterX 🦞, an OpenClaw🦞 specialized for document work on your computer. It uses high-accuracy document parsing, extraction, classification through LlamaCloud, meaning it can comb through complicated PDFs (with scans, tables, diagrams) and extract out 100% accurate context! It can run as a Telegram bot and is built on top of agentfs (Turso) as a file system. Big shoutout to Clelia Bertelli (🦙/acc). This is a fun project inspired by OpenClaw🦞’s success, and besides being a fun tool to use, it can be a great reference for building your own generalized coding agents! Readme: LlamaCloud:

We built LobsterX 🦞, an OpenClaw🦞 specialized for document work on your computer. It uses high-accuracy document parsing, extraction, classification through LlamaCloud, meaning it can comb through complicated PDFs (with scans, tables, diagrams) and extract out 100% accurate context! It can run as a Telegram bot and is built on top of agentfs (Turso) as a file system. Big shoutout to Clelia Bertelli (🦙/acc). This is a fun project inspired by OpenClaw🦞’s success, and besides being a fun tool to use, it can be a great reference for building your own generalized coding agents! Readme: LlamaCloud:

Jerry Liu

27,071 次观看 • 8 个月前