Loading video...

Video Failed to Load

Go Home

I've been obsessed with motion amplified videos lately. By utilizing high definition video & image processing, the tiniest of movements are amplified into clearly seen real-time motion. Clips from RDI Technologies & RMS Ltd. dynamically demonstrate what these systems are capable of. Potential problems become highlighted, with the software...

99,184 views • 5 days ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

On Figma Motion, my demo & review. This is one of those updates that clicked swiftly into my workflow. Like in my 3D pipeline, using this stick shift animation, I emphasize hardware feedback with motion from Figma Motion. Assets are animated in Fig Motion and loaded into Blender as video textures for mesh and material control. It's advantageous since it is built into an ubiquitous ecosystem. A lot of work these days start in Figma even for someone like me that works outside the tool frequently. Can't over-emphasize my appreciation for the schema used to introduce motion to nearly all properties. Reminds me of how motion works in Blender - with better complexity management. Better than introducing more menus for those. Ease curves iD between keyframes is also an improvement over existing systems. Having spent some time on the tool, here are updates I'll like to see to Figma Motion. These are based on my immediate needs as at the time of working on this demo: • Using modifier keys (CMD, Shift, Ctrl) to jump / nudge across the timeline. E.g: holding down Shift key to make the playhead jump 100ms etc. • Jump to previous or next keyframe. • Better anchor point trails • Renaming layers from the timeline as well. • Editable custom bezier styles: after saving a style, I should be able to edit the curve - just as you can edit colour styles. • Enable transform on the timeline. I should be able to flip or scale keyframes. I hope to continue trying more ideas. Craft focused tools have had to take a backseat in recent times. Pleasing to see this come to light.

seyi

29,245 views • 2 months ago

[CLIP] by Hand ✍️ The CLIP (Contrastive Language–Image Pre-training) model, a groundbreaking work by OpenAI, redefines the intersection of computer vision and natural language processing. It is the basis of all the multi-modal foundation models we see today. How does CLIP work? Goal: 🟨 Learn a shared embedding space for text and image [1] Given ↳ A mini batch of 3 text-image pairs ↳ OpenAI used 400 million text-image pairs to train its original CLIP model. Process 1st pair: "big table" [2] 🟪 Text → 2 Vectors (3D) ↳ Look up word embedding vectors using word2vec. [3] 🟩 Image → 2 Vectors (4D) ↳ Divide the image into two patches. ↳ Flatten each patch [4] Process other pairs ↳ Repeat [2]-[3] [5] 🟪 Text Encoder & 🟩 Image Encoder ↳ Encode input vectors into feature vectors ↳ Here, both encoders are simple one layer perceptron (linear + ReLU) ↳ In practice, the encoders are usually transformer models. [6] 🟪 🟩 Mean Pooling: 2 → 1 vector ↳ Average 2 feature vectors into a single vector by averaging across the columns ↳ The goal is to have one vector to represent each image or text [7] 🟪 🟩 -> 🟨 Projection ↳ Note that the text and image feature vectors from the encoders have different dimensions (3D vs. 4D). ↳ Use a linear layer to project image and text vectors to a 2D shared embedding space. 🏋️ Contrastive Pre-training 🏋️ [8] Prepare for MatMul ↳ Copy text vectors (T1,T2,T3) ↳ Copy the transpose of image vectors (I1,I2,I3) ↳ They are all in the 2D shared embedding space. [9] 🟦 MatMul ↳ Multiply T and I matrices. ↳ This is equivalent to taking dot product between every pair of image and text vectors. ↳ The purpose is to use dot product to estimate the similarity between a pair of image-text. [10] 🟦 Softmax: e^x ↳ Raise e to the power of the number in each cell ↳ To simplify hand calculation, we approximate e^□ with 3^□. [11] 🟦 Softmax: ∑ ↳ Sum each row for 🟩 image→🟪 text ↳ Sum each column for 🟪 text→ 🟩 image [12] 🟦 Softmax: 1 / sum ↳ Divide each element by the column sum to obtain a similarity matrix for 🟪 text→🟩 image ↳ Divide each element by the row sum to obtain a similarity matrix for 🟩 image→🟪 text [13] 🟥 Loss Gradients ↳ The "Targets" for the similarity matrices are Identity Matrices. ↳ Why? If I and T come from the same pair (i=j), we want the highest value, which is 1, and 0 otherwise. ↳ Apply the simple equation of [Similarity - Target] to compute gradients of for both directions. ↳ Why so simple? Because when Softmax and Cross-Entropy Loss are used together, the math magically works out that way. ↳ These gradients kick off the backpropagation process to update weights and biases of the encoders and projection layers (red borders).

Tom Yeh

67,883 views • 2 years ago

Google presents Still-Moving Customized Video Generation without Customized Video Data Customizing text-to-image (T2I) models has seen tremendous progress recently, particularly in areas such as personalization, stylization, and conditional generation. However, expanding this progress to video generation is still in its infancy, primarily due to the lack of customized video data. In this work, we introduce Still-Moving, a novel generic framework for customizing a text-to-video (T2V) model, without requiring any customized video data. The framework applies to the prominent T2V design where the video model is built over a text-to-image (T2I) model (e.g., via inflation). We assume access to a customized version of the T2I model, trained only on still image data (e.g., using DreamBooth or StyleDrop). Naively plugging in the weights of the customized T2I model into the T2V model often leads to significant artifacts or insufficient adherence to the customization data. To overcome this issue, we train lightweight Spatial Adapters that adjust the features produced by the injected T2I layers. Importantly, our adapters are trained on "frozen videos" (i.e., repeated images), constructed from image samples generated by the customized T2I model. This training is facilitated by a novel Motion Adapter module, which allows us to train on such static videos while preserving the motion prior of the video model. At test time, we remove the Motion Adapter modules and leave in only the trained Spatial Adapters. This restores the motion prior of the T2V model while adhering to the spatial prior of the customized T2I model. We demonstrate the effectiveness of our approach on diverse tasks including personalized, stylized, and conditional generation. In all evaluated scenarios, our method seamlessly integrates the spatial prior of the customized T2I model with a motion prior supplied by the T2V model.

AK

40,485 views • 2 years ago

What if geoengineering wasn't just about blocking out the sun for "climate change" purposes, but was for a more nefarious intention to alter the schumann resonance of the earth to influence human behavior and perception? These earthly derived frequencies are profoundly connected to human health, circadian rhythms, nervous system function, human brainwave patterns, and so many other aspects of our physiology. By putting reflective particulate matter into the atmosphere, we are altering the resonance between the surface and ionosphere, giving these frequencies another layer to bounce off of to change the tone, or to be blocked entirely. I think the geoengineering agenda is multifaceted with numerous motivations, with one thing I know for absolute sure. It's not to stop climate change. Here are some interesting papers on the coherence between the earthly resonances/frequencies and human physiology, and a clip describing the connection between schumann and human alpha brainwaves. Human intelligence: The brain, an electromagnetic system synchronised by the Schumann Resonance signal Innovative technical implementation of the Schumann resonances and its influence on organisms and biological cells Synchronization of Human Autonomic Nervous System Rhythms with Geomagnetic Activity Similar Spectral Power Densities Within the Schumann Resonance and a Large Population of Quantitative Electroencephalographic Profiles: Supportive Evidence for Koenig and Pobachenko Electromagnetic activity: a possible player in epilepsy Schumann Resonances, a plausible biophysical mechanism for the human health effects of Solar/Geomagnetic Activity

Inversionism

144,671 views • 3 years ago