正在加载视频...

视频加载失败

When I first took ordinary differential equations, the pattern was always the same. Week 1 turns into a speedrun of methods: separation of variables, integrating factors, variation of parameters, Bernoulli, exact equations… and by Week 2 or 3 the course has quietly degenerated into hammer-picking. Spot the form, apply...

53,841 次观看 • 10 个月前 •via X (Twitter)

40 条评论

Mathelirium 的头像
Mathelirium10 个月前

The Lecture Series

Andréa Gourion 的头像
Andréa Gourion10 个月前

The baffling reality of North American eng. students: They can solve Riccati equations blindfolded. Yet, they are completely stumped by uniqueness on a phase portrait. We are teaching them to compute, not to see.

Mathelirium 的头像
Mathelirium10 个月前

Absolutely!

Science Bob McGwier 的头像
Science Bob McGwier10 个月前

I took physics with calculus and advanced physics and electrical and mechanical engineering courses at the same time and it totally integrated into the toolkit with the necessary motivational background that allows one to automatically see how it can be used in new topics. Add to that Langrangian, Hamilton and Calculus of Variations based understanding of mechanics and the world’s oyster until you want non-Newtonian mechanics and then you need differential geometry. My master’s thesis was numerical ODE solutions on manifolds and my life trajectory was built. Marriage of applied mathematics tools with actual applications is “The Way” in my experience and opinion.

Norm Matloff 你有冇諗清楚呀? 的头像
Norm Matloff 你有冇諗清楚呀?10 个月前

Very nice. One of the few times I've watched a math video in full.

Mathelirium 的头像
Mathelirium10 个月前

He’s incredible. Maybe it’s just me, but you can feel the energy he brings,esp at his age. Old son of a gun is almost bouncing as he moves across the class 😁👌🏻🙌🏻 He respects the subject and the room. You can tell he genuinely loves what he’s doing, but there’s zero casualness about it. He’s prepared. Every example is chosen on purpose.🫡

Sonic Reducer 的头像
Sonic Reducer10 个月前

…& Then you use the green one as fire-starter 🔥, use the purple one Pro Re Nata…& almost everything else is Runge-Kutta / Hybrid Gear / Bulirsch–Stoer. Life goes on.

Mathelirium 的头像
Mathelirium10 个月前

Awesome 👌🏻

Sonic Reducer 的头像
Sonic Reducer10 个月前

😬😉

Mathelirium 的头像
Mathelirium10 个月前

Cool. pls share the system eqns

Sonic Reducer 的头像
Sonic Reducer10 个月前

✅ DOI: 10.1086/109234

Eric Tauriainen 的头像
Eric Tauriainen10 个月前

My Diff E class was nothing but a bag of tricks. I hated it because there was no underlying method or technique.

Jason M Lewis 的头像
Jason M Lewis10 个月前

So cool to see Prof. Mattuck in action again. I took a differentials equations course that he taught as an undergraduate. I think that it was the same course in the video and in the same room and chalk boards. He was an extremely good lecturer on the topic.

Gold Smith 的头像
Gold Smith10 个月前

Great post. I am not a mathematician, I am physical scientist. When I took DiffEQs, I immediately tied it to physics and physical chemistry and then to chemical engineering. I kind of love differential equations. That said the course was ridiculously easy because you marched through Boyce and DiPrama learning recipes, algorithms. I know you didn't like that but it gave me time to study other things closer to my major. However, it was only later, when I for example I took quantum mechanics that ideas like the time rate of change is proportional to the curvature in space, did a deeper understanding, a more intuitive and geo-spatial understanding begin to form in my mind. When I then had to teach, this became even more important to me. I wanted my students to know what the math was telling them about the system and to have some feeling before solving the equation for its parametric sensitivity, its tendency to go to a steady state and its likely solution shape in space and time.

gmalcolms 🇯🇵🇺🇸🇮🇹🇺🇦 的头像
gmalcolms 🇯🇵🇺🇸🇮🇹🇺🇦10 个月前

When I taught ODE I showed near the end of the semester that almost all of the techniques presented in the course (everything except power series) were special cases of Lie's use of symmetries to solve DEs.

Mathelirium 的头像
Mathelirium10 个月前

I’m not familiar with Lie algebra yet. When you say Lie symmetries for an ODE, do you mean noticing a way to relabel the picture (like re shifting, scaling, or rotating) that doesn’t actually change the equation?

Mathelirium 的头像
Mathelirium10 个月前

Id appreciate an example

barry goldman 的头像
barry goldman10 个月前

i remember that. we had the solve the random forms thing but also i remember the slope field thing. but true, in general, i found the course REALLY boring. and i don't remember much of it.

Mathelirium 的头像
Mathelirium10 个月前

Really? What were you studying?

barry goldman 的头像
barry goldman10 个月前

it was just beginning diffeq at the community college, forgot the name of the textbook. i was doing some kind of generic engineering path. i learnt heavier maths later.

Douglas 的头像
Douglas10 个月前

Yes, My first pass through differential equations was just learning to apply the many techniques. What you've said here did not dawn upon me until many years later when I realized most of nature could be explained through different equations, fields and potentials.

blackbird014 的头像
blackbird01410 个月前

I have noticed that when any problem is explained differently from your first approach is more appreciated as introduces a new point of view. I loved theoretical physics from Landau and Feynman mechanics but I am not sure if starting with them i would have mastered the subject.

Mathelirium 的头像
Mathelirium10 个月前

I agree. I jus feel we should spend real time teaching geometry as much as teaching techniques. Simply because humans think in pictures.

blackbird014 的头像
blackbird01410 个月前

1. The funny thing is: i was automatically mapping to euclidean geometry in R2 linear algebra, norm and hilbert spaces. When infinite dimensions came I was drawing lines on a plane, which would make no sense, understanding before studying why close and limited is not compact.

blackbird014 的头像
blackbird01410 个月前

2. I am convinced that starting geometrically was natural as it is how our experience works. But logically everything could have been done the other way around. I know people who really start from algebra and deduct the experience: some are smart! we are just wired differently.

Mathelirium 的头像
Mathelirium10 个月前

Yeah. So, we should give students the minimum tool needed to get moving, then immediately cash it out geometrically so they see what the algebra just did. Then you add the next tool with that picture already in place. Otherwise methods jus turn into button-pressing, and the geometry arrives too late to fix the terrible habits. Its often so hard to unlearn something😄

blackbird014 的头像
blackbird01410 个月前

I am italian. At my old times we made mainly geometry before. Cartesian geo was fully deducted. Enrico Fermi, from whom Fermilab gets his name said that he understood math in that moment: he realized it was not a set of rules. To me was the same.

doer 的头像
doer10 个月前

And this MIT ODR course MUST be taken after linear algebra or supplemented with it by Prof. Gilbert Strang. The amount of connections you’ll make is unreal and the intuition that will be developed is insane

Mathelirium 的头像
Mathelirium10 个月前

True

Charles Forsyth 的头像
Charles Forsyth10 个月前

"And that’s a big deal, because in real modeling the equations you meet are rarely nice enough to reward memorized recipes" The first lecturer I had on ODEs in his first lecture stated that in many cases you come across in practice, you'd use a computer (no closed form), but the point of the course was to extend your own expertise in a new domain, understand fundamentals, and know how and why to program those computers.

Gary🇺🇸 的头像
Gary🇺🇸10 个月前

Well I always seemed to learn the n+1 time, with n being the time I needed to learn it. Didn’t really learn algebra until trigonometry, didn’t learn trigonometry until calculus, didn’t learn calculus until physics, didn’t learn physics until mechanics, etc.

Veda Konduru 的头像
Veda Konduru10 个月前

Brilliant! What a wonderful thought process! (I recommend my fellow geeks and nerds to read it)

Kym Derriman 的头像
Kym Derriman10 个月前

“I’m going to dedicate this first day to not solving a single differential equation” that’s how you know it’s good.

Nasir AFAF 的头像
Nasir AFAF10 个月前

I'm not sure of others, but I have always seen any ODE or PDE as a statement about geometry. I'm surprised that others don't, if that's the case. But you can always change views, and sometimes you must For example in the simple Black Scholes equation, or its Local Vol improvement, you can see the terms in 3 different ways. You can see slopes and curvature. Or you could see convection and diffusion. Or you can you position changing in terms of delta and gamma. The latter is the essential bit in that case for any trader to imagine how his P/L will change based on whether he has left the delta unhedged or not, SC how he trades the gamma. It's the essential first step for a beginning trader and it's a better picture than (slope, curvature) or (convection, diffusion). Really you want (dynamic delta, dynamic gamma) understanding. But if you were a quant implementing numerical solutions you might want to know about (convection, diffusion) because your solver might have areas where convection dominates diffusion leaving the pde locally hyperbolic with the potential instabilities propogating all way back to the solution. Or if you were a quant doing smile modelling you might want to be aware that bad smile Interpolations could ruin your delta and gamma clocks because you had violated some constraints on implied volatility slope and curvature leading to B minus traders and non-quants like @nntaleb believing in the existence of negative probabilities. You should never force one view or the other. Switching perspectives is often the most useful approach one can adopt (My 18 year old understands maths and probability much better than him, not knowing the Wick rotation in the path integral formulation of Quantum Mechanics, but explaining to me in the most intuitive mathematics the other day why you could not work with real valued wavefunctions).

JP Calma | HOMEQUBE 的头像
JP Calma | HOMEQUBE10 个月前

phenomenon first is systems thinking

CSFSafe – DIY Cybersecurity Playbook 的头像
CSFSafe – DIY Cybersecurity Playbook10 个月前

This brought back memories

Insight to incite works llc 的头像
Insight to incite works llc10 个月前

And did he see the truth by logic and reasoning of numbers? It is only the decoding symbols?

Alfredo Acosta Padilla 的头像
Alfredo Acosta Padilla10 个月前

Mi libro "Calculus Without Limits" va en la misma dirección: recuperar la esencia algebraica del cálculo, sin perderse en límites y continuos.

TheoryOfNearlyEverything 的头像
TheoryOfNearlyEverything10 个月前

math is crooked in platonism, reality not

Ryan Goh 的头像
Ryan Goh10 个月前

See the introductory text, Differential Equations by Blanchard, Devaney, and Hall. The entire book is in reaction to the problem you describe.

相关视频

Lecture 4 on Calculus of Variations You might wonder...If I’m optimizing a shape...a curve, a surface, a whole path, what does "take the derivative and set it to zero" even mean? Do I take the damn derivative with respect to a curve/surface? 🤔 In normal calculus the variable is a number x, so the reflex is clean...f′(x)=0. In calculus of variations the variable is a whole function...the geometry itself, like a curve y(x) (or a surface z(x,y)). So the derivative can’t be a single slope. It has to be a pointwise sensitivity, i.e. how the objective reacts to tiny local deformations. You’re holding a whole shape, like a curve y(x). Your objective isn’t f(x) anymore, it’s a functional J[y], and as we've seen with our first there examples, usually an integral that depends on the entire curve (often through y and y’). To talk about a “derivative”, you do the only thing that makes sense: you nudge the entire curve by a tiny amount and see how J changes. Pick a wiggle shape η(x). It’s not random...it’s any admissible deformation direction. Admissible just means it obeys the constraints. If the endpoints are fixed, you force η(0)=η(1)=0 so the wiggle doesn’t move the endpoints. Then scale that wiggle by a small number ε and define the perturbed curve yε(x)=y(x)+εη(x). Now treat ε like the usual scalar in a Taylor expansion. As ε→0, J[y+εη] expands as J[y+εη] = J[y] + ε · (first-order term depending linearly on η) + o(ε). So the difference is J[y+εη] - J[y] = ε · (linear functional of η) + o(ε). For the standard integral of a Lagrangian problems, that linear functional can be written as an inner product with some function of x: J[y+εη] - J[y] = ε ∫ (δJ/δy)(x) η(x) dx + o(ε). That’s the definition-level meaning of δJ/δy: it’s the unique pointwise sensitivity function that makes this identity true for every admissible η. If δJ/δy is positive at some x, then choosing η negative there decreases J; if δJ/δy is negative there, pushing y upward locally decreases J. It’s literally a map along the curve saying push this way to go downhill. Now translate “set the derivative to zero.” At a minimizer y*, the first-order change must vanish for every admissible wiggle: J[y*+εη] − J[y*] = o(ε) for all η. Plug in the expansion and the ε-term must be zero: ∫ (δJ/δy)(x) η(x) dx = 0 for all admissible η. Here’s the crucial logic step: the only way an integral against every test function η can be zero is if the integrand itself is zero (in the usual sense used in analysis). So you get δJ/δy = 0. For the common case J[y]=∫ L(x, y, y’) dx, you can compute δJ/δy explicitly and it becomes the Euler–Lagrange expression δJ/δy = ∂L/∂y − d/dx(∂L/∂y’). So if you name the Euler–Lagrange residual as “left-hand side” R(x) = ∂L/∂y − d/dx(∂L/∂y’), then “set the derivative to zero” is exactly R(x)=0. That’s why animation works so well. You don’t have to solve R=0 in one shot. You can evolve the curve in an artificial time τ by pushing it in the downhill direction: ∂y/∂τ = −R(y). Where the residual is large, the curve moves a lot; as the residual drains toward zero, the motion dies out and the curve settles into an extremal. In our animations, we start from an intentionally ugly curve/surface. Frame by frame the functional drops, the residual drains away, and the geometry relaxes into an extremal. #CalculusOfVariations #EulerLagrange #FunctionalDerivative #GradientFlow #Optimization #MathAnimation

Mathelirium

12,186 次观看 • 10 个月前

Do you actually know what convex optimization is in the geometric, guarantee-theoretic sense or have you only met it through solvers and loss curves? Convexity is rare comfort in optimization...there are no spurious local minima, no surprise traps, and inequalities you can use like tools instead of prayers. So, what is this convexity? Let x = (x₁, x₂) and let f(x) be convex. Plot the surface z = f(x). Pick a contact point x₀. The local slope is the gradient p = ∇f(x₀). That p is exactly the data that defines the supporting plane: z = f(x₀) + p · (x − x₀). Thus, f is said to be convex because for every x, f(x) ≥ f(x₀) + p · (x − x₀). So the plane at x₀ can slide under the surface, but it never slices through it. Not near the point...everywhere. Now for here is the interesting part: The slope becomes a coordinate system! Rewrite the same plane as z = p · x − b, where b is the offset. Because the plane passes through (x₀, f(x₀)), the offset is forced to be b = p · x₀ − f(x₀). And that number isn’t just geometry trivia. It’s the convex conjugate: f*(p) = sup over x ( p · x − f(x) ). At a differentiable contact point, the supporting plane touches f tightly enough that the supremum is achieved at x₀, giving the identity f*(p) = p · x₀ − f(x₀) when p = ∇f(x₀). So one moving contact point gives two linked readouts: primal position x₀ dual position (slope) p = ∇f(x₀) dual offset f*(p) One surface. Two worlds. #ConvexOptimization #Optimization #MachineLearning #SignalProcessing #AppliedMath #Engineering

Mathelirium

38,506 次观看 • 10 个月前

Ten million people have watched an MIT professor teach a course whose first lecture is literally titled "What is a Derivative?" Almost none have written down the two-line answer. He filmed the lecture once in the fall of 2007 and it has been on YouTube ever since. Math tutors charge $200 an hour to teach a diluted version of what he covered in 50 minutes for free. His name is David Jerison. He is a professor of mathematics at MIT and the instructor of 18.01 Single Variable Calculus, one of the most-watched math courses in the history of the internet. The 50-minute clip in this video is Lecture 1, filmed at MIT in the fall of 2007. Jerison is deriving the definition of a derivative from a single tangent line. The whole framework fits on a napkin. A derivative is just how much y changes when x moves a tiny bit. Draw a tangent line to any curve at any point. The slope of that line is the derivative. Memorize one formula, the power rule, and you can differentiate every polynomial on earth in your head. Chain that with a handful of exceptions and you can differentiate almost every function humanity has ever written down. That single set of rules is what every neural network runs on gradient descent, what every rocket landing at SpaceX solves in real time, and what every options desk at Goldman Sachs is running behind every quote you see on the screen. "In mathematics you don't understand things. You just get used to them." That is John von Neumann, the mathematician who helped design the atomic bomb and invent the modern computer. Jerison returns to the same idea in every lecture. Almost no student giving up on calculus has heard von Neumann say it out loud. Every quant fund on Wall Street pays entry-level analysts $250,000 to know the same power rule Jerison derives on the board. Every AI bootcamp charges tens of thousands to teach a diluted version of the same equation on a laptop. The lecture is free on MIT OpenCourseWare. The textbook is under sixty dollars. Almost none of the millions who watched have ever taken the power rule and applied it to their own numbers on their own paper. The math is free. The willingness to actually take one derivative before your next model, trade, or engineering trade-off is the entire edge.

Lumen

31,497 次观看 • 1 个月前

The Trap in Every Mathematics Lecture If you’ve taken a lot of math courses, you start to recognize a pattern. There’s a moment where the lecturer is warming up with the obvious stuff...add matrices entrywise, scale by α, do the row-column product...and you’re thinking, alright… where is this going? Then you relax. You stop resisting. And right there, they slip in one line that changes how you see the whole subject. When Benedict Gross says "matrices represent linear operators,"he’s telling you to stop treating a matrix as a rectangle of numbers and start treating it as an action. A linear operator is a function T: Rⁿ → Rⁿ that respects two rules: T(u+v)=T(u)+T(v) and T(αu)=αT(u). Once you pick a basis, T is completely determined by where it sends the basis vectors e₁,…,eₙ. Put T(e₁),…,T(eₙ) into columns and you get a matrix A. That is what "A represents T" means...A is the coordinate portrait of the transformation. Now the punchline that makes matrix multiplication feel inevitable. If B represents S and A represents T, then doing S first and then T is the composition T∘S. In coordinates that becomes A(Bx)=(AB)x. So multiplying matrices is really composing transformations. That’s why multiplication is usually not commutative: T∘S is generally not the same transformation as S∘T, and the matrices inherit that noncommutativity. This explains half of Linear Algebra because it tells you what the course is really about...functions that move vectors around, not grids of numbers. A matrix is just the written form of that function once you choose coordinates. Then the rules stop feeling random Multiplying matrices means doing one move and then another, an inverse means you can undo the move, eigenvectors are directions that don’t get turned, and changing basis is just describing the same move in a different language. That one idea makes a lot of linear algebra click. #LinearAlgebra #Matrices #GroupTheory #GLn #MathLectures #Mathematics

Mathelirium

66,892 次观看 • 9 个月前

This man teaches at a community college in California. His salary: around $800,000 a year. The engineers who passed calculus because of him: $1,800,000 to start. He has more calculus students than Harvard, MIT, and Stanford combined. This is Professor Leonard's Calculus 2, Lecture 6.2. Free on YouTube. Professor Leonard has taught calculus on YouTube for over a decade. His channel has millions of subscribers across 150 countries. Every major university has students who watch him the night before their exam. Then the concept. An inverse function is a machine that undoes another machine. If a function takes 2 and gives you 8, the inverse takes 8 and gives you back 2. Finding an inverse means switching every x and y in the equation and solving for y again. The graph flips across the line y = x like a mirror. Then the problem. Sometimes it is easy to find the inverse. Sometimes it is impossible to write it explicitly. A function like 3π sin x + sin x cannot be solved for x with algebra. You have to think. What angle makes the whole thing equal to 1? You work backwards through the unit circle until the answer appears. Then the shortcut. If you want the derivative of an inverse at a point, you do not need the inverse itself. You only need the derivative of the original function. The formula: the derivative of the inverse at a point equals 1 divided by the derivative of the original function evaluated at the switched point. The inverse flips the coordinates, so you flip where you plug in. Watch the moment he shows why G prime of 8 equals 1/12 without ever writing the inverse function. Every engineering student memorizes the derivative rules. Professor Leonard's lecture is the one that shows why the inverse derivative formula is just those same rules run backwards. A software engineer at a semiconductor company in Austin said Professor Leonard's channel is the reason she passed Calculus 2 on her second attempt. She graduated, joined the company, and now makes $165,000 a year. Bookmark this and watch later - after this lecture every inverse problem on your exam will feel like a question you already answered.

Lupen

739,060 次观看 • 2 个月前

Lecture 1 on Physics-Informed Neural Networks: A Mini-Series Physics-Informed Neural Networks (PINNs) are neural networks trained to satisfy a differential equation by building the PDE residual directly into the loss. They emerged from a very practical problem...classical PDE pipelines can be brilliant, but they often demand heavy discretization work (meshes, stencils, stability tuning), and the method you build is usually tied to one geometry and one solver setup. A PINN flips the workflow by representing the solution itself as a smooth function uᵩ(x,t) and enforcing the physics everywhere you choose to sample the domain. People often meet PINNs in the least helpful way...via a flashy solution plot, and almost no explanation of what was enforced to get it. In this series we keep the enforcement visible. We pick a differential equation, represent the unknown solution as a flexible function, measure how well that function satisfies the equation across the domain, and train it to reduce that mismatch everywhere we sample. A normal neural net learns from labels...you give it inputs and target outputs. A PINN learns from a differential equation...you give it inputs (x,t) and it gets punished whenever its output fails the PDE. By punish we mean that the loss increases when the mismatch is large we reward it if the loss decreases as the mismatch gets smaller. The network isn’t replacing physics, it’s becoming a flexible function that is forced to satisfy the same calculus you’d impose on any candidate solution. The math breakdown: We start with a PDE we want to solve on a domain Ω. Write it as uₜ(x,t) + N(u(x,t), uₓ(x,t), uₓₓ(x,t), …) = 0 for (x,t) in Ω A PINN replaces the unknown function u with a neural network output uᵩ(x,t) Now define the physics residual by plugging uᵩ into the PDE rᵩ(x,t) = ∂uᵩ/∂t + N(uᵩ, ∂uᵩ/∂x, ∂²uᵩ/∂x², …) If uᵩ were an exact solution, we would have rᵩ(x,t) = 0 everywhere. We may also have data points (xᵢ,tᵢ,uᵢ) from measurements or a known initial condition. The training objective is just a weighted sum of squared errors L(ᵩ) = L_data(ᵩ) + λ L_phys(ᵩ) + L_bc/ic(ᵩ) with L_data(ᵩ) = meanᵢ |uᵩ(xᵢ,tᵢ) − uᵢ|² L_phys(ᵩ) = meanⱼ |rᵩ(xⱼ,tⱼ)|² where (xⱼ,tⱼ) are the collocation points in Ω L_bc/ic(ᵩ) = penalties enforcing boundary conditions and initial conditions The key technical step is that the derivatives inside rᵩ are computed by automatic differentiation ∂uᵩ/∂t, ∂uᵩ/∂x, ∂²uᵩ/∂x², … So we can differentiate the total loss L(ᵩ) with respect to ᵩ and train with gradient descent. This is the whole idea behind PINNs. Learn a function, but make the PDE part of the loss, so the network is trained to be a solution, not just a curve-fitter. In the render, the main 3D surface is the network’s current guess uᵩ(x,t), drawn as a living sheet over the (x,t) plane. Hovering above is the neural scaffold...a visible graph of feature nodes and connections. The bright tension threads are the physics residual rᵩ(x,t): each thread tethers a collocation bead on the sheet up to the scaffold, and it thickens and brightens exactly where |rᵩ| is large (color encodes the sign). As training runs, those threads go slack across the domain not because we hid the error, but because the network has actually been pushed toward rᵩ(x,t) ≈ 0. #PINNs #PhysicsInformedNeuralNetworks #ScientificMachineLearning #PDE #DifferentialEquations #Optimization #MachineLearning #AppliedMath #ComputationalPhysics

Mathelirium

47,308 次观看 • 10 个月前

The Trap in Every Mathematics Lecture If you’ve taken enough math courses, you start noticing the same little move. The lecturer warms up with the obvious stuff, add matrices entrywise, scale by α, do the row-column product, and you’re thinking alright, where is this going. Then you relax. You stop resisting. And right there, they drop one line that quietly rewires the whole subject. When Benedict Gross says matrices represent linear operators, he’s telling you to stop treating a matrix as a rectangle of numbers and start treating it as an action. A linear operator is a function T: ℝⁿ → ℝⁿ that respects two rules: T(u+v) = T(u) + T(v) T(αu) = αT(u) Once you pick a basis, T is completely determined by where it sends the basis vectors e₁,…,eₙ. Put T(e₁),…,T(eₙ) into columns and you get a matrix A. That is what A represents T means. A is the coordinate portrait of the transformation. Now the punchline that makes matrix multiplication feel inevitable. If B represents S and A represents T, then doing S first and then T is the composition T∘S. In coordinates that becomes A(Bx) = (AB)x. So multiplying matrices is really composing transformations. That’s why multiplication is usually not commutative. T∘S is generally not the same transformation as S∘T, and the matrices inherit that noncommutativity. This explains half of linear algebra because it tells you what the course is really about: functions that move vectors around, not grids of numbers. A matrix is just the written form of that function once you choose coordinates. After that, the rules stop feeling random. Multiplying matrices means doing one move and then another. An inverse means you can undo the move. Eigenvectors are directions that don’t get turned. Changing basis is just describing the same move in a different language. One idea, and a lot of linear algebra suddenly clicks. #LinearAlgebra #Matrices #LinearMaps #Eigenvectors #ChangeOfBasis #Mathematics

Mathelirium

133,454 次观看 • 8 个月前

What if Your Neural Network Was Forced to Obey Physics? Physics-Informed Neural Networks (PINNs) are neural networks trained to satisfy a differential equation by building the PDE residual directly into the loss. They emerged from a very practical problem...classical PDE pipelines can be brilliant, but they often demand heavy discretization work (meshes, stencils, stability tuning), and the method you build is usually tied to one geometry and one solver setup. A PINN flips the workflow by representing the solution itself as a smooth function uᵩ(x,t) and enforcing the physics everywhere you choose to sample the domain. People often meet PINNs in the least helpful way...via a flashy solution plot, and almost no explanation of what was enforced to get it. In this series we keep the enforcement visible. We pick a differential equation, represent the unknown solution as a flexible function, measure how well that function satisfies the equation across the domain, and train it to reduce that mismatch everywhere we sample. A normal neural net learns from labels...you give it inputs and target outputs. A PINN learns from a differential equation...you give it inputs (x,t) and it gets punished whenever its output fails the PDE. By punish we mean that the loss increases when the mismatch is large we reward it if the loss decreases as the mismatch gets smaller. The network isn’t replacing physics, it’s becoming a flexible function that is forced to satisfy the same calculus you’d impose on any candidate solution. The math breakdown: We start with a PDE we want to solve on a domain Ω. Write it as uₜ(x,t) + N(u(x,t), uₓ(x,t), uₓₓ(x,t), …) = 0 for (x,t) in Ω A PINN replaces the unknown function u with a neural network output uᵩ(x,t) Now define the physics residual by plugging uᵩ into the PDE rᵩ(x,t) = ∂uᵩ/∂t + N(uᵩ, ∂uᵩ/∂x, ∂²uᵩ/∂x², …) If uᵩ were an exact solution, we would have rᵩ(x,t) = 0 everywhere. We may also have data points (xᵢ,tᵢ,uᵢ) from measurements or a known initial condition. The training objective is just a weighted sum of squared errors L(ᵩ) = L_data(ᵩ) + λ L_phys(ᵩ) + L_bc/ic(ᵩ) with L_data(ᵩ) = meanᵢ |uᵩ(xᵢ,tᵢ) − uᵢ|² L_phys(ᵩ) = meanⱼ |rᵩ(xⱼ,tⱼ)|² where (xⱼ,tⱼ) are the collocation points in Ω L_bc/ic(ᵩ) = penalties enforcing boundary conditions and initial conditions The key technical step is that the derivatives inside rᵩ are computed by automatic differentiation ∂uᵩ/∂t, ∂uᵩ/∂x, ∂²uᵩ/∂x², … So we can differentiate the total loss L(ᵩ) with respect to ᵩ and train with gradient descent. This is the whole idea behind PINNs. Learn a function, but make the PDE part of the loss, so the network is trained to be a solution, not just a curve-fitter. In the render, the main 3D surface is the network’s current guess uᵩ(x,t), drawn as a living sheet over the (x,t) plane. Hovering above is the neural scaffold...a visible graph of feature nodes and connections. The bright tension threads are the physics residual rᵩ(x,t): each thread tethers a collocation bead on the sheet up to the scaffold, and it thickens and brightens exactly where |rᵩ| is large (color encodes the sign). As training runs, those threads go slack across the domain not because we hid the error, but because the network has actually been pushed toward rᵩ(x,t) ≈ 0. #PINNs #PhysicsInformedNeuralNetworks #ScientificMachineLearning #PDE #DifferentialEquations #Optimization #MachineLearning #AppliedMath #ComputationalPhysics

Mathelirium

17,459 次观看 • 5 个月前

What are Physics-Informed Neural Networks (PINNs) Physics-Informed Neural Networks (PINNs) are neural nets trained to satisfy a differential equation. The trick is simple. You bake the PDE residual straight into the loss. They came out of a very practical pain point. Classical PDE pipelines can be amazing, but they often demand a lot of setup work. Meshes. Stencils. Stability tuning. And once you build a solver, it’s usually tied to one geometry and one discretization choice. A PINN flips the workflow. You represent the solution itself as a smooth function uᵩ(x,t) and you enforce the physics wherever you choose to sample the domain. Most people first meet PINNs in the least helpful way. A pretty solution surface, almost no clarity on what was enforced to make it appear. In this series we keep the enforcement visible. We pick a PDE, represent the unknown solution as a flexible function, measure how badly that function violates the equation across the domain, and train it to reduce that mismatch at the points we sample. A normal neural net learns from labels. You give it inputs and target outputs. A PINN learns from an equation. You give it inputs (x,t), and it gets penalized whenever its output fails the PDE. Smaller mismatch means smaller loss. Bigger mismatch means bigger loss. That’s all “punish” and “reward” mean here. The network isn’t replacing physics. It’s just a flexible function that we force to obey the same calculus you’d demand from any candidate solution. The math breakdown: We start with a PDE on a domain Ω. Write it as uₜ(x,t) + N(u(x,t), uₓ(x,t), uₓₓ(x,t), …) = 0 for (x,t) in Ω A PINN replaces the unknown u with a neural network output uᵩ(x,t) Now define the physics residual by plugging uᵩ into the PDE rᵩ(x,t) = ∂uᵩ/∂t + N(uᵩ, ∂uᵩ/∂x, ∂²uᵩ/∂x², …) If uᵩ were an exact solution, we’d have rᵩ(x,t) = 0 everywhere. We may also have data points (xᵢ,tᵢ,uᵢ) from measurements or from an initial condition. The training objective is a weighted sum of squared errors L(ᵩ) = L_data(ᵩ) + λ L_phys(ᵩ) + L_bc/ic(ᵩ) with L_data(ᵩ) = meanᵢ |uᵩ(xᵢ,tᵢ) − uᵢ|² L_phys(ᵩ) = meanⱼ |rᵩ(xⱼ,tⱼ)|² where (xⱼ,tⱼ) are collocation points in Ω L_bc/ic(ᵩ) = penalties enforcing boundary conditions and initial conditions The key technical step is how we get the derivatives inside rᵩ. We don’t approximate them with finite differences. We compute them with automatic differentiation: ∂uᵩ/∂t, ∂uᵩ/∂x, ∂²uᵩ/∂x², … Then we differentiate the total loss L(ᵩ) with respect to ᵩ and train with gradient descent. That’s the whole idea. Learn a function, but make the PDE part of the loss, so the network is trained to be a solution, not just a curve-fitter. In the render, the main 3D surface is the network’s current guess uᵩ(x,t), drawn as a living sheet over the (x,t) plane. Hovering above is the neural scaffold, a visible graph of feature nodes and connections. The bright tension threads are the physics residual rᵩ(x,t). Each thread tethers a collocation bead on the sheet up to the scaffold, and it thickens and brightens exactly where |rᵩ| is large, with color showing the sign. As training runs, those threads go slack across the domain, not because we hid the error, but because the network has actually been pushed toward rᵩ(x,t) ≈ 0. #PINNs #ScientificMachineLearning #PDE #DifferentialEquations #Optimization #MachineLearning #AppliedMath #ComputationalPhysics

Mathelirium

44,924 次观看 • 9 个月前

MIT FILMED THE LECTURE WHERE THEIR MOST LEGENDARY LINEAR ALGEBRA PROFESSOR EXPLAINS WHY EVERY GPS SIGNAL EVERY MEDICAL SCAN AND EVERY AI MODEL ON EARTH IS SECRETLY SOLVING A PROBLEM THAT HAS NO SOLUTION This is Gilbert Strang, MIT, 18.06 Linear Algebra, lecture 15. The professor whose textbooks sit in over 3,000 universities across 135 countries and whose course has been watched by millions of engineers and mathematicians worldwide. He opens with one claim - when equations have no solution, you do not give up. You solve the closest problem that can be solved. He starts with a vector b and a line through a. The projection of b onto that line is the point closest to b that actually lives on the line. The key is a right angle. The error - the gap between b and its projection - must be perpendicular to a. That one geometric fact produces the entire formula. The projection is a times a transpose b divided by a transpose a. One fraction. The numerator is a matrix. The denominator is a number. Then the projection matrix. Every projection is carried out by a matrix P that multiplies b and lands on the line. That matrix has two properties that define all projections everywhere. First, P transpose equals P - the matrix is symmetric. Second, P squared equals P - project twice and you stay where you are. The first projection moves you onto the line. The second leaves you there. Then higher dimensions. Instead of projecting onto a line, project onto a plane. Instead of one vector a, you have a matrix A with two columns spanning the plane. The error vector must now be perpendicular to both columns - perpendicular to the entire plane. That condition produces one matrix equation. A transpose times the error equals zero. The error lives in the null space of A transpose, which is exactly perpendicular to the column space of A. The four fundamental subspaces appear without being called. Then the formula for n dimensions. The projection matrix is A times A transpose A inverse times A transpose. Strang warns the room not to simplify it by canceling A inverse against A - A is not square, it has no inverse, and the formula cannot be pulled apart. The only case where it simplifies to the identity is when A spans the whole space and the projection is b itself. Watch the moment he applies the formula to fitting a line through three points that no line can pass through. Three equations, two unknowns, no solution. He writes the matrix, writes the right-hand side, and shows that multiplying both sides by A transpose produces an equation that always has a solution. That equation is the foundation of least squares, GPS triangulation, and every regression model trained in 2026. A data scientist I know rewatched this lecture before building a recommendation system from scratch. Said it was the first time the normal equations felt like geometry rather than a formula someone handed down to memorize. Free on YouTube, MIT OpenCourseWare, filmed over 20 years ago. bookmark this and watch later - after this lecture every unsolvable equation you meet will feel like a projection waiting to be found

Lupen

24,677 次观看 • 3 个月前

A woman who spent nine years gluing paper models in a print shop just told a room of physicists their whole field stands on a mistake, one line, no hedging: "Every theory we have takes space and time for granted, like a bagel that forgot it was once a flat sheet of paper." That's Bianca Dittrich. She has a free lecture course that asks one question: what is left of geometry once you quantize it? The answer is: far less than you can picture. Quantum gravity looks like one more field theory. Buried inside is something stranger. Every quantum theory we have puts fields on a fixed stage, flat or curved, and does the physics on top of it. Here the stage itself is the thing being quantized. Your gut reads an atom of spacetime as a tiny grain sitting somewhere. Wrong. It cannot sit anywhere, because it is the somewhere. The move is invisible to human intuition, which is exactly why the people who get anywhere stop asking where the pieces are and start asking what a measurement even means. In 3D the whole thing collapses in a way that should scare you. No matter, no cosmological constant, and gravity is locally flat everywhere. Six degrees of freedom per point, all of them eaten by diffeomorphism symmetry. A field theory that ends up with finitely many real degrees of freedom, sometimes zero. None of it is hidden. Cut a parallelogram out of paper, glue the edges, and you have a torus. Flat everywhere, and yet two numbers survive that no local measurement can see. The lecture is free. Here is the trap: you feel every equation you can solve, every geometry you can draw, as progress. What you cannot feel is the gap you have to cross. Ten to the forty-one, from the Planck scale back up to the world you live in. And crossing it is the only thing that pays. Almost every approach still cannot show it recovers ordinary physics at the far end, and almost everyone quits long before then. The math is free to learn. The nerve to stop trusting your picture of space, that part you still have to bring yourself.

Zyron

111,312 次观看 • 3 个月前

Paul Verhoeven on whether the events that take place in "Total Recall" (1990) are real or just a dream: "It is both. To be honest, that’s what I want. I made the movie in a way that it would be true on both levels, and I spent a lot of time to get that. If you want a scientific explanation, you know, of course, in quantum mechanics there is a very interesting principle, the principle of uncertainty, Heisenberg’s principle. If you have a big object and if you try to measure the place of the object and the velocity of the object at the same time, the more precisely you measure velocity the less precise place gets. So that’s the principle. That means, of course, that there are different realities possible at the same moment. What I wanted to do in 'Total Recall' is to do a movie where both levels are true. I mean for me, of course, the film anyhow has to do with two realities, one being the reality of going as a secret agent to Mars and discovering that there is a problem, and solving the problem, which is starting the nuclear reactor and helping the guerrillas and destroying Cohaagen. The second level of the movie, of course, is that from the moment that he goes into the Rekall chair ‘til the end it’s a dream, and I tried to make that second level work throughout the whole movie. So there’s the dream level which starts when he gets into the chair and the thing is in his neck, and that would go throughout the whole movie, so in the next scene where they say, Oh, there’s a problem, there’s a big glitch here, that would be already the dream, of course. That’s where the dream starts. And the next scene where they are fighting and stuff would be part of his dream, convincing him that it is real, because there is a glitch but that would be part of the program. It would be built into the program to make him accept the fact that it’s real, but it’s a dream. If you look at the movie, if you haven’t seen it, or for the second time, you’ll see that the whole program that’s set up at the beginning when he goes to the Rekall office and he talks to this guy who sells him the program on Mars, you’ll see that he gets everything that he wants: he gets the trip to Mars, he gets the girl, the exotic girl, he ki!!s the bad guys, and he saves the entire planet. That’s what he does. And that’s basically the dream. Even halfway through the movie, you may remember, this other guy comes in, Dr. Edgemar, and tells him that he’s in a dream, that he’s still in the Rekall chair, and then Arnold says, “If I’m there, I can ki!! you.” And he puts a gun to his head and the guy says, “Sure, no problem for me, big problem for you, because you will be psychotic from now on because the walls of reality will fall apart. One moment you will be the savior of the rebel cause, the next moment you’ll be Cohaagen’s bosom buddy, but in the end—you will even have these strange fantasies about alien civilizations—but at the end you will be lobotomized.” And then if you see the movie, you realize that all these things happen. I mean he is lobotomized at the end. That’s why at the last shot, when they are so happy and kissing each other, it slowly fades to white, which for me meant, “OK, there he goes. That’s the end-that’s the dream—they lobotomized him.” And all the other things happened, he finds the alien civilization, he rescues the planet, he finds the good girl, he k!!ls the bad guys, but it’s a dream. Now, of course you can see it as a reality, too. So at the end of the movie, getting to white means either it’s a happy ending or he loses his brains . . . which is probably also a happy ending, I don’t know. That was basically what l wanted—that at the end there would be two possibilities, and they would be both true—for me they are both true—it’s not either one or the other. It’s not that either it’s a dream or it is a reality. It is a dream and it is a reality. And I think they’re both there." (Paul Verhoeven's interview with Chris Shea & Wade Jennings, 1992) P.S: On this day, 36 years ago, "Total Recall" (1990) premiered in Los Angeles, California, USA.

DepressedBergman

66,465 次观看 • 5 个月前

Sometimes the thing that hurts you, isn’t the moment itself, it’s the fact that you keep reliving it. Not once. Not twice. But in patterns that look different outside and feel identical inside. You start wondering why it keeps happening. Why the same fears return. Why the same version of you shows up even when you swore you were done with him. Most people think life moves in a straight line. But the Vishnu Purana says something completely different: “Krita, Treta, Dvapara and Kali, these ages turn like a wheel.” A wheel. Not a timeline. A rotation that keeps circling back until something in you changes. Centuries later, Nietzsche said almost the same thing, his idea of “eternal recurrence.” If you had to live this day again and again, would you be proud of it, or terrified that you’re still choosing the same life? And even modern physics keeps stumbling toward the same shape, cyclic universe models, Big Bangs followed by cosmic “bounces,” universe after universe rising from the ashes of the last. Once you see this, your own life starts making a different kind of sense. You stop blaming fate and start noticing your habits. You stop praying for a new life while living the old one on autopilot. Because you’re not trapped in a cycle. You’re participating in one. So ask yourself, What keeps returning because you haven’t faced it yet? What pattern keeps knocking like a teacher you ignore? What moment repeats because you haven’t shown up differently? In a universe where time moves in circles, even the smallest choice isn’t small. It becomes a pattern. A future. A repetition, or a release. Maybe this is the moment where the wheel comes back around and you finally choose a different version of you. Maybe this is your cycle break.

Wisdom Walk

11,296 次观看 • 11 个月前