正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

So much discussion about whether we should be using Chinese open-source models in the US. But how could they actually hurt us? Matan Grimberg Matan Grinberg breaks down the biggest risks- 1. Intentional vulnerabilities. A model could contain backdoors, sleeper behavior, or other weaknesses deliberately introduced into the weights,... potentially sitting dormant until the right conditions trigger them. 2. Unintentional vulnerabilities. A model built in China will naturally be trained and optimized around Chinese users, codebases, languages, and data. It could perform incredibly well overall while having subtle blind spots or security weaknesses in Western systems that nobody intentionally put there. The third we may not know for years. The most concerning failures might not show up in today’s benchmarks or security evaluations. If models become deeply embedded across companies and infrastructure, vulnerabilities could emerge only after we’ve become dependent on them.show more

Sabrina Halper

15,865 subscribers

17,244 次观看 • 2 个月前 •via X (Twitter)

科学技术财经

Anya Rossi• Live Now

Private livecam show

9 条评论

Sabrina Halper 的头像

Sabrina Halper2 个月前

Full episode on YouTube:

Droid 的头像

Droid2 个月前

@matanSF That's my CEO!

Ashley Jepson 的头像

Ashley Jepson2 个月前

@matanSF the ceo aura is palpable

Rick A.F. 的头像

Rick A.F.2 个月前

I don't know if this true at all tbh. I use deepseek, I have Codex/OpenAI check it with SOL. I mix up models all the time, they collaborate, they change, they code. I don't think there is any hidden stuff like iin this video. Even sleeper behavior does not make sense to me, these models can be hosted locally and can not act alone?

Vikram Angrish 的头像

Vikram Angrish2 个月前

@matanSF Compared to what? Closed source? Total Blackbox?

Sebastian Escarrer 的头像

Sebastian Escarrer2 个月前

@matanSF the debate is stuck on whether to use them. companies already are. the real question is whether anyone deploying them can say what's inside

号角的头像

号角2 个月前

@matanSF 这是个傻逼吗？开源模型的权重全部都是可以审核的，它的架构推理你也可以部署在本地。比模型权重没有开放，系统提示词不明确的，推理过程也是黑盒的，要好很多吧？

Richa Sharma 的头像

Richa Sharma2 个月前

@matanSF The concept of backdoors still fascinates me actually the first time I heard it (was at a party) from @hendrycks . He could be another great podcast guest Sabrina!

sophs b 的头像

sophs b2 个月前

@matanSF Intentional backdoors are a plausible risk, but the bigger threat may be subtle, unintentional biases baked into training data that can't be easily audited. Where's the line between acceptable and unacceptable foreign influence?

相关视频

"It wouldn't surprise me if those Chinese transformers had a back door that could be turned off. We don’t even check them. That is super dangerous, and there are a lot of other vulnerabilities that we haven't even thought about." Vulnerabilities of the Grid with Erik Bethel.

"It wouldn't surprise me if those Chinese transformers had a back door that could be turned off. We don’t even check them. That is super dangerous, and there are a lot of other vulnerabilities that we haven't even thought about." Vulnerabilities of the Grid with Erik Bethel.

Shawn Ryan

94,140 次观看 • 2 年前

“We have a crisis of open source models in the Western world. Outside of China, there are no good open source models. We don't even have any in the US now. The talent, the capital and the focus to be best-in-class at pre-training, mid-training, post-training is an extremely scarce skillset. The answer for a lot of countries may just be to take an open weights model from China, post-train or fine-tune their own version, and have that be what they start from." Everett Randle Why does the West have such poor open source models and is it a national security threat to rely on open-source Chinese models Demis Hassabis Yann LeCun Aidan Gomez Lilian Weng Jan Leike

“We have a crisis of open source models in the Western world. Outside of China, there are no good open source models. We don't even have any in the US now. The talent, the capital and the focus to be best-in-class at pre-training, mid-training, post-training is an extremely scarce skillset. The answer for a lot of countries may just be to take an open weights model from China, post-train or fine-tune their own version, and have that be what they start from." Everett Randle Why does the West have such poor open source models and is it a national security threat to rely on open-source Chinese models Demis Hassabis Yann LeCun Aidan Gomez Lilian Weng Jan Leike

Harry Stebbings

63,738 次观看 • 4 个月前

Aligned with Matan Grinberg's intuition that in the next 12 months, 90% of tokens could be going to open models. We're seeing more and more companies using frontier APIs for experimenting and open-source or private models for production and larger workloads!

Aligned with Matan Grinberg's intuition that in the next 12 months, 90% of tokens could be going to open models. We're seeing more and more companies using frontier APIs for experimenting and open-source or private models for production and larger workloads!

clem 🤗

24,138 次观看 • 4 个月前

The biggest AI companies may be using safety to lock everyone else out of the future (Save this). David Sacks believes that warnings about catastrophic AI risks will build public support for a powerful federal regulator. That regulator may never explicitly ban open source AI. Instead, it could require every advanced model to remain continuously monitored, centrally controlled and capable of being withdrawn. Closed models such as Claude could satisfy those requirements because they operate on company controlled servers. Open weight models would struggle to comply because anyone can download, copy and modify their underlying weights. Once those weights are publicly released, the developer cannot recall every copy, monitor every user or guarantee that its original safeguards remain intact. Anthropic identifies this irreversibility as a legitimate security concern. Applying identical rules to open and closed models could therefore produce very unequal consequences. Anthropic and OpenAI could afford expensive testing, licensing and monitoring requirements, while startups and independent developers might be unable to comply. The eventual result could be a government protected oligopoly dominated by a few closed model companies. There is evidence supporting part of Sacks’ concern. Anthropic advocates mandatory pre-release testing for every sufficiently powerful model, whether it is open or closed, with evaluations focused on cyber, biological and alignment risks. However, Anthropic explicitly denies supporting a blanket ban on open weight models. The company describes open models without dangerous capabilities as a public good and argues that regulation should depend on demonstrated capabilities rather than whether a model is open or closed. Sacks’ strongest argument is therefore about regulatory consequences because safety organizations could receive stronger protections, politicians could acquire greater authority and dominant AI companies could gain an expensive compliance moat. And open source competitors could gradually be eliminated without the government ever formally announcing a ban.

The biggest AI companies may be using safety to lock everyone else out of the future (Save this). David Sacks believes that warnings about catastrophic AI risks will build public support for a powerful federal regulator. That regulator may never explicitly ban open source AI. Instead, it could require every advanced model to remain continuously monitored, centrally controlled and capable of being withdrawn. Closed models such as Claude could satisfy those requirements because they operate on company controlled servers. Open weight models would struggle to comply because anyone can download, copy and modify their underlying weights. Once those weights are publicly released, the developer cannot recall every copy, monitor every user or guarantee that its original safeguards remain intact. Anthropic identifies this irreversibility as a legitimate security concern. Applying identical rules to open and closed models could therefore produce very unequal consequences. Anthropic and OpenAI could afford expensive testing, licensing and monitoring requirements, while startups and independent developers might be unable to comply. The eventual result could be a government protected oligopoly dominated by a few closed model companies. There is evidence supporting part of Sacks’ concern. Anthropic advocates mandatory pre-release testing for every sufficiently powerful model, whether it is open or closed, with evaluations focused on cyber, biological and alignment risks. However, Anthropic explicitly denies supporting a blanket ban on open weight models. The company describes open models without dangerous capabilities as a public good and argues that regulation should depend on demonstrated capabilities rather than whether a model is open or closed. Sacks’ strongest argument is therefore about regulatory consequences because safety organizations could receive stronger protections, politicians could acquire greater authority and dominant AI companies could gain an expensive compliance moat. And open source competitors could gradually be eliminated without the government ever formally announcing a ban.

Milk Road AI

57,724 次观看 • 2 个月前

What happens when AI finds vulnerabilities faster than teams can fix them? Nikesh Arora breaks down how AI could surface long-hidden weaknesses across enterprise systems faster than they can be remediated.

What happens when AI finds vulnerabilities faster than teams can fix them? Nikesh Arora breaks down how AI could surface long-hidden weaknesses across enterprise systems faster than they can be remediated.

Palo Alto Networks

23,076 次观看 • 6 个月前

🚨 BIG BREAKING: MHA reportedly preparing ACTION on Chinese smartphone companies According to sources, user data privacy, data on foreign/Chinese servers, security vulnerabilities and national security are major concerns. If the Govt cracks down, this could be a BIG and much-needed step for India. A MASSIVE GAME CHANGER High time India builds its own strong smartphone ecosystem with hardware, software and security made in India🇮🇳

🚨 BIG BREAKING: MHA reportedly preparing ACTION on Chinese smartphone companies According to sources, user data privacy, data on foreign/Chinese servers, security vulnerabilities and national security are major concerns. If the Govt cracks down, this could be a BIG and much-needed step for India. A MASSIVE GAME CHANGER High time India builds its own strong smartphone ecosystem with hardware, software and security made in India🇮🇳

News Algebra

71,652 次观看 • 3 个月前

"We do not want the standard to become Chinese across the world, or even in China." US Treasury Secretary Scott Bessent tells Jonathan Ferro and Annmarie Hordern the agreement for Nvidia to share revenues from sales of its H20 chip in China is a "unique solution" that could be expanded over time

"We do not want the standard to become Chinese across the world, or even in China." US Treasury Secretary Scott Bessent tells Jonathan Ferro and Annmarie Hordern the agreement for Nvidia to share revenues from sales of its H20 chip in China is a "unique solution" that could be expanded over time

Bloomberg

41,138 次观看 • 1 年前

SITUATION EXPLAINED: What happens to open source when the US restricts access to frontier AI models? We asked Adrian Dittmann: "China is releasing these models [open source] to gain international dominance, people will work on these things and say, 'Hey, maybe I can contribute to this if it's open source.' This is the thing that actually gets them talent." "If you're not allowed into the next GPT release or you're not allowed to use Fable, then what are you gonna do? You're stuck with the existing stuff, or you will have to use an open source model that might have subtly better capabilities." "The United States will catch up to open source in some form as well. They seem to just be maximizing product creation." "The problem with open source models is you have to be kind of a nerd in order to use them properly. Consumer facing, the effects will be minimal because the average person doesn't care about open source models. They only care whether or not they can do a quick search with Gemini or ChatGPT."

SITUATION EXPLAINED: What happens to open source when the US restricts access to frontier AI models? We asked Adrian Dittmann: "China is releasing these models [open source] to gain international dominance, people will work on these things and say, 'Hey, maybe I can contribute to this if it's open source.' This is the thing that actually gets them talent." "If you're not allowed into the next GPT release or you're not allowed to use Fable, then what are you gonna do? You're stuck with the existing stuff, or you will have to use an open source model that might have subtly better capabilities." "The United States will catch up to open source in some form as well. They seem to just be maximizing product creation." "The problem with open source models is you have to be kind of a nerd in order to use them properly. Consumer facing, the effects will be minimal because the average person doesn't care about open source models. They only care whether or not they can do a quick search with Gemini or ChatGPT."

MTS

14,406 次观看 • 4 个月前

🚨 John Solomon Reveals FIVE Foreign Powers Have The Technology To FLIP VOTES On Electronic Voting Machines -China -Russia -North Korea -Iran "There were five foreign powers who could take the known vulnerabilities of the machines and potentially flip votes, China, Russia, Iran, North Korea, and Venezuela" "Nobody acted in the Trump Presidency, at the end of Trump one, or at any time in the Biden presidency to close those vulnerabilities down—So we went through the 2020 election, the 2022 election, and the 2024 election with those same vulnerabilities sitting there." Keep up the great reporting, John Solomon

🚨 John Solomon Reveals FIVE Foreign Powers Have The Technology To FLIP VOTES On Electronic Voting Machines -China -Russia -North Korea -Iran "There were five foreign powers who could take the known vulnerabilities of the machines and potentially flip votes, China, Russia, Iran, North Korea, and Venezuela" "Nobody acted in the Trump Presidency, at the end of Trump one, or at any time in the Biden presidency to close those vulnerabilities down—So we went through the 2020 election, the 2022 election, and the 2024 election with those same vulnerabilities sitting there." Keep up the great reporting, John Solomon

Benny Johnson

122,032 次观看 • 3 个月前

🚨 BREAKING: DHS announces it will be requiring MANDATORY, random AUDITS of paper ballots during the 2026 midterm elections because of major vulnerabilities to tampering and foreign or Chinese involvement in machines — Just the News GOOD! Audit it all! 🔥 Sec. Mullin confirms it: “Voting machines with components manufactured by foreign adversaries introduce significant security risks.” “These vulnerabilities mean that malicious actors could potentially compromise election infrastructure at any stage of the supply chain, even before the machines are assembled or deployed.” “If a component is tampered with during manufacturing, it could serve as a point-of-entry for hackers, allowing for the possibility of synchronized attacks across multiple machines and jurisdictions.”

🚨 BREAKING: DHS announces it will be requiring MANDATORY, random AUDITS of paper ballots during the 2026 midterm elections because of major vulnerabilities to tampering and foreign or Chinese involvement in machines — Just the News GOOD! Audit it all! 🔥 Sec. Mullin confirms it: “Voting machines with components manufactured by foreign adversaries introduce significant security risks.” “These vulnerabilities mean that malicious actors could potentially compromise election infrastructure at any stage of the supply chain, even before the machines are assembled or deployed.” “If a component is tampered with during manufacturing, it could serve as a point-of-entry for hackers, allowing for the possibility of synchronized attacks across multiple machines and jurisdictions.”

Eric Daugherty

313,103 次观看 • 2 个月前

Anthropic's new Mythos AI model has become a flashpoint in the debate over how artificial intelligence could transform cybersecurity, after the company said the unreleased system can find and exploit serious software vulnerabilities

Anthropic's new Mythos AI model has become a flashpoint in the debate over how artificial intelligence could transform cybersecurity, after the company said the unreleased system can find and exploit serious software vulnerabilities

Reuters

51,293 次观看 • 6 个月前

NVIDIA CEO, Jensen Huang, warns that America's lead in AI is far from secure. He breaks down the US-China AI competition into what he calls a "five-layer cake." And while the US dominates some layers, Jensen sees critical vulnerabilities in others... 1) Energy: China has twice as much as the US despite a smaller economy. Which "makes no sense" to Jensen. 2) Chips: The US is "generations ahead," but Jensen warns against complacency. "Anybody who thinks China can't manufacture is missing the big idea." 3) Infrastructure: Standing up a data center in the US takes about three years. In China? "They can build a hospital in a weekend." 4) Models: US frontier models are "unquestionably world class," but "China is well ahead, way ahead on open source." 5) Applications: Public sentiment differs sharply. Ask both populations whether AI will do more good than harm, and "in their case 80% would say AI will do more good than harm. In our case, it'd be the other way around." Jensen's warning is clear. Leading in chips and frontier models isn't enough when you're behind on energy, infrastructure speed, open source, and public trust. Winning the AI race requires strength across the entire stack, and right now, the US has work to do.

NVIDIA CEO, Jensen Huang, warns that America's lead in AI is far from secure. He breaks down the US-China AI competition into what he calls a "five-layer cake." And while the US dominates some layers, Jensen sees critical vulnerabilities in others... 1) Energy: China has twice as much as the US despite a smaller economy. Which "makes no sense" to Jensen. 2) Chips: The US is "generations ahead," but Jensen warns against complacency. "Anybody who thinks China can't manufacture is missing the big idea." 3) Infrastructure: Standing up a data center in the US takes about three years. In China? "They can build a hospital in a weekend." 4) Models: US frontier models are "unquestionably world class," but "China is well ahead, way ahead on open source." 5) Applications: Public sentiment differs sharply. Ask both populations whether AI will do more good than harm, and "in their case 80% would say AI will do more good than harm. In our case, it'd be the other way around." Jensen's warning is clear. Leading in chips and frontier models isn't enough when you're behind on energy, infrastructure speed, open source, and public trust. Winning the AI race requires strength across the entire stack, and right now, the US has work to do.

Big Brain AI

59,540 次观看 • 10 个月前

“AI MODELS COULD BECOME 10× SMALLER WITHOUT LOSING MOST OF THEIR INTELLIGENCE.” Mark Zuckerberg says one of the most powerful developments in AI is model distillation: taking the capabilities of a much larger model and transferring them into a much smaller one. - Meta's huge frontier models can serve as "teachers" for smaller models. - Zuckerberg says a model could potentially retain around 90–95% of the larger model's intelligence while being only ~10% of its size. - That means dramatically lower inference costs, memory requirements and computing power. - Developers can distill and customize these capabilities for their own applications. And that's where open-source models come into the picture.

“AI MODELS COULD BECOME 10× SMALLER WITHOUT LOSING MOST OF THEIR INTELLIGENCE.” Mark Zuckerberg says one of the most powerful developments in AI is model distillation: taking the capabilities of a much larger model and transferring them into a much smaller one. - Meta's huge frontier models can serve as "teachers" for smaller models. - Zuckerberg says a model could potentially retain around 90–95% of the larger model's intelligence while being only ~10% of its size. - That means dramatically lower inference costs, memory requirements and computing power. - Developers can distill and customize these capabilities for their own applications. And that's where open-source models come into the picture.

SciTech Era

77,374 次观看 • 3 个月前

Amp CEO, Quinn Slack on why he thinks Kimi K3 could be a Sputnik moment for America: "With GLM 5.2 we had a mini Sputnik moment. When the Soviet Union launched a satellite into space before the US and we realized we have to catch up." "Kimi K3 I need to go and see, but that could be an even bigger Sputnik moment that wakes us up and will probably create a lot of good effects in terms of catalyzing the understanding of AI as a strategic advantage for the US rather than as something people should be against." "But I think it could also scare a lot of people, and I can understand why they'd be scared." "The worst possible outcome could be that open models are banned or are banned from certain industries or companies in the US. There's a lot of people in lobbying organizations in Washington DC, and a lot of people in various parts of the government that want to do that." "They want to say, we won't let these models trained in China be used in the US. There's a lot of people trying to do that now, and that would make us all worse off. I'm pretty nervous about that." Quinn Slack Amp

Amp CEO, Quinn Slack on why he thinks Kimi K3 could be a Sputnik moment for America: "With GLM 5.2 we had a mini Sputnik moment. When the Soviet Union launched a satellite into space before the US and we realized we have to catch up." "Kimi K3 I need to go and see, but that could be an even bigger Sputnik moment that wakes us up and will probably create a lot of good effects in terms of catalyzing the understanding of AI as a strategic advantage for the US rather than as something people should be against." "But I think it could also scare a lot of people, and I can understand why they'd be scared." "The worst possible outcome could be that open models are banned or are banned from certain industries or companies in the US. There's a lot of people in lobbying organizations in Washington DC, and a lot of people in various parts of the government that want to do that." "They want to say, we won't let these models trained in China be used in the US. There's a lot of people trying to do that now, and that would make us all worse off. I'm pretty nervous about that." Quinn Slack Amp

MTS

58,660 次观看 • 4 个月前

BURN AND BURY: Burner phones had to be deployed and DESTROYED completely by U.S. delegation members traveling to China with President Trump to survive Beijing's extreme espionage threats. Ainsley Earhardt: “I have sources that are on the plane... They had to leave their American phones, turn them off. They did not take them into China. Or if they did, they left them on the planes... All the Americans were using burner phones and they had to destroy them and leave them in China.” “They don't want anything that belongs to the Chinese on that plane because they could be bugged. There could be spies... The security was so tight, apparently, at the hotels and in their rooms.”

BURN AND BURY: Burner phones had to be deployed and DESTROYED completely by U.S. delegation members traveling to China with President Trump to survive Beijing's extreme espionage threats. Ainsley Earhardt: “I have sources that are on the plane... They had to leave their American phones, turn them off. They did not take them into China. Or if they did, they left them on the planes... All the Americans were using burner phones and they had to destroy them and leave them in China.” “They don't want anything that belongs to the Chinese on that plane because they could be bugged. There could be spies... The security was so tight, apparently, at the hotels and in their rooms.”

FOX & Friends

395,257 次观看 • 6 个月前

REPORT: Secret Chinese tech has been found inside U.S. solar equipment—and U.S. investigators say it could shut down the entire power grid. For the past nine months, these investigators have uncovered rogue communication devices buried in solar inverters and batteries made in China. These hidden parts were NOT listed in the manuals. But once investigators tore them open, they discovered a secret way to bypass security and take control remotely. If triggered, these backdoors could shut down power systems, damage the grid, and cause BLACKOUTS across the country, officials warned. Rep. August Pfluger said the CCP “stops at nothing” to break into our critical systems. “It’s about time we ramp up our efforts to show China that compromising us will no longer be acceptable,” he added. The threat is so serious, two senators introduced a bill to block these components. But it’s still sitting in committee—going nowhere. Because when the lights go out, it won’t just be your power—your country’s defenses go out with it. And you can understand how scary that is. Watch the full breakdown with .

REPORT: Secret Chinese tech has been found inside U.S. solar equipment—and U.S. investigators say it could shut down the entire power grid. For the past nine months, these investigators have uncovered rogue communication devices buried in solar inverters and batteries made in China. These hidden parts were NOT listed in the manuals. But once investigators tore them open, they discovered a secret way to bypass security and take control remotely. If triggered, these backdoors could shut down power systems, damage the grid, and cause BLACKOUTS across the country, officials warned. Rep. August Pfluger said the CCP “stops at nothing” to break into our critical systems. “It’s about time we ramp up our efforts to show China that compromising us will no longer be acceptable,” he added. The threat is so serious, two senators introduced a bill to block these components. But it’s still sitting in committee—going nowhere. Because when the lights go out, it won’t just be your power—your country’s defenses go out with it. And you can understand how scary that is. Watch the full breakdown with .

The Vigilant Fox 🦊

192,758 次观看 • 1 年前

Palantir cofounder Joe Lonsdale says Chinese AI models are "dangerous": "If this Chinese model sees that you're working for the US government, it actually makes your code more vulnerable. We've seen this many times over time." "I was against China being able to go on TikTok and program socialism or whatever else into our young people, I also don't want China's AI to go into our companies and be able to program whatever vulnerabilities other kinds of secret things they're going to do there." "We have to be very careful about the Chinese models." Via Liz Claman FOX Business

Palantir cofounder Joe Lonsdale says Chinese AI models are "dangerous": "If this Chinese model sees that you're working for the US government, it actually makes your code more vulnerable. We've seen this many times over time." "I was against China being able to go on TikTok and program socialism or whatever else into our young people, I also don't want China's AI to go into our companies and be able to program whatever vulnerabilities other kinds of secret things they're going to do there." "We have to be very careful about the Chinese models." Via Liz Claman FOX Business

Jawwwn

42,893 次观看 • 3 个月前

🚨 Brandon Judd says “It’s Going to be Bad” when we learn why there are so many Illegal Chinese Military Aged Men in the US • Q: How do Chinese get out of China? —— A: They don’t have the money to get out of China… The cartels fund and smuggle them out of China. —— they pay the cartel back through slave labor, sex work, etc • Q: What about the military aged Chinese men? —— A: We don’t know what their purpose is here in the United States, but it’s going to be bad • Q: Do you believe the Chinese military aged men are being sent here by China? —— A: We believe so, yes. “Whether they’re spying on us or laying in wait… for some other purpose, we just don’t know.” Q: Does anyone monitor them or know where they are? —— A: No… when these people were released, we lose complete contact with them, unless they show up to their court appearances, which the majority of them do not.

🚨 Brandon Judd says “It’s Going to be Bad” when we learn why there are so many Illegal Chinese Military Aged Men in the US • Q: How do Chinese get out of China? —— A: They don’t have the money to get out of China… The cartels fund and smuggle them out of China. —— they pay the cartel back through slave labor, sex work, etc • Q: What about the military aged Chinese men? —— A: We don’t know what their purpose is here in the United States, but it’s going to be bad • Q: Do you believe the Chinese military aged men are being sent here by China? —— A: We believe so, yes. “Whether they’re spying on us or laying in wait… for some other purpose, we just don’t know.” Q: Does anyone monitor them or know where they are? —— A: No… when these people were released, we lose complete contact with them, unless they show up to their court appearances, which the majority of them do not.

MJTruthUltra

2,389,119 次观看 • 1 年前