Загрузка видео...

Не удалось загрузить видео

На главную

Blog post - Autoregression vs Diffusion - Understanding Sampling via Optimal Transport Autoregression and diffusion look like opposites. Yet, beneath the implementation details, both are solving the same transport problem: how to turn simple noise into structured data.

20,283 просмотров • 4 месяцев назад •via X (Twitter)

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Another Day, Another Safety Hazard: Is KSRTC Ignoring Basic Maintenance? Is this the new standard of bus maintenance in Karnataka? This KSRTC bus appears to be moving unevenly on the road instead of running straight, raising serious concerns about its condition and maintenance. Public transport vehicles carry hundreds of passengers every day, and even a small mechanical issue can put many lives at risk. The poor condition of the bus clearly reflects a lack of proper inspection and maintenance. If such vehicles are allowed to operate on busy roads, they not only endanger passengers but also other road users. Safety should be the highest priority for any transport authority, yet incidents like this raise questions about whether regular checks are being conducted effectively. The Transport Department and the Transport Minister Ramalinga Reddy must take accountability and ensure that all buses are thoroughly inspected before being put into service. Preventive maintenance is far cheaper than dealing with accidents and loss of life. If an accident occurs due to negligence, who will take responsibility? The authorities cannot continue to ignore these warning signs while citizens risk their safety every day.Public transport should inspire confidence, not fear. Passengers deserve safe, reliable, and well-maintained buses, and the government must ensure that taxpayer money is being used to maintain these vehicles to the highest standards. #bangalore #bengaluru #ksrtc DK Shivakumar Siddaramaiah BJP Karnataka alok kumar DGP KARNATAKA ಕರ್ನಾಟಕ ರಾಜ್ಯ ಪೊಲೀಸ್ Karnataka State Police S. Lalitha ChristinMathewPhilip

Karnataka Portfolio

10,201 просмотров • 3 месяцев назад

Most recent diffusion language model research (that I’ve seen) seems to be using masking as the noising process. It looks like, however, most closed-source models (Google Gemini Diffusion and possibly Inception Labs’ Mercury) use a different noising process, where instead of masking tokens, they replace them with different tokens (either with a random token or a semantically similar token). I wondered how they were getting such high throughput with the latter noising process, since I believed that optimizing inference with KVCache approximation would be more difficult (for various reasons). I visualized this noising process with tiny-diffusion and compared it to normal unmasking, and was very surprised to see how fast the generation “settles” into a reasonable output, and then only slightly refines afterwards, requiring much fewer steps in total. Unmasking (where tokens are never remasked, the typical implementation) is inherently limited in generation speed by the fact that an increase in tokens decoded per step leads to more errors due to the mismatch between individual and marginal token probability distributions we sample from. The token replacement noising process seems to have a much different set of characteristics. Because we sample each token per step, every token makes “progress” towards the final output each iteration (in addition to *potentially* giving other tokens more information in future steps). Generally, masking has outperformed other noising processes, which is probably why most research focused on it (using smaller models). But the paper referred to in the retweet shows that random replacement as a noising process may scale better as model size increases. Big labs might have noticed these results much earlier (due to having drastically more training resources and being able to test larger models), which may explain the discrepancy in the choice of noising process. I’m gonna test this with larger models, since tiny-diffusion only has 10M parameters.

nathan (in sf)

40,440 просмотров • 7 месяцев назад

FACT Check: Conservatives are attacking Biden saying he's requiring Americans Trapped in Israel, who want to leave, sign a promissory note to repay costs? FACTS: This has been US policy for at least 79 years! Although the United States government is requiring individuals who intend to be evacuated sign a promissory note (known as the form DS-5528), this has been a US policy going back to at least 1944. President Trump required those evacuated from foreign nations sign the same note and reimburse costs just like Biden is and all the previous presidents have since 1944. Here's what the US State Department website (which was active during Trump's President says about Form DS-5528? "Generally, individuals evacuated on a U.S. government-coordinated transport, including charter and military flights or ships, even if those transports are provided by another country’s government, must sign an Evacuee Manifest and Promissory Note (Form DS-5528) note prior to departure. The Department of State uses the Form DS-5528 to document who got on which transport, and it lets us know how to contact evacuees for billing purposes. U.S. law requires that departure assistance to private U.S. citizens or third country nationals be provided “on a reimbursable basis to the maximum extent practicable.” By taking a U.S. government coordinated transport, evacuees are obligated to repay the cost of their transportation. The amount billed to evacuees is based on the cost of a full fare economy flight, or comparable alternate transportation, to the designated destination(s) that would have been charged immediately prior to the events giving rise to the evacuation. Because different evacuation transports may go to different destinations, the cost of one transport may be different than another. We encourage people to leave on the first transport they are able and eligible to board." FACTS MATTER. Stop spreading misinformation.

Brian Krassenstein

904,508 просмотров • 2 лет назад

OAU transport system was near perfect, adequate buses and bikes, we rarely experienced queues until the First Lady came and decided she didn’t like the ease of transportation and introduced “change” by donating CNG buses. The school management in turn banned all motorcycles and commercial buses on campus and subjected over 30,000 students to just about 50 buses and a few tricycles. OAU has one of the largest land masses of any Nigerian university, yet students are now stranded daily. This is a Monday morning where students are supposed to rush for class, but they are stuck at the campus gate because of the inefficiency of the CNG buses. Students are struggling to go to class in the morning and in the evenings to even get back to their hostels. Students staying off campus now spend almost double to get to campus, all alternative transport means have been removed The management have cars to bypass all of this, but majority of students do not. Yet they released statements talking about how the buses will “ease transportation” and even implied students appreciate the system. Meanwhile, students are trekking, missing classes, and spending hours in queues. Let it be clear that students do not appreciate this system. It has made our lives harder, not better. What used to be a smooth system has now become a daily struggle. There are many pressing issues in this school, but they chose to dismantle a working transport system and replace it with hardship. We can no longer remain silent. Let the whole world know what OAU students are going through. Please if you come across this tweet, help us retweet it whether you are an OAU student or not We demand our towngboro buses and motorcycles back.

BIG VIRG

126,127 просмотров • 4 месяцев назад