Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Today we’re launching Model Vault — a dedicated, fully managed platform to run Cohere models securely and at scale. Model Vault delivers the control and isolation of self-hosting, without the operational burden: 🔒 Dedicated, isolated VPC ⚡ No noisy neighbors or rate limits 🔁 Elastic inference with predictable performance...

29,358 Aufrufe • vor 5 Monaten •via X (Twitter)

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Santiago

164,162 Aufrufe • vor 2 Jahren

We made a thing! Very happy to announce sqlcoder-pro and the Defog Alignment Platform. Available to use immediately without a wait-list, weights will be open-sourced very soon. The video does a quick show and tell comparison against ChatGPT (with gpt-4o). Read on for more details! TLDR 💪 equal (or better) performance on text-to-SQL as the most capable Claude-3.5 or GPT-4 models 🤝 You can use it today on a free plan/free trial, without a waitlist 🪽 self-hostable on a single RTX4090, with 2 second median generation times for SQL queries 🔁 exactly the same output every time, give the same prompt 👨🏻‍🏫 teachable and steerable: show the model what you want it to do 🛞 debuggable – you can understand WTF is going on inside the model, instead of treating it like a black box Let's dig into each of these one-by-one! Performance SQLCoder-8b-pro significantly exceeds the performance of our previous sqlcoder-8b model on Postgres text-to-SQL (from 88.2% to 90.2% accuracy - gpt-4o is at 87.6%, for reference). It is also better at following instructions. This was done via self-merges, hand crafted fine-tuning data, and adapting the training data to fit our tokenizer. Cost You can host this on the model on a single $3,500 RTX4090, and support ~5 requests/second via VLLM. If you're looking to host on the cloud instead, you can run it on a single L4 GPU that costs $300/mo on GCP Repeatability We have a dense 8b model with no MoE shenanigans. For the same prompt with temperature=0, you'll always get the same answer – which is critical in BI. Teachable In our alignment and feedback modes, you can give the model feedback on how it answered certain questions, and it will automatically adapt to the feedback. Debuggable You can use logprobs and attention scores to determine where, exactly is the model paying attention to inside a prompt + what it's getting confused by when generating outputs. Available today You can use Defog on the cloud today by going to docs[dot]defog[dot]ai, and getting an API key. Excited to hear what you think!

Rishabh Srivastava

13,460 Aufrufe • vor 1 Jahr

Here’s my written & video review of the new 2026 Tesla Model Y Performance after driving it for a week. This is the best-value new Tesla you can buy. Crazy performance, no real drawbacks, and all for just $57,490. Let’s dive in. Price: I haven’t seen many others mention this: every option on the Model Y Performance is included at no extra cost in the US (except FSD). So if you spec a Model Y Premium AWD with an upgraded paint color, tow package, white interior, and upgraded 20" wheels, a fully loaded Model Y Premium AWD ends up only about $2,500 less expensive than a fully loaded Model Y Performance. Ride Quality: I thought I might feel worse ride quality vs my Premium AWD Model Y with 20" wheels, but I struggled to find any real difference, despite the larger 21" wheels, firmer suspension setting, and 0.6" lower ride height on the Performance trim. A true testament to Tesla's engineering magic on this thing. Exterior Design: Unlike the previous Model Y Performance, Tesla made some exterior design tweaks with a new front and rear fascia to spice things up a bit. The result, in my opinion, is the best-looking Model Y trim you can buy. It definitely has a more aggressive presence in person, even if it's subtle. The carbon-fiber spoiler boosts high-speed stability and cuts aerodynamic drag by 10%. The new 21’’ Arachnid 2.0 wheels look fantastic in person, one of my favorite designs ever from Tesla. Staggered wheel and tire fitment provides better grip and steering. The beefier 275mm rear tires (255mm in the front) give the vehicle a better stance from behind. Vehicle-to-Load (V2L): For the first time on a Model Y in North America, you can now plug in anything you want to the exterior charge port with an adapter, even a campsite! It provides up to 2.4 kW of power (120V at 20A) from two household outlets. It's a great feature. Interior: It’s what you know and love, but with a few changes that elevate the ownership experience. New with the Performance is a larger 16" center screen (vs. 15.4" on non-Performance models), with thinner bezels and higher resolution. It’s not a huge difference on paper, but you definitely notice it in daily use. The carbon-fiber décor on the door cards and dash is a nice touch, though I would like to see it extended to the center console. The new performance seats are the best seats of any Tesla I've ever experienced. While they retain aggressive bolstering in the torso area, the bottom seat cushion has less aggressive bolstering than on the Model 3 Performance seats, making it easier to get in and out. It also doesn’t squeeze your thighs too tightly. The powered thigh extenders add comfort on longer drives, especially for taller people who want extra support. And of course, they’re heated and ventilated. The headrests also feel more comfortable than the ones in my Model Y. I want these seats. Unlike the old Model Y Performance, the new one has no Track Mode. Why? Because nobody used it lol. No point in putting engineering resources into something people won’t use. The refreshed Model 3 Performance still has it, though. Cabin Quietness: Despite the thinner-profile tires, there is no noticeable difference vs my Premium Model Y. Decibel reading results at highway speeds were visually the same compared to my 2026 Model Y Premium (65-66). Driving Impressions: It’s amazing. Sharp, precise, and agile. The vehicle feels stable at all times. Acceleration is blistering (3.3s 0–60 mph), with plenty of punch even at higher speeds. The tires offer good grip, and cornering is fantastic for an SUV. The suspension setup is great. More steering wheel feedback would be nice, though. Cruising around traffic is a joy. The brakes are much improved over the previous Model Y Performance and are far better suited for spirited driving. There are three acceleration modes: Chill, Standard, and Insane. Just stay in Insane. You’d be insane not to lol. The car also lets you switch between two ride and handling modes: Standard and Sport. The difference isn’t huge, but Standard is better if you’ve got passengers. FSD: I unfortunately wasn’t able to get FSD V14 on this car. It had V13.2.9, so I didn’t use it much. But in the little time I did, it was smooth and comfortable. It didn’t bother me because V14 will perform just as well here as it does on my 2026 Model Y Premium AWD. Conclusion: You won’t find another new SUV today that offers this level of performance for the price. Back in 2022, when Tesla couldn’t build Model Ys fast enough, a fully loaded Model Y Performance cost over $90,440. Today, the refreshed and far more capable 2026 Model Y Performance is just $57,490 fully loaded, and you can simply subscribe to FSD for $99/month. The 2026 Model Y Performance delivers utility, great performance, comfort, tech, self-driving and everything else people love about the Model Y. It’s a no-brainer purchase. I want one badly, but I'll need to show restraint, as I’m saving up for a house lol.

Sawyer Merritt

222,856 Aufrufe • vor 7 Monaten