Iterating... Evals take time and are boring: but are... a fundamental validation step of sane LLM inference. Let's try to make them as easy and fun to run as possible.show more

Unpopular opinion: Most agent evals are theatre. You run... them once before the deployment. It'll take 800ms+ as another LLM would be judging your LLM. Most annoying part - no one tells where in the chain things went wrong. I wasted a lot of time in this loop. And then I came across Future AGI bringing 5 different tools under one umbrella, best part - the platform is completely open source. They open sourced their entire platform and the eval layer is noticeably different. It is multimodal - works on everything text, image, audio, pdf. Not an LLM-as-judge adding latency but an agent with memory and tools. The biggest win are learned classifiers trained on actual production failure patterns to run evals at low cost. It also runs across the full reasoning chain, not just the final response. Check out → Try it here →show more

okay I've made these available to preorder, these are... limited and I don't know if I'll be making anymore after this batch as they take a lot of time and effort lmao. however I will try and make some of the Breach ones to go with them next |-/show more

Would you? Could you? Challenge your balance and speed... with the thrilling water stone run! These stones dip into the water if you linger too long, requiring quick reflexes and steady footing to make it across. A fun and exciting test of agility and balance-can you master the art of running on water stones? This looks fun, but things are never as easy as they look.show more

NEFERTITI Something as irrelevant and as incompetent as Tulumbu... dey talk and you wan make human being take notes??? Like WTAF are you expecting him to write? Balablue? Dasindasundagoden? Make u na try dey pity pesin o!show more

“When I step onto the pitch, I try to... manage my emotions as much as possible to be clinical. And of course, when you score or assist, there are some emotions that come in — but they go away just as quickly because you have to immediately focus on the next play. So you enjoy the moment, but it’s extremely quick.”show more

It's amazing that women are actually confused as to... why men don't approach them and flirt them anymore. All you had to do was be sane.show more

A million children once lived here. They are lying... about the dead and the plan was never to expel, but to murder as many as possible because Palestine only exists as long as there are Palestinians. They will leave a small amount and claim to "safely evacuated 2 million people."show more

TRUMP: The U.S. will run Venezuela. “We are going... to run [Venezuela] until such time as we can do a safe, proper, and judicious transition [of power.]”show more

Trump on Venezuela: We are going to run it... essentially until such time as a proper transition can take place.show more

Tutorial Time: Run any open-source LLM locally. Now we... will run an LLM on your M1/2 Mac. And its fast. All you need is moved to: @lmstudio let's get started. Good to be back. A threadshow more

🐾 Trying to follow in mom’s footsteps isn’t always... easy… but our red panda boys are figuring it out one step (and stumble) at a time.show more

A little girl in a bomb shelter in Israel... is going from dog to dog and petting them to make them calmer, as they are afraid of the sirens and explosions. I love this.show more

60yds+ 5.3’s+ are easy these days when I have... so much time to punt and workout as a free agent lolshow more

Elon Musk: “Spend less time on finance, in conference... rooms and on PowerPoint, and more time just trying to make your product as amazing as possible.”show more

hello i have watched the entire episode of the... bbc reality show where british people are dropped in vancouver and asked to get to haida gwaii as fast as possible without flying or having phones/computers to guide them and it is just as wonderful as i hopedshow more

👤: stray kids really took it one step at... a time, step by step to get to where they are now to become world stars 💬: usually groups like that tend to last a long time 🐶: if you ask me what my goal is, i always say that it's not about results or visible value but i want to keep going for as long as possibleshow more