
Nick Khami
@skeptrune • 18,905 subscribers
inference @morphllm, you should try to fail faster
Shorts
Videos

introducing an ai agent that handles phone calls for you. you can use it to cancel subscriptions, book medical appointments, dinners, change flights, or anything else possible with a call. most importantly, it works in claude code & codex. i spend most of my time in the terminal, so i want my productivity tools to live there as well. switching to imessage or another app annoys me. i've now handled dozens of tasks over the phone using it & am in love. if you're like me & hate breaking concentration to dial, you'll likely love it as well.
Nick Khami200,201 Aufrufe • vor 19 Tagen

you can make any open source model behave like jev with just a bit of inference engineering. it's shockingly easy. to prove it, we built a new endpoint we're calling deepseek-v4.1-flash-jev. see the demo below. here's how it's done: sglang (an inference engine) offers a scoring endpoint in addition to the normal generation one. in scoring mode, given an input & set of possible answers, it forces the model to produce probabilities for each one. example: > input: what is most common letter in abcccde? > possible answers: a, b, c > output: (c, 0.9), (b, 0.0.5), (a, 0.05) getting the above behavior instead of streamed output is as simple as using sglang's /v1/score endpoint instead of /generate. there's just one other trick required. for deepseek, you have to add a closing think tag before the response. this forces a direct answer instead of a reasoning trace. if you want reasoning, you can do that too, but imo that makes things too slow to be worth it. dsv4.1 flash is not as good as jev, but if we had enough spare compute to experiment with this same approach for a larger model then i think the decision quality would be at least as good, if not better. also, somewhat unrelated, i think decision-making models kill all prospecting & sourcing work. i would have absolutely killed to have jev or similar when i was recruiting Mintlify. absolutely incredible.
Nick Khami105,854 Aufrufe • vor 1 Monat

claude has started to get really damn good at design. this is impressive
Nick Khami249,309 Aufrufe • vor 6 Monaten

inner richmond + golden gate park + devil's teeth + easter in the presidio = a perfect sunday afternoon ☀️
Nick Khami80,158 Aufrufe • vor 6 Monaten

meet scribe! it's like google docs, but for markdown when doing anything with ai, it was a pain in the ass to collab on plan docs & copy for emails/blogs. scribe solves that, it's the best way for humans & agents to collaborate on markdown fully multiplayer. supports code editor shortcuts like ctrl+d and ctrl+shift+arrow for multi-cursor also ships with clean macos/linux desktop apps, skills, & a feature complete API that's accessible to agents i've been using it for the past week and am in love.
Nick Khami36,943 Aufrufe • vor 3 Monaten

watching your CEO ratio a hater has got to be a top five startup experience
Nick Khami65,388 Aufrufe • vor 6 Monaten

hi, Michael and i are starting a low effort podcast and hiring a video editor we're recording once or twice a week, and you should apply. remote, pay is $1500-$3000/mo depending on experience and location our interview process will be entirely proof of work based. dm us with your experience and pitch. you'll be expected to ship the podcast and clips end to end. we care that you've done this before if you're interested, dm me! --- 00:00 SDLC Is Broken: Ship Fast, Kill Faster 10:22 DevRel Is Dead 24:05 Handling Public Criticism: Cursor, Roy Lee & Hacker News 34:07 Composio & the Pain of Agent Integrations 46:30 Jensen's OpenClaw Takes & the Buggy Reality 56:08 Proactive Agents as Autonomous Employees
Nick Khami57,975 Aufrufe • vor 6 Monaten

keeping up with the movement of culture is very difficult back in march, my entire timeline was cheering at the kalanick clip taken in context, han's post makes more sense. the spirit of it is to push until you're uncomfortable with everything you do. unfortunately, the memetic reverberations were not in our favor today. unrelated, austin quality of life is unbeatable. i'm incredibly motivated by the prospect of taking a jetski to the office sf is not the place to live if you want to prio smiling
Nick Khami21,914 Aufrufe • vor 3 Monaten
Keine weiteren Inhalte verfügbar