Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

AI chat sample now streaming the chat replies across multiple browsers and can work with multiple replicas by publishing the chat stream via Redis (saving the full message to the db). Still very chatty (pun intended) and inefficient but fun to build! The video shows how aspire can amplify...

13,320 Aufrufe • vor 1 Jahr •via X (Twitter)

9 Kommentare

Profilbild von dinko_pavicic
dinko_pavicicvor 1 Jahr

Wonder if Orleans could be feasible for this? For example, to have a chat room grain that stores last xx messages in the grain state. Since grain, when activated stays in the memory for some time could be similar to Redis? For older messages, query the db through grain.

Profilbild von Nima
Nimavor 1 Jahr

Probably overkill but try Orleans, no need for redis, simpler architecture.

Profilbild von Mcs
Mcsvor 1 Jahr

Do you have this sample code in a repo?

Profilbild von Ben Morris
Ben Morrisvor 1 Jahr

Realtime apps are fun. My little side project is similar .NET 9/redis/SignalR live chat app, built loosely over OpenAI assistants API. How are you handling user sending 2nd message while current one is processing?

Profilbild von David Fowler
David Fowlervor 1 Jahr

Before the latest change I was using a semaphore, but now that I moved to redis that’s not currently blocked. I need to reimplement mutual exclusion ( I also need to implement cancellation of the steam.

Profilbild von Theo Albers '67
Theo Albers '67vor 1 Jahr

I used your repo on a brand new home pc. I had issues with podman, networking, but the Aspire part, getting started with another one's repo, worked like a charm.

Profilbild von Greg Kedzierski
Greg Kedzierskivor 1 Jahr

There's no way to get a trace starting from the client app, right?

Profilbild von David Fowler
David Fowlervor 1 Jahr

You can. I just didn’t do it.

Profilbild von ZeBobo5
ZeBobo5vor 1 Jahr

Time to fine tune your model on Aspire deployment ?

Ähnliche Videos