Function call for Groq 😎 Hey Groq Inc I've developed a proxy server enabling function calls for Groq cloud, couldn't wait for you guys :D, and it has OpenAI interface compatibility. It works seamlessly with libraries like LlamaIndex, LangChain, and my favorite, PhiData. Check out this demo video to... see it in action! Currently in debug mode, If I know this is something helpful for the community then I add stream mode soon, share the GitHub repo release and a live server for free access for public.show more

Woke up and was like "what!!!" seeing the community reactions and interest for the first time 😂 Super glad people are into it. So, I'm gonna jump to release the first version by this week! But after that, I need the community to step in and contribute cuz I can't do it alone 😅 Maybe we'll turn it into a function call proxy for all open source models running locally (ollama) and on GroqCloud. Thx @GroqInc for your active engagement. I will try to create a post and explain my approach for this proxy server.

@GroqInc Awesome 👏. We’re working on function calling but greatly appreciate community contributions in the area!

@GroqInc You're welcome! What Groq does is like bringing electricity everywhere, and in 2024, AI is the electricity. Can't wait for native support, especially for fine-tuning and uploading user's custom models.

@GroqInc This is so cool. We’re really excited about bringing y’all more features. Love seeing the community as excited as we are!

@GroqInc How could it not be, when you're processing 500+ tokens per second in such a deterministic way!! It's like being on steroids! Anyway feel good to contribute here and love being part of speeding up AI.

@GroqInc This is a huge unlock for agents. You could execute multiple function call trajectories and pick the best one, all without waiting a lifetime.

@GroqInc Exactly! Imagine running multiple pipelines all in parallel. You could have a simulated world with tons of agents collaborating at speeds of 500-1000 tokens per second 🤩

@GroqInc Dope will cover this in this weeks #ThursdAI

@GroqInc Appreciate that! Planning to release the first baby version by this week. I'll make a short video to explain the code and ask the community to join and help improve it.

Function Call Proxy Update, Stardate 47457.1! (Guess when is this reference 😉) Hey community & @GroqInc, making progress on the function call. Might release the server early for everyone to test while I polish the code & prep the repo. Oh, and yeah, showing off my monitor 😁