AI Engineer Foundation

🚀 Last month I participated in the Voice & Multimodal Hackathon by AI Engineer Foundation where I met Damien M. from Deepgram I believe that voice is the future of AI, and this hackathon was the perfect opportunity to explore that idea. With Michał Miszczyszyn we used the Vercel Generative UI demo and added voice features using Deepgram on top of it. We also switch the LLM interaction from Gemini to Groq for faster responses. 👉 Now, you can book flights, buy books, or schedule medical visits using just your voice! One big challenge was making sure the voice interface was fast enough to feel natural. Luckily, Damien Murphy, one of the judges, was there to help us. He shared some great tips and pointed us to the Deepgram docs. Thanks to Damien’s help, we got the voice interface working really well, and we saw just how powerful Deepgram is! After the hackathon, we recorded an interview to talk more about the future of voice in AI.

Excited! Come thru! Eat Sushi.

join us at this hackathon if you're in SF. It will be centered around webRTC, one of the technologies that will help every AI engineer create snappy user experiences for their end users.

Last Saturday (on 02/24/24), Sasha organized an OSS Function Calling + RAG Hackathon with our amazing sponsors: Fireworks AI and LlamaIndex (Platinum), Vectara and e2b.dev(Gold) and AgentOps.ai and Staf.ai (Silver) and pebblebed (Location Sponsor) Here are the results: First place ($3500): Jolly Journey by Emin, Campbell, and Kate, see their post here: https://lnkd.in/guM44zcV Second place ($1000): Juke Box by Omar Salim and Zak Elhjouji - Bridging the gap between AI and average humans that don't necessarily have access to smart device. Making LLMs more accessible to those who might not even know how to use a computer. You can call a phone number and be greeted by Frank Sinatra (Or any voice you like). It's like a dial-a-tone format where you can talk to them and ask them to play your favorite music pulled from Youtube. You can share feelings you have or very abstract queries and it can look up the lyrics that match it based on embeddings. Third place ($500): Drone Vision by I Yosun Chang and Sagar - natural language function calling for your drone from your vision pro. LlamaIndex/Vectara Prize Category: Get Me Job by Dylan, Hiroaki, Ullas Terakanambi, Hui-Kang. Crawled 1200 job descriptions on Lever; Parsed the job description with Fireworks function calling and indexed the result on Vectara; Use LlamaParse to parse the user uploaded resume; Used GPT-4 function calling to parse the resume; Used fields such as years of experience and education attainment to filter job description; Used semantic matching to rank the most relevant job descriptions for the resume. Grateful to our well represented judges: * Judges from Sponsor Companies: Raymond, Dmytro, Jerry, Ofer, Jakub * Judges from Startups: @swyx, Shreya, cora, Melissa, Omoju * Judges from Venture: Jennifer, Stephanie Hackathon Reflection by Sasha: https://lnkd.in/gUG4_gUs

This Saturday (2/24), the biggest hackathon in all of San Francisco: AI Engineer Foundation hackathon focused on Function Calling + RAG. It is held in the Arena in San Francisco. We have already reached MAX capacity in under 1 week of planning. The energy is insane! Thank you so much to our sponsors and our judges for making this happen. Sponsors: Platinum Sponsors: Fireworks AI, LlamaIndex Gold Sponsors: e2b.dev, Vectara Silver Sponsors: AgentOps.ai and Staf.ai Judges: Dmytro Dzhulgakov, Pawel Garbacki, Jerry Liu, Jennifer Kaehms, Stephanie Sher, Omoju Miller, @Swyx, Shreya Rajpal, cora kyler, Pamela Vagata, Jakub Novak, Ofer Mendelevitch https://lnkd.in/gcX2zHjd?

Hackathon next week Feb 24th, 2024 in the heart of SF! Calling all OSS developers and hackers.