Building LLM Chatbots with Milvus to Leverage Your Internal Knowledge Base

Attendees will undergo a guided workshop to learn how to: 

• Store their internal knowledge base data on Milvus
• Use Milvus to perform fast vector searches on their data
• Compute embeddings using an LLM embedding model

• We will use MiniLM SBERT model in a Jupyter Notebook running in a Shakudo Session
• Craft a prompt to send to a LLM endpoint for “speaking to their data”
• The LLM we will use runs on Shakudo as a Service
• Use the Shakudo platform, which provides an immediately available, fully managed version of Milvus and easily connects Milvus to other important stack components, including Nvidia Rapids and Dask