Self-hosted LLMs: Why and How

(ET)

Attendees will learn:

  • The high-level difference between self-hosted and managed LLM services
  • Common reasons to move from managed to self-hosted
  • Common pitfalls/challenges in working with self-hosted models
  • A few example workflows involving product development based on self-hosted LLMs
  • How Shakudo covers a lot of the challenges, letting users focus on developing impactful products while reaping the benefits of a self-hosted LLMs