[Video Tutorial] Lemonade Server: Local LLM Serving with GPU and NPU Acceleration

mqdefault_6s

In this video, we introduce Lemonade Server - a powerful tool that lets you deploy local large language models (LLMs) directly on your PC. With support for industry-standard APIs, Lemonade Server easily connects to a wide range of applications, enabling you to replace cloud-based LLMs with fast, private, local alternatives.

:wrench: What You’ll See

  • How to install and set up Lemonade Server
  • Downloading, managing, and prompting LLMs
  • Exploring key resources: GitHub repo, documentation, model details, and featured apps

:desktop_computer: Test Setup
We demonstrate everything using an AMD Ryzen™ AI 395+ Mini PC with 128GB of RAM, showcasing the performance and flexibility of local inference.

Whether you’re a developer, researcher, or enthusiast, this walkthrough will help you get started with local LLMs in minutes.

:movie_camera: Watch the full video: https://youtu.be/mcf7dDybUco?si=9obBpEqeayy0ac4_

Links Referenced in the Video:
Lemonade Server: https://lemonade-server.ai
Local LLM Servers: https://lemonade-server.ai/docs/serve…

Find the resources you need to develop using AMD products: https://www.amd.com/en/developer.html