Adapting AIM LLMs For Specific Use Cases Through Fine-Tuning in AMD AI Workbench

In this blog, you will learn how to fine-tune a pre-trained Large Language Model (LLM) with AMD AI Workbench without writing a single line of code and then deploy it using AMD Inference Microservices (AIMs).

Rather than training a model from scratch, fine-tuning allows you to adapt a pre-trained model to your specific use case. In addition, AIMs provide standardized, portable inference microservices for serving AI models. AIMs abstract away the complexities involved in model serving by providing an intelligent orchestration layer that automatically configures runtime environments, detects available accelerators, and selects an optimized performance profile (configuration parameters for the inference engine).

First, we will discuss why you might want to fine-tune a model. Then, we will guide you through a real fine-tuning workflow in the AMD AI Workbench GUI:

  1. Uploading a dataset

  2. Selecting a model

  3. Configuring training parameters

  4. Running the training job

  5. Deploying the model as an AIM

At the end of the blog, you will have your own fine-tuned model deployed and ready to try out, and you will be ready to start your own experiments.

Read the blog here: Adapting AIM LLMs For Specific Use Cases Through Fine-Tuning in AMD AI Workbench — ROCm Blogs

1 Like