Skip to content

Fine-tuning LLMs with QLoRA

Introduction Open-source base LLMs, like Facebook’s LLaMA or Microsoft’s Phi models, provide an excellent starting point for natural language processing tasks. Typically, however, these models aren’t well-suited for domain-specific tasks; developers must fine-tune a subset of the model’s weights to… Read More »Fine-tuning LLMs with QLoRA