This session will dive into the practicalities of deploying LLMs in business settings. We'll explore when to leverage LLMs and address how to minimise the complexity of the problem. Our discussion will guide you through designing an evaluation methodology and detail the circumstances necessitating fine-tuning for optimal performance. We will elaborate on the nuances of training data selection, establishing a flexible training ecosystem, hyperparameter optimisation, scalable training, and finetuning workflows. As part of the practical session, we will go through the ETL process, how to format and structure data for finetuning, and how to organize, save, and manage these datasets. We will demonstrate a few finetuning configurations, show you how to monitor and evaluate your finetuned LLMs, and collect further datasets to improve your finetuned LLM over time.
LLMs in Production: Fine-Tuning, Scaling, and Evaluation
Type: Breakout
Track: Generative AI
Level: Intermediate
Technologies: AI/Machine Learning, GenAI/LLMs
Speakers

Sr. Specialist Solutions Architect, Databricks

Chapter Leader, Data Science & AI, ASB Bank
- Wednesday, Aug 283:30 PM - 4:10 PM AESTBreakout Room 4 (Level 3 Plenary Room)





