Data + AI World Tour
Databricks
  • Home
  • Sponsors
  • Sessions
  • Support

Data + AI World Tour Sydney

Thank you for a great Data + AI World Tour - we look forward to seeing you next year! If you missed the event, you can attend our virtual event on 12 December.

28 August 2024 | Hilton Sydney

View All SessionsView All Sessions
LLMs in Production: Fine-Tuning, Scaling, and Evaluation

This session will dive into the practicalities of deploying LLMs in business settings. We'll explore when to leverage LLMs and address how to minimise the complexity of the problem. Our discussion will guide you through designing an evaluation methodology and detail the circumstances necessitating fine-tuning for optimal performance. We will elaborate on the nuances of training data selection, establishing a flexible training ecosystem, hyperparameter optimisation, scalable training, and finetuning workflows. As part of the practical session, we will go through the ETL process, how to format and structure data for finetuning, and how to organize, save, and manage these datasets. We will demonstrate a few finetuning configurations, show you how to monitor and evaluate your finetuned LLMs, and collect further datasets to improve your finetuned LLM over time.

Type: Breakout
Track: Generative AI
Level: Intermediate
Technologies: AI/Machine Learning, GenAI/LLMs

Speakers

Brian Law

Sr. Specialist Solutions Architect, Databricks

Sam Hambling

Chapter Leader, Data Science & AI, ASB Bank

  • Wednesday, Aug 283:30 PM - 4:10 PM AEST
    Breakout Room 4 (Level 3 Plenary Room)
Databricks
  • Youtube
  • X
  • Event Terms
  • Privacy Notice
  • Your Privacy Choices
  • Your California Privacy Rights

Apache, Apache Spark, Spark, and the Spark logo are trademarks of the Apache Software Foundation. The Apache Software Foundation has no affiliation with and does not endorse the materials provided at this event.