Event box

Introduction to LLMs and Inference on UVA HPC

Introduction to LLMs and Inference on UVA HPC

This workshop will cover an introduction to LLMs and how to use them for inference on UVA HPC systems. Hands-on exercises will be included in the workshop. We will cover LLM set up/installation, HPC resource allocation, model selection from a hub such as Hugging Face, using LLMs for inference, and creating Slurm scripts for LLM jobs.

For UVA users only. An HPC account is recommended. You should be familiar with Python and general HPC concepts. Familiarity with LLMs will be helpful but is not necessary.

 

Date:
Thursday, February 13, 2025
Time:
10:00am - 12:00pm
Categories:
Data Workshop Data Workshop > Research Computing Data Workshop Workshop
Presenter:
Kathryn Linehan

Registration is required. There are 43 seats available.


Click to add to your Calendar! >> Add to a Calendar using iCal
The UVA Library is committed to hosting library events that are inclusive and welcoming to all. If you need certain accommodations to participate fully in this event, please contact libevents@virginia.edu.

Event Organizer

Kathryn Linehan
Ricky Patterson