Multi-GPU LLM Inference
An introduction to using LLMs for inference using multiple GPUs. Basic knowledge of using LLMs for inference is required. Example scripts will be provided.
For UVA users only. An HPC account is recommended. Familiarity with Python and LLMs is also required.
- Date:
- Tuesday, June 3, 2025
- Time:
- 2:00pm - 4:00pm
- Categories:
- Data Workshop Data Workshop > Research Computing Data Workshop Workshop
- Presenter:
- Marcus Bobar & Kathryn Linehan
Click to add to your Calendar! >> Add to a Calendar using iCal
The UVA Library is committed to hosting library events that are inclusive and welcoming to all. If you need certain accommodations to participate fully in this event, please contact libevents@virginia.edu.