Title: LLM Inference  
Author: Faveo Hörold May 21, 2024
Last Changed by: Benjamin Cumming (CSCS) Jun 03, 2025
Tiny Link: (useful for email) https://confluence.cscs.ch/x/Hy7LMg
Export As: Word · PDF  
Incoming Links
Knowledge Base (1)
    Page: ML Tutorials
Hierarchy
Parent Page
    Page: ML Tutorials
Labels
Global Labels (5)
Recent Changes
Time Editor  
Jun 03, 2025 14:51 Benjamin Cumming (CSCS) View Changes
Jan 29, 2025 10:06 Lukas Drescher (CSCS) View Changes
Jul 05, 2024 09:10 Auriane Reverdell (CSCS) View Changes
Jul 05, 2024 07:36 Henrique Mendonça (CSCS) View Changes
remove inline comments
Jun 28, 2024 13:54 Auriane Reverdell (CSCS)  
Outgoing Links
External Links (15)
    https://user.cscs.ch/access/auth/mfa/
    https://www.nvidia.com/en-us/gpu-cloud/
    https://slurm.schedmd.com/overview.html
    https://docs.cscs.ch/guides/mlp_tutorials/
    nvcr.io/nvidia/pytorch:24.01-py3
    https://huggingface.co/
    https://huggingface.co/google/gemma-7b
    https://docs.cscs.ch
    https://podman.io/
    https://docs.docker.com/develop/develop-images/instructions…
    https://confluence.cscs.ch/display/KB/Building+Container+Im…
    https://catalog.ngc.nvidia.com/
    https://docs.docker.com/reference/dockerfile/
    https://huggingface.co/google/gemma-7b-it
    https://huggingface.co/google/gemma-7b#description