documentation

Linux

Server Setup

Monitoring

htop

htop is a more detailed top

nvtop

nvtop is for monitoring gpu usage. Useful for working out whether an llm is using GPU or memory