Does faster RAM make local LLMs faster? DDR5 speed vs capacity when models spill out of VRAM
Faster DDR5 can make local LLMs much faster in some setups and barely matter in others. The difference comes down to where the model actually runs.
Faster DDR5 can make local LLMs much faster in some setups and barely matter in others. The difference comes down to where the model actually runs.