I changed two settings in my local AI setup, and stopped needing more VRAM
Is your GPU to blame, or your runtime's defaults?
This is a summary aggregated from XDA Developers. Read the complete article on the original site:
Read full article at XDA Developers