Error

Not enough memory to run the model

The model and its context do not fit in the memory available, and how to make them fit.

What it means

A model needs room for its weights and for the context it is working through, in your graphics card's memory or, without one, in system memory. The engine asked for more than was free and was refused.

What to do

  • Choose a smaller model, or a smaller quantization of the same one. The tables in the wiki show what fits which hardware.
  • Lower the Context window in Settings → Models.
  • Close programs that use the graphics card, such as games, video editors, and other AI tools, then try again.

Still stuck

Settings → Data → Open log folder has the logs, and app.log is safe to share. Open an issue with the message you saw and that log, or read Troubleshooting.