New Local GGUF Model

New Local GGUF model

You can create a new local GGUF model by linking your GGUF files.

To create a new local GGUF model, follow these steps:

  • Go to Model page by clicking the "Model" button on the bottom left toolbar.
  • Click the "New Model" button, and click the "New Local GGUF Model" button.
  • Click "Link GGUF" button and select your GGUF files from file system.
  • Click "Create" button.