KoboldAI Quickstart

Install

Windows:

KoboldAI for Windows in one image

Linux:

sudo curl -fLo /usr/bin/koboldcpp https://koboldai.org/cpplinux && sudo chmod +x /usr/bin/koboldcpp

MacOS:

curl -fLo ~/Applications/koboldcpp-mac-arm64 https://koboldai.org/cppmac && chmod +x ~/Applications/koboldcpp-mac-arm64

MacOS optional: If you double click the file in finder it will produce a error message regarding security, but in system settings you could afterwards choose to override it, so you can even start the GUI from finder by double clicking it then. It's under Settings/Security/Allow App if you scroll to the bottom in the Security chapter and then when you once click "open anyway" he remembers and whitelists KoboldCPP.

Setup

Settings in one overview:

(Image guide originally from /lmg/, thanks anon)