However, since I already have pi working with llama.cpp server from a docker container, I did a quick experiment to compare three code bases:
https://gist.github.com/ontouchstart/7483c12efa3c3d3a49e38c2...
https://gist.github.com/ontouchstart/217fe2b8103a5c0bfaee1e9...
Very interesting.
Will do it again next week if I can get unsloth studio working.
curl -LsSf https://astral.sh/uv/install.sh | sh
uv venv unsloth_studio --python 3.13
source unsloth_studio/bin/activate
uv pip install unsloth==2026.3.7 --torch-backend=auto
unsloth studio setup
unsloth studio -H 0.0.0.0 -p 8888
https://gist.github.com/ontouchstart/532312fcba59aec3ce7f6aa...
Here is the error message on my machine:
https://gist.github.com/ontouchstart/86ca3cbd8b6b61fa0aeec75...
It seems we might need more instructions on how to set up python (via uv) in vanilla MacOS.
Is there an alternative, tutorial, or project you'd recommend that would help me do supervised fine tuning (SFT) with the metal stack / macOS?
(base) unsloth git:(main) unsloth studio setup ╔══════════════════════════════════════╗ ║ Unsloth Studio Setup Script ║ ╚══════════════════════════════════════╝ Node v25.8.1 and npm 11.11.0 already meet requirements. Skipping nvm install. Node v25.8.1 | npm 11.11.0 npm run build failed (exit code 2): > unsloth-theme@0.0.0 build > tsc -b && vite build src/features/chat/shared-composer.tsx(366,17): error TS6133: 'status' is declared but its value is never read.
This needs to go on homebrew or be a zip file with an app for manual download.
Is it like, for AI hobbyists? I.e. I have a 4090 at home and want to fine-tune models?
Is it a competitor to LMStudio?
82 comments
However, since I already have pi working with llama.cpp server from a docker container, I did a quick experiment to compare three code bases:
https://gist.github.com/ontouchstart/7483c12efa3c3d3a49e38c2...
https://gist.github.com/ontouchstart/217fe2b8103a5c0bfaee1e9...
Very interesting.
Will do it again next week if I can get unsloth studio working.
curl -LsSf https://astral.sh/uv/install.sh | sh
uv venv unsloth_studio --python 3.13
source unsloth_studio/bin/activate
uv pip install unsloth==2026.3.7 --torch-backend=auto
unsloth studio setup
unsloth studio -H 0.0.0.0 -p 8888
https://gist.github.com/ontouchstart/532312fcba59aec3ce7f6aa...
Here is the error message on my machine:
https://gist.github.com/ontouchstart/86ca3cbd8b6b61fa0aeec75...
It seems we might need more instructions on how to set up python (via uv) in vanilla MacOS.
Is there an alternative, tutorial, or project you'd recommend that would help me do supervised fine tuning (SFT) with the metal stack / macOS?
This needs to go on homebrew or be a zip file with an app for manual download.
Is it like, for AI hobbyists? I.e. I have a 4090 at home and want to fine-tune models?
Is it a competitor to LMStudio?