7·
17 days agoWhy is this news?
- 0 Posts
- 4 Comments
Joined 1 year ago
Cake day: June 15th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
I got a home server with a Nvidia Tesla P4, not the most power or the most vram (8gb), but can be gotten for ~$100usd (it is a headless GPU so no video outputs)
I’m using ollama with dolphin-mistral and recently deepseek coder
If it’s not open source and open hardware I’m not putting that shit in my head lmfao
I run GitLab with docker compose and watchtower, all the updates are automated and have never caused any issues for me.
That being said my setup uses about 7-8gb of ram.