minus-squarecoja@lemmy.mltoSelfhosted@lemmy.world•What would be the cheapest and most cost-effeciant way of self hosting LLMslinkfedilinkarrow-up1·edit-26 months agoNot sure about the setup, but I believe 7600XT would be the best buy, it has 16GB VRAM and it’s supported now linkfedilink
coja@lemmy.ml to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.com · 1 year agoDeploy the cracklemmy.mlimagemessage-square0fedilinkarrow-up12arrow-down10
arrow-up12arrow-down1imageDeploy the cracklemmy.mlcoja@lemmy.ml to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.com · 1 year agomessage-square0fedilink
Not sure about the setup, but I believe 7600XT would be the best buy, it has 16GB VRAM and it’s supported now