

Depends on how much quantization, but still fairly beefy, couldn’t run it on my homelab with a 3080ti for example.
I generally use smaller 8-12b models and they’re alright depending on the task.


Depends on how much quantization, but still fairly beefy, couldn’t run it on my homelab with a 3080ti for example.
I generally use smaller 8-12b models and they’re alright depending on the task.


Eh, yes you’re right but seriously what are we gaining from this mission? As far as I’ve heard there’s nothing really new that were gaining from it, just… Because?
To the ops point, there are a multitude of more beneficial projects that money could have gone toward instead in the same realm.
Lmao e/OS CEO says a thing, someone inevitably in the comments, “How could GrapheneOS do this!”


There’s a silly bug where if you use Ventoy to install proxmox it fucks up the efi partition and won’t allow boot without the USB in, I left that USB in for probably 6 months before bothering to fix it lol.
That was 13 years ago, I’m also curious how much that relates to world events vs age