@[email protected] to [email protected]English • 20 days agoFramework’s first desktop is a strange—but unique—mini ITX gaming PCarstechnica.comexternal-linkmessage-square241fedilinkarrow-up1630arrow-down19
arrow-up1621arrow-down1external-linkFramework’s first desktop is a strange—but unique—mini ITX gaming PCarstechnica.com@[email protected] to [email protected]English • 20 days agomessage-square241fedilink
minus-square@[email protected]linkfedilinkEnglish2•19 days agoMany LLM operations rely on fast memory and gpus seem to have that. Even though their memory is soldered and vbios is practically a black box that is tightly controlled. Nothing on a GPU is modular or repairable without soldering skills(and tools).
Would 256GB/s be too slow for large llms?
It runs on the gpu
Many LLM operations rely on fast memory and gpus seem to have that. Even though their memory is soldered and vbios is practically a black box that is tightly controlled. Nothing on a GPU is modular or repairable without soldering skills(and tools).
Huh?