@[email protected] to Programmer [email protected]English • 4 months agomuskrat's data eng expert's hard drive overheats while processing 60k rowslemmy.dbzer0.comimagemessage-square291fedilinkarrow-up1965arrow-down113
arrow-up1952arrow-down1imagemuskrat's data eng expert's hard drive overheats while processing 60k rowslemmy.dbzer0.com@[email protected] to Programmer [email protected]English • 4 months agomessage-square291fedilink
minus-square@[email protected]linkfedilink58•4 months agoi mean its even excel sized depending on how many columns. This is seriously sad and alarming
minus-square@[email protected]linkfedilink2•4 months agoHoly shit if this ids lm issue that’s too funny
minus-square@[email protected]linkfedilink46•4 months agoSqlite can easily handle millions of rows. Don’t sell it short
minus-squareThe_DecryptorlinkfedilinkEnglish9•4 months agoHow about a 6.4TB sqlite database? https://boyter.org/posts/searchcode-bigger-sqlite-than-you/
minus-square@[email protected]linkfedilinkEnglish4•4 months agoI have an sqlite db that is a few GB in size, game saves using the format. Sadly almost all blob data, would love to play with it if it was a bit more readable
deleted by creator
i mean its even excel sized depending on how many columns. This is seriously sad and alarming
deleted by creator
Holy shit if this ids lm issue that’s too funny
Sqlite can easily handle millions of rows. Don’t sell it short
How about a 6.4TB sqlite database?
https://boyter.org/posts/searchcode-bigger-sqlite-than-you/
Should be enough to hold 60k rows
I have an sqlite db that is a few GB in size, game saves using the format. Sadly almost all blob data, would love to play with it if it was a bit more readable
deleted by creator
60k is single json file