fossilesque@mander.xyzM to Science Memes@mander.xyzEnglish · 2 years agoPandasmander.xyzimagemessage-square40fedilinkarrow-up1357
arrow-up1357imagePandasmander.xyzfossilesque@mander.xyzM to Science Memes@mander.xyzEnglish · 2 years agomessage-square40fedilink
minus-squaregigachad@sh.itjust.workslinkfedilinkEnglisharrow-up5·2 years agoI guess it’s more of a critique of how bad CSV is for storing large data than pandas being inefficient
minus-squarezaphod@sopuli.xyzlinkfedilinkEnglisharrow-up13·2 years agoCSV is not optimal, but then someone shows up and gives you 60GB of JSON instead of 600MB of CSV.
minus-squareDiplomjodler@lemmy.worldlinkfedilinkEnglisharrow-up4·2 years agoWhy do you have to personally attack me like that?
minus-squarenaught@sh.itjust.workslinkfedilinkEnglisharrow-up3·2 years agoOr they dump their entire 6gb SQL database, customer info and all, into a SQL file that you have to load into a mariadb docker container when you just needed a subset that you were going to turn into csv anyway ☺️
I guess it’s more of a critique of how bad CSV is for storing large data than pandas being inefficient
CSV is not optimal, but then someone shows up and gives you 60GB of JSON instead of 600MB of CSV.
Why do you have to personally attack me like that?
Or they dump their entire 6gb SQL database, customer info and all, into a SQL file that you have to load into a mariadb docker container when you just needed a subset that you were going to turn into csv anyway ☺️
Fine! .csv.gz ftw!