@fossilesque@mander.xyzM to Science Memes@mander.xyzEnglish • 2 months agoPandasmander.xyzimagemessage-square40fedilinkarrow-up1357
arrow-up1357imagePandasmander.xyz@fossilesque@mander.xyzM to Science Memes@mander.xyzEnglish • 2 months agomessage-square40fedilink
minus-square@QuizzaciousOtter@lemm.eelinkfedilinkEnglish13•2 months agoI really don’t think that’s a lot either. Nowadays we routinely process terabytes of data.
minus-square@Kausta@lemm.eelinkfedilinkEnglish9•2 months agoYeah, it was just a simple example. Although using just pandas (without something like dask) for loading terabytes of data at once into a single dataframe may not be the best idea, even with enough memory.
I really don’t think that’s a lot either. Nowadays we routinely process terabytes of data.
Yeah, it was just a simple example. Although using just pandas (without something like dask) for loading terabytes of data at once into a single dataframe may not be the best idea, even with enough memory.