Data files: pickle support?

Do you plan to allow the data wizard to handle pickle .pkl files? I assume you’re using pandas.read_csv for CSV input; hopefully it would be very easy to use pandas.read_pickle - and since the resulting dataframe already has dtype information maybe it would be even better.

I’ve just spent many days doing preprocessing on a 0.5GB CSV that results in a (only slightly smaller) 0.3GB pkl that I want anyway - would be a shame/nuisance to generate a CSV from the more efficient pkl :slight_smile:

Hey @JulianSMoore :wave:
We plan on expanding the list of filetypes that can be loaded into the Data Wizard. I’ll add .pkl to the list :slight_smile:

1 Like