Skip to content

IMTMarburg/mbf_pandas_msgpack

 
 

Repository files navigation

pandas-msgpack

Travis Build Status

pandas-msgpack is a package providing an interface to msgpack from pandas

In 2019, pandas deprecated the msgpack io interface, suggesting people use pyarrow instead.

Unfortunatly, pyarrow doesn't do columns-containing-tuples, and we do have older msgpacked DataFrames that we still need to unpack.

Somebody had already forked the msgpack code earlier, but it had bitrotted away from the current pandas internal.

This fork restores it to mostly-working order - notably, all datetime and sparse array handling have been removed. Datetime, because the numpy dtype no longer stores timezones, and it wasn't important to our particular mission, and sparse arrays because they have been deprecated anyway (and were not important to our mission).

Installation

Install latest development version

$ pip install mbf_pandas

Usage

See the pandas-msgpack documentation for more details, just replace all import pandas_msgpack with import mbf_pandas_msgpack