Allow saving of dataframes about scrapbook HOT 5 CLOSED

Yes today you have to convert to/from json which has lots of problems.

This PR: #37 adds pandas and arrow dataframe support, but I had put it on hold for other work. I've wrapped up those other tasks so this is like the next PR / feature I will be working on in the near future to get released.

from scrapbook.

This functionality was merged to master last week, just not released yet -- it uses pyarrow to encode the dataframe in master which is a little better than the to_dict and from_dict.

from scrapbook.

If you look at this file: https://github.com/nteract/scrapbook/blob/master/scrapbook/encoders.py
arrow is commented out for some reasons.

from scrapbook.

Just a quick note here - couldn't this be relatively quickly solved by using an encoder such as this:

class DataFrameEncoder(object):
    def encode(self, scrap):
        # scrap.data is any type, usually specific to the encoder name
        scrap = scrap._replace(data=scrap.data.to_dict())
        return scrap

    def decode(self, scrap):
        # scrap.data is one of [None, list, dict, *six.integer_types, *six.string_types]
        scrap = scrap._replace(data=pd.DataFrame.from_dict(scrap.data))
        return scrap

encoder_registry.register('pandas', DataFrameEncoder())

This allows me to do sb.glue('mydf', 'df', 'pandas')

Maybe not very edge-casey and elegant, but could be a start?

from scrapbook.

In this PR #62 (closing as the issue should be resolved)

from scrapbook.