Skip to content

BBVA/data-refinery

Repository files navigation

Build Status Coverage Docs Version PyVersions License

Data Refinery

The main goal of the library is perform a Transformation over a data event. Supports a variety of functions typically used on machine learning and AI.

Development is oriented into a functional style avoiding side effects on transformations.

Installation

In console pip install data-refinery or python setup.py install from sources.

Usage example

from datarefinery.TupleOperations import wrap, keep, substitution
from datarefinery.CombineOperations import sequential

x2 = wrap(lambda x: x*2)

operation = sequential(keep(["name"]), substitution(["value"], x2))
(res, err) = operation({"name": "John", "value": 10})
print(res) # {"name": "John", "value": 20}

Documentation

Visit complete documentation at readthedocs.io.

Compatibility

Python: 3.5, 3.6

Contribute

Follow the steps on the how to contribute document.