Skip to content

dberardo-com/river

ย 
ย 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

river_logo


tests documentation roadmap pypi pepy bsd_3_license


River is a Python library for online machine learning. It aims to be the most user-friendly library for doing machine learning on streaming data. River is the result of a merger between creme and scikit-multiflow.

โšก๏ธ Quickstart

As a quick example, we'll train a logistic regression to classify the website phishing dataset. Here's a look at the first observation in the dataset.

>>> from pprint import pprint
>>> from river import datasets

>>> dataset = datasets.Phishing()

>>> for x, y in dataset:
...     pprint(x)
...     print(y)
...     break
{'age_of_domain': 1,
 'anchor_from_other_domain': 0.0,
 'empty_server_form_handler': 0.0,
 'https': 0.0,
 'ip_in_url': 1,
 'is_popular': 0.5,
 'long_url': 1.0,
 'popup_window': 0.0,
 'request_from_other_domain': 0.0}
True

Now let's run the model on the dataset in a streaming fashion. We sequentially interleave predictions and model updates. Meanwhile, we update a performance metric to see how well the model is doing.

>>> from river import compose
>>> from river import linear_model
>>> from river import metrics
>>> from river import preprocessing

>>> model = compose.Pipeline(
...     preprocessing.StandardScaler(),
...     linear_model.LogisticRegression()
... )

>>> metric = metrics.Accuracy()

>>> for x, y in dataset:
...     y_pred = model.predict_one(x)      # make a prediction
...     metric = metric.update(y, y_pred)  # update the metric
...     model = model.learn_one(x, y)      # make the model learn

>>> metric
Accuracy: 89.20%

Of course, this is just a contrived example. We welcome you to check the introduction section of the documentation for a more thorough tutorial.

๐Ÿ›  Installation

River is intended to work with Python 3.8 or above. Installation can be done with pip:

pip install river

There are wheels available for Linux, MacOS, and Windows, which means that you most probably won't have to build River from source.

You can install the latest development version from GitHub as so:

pip install git+https://github.com/online-ml/river --upgrade

Or, through SSH:

pip install git+ssh://[email protected]/online-ml/river.git --upgrade

๐Ÿ”ฎ Features

  • Linear models with a wide array of optimizers
  • Nearest neighbors, decision trees, naรฏve Bayes
  • Anomaly detection
  • Drift detection
  • Recommender systems
  • Time series forecasting
  • Imbalanced learning
  • Clustering
  • Feature extraction and selection
  • Online statistics and metrics
  • Built-in datasets
  • Progressive model validation
  • Model pipelines as a first-class citizen
  • Check out the API for a comprehensive overview

๐Ÿค” Should I be using River?

You should ask yourself if you need online machine learning. The answer is likely no. Most of the time batch learning does the job just fine. An online approach might fit the bill if:

  • You want a model that can learn from new data without having to revisit past data.
  • You want a model which is robust to concept drift.
  • You want to develop your model in a way that is closer to what occurs in a production context, which is usually event-based.

Some specificities of River are that:

  • It focuses on clarity and user experience, more so than performance.
  • It's very fast at processing one sample at a time. Try it, you'll see.
  • It plays nicely with the rest of Python ecosystem.

๐Ÿ”— Useful links

๐Ÿ‘ Contributing

Feel free to contribute in any way you like, we're always open to new ideas and approaches.

  • Open a discussion if you have any question or enquiry whatsoever. It's more useful to ask your question in public rather than sending us a private email. It's also encouraged to open a discussion before contributing, so that everyone is aligned and unnecessary work is avoided.
  • Feel welcome to open an issue if you think you've spotted a bug or a performance issue.
  • Our roadmap is public. Feel free to work on anything that catches your eye, or to make suggestions. Simpler tasks are listed here.

Please check out the contribution guidelines if you want to bring modifications to the code base.

๐Ÿค Affiliations

Sponsors

sponsors

Collaborating institutions and groups

collaborations

๐Ÿ’ฌ Citation

If River has been useful to you and you would like to cite it in an scientific publication, please refer to the paper published at JMLR:

@article{montiel2021river,
  title={River: machine learning for streaming data in Python},
  author={Montiel, Jacob and Halford, Max and Mastelini, Saulo Martiello and Bolmier, Geoffrey and Sourty, Raphael and Vaysse, Robin and Zouitine, Adil and Gomes, Heitor Murilo and Read, Jesse and Abdessalem, Talel and others},
  year={2021}
}

๐Ÿ“ License

River is free and open-source software licensed under the 3-clause BSD license.

About

๐ŸŒŠ Online machine learning in Python

Resources

License

Code of conduct

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 97.9%
  • Cython 2.1%