Skip to content

Kernel structure discovery research code - likely to be unstable

License

Notifications You must be signed in to change notification settings

elbakramer/gpss-research

This branch is up to date with jamesrobertlloyd/gpss-research:master.

Folders and files

NameName
Last commit message
Last commit date
Apr 19, 2014
Nov 30, 2014
Nov 30, 2014
Sep 25, 2013
Apr 24, 2014
Jul 24, 2014
Nov 30, 2014
Nov 30, 2014
Jul 27, 2015
Sep 23, 2014
Apr 7, 2015
Mar 22, 2015
Jun 29, 2014

Repository files navigation

This is part of the automatic statistician project

Automatic Bayesian Covariance Discovery

This repo contains the source code to run the system described in the paper

Automatic Construction and Natural-Language Description of Nonparametric Regression Models by James Robert Lloyd, David Duvenaud, Roger Grosse, Joshua B. Tenenbaum and Zoubin Ghahramani, appearing in AAAI 2014.

Abstract

This paper presents the beginnings of an automatic statistician, focusing on regression problems. Our system explores an open-ended space of statistical models to discover a good explanation of a data set, and then produces a detailed report with figures and natural-language text. Our approach treats unknown regression functions nonparametrically using Gaussian processes, which has two important consequences. First, Gaussian processes can model functions in terms of high-level properties (e.g. smoothness, trends, periodicity, changepoints). Taken together with the compositional structure of our language of models this allows us to automatically describe functions in simple terms. Second, the use of flexible nonparametric models and a rich language for composing them in an open-ended manner also results in state-of-the-art extrapolation performance evaluated over 13 real time series data sets from various domains.

Feel free to email the authors with any questions:
James Lloyd (jrl44@cam.ac.uk)
David Duvenaud (dduvenaud@seas.harvard.edu)
Roger Grosse (rgrosse@cs.toronto.edu)

Data used in the paper

Related Repo

Source code to run an earlier version of the system, appearing in Structure Discovery in Nonparametric Regression through Compositional Kernel Search by David Duvenaud, James Robert Lloyd, Roger Grosse, Joshua B. Tenenbaum, Zoubin Ghahramani
can be found at

github.com/jamesrobertlloyd/gp-structure-search/.

About

Kernel structure discovery research code - likely to be unstable

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • TeX 63.7%
  • MATLAB 15.5%
  • Python 10.1%
  • Mathematica 3.6%
  • HTML 3.4%
  • Fortran 2.5%
  • Other 1.2%