2.2. Statistical-learning for scientific data processing tutorial

Statistical learning

Machine learning is a technique with a growing importance, as the size of the datasets experimental sciences are facing is rapidly growing. Problems it tackles range from building a prediction function linking different observations, to classifying observations, or learning the structure in an unlabeled dataset.

This tutorial will explore statistical learning, that is the use of machine learning techniques with the goal of statistical inference: drawing conclusions on the data at hand.

sklearn is a Python module integrating classic machine learning algorithms in the tightly-knit world of scientific Python packages (numpy, scipy, matplotlib).

Note

This document is meant to be used with scikit-learn version 0.7+.

Warning

In scikit-learn release 0.9, the import path has changed from scikits.learn to sklearn. To import with cross-version compatibility, use:

try:
    from sklearn import something
except ImportError:
    from scikits.learn import something

• 2.2.1. Statistical learning: the setting and the estimator object in the scikit-learn
  • 2.2.1.1. Datasets
  • 2.2.1.2. Estimators objects
• 2.2.2. Supervised learning: predicting an output variable from high-dimensional observations
  • 2.2.2.1. Nearest neighbor and the curse of dimensionality
  • 2.2.2.2. Linear model: from regression to sparsity
  • 2.2.2.3. Support vector machines (SVMs)
• 2.2.3. Model selection: choosing estimators and their parameters
  • 2.2.3.1. Score, and cross-validated scores
  • 2.2.3.2. Cross-validation generators
  • 2.2.3.3. Grid-search and cross-validated estimators
• 2.2.4. Unsupervised learning: seeking representations of the data
  • 2.2.4.1. Clustering: grouping observations together
  • 2.2.4.2. Decompositions: from a signal to components and loadings
• 2.2.5. Putting it all together
  • 2.2.5.1. Pipelining
  • 2.2.5.2. Face recognition with eigenfaces
  • 2.2.5.3. Open problem: Stock Market Structure
• 2.2.6. Finding help
  • 2.2.6.1. The project mailing list
  • 2.2.6.2. Q&A communities with Machine Learning practictioners