"Linear" (Machine Learning Method)

Details & Suboptions

  • "Linear" is a linear dimensionality reduction method. The method learns a low-dimensional representation of data via a linear mapping.
  • "Linear" works for datasets that have a large number of features, large number of examples and possibly many missing values (and hence can be used for collaborative filtering); however it can fail for datasets with nonlinear manifolds.
  • The following plots show the results of the "Linear" method applied to benchmark datasets Fisher's Irises, MNIST and FashionMNIST:
  • Depending on the data, the "Linear" method either first standardizes the data (it effectively becomes the "PrincipalComponentsAnalysis" method) or keeps the data as is (it effectively becomes the "LatentSemanticAnalysis" method).
  • Learned parameters are a matrix of size where and are the original and final dimensions of the data. The reduction is done through a matrix multiplication.
  • Parameters are found by minimizing the reconstruction error (mean squared error) of the training data.
  • Internally, procedures like singular value decomposition, alternating least squares and power iteration are used.

Examples

open allclose all

Basic Examples  (1)

Train a linear dimensionality reduction using the "Linear" method from a list of vectors:

Use the trained reducer on new vectors:

Scope  (1)

Dataset Visualization  (1)

Load the Fisher Iris dataset from ExampleData:

Generate a reducer function using "Linear" with the features of each example:

Group the examples by their species:

Reduce the dimension of the features:

Visualize the reduced dataset: