Regression algorithms

Warning

Some algorithms may require the installation of GEMSEO with all its features and some others may depend on plugins.

Note

All the features of the wrapped optimization libraries may not be exposed through GEMSEO.

GaussianProcessRegressor

Module: gemseo.mlearning.regression.gpr

Required parameters
  • data : Dataset

    The learning dataset.

Optional parameters
  • alpha : float | ndarray, optional

    The nugget effect to regularize the model.

    By default it is set to 1e-10.

  • bounds : __Bounds | Mapping[str, __Bounds] | None, optional

    The lower and upper bounds of the parameter length scales when kernel is None. Either a unique lower-upper pair common to all the inputs or lower-upper pairs for some of them. When bounds is None or when an input has no pair, the lower bound is 0.01 and the upper bound is 100.

    By default it is set to None.

  • input_names : Iterable[str] | None, optional

    The names of the input variables. If None, consider all the input variables of the learning dataset.

    By default it is set to None.

  • kernel : Kernel | None, optional

    The kernel specifying the covariance model. If None, use a Matérn(2.5).

    By default it is set to None.

  • n_restarts_optimizer : int, optional

    The number of restarts of the optimizer.

    By default it is set to 10.

  • optimizer : str | Callable, optional

    The optimization algorithm to find the parameter length scales.

    By default it is set to fmin_l_bfgs_b.

  • output_names : Iterable[str] | None, optional

    The names of the output variables. If None, consider all the output variables of the learning dataset.

    By default it is set to None.

  • random_state : int | None, optional

    The seed used to initialize the centers. If None, the random number generator is the RandomState instance used by numpy.random.

    By default it is set to None.

  • transformer : Mapping[str, TransformerType] | None, optional

    The strategies to transform the variables. The values are instances of Transformer while the keys are the names of either the variables or the groups of variables, e.g. “inputs” or “outputs” in the case of the regression algorithms. If a group is specified, the Transformer will be applied to all the variables of this group. If None, do not transform the variables.

    By default it is set to None.

LinearRegressor

Module: gemseo.mlearning.regression.linreg

Required parameters
  • data : Dataset

    The learning dataset.

Optional parameters
  • fit_intercept : bool, optional

    Whether to fit the intercept.

    By default it is set to True.

  • input_names : Iterable[str] | None, optional

    The names of the input variables. If None, consider all the input variables of the learning dataset.

    By default it is set to None.

  • l2_penalty_ratio : float, optional

    The penalty ratio related to the l2 regularization. If 1, use the Ridge penalty. If 0, use the Lasso penalty. Between 0 and 1, use the ElasticNet penalty.

    By default it is set to 1.0.

  • output_names : Iterable[str] | None, optional

    The names of the output variables. If None, consider all the output variables of the learning dataset.

    By default it is set to None.

  • penalty_level : float, optional

    The penalty level greater or equal to 0. If 0, there is no penalty.

    By default it is set to 0.0.

  • transformer : Mapping[str, TransformerType] | None, optional

    The strategies to transform the variables. The values are instances of Transformer while the keys are the names of either the variables or the groups of variables, e.g. “inputs” or “outputs” in the case of the regression algorithms. If a group is specified, the Transformer will be applied to all the variables of this group. If None, do not transform the variables.

    By default it is set to None.

  • **parameters : float | int | str | bool | None

    The parameters of the machine learning algorithm.

MOERegressor

Module: gemseo.mlearning.regression.moe

Required parameters
  • data : Dataset

    The learning dataset.

Optional parameters
  • hard : bool, optional

    Whether clustering/classification should be hard or soft.

    By default it is set to True.

  • input_names : Iterable[str] | None, optional

    The names of the input variables. If None, consider all the input variables of the learning dataset.

    By default it is set to None.

  • output_names : Iterable[str] | None, optional

    The names of the output variables. If None, consider all the output variables of the learning dataset.

    By default it is set to None.

  • transformer : Mapping[str, TransformerType] | None, optional

    The strategies to transform the variables. The values are instances of Transformer while the keys are the names of either the variables or the groups of variables, e.g. “inputs” or “outputs” in the case of the regression algorithms. If a group is specified, the Transformer will be applied to all the variables of this group. If None, do not transform the variables.

    By default it is set to None.

PCERegressor

Module: gemseo.mlearning.regression.pce

Required parameters
  • data : Dataset

    The learning dataset.

  • probability_space : ParameterSpace

    The set of random input variables defined by OTDistribution instances.

Optional parameters
  • degree : int, optional

    The polynomial degree of the PCE.

    By default it is set to 2.

  • discipline : MDODiscipline | None, optional

    The discipline to evaluate with the quadrature strategy if the learning set does not have output data. If None, use the output data from the learning set.

    By default it is set to None.

  • input_names : Iterable[str] | None, optional

    The names of the input variables. If None, consider all the input variables of the learning dataset.

    By default it is set to None.

  • n_quad : int | None, optional

    The total number of quadrature points used by the quadrature strategy to compute the marginal number of points by input dimension. If None, this degree will be set equal to the polynomial degree of the PCE plus one.

    By default it is set to None.

  • output_names : Iterable[str] | None, optional

    The names of the output variables. If None, consider all the output variables of the learning dataset.

    By default it is set to None.

  • sparse_param : Mapping[str, int | float] | None, optional

    The parameters for the Sparse Cleaning Truncation Strategy and/or hyperbolic truncation of the initial basis: - max_considered_terms (int) – The maximum considered terms (default: 120), - most_significant (int) – The most Significant number to retain (default: 30), - significance_factor (float) – Significance Factor (default: 1e-3), - hyper_factor (float) – The factor for the hyperbolic truncation strategy (default: 1.0). If None, use default values.

    By default it is set to None.

  • stieltjes : bool, optional

    Whether to use the Stieltjes method.

    By default it is set to True.

  • strategy : str, optional

    The strategy to compute the parameters of the PCE, either ‘LS’ for least-square, ‘Quad’ for quadrature or ‘SparseLS’ for sparse least-square.

    By default it is set to LS.

  • transformer : Mapping[str, TransformerType] | None, optional

    The strategies to transform the variables. The values are instances of Transformer while the keys are the names of either the variables or the groups of variables, e.g. “inputs” or “outputs” in the case of the regression algorithms. If a group is specified, the Transformer will be applied to all the variables of this group. If None, do not transform the variables.

    By default it is set to None.

PolynomialRegressor

Module: gemseo.mlearning.regression.polyreg

Required parameters
  • data : Dataset

    The learning dataset.

  • degree : int

    The polynomial degree.

Optional parameters
  • fit_intercept : bool, optional

    Whether to fit the intercept.

    By default it is set to True.

  • input_names : Iterable[str] | None, optional

    The names of the input variables. If None, consider all the input variables of the learning dataset.

    By default it is set to None.

  • l2_penalty_ratio : float, optional

    The penalty ratio related to the l2 regularization. If 1, the penalty is the Ridge penalty. If 0, this is the Lasso penalty. Between 0 and 1, the penalty is the ElasticNet penalty.

    By default it is set to 1.0.

  • output_names : Iterable[str] | None, optional

    The names of the output variables. If None, consider all the output variables of the learning dataset.

    By default it is set to None.

  • penalty_level : float, optional

    The penalty level greater or equal to 0. If 0, there is no penalty.

    By default it is set to 0.0.

  • transformer : Mapping[str, TransformerType] | None, optional

    The strategies to transform the variables. The values are instances of Transformer while the keys are the names of either the variables or the groups of variables, e.g. “inputs” or “outputs” in the case of the regression algorithms. If a group is specified, the Transformer will be applied to all the variables of this group. If None, do not transform the variables.

    By default it is set to None.

  • **parameters : float | int | str | bool | None

    The parameters of the machine learning algorithm.

RBFRegressor

Module: gemseo.mlearning.regression.rbf

Required parameters
  • data : Dataset

    The learning dataset.

Optional parameters
  • der_function : Callable[[ndarray], ndarray] | None, optional

    The derivative of the radial basis function, only to be provided if function is a callable and if the use of the model with its derivative is required. If None and if function is a callable, an error will be raised. If None and if function is a string, the class will look for its internal implementation and will raise an error if it is missing. The der_function shall take three arguments (input_data, norm_input_data, eps). For an RBF of the form function(\(r\)), der_function(\(x\), \(|x|\), \(\epsilon\)) shall return \(\epsilon^{-1} x/|x| f'(|x|/\epsilon)\).

    By default it is set to None.

  • epsilon : float | None, optional

    An adjustable constant for Gaussian or multiquadric functions. If None, use the average distance between input data.

    By default it is set to None.

  • function : str | Callable[[float, float], float], optional

    The radial basis function taking a radius r as input, representing a distance between two points. If it is a string, then it must be one of the following: .. code:: ‘multiquadric’: sqrt((r/self.epsilon)**2 + 1) ‘inverse’: 1.0/sqrt((r/self.epsilon)**2 + 1) ‘gaussian’: exp(-(r/self.epsilon)**2) ‘linear’: r ‘cubic’: r**3 ‘quintic’: r**5 ‘thin_plate’: r**2 * log(r) If it is a callable, then it must take two arguments (self, r), e.g. lambda self, r: return sqrt((r/self.epsilon)**2 + 1) for the multiquadric function. The epsilon parameter will be available as self.epsilon. Other keyword arguments passed in will be available as well.

    By default it is set to multiquadric.

  • input_names : Iterable[str] | None, optional

    The names of the input variables. If None, consider all the input variables of the learning dataset.

    By default it is set to None.

  • norm : str | Callable[[ndarray, ndarray], float], optional

    The distance metric to be used, either a distance function name known by SciPy or a function that computes the distance between two points.

    By default it is set to euclidean.

  • output_names : Iterable[str] | None, optional

    The names of the output variables. If None, consider all the output variables of the learning dataset.

    By default it is set to None.

  • smooth : float, optional

    The degree of smoothness, 0 involving an interpolation of the learning points.

    By default it is set to 0.0.

  • transformer : Mapping[str, TransformerType] | None, optional

    The strategies to transform the variables. The values are instances of Transformer while the keys are the names of either the variables or the groups of variables, e.g. “inputs” or “outputs” in the case of the regression algorithms. If a group is specified, the Transformer will be applied to all the variables of this group. If None, do not transform the variables.

    By default it is set to None.

RandomForestRegressor

Module: gemseo.mlearning.regression.random_forest

Required parameters
  • data : Dataset

    The learning dataset.

Optional parameters
  • input_names : Iterable[str] | None, optional

    The names of the input variables. If None, consider all the input variables of the learning dataset.

    By default it is set to None.

  • n_estimators : int, optional

    The number of trees in the forest.

    By default it is set to 100.

  • output_names : Iterable[str] | None, optional

    The names of the output variables. If None, consider all the output variables of the learning dataset.

    By default it is set to None.

  • transformer : Mapping[str, TransformerType] | None, optional

    The strategies to transform the variables. The values are instances of Transformer while the keys are the names of either the variables or the groups of variables, e.g. “inputs” or “outputs” in the case of the regression algorithms. If a group is specified, the Transformer will be applied to all the variables of this group. If None, do not transform the variables.

    By default it is set to None.