Analytical test case # 3

In this example, we consider a simple optimization problem to illustrate algorithms interfaces and DOE libraries integration. Integer variables are used

Imports

from __future__ import annotations

from gemseo.algos.design_space import DesignSpace
from gemseo.algos.doe.doe_factory import DOEFactory
from gemseo.algos.opt_problem import OptimizationProblem
from gemseo.api import configure_logger
from gemseo.api import execute_post
from gemseo.core.mdofunctions.mdo_function import MDOFunction
from numpy import sum as np_sum

LOGGER = configure_logger()

Define the objective function

We define the objective function \(f(x)=\sum_{i=1}^dx_i\) using a MDOFunction.

objective = MDOFunction(np_sum, name="f", expr="sum(x)")

Define the design space

Then, we define the DesignSpace with GEMSEO.

design_space = DesignSpace()
design_space.add_variable("x", 2, l_b=-5, u_b=5, var_type="integer")

Define the optimization problem

Then, we define the OptimizationProblem with GEMSEO.

problem = OptimizationProblem(design_space)
problem.objective = objective

Solve the optimization problem using a DOE algorithm

We can see this optimization problem as a trade-off and solve it by means of a design of experiments (DOE), e.g. full factorial design

DOEFactory().execute(problem, "fullfact", n_samples=11**2)
    INFO - 17:24:48: Optimization problem:
    INFO - 17:24:48:    minimize f = sum(x)
    INFO - 17:24:48:    with respect to x
    INFO - 17:24:48:    over the design space:
    INFO - 17:24:48:    +------+-------------+-------+-------------+---------+
    INFO - 17:24:48:    | name | lower_bound | value | upper_bound | type    |
    INFO - 17:24:48:    +------+-------------+-------+-------------+---------+
    INFO - 17:24:48:    | x[0] |      -5     |  None |      5      | integer |
    INFO - 17:24:48:    | x[1] |      -5     |  None |      5      | integer |
    INFO - 17:24:48:    +------+-------------+-------+-------------+---------+
    INFO - 17:24:48: Solving optimization problem with algorithm fullfact:
    INFO - 17:24:48: ...   0%|          | 0/121 [00:00<?, ?it]
    INFO - 17:24:48: ...   1%|          | 1/121 [00:00<00:00, 2688.66 it/sec, obj=-10]
    INFO - 17:24:48: ...   2%|▏         | 2/121 [00:00<00:00, 2065.65 it/sec, obj=-9]
    INFO - 17:24:48: ...   2%|▏         | 3/121 [00:00<00:00, 1979.69 it/sec, obj=-8]
    INFO - 17:24:48: ...   3%|▎         | 4/121 [00:00<00:00, 1959.04 it/sec, obj=-7]
    INFO - 17:24:48: ...   4%|▍         | 5/121 [00:00<00:00, 1949.39 it/sec, obj=-6]
    INFO - 17:24:48: ...   5%|▍         | 6/121 [00:00<00:00, 1943.31 it/sec, obj=-5]
    INFO - 17:24:48: ...   6%|▌         | 7/121 [00:00<00:00, 1942.71 it/sec, obj=-4]
    INFO - 17:24:48: ...   7%|▋         | 8/121 [00:00<00:00, 1907.15 it/sec, obj=-3]
    INFO - 17:24:48: ...   7%|▋         | 9/121 [00:00<00:00, 1899.50 it/sec, obj=-2]
    INFO - 17:24:48: ...   8%|▊         | 10/121 [00:00<00:00, 1893.16 it/sec, obj=-1]
    INFO - 17:24:48: ...   9%|▉         | 11/121 [00:00<00:00, 1896.70 it/sec, obj=0]
    INFO - 17:24:48: ...  10%|▉         | 12/121 [00:00<00:00, 1898.66 it/sec, obj=-9]
    INFO - 17:24:48: ...  11%|█         | 13/121 [00:00<00:00, 1901.05 it/sec, obj=-8]
    INFO - 17:24:48: ...  12%|█▏        | 14/121 [00:00<00:00, 1902.30 it/sec, obj=-7]
    INFO - 17:24:48: ...  12%|█▏        | 15/121 [00:00<00:00, 1890.12 it/sec, obj=-6]
    INFO - 17:24:48: ...  13%|█▎        | 16/121 [00:00<00:00, 1884.55 it/sec, obj=-5]
    INFO - 17:24:48: ...  14%|█▍        | 17/121 [00:00<00:00, 1882.99 it/sec, obj=-4]
    INFO - 17:24:48: ...  15%|█▍        | 18/121 [00:00<00:00, 1881.79 it/sec, obj=-3]
    INFO - 17:24:48: ...  16%|█▌        | 19/121 [00:00<00:00, 1884.72 it/sec, obj=-2]
    INFO - 17:24:48: ...  17%|█▋        | 20/121 [00:00<00:00, 1855.52 it/sec, obj=-1]
    INFO - 17:24:48: ...  17%|█▋        | 21/121 [00:00<00:00, 1856.98 it/sec, obj=0]
    INFO - 17:24:48: ...  18%|█▊        | 22/121 [00:00<00:00, 1858.88 it/sec, obj=1]
    INFO - 17:24:48: ...  19%|█▉        | 23/121 [00:00<00:00, 1848.70 it/sec, obj=-8]
    INFO - 17:24:48: ...  20%|█▉        | 24/121 [00:00<00:00, 1848.83 it/sec, obj=-7]
    INFO - 17:24:48: ...  21%|██        | 25/121 [00:00<00:00, 1848.88 it/sec, obj=-6]
    INFO - 17:24:48: ...  21%|██▏       | 26/121 [00:00<00:00, 1851.48 it/sec, obj=-5]
    INFO - 17:24:48: ...  22%|██▏       | 27/121 [00:00<00:00, 1853.94 it/sec, obj=-4]
    INFO - 17:24:48: ...  23%|██▎       | 28/121 [00:00<00:00, 1856.27 it/sec, obj=-3]
    INFO - 17:24:48: ...  24%|██▍       | 29/121 [00:00<00:00, 1858.52 it/sec, obj=-2]
    INFO - 17:24:48: ...  25%|██▍       | 30/121 [00:00<00:00, 1852.55 it/sec, obj=-1]
    INFO - 17:24:48: ...  26%|██▌       | 31/121 [00:00<00:00, 1852.61 it/sec, obj=0]
    INFO - 17:24:48: ...  26%|██▋       | 32/121 [00:00<00:00, 1852.07 it/sec, obj=1]
    INFO - 17:24:48: ...  27%|██▋       | 33/121 [00:00<00:00, 1854.27 it/sec, obj=2]
    INFO - 17:24:48: ...  28%|██▊       | 34/121 [00:00<00:00, 1855.67 it/sec, obj=-7]
    INFO - 17:24:48: ...  29%|██▉       | 35/121 [00:00<00:00, 1857.34 it/sec, obj=-6]
    INFO - 17:24:48: ...  30%|██▉       | 36/121 [00:00<00:00, 1858.95 it/sec, obj=-5]
    INFO - 17:24:48: ...  31%|███       | 37/121 [00:00<00:00, 1855.86 it/sec, obj=-4]
    INFO - 17:24:48: ...  31%|███▏      | 38/121 [00:00<00:00, 1855.26 it/sec, obj=-3]
    INFO - 17:24:48: ...  32%|███▏      | 39/121 [00:00<00:00, 1855.57 it/sec, obj=-2]
    INFO - 17:24:48: ...  33%|███▎      | 40/121 [00:00<00:00, 1855.97 it/sec, obj=-1]
    INFO - 17:24:48: ...  34%|███▍      | 41/121 [00:00<00:00, 1857.41 it/sec, obj=0]
    INFO - 17:24:48: ...  35%|███▍      | 42/121 [00:00<00:00, 1858.75 it/sec, obj=1]
    INFO - 17:24:48: ...  36%|███▌      | 43/121 [00:00<00:00, 1859.75 it/sec, obj=2]
    INFO - 17:24:48: ...  36%|███▋      | 44/121 [00:00<00:00, 1861.11 it/sec, obj=3]
    INFO - 17:24:48: ...  37%|███▋      | 45/121 [00:00<00:00, 1856.98 it/sec, obj=-6]
    INFO - 17:24:48: ...  38%|███▊      | 46/121 [00:00<00:00, 1856.90 it/sec, obj=-5]
    INFO - 17:24:48: ...  39%|███▉      | 47/121 [00:00<00:00, 1856.53 it/sec, obj=-4]
    INFO - 17:24:48: ...  40%|███▉      | 48/121 [00:00<00:00, 1858.03 it/sec, obj=-3]
    INFO - 17:24:48: ...  40%|████      | 49/121 [00:00<00:00, 1859.36 it/sec, obj=-2]
    INFO - 17:24:48: ...  41%|████▏     | 50/121 [00:00<00:00, 1860.43 it/sec, obj=-1]
    INFO - 17:24:48: ...  42%|████▏     | 51/121 [00:00<00:00, 1861.85 it/sec, obj=0]
    INFO - 17:24:48: ...  43%|████▎     | 52/121 [00:00<00:00, 1859.24 it/sec, obj=1]
    INFO - 17:24:48: ...  44%|████▍     | 53/121 [00:00<00:00, 1858.59 it/sec, obj=2]
    INFO - 17:24:48: ...  45%|████▍     | 54/121 [00:00<00:00, 1858.48 it/sec, obj=3]
    INFO - 17:24:48: ...  45%|████▌     | 55/121 [00:00<00:00, 1858.50 it/sec, obj=4]
    INFO - 17:24:48: ...  46%|████▋     | 56/121 [00:00<00:00, 1859.75 it/sec, obj=-5]
    INFO - 17:24:48: ...  47%|████▋     | 57/121 [00:00<00:00, 1860.90 it/sec, obj=-4]
    INFO - 17:24:48: ...  48%|████▊     | 58/121 [00:00<00:00, 1861.99 it/sec, obj=-3]
    INFO - 17:24:48: ...  49%|████▉     | 59/121 [00:00<00:00, 1863.07 it/sec, obj=-2]
    INFO - 17:24:48: ...  50%|████▉     | 60/121 [00:00<00:00, 1859.62 it/sec, obj=-1]
    INFO - 17:24:48: ...  50%|█████     | 61/121 [00:00<00:00, 1859.42 it/sec, obj=0]
    INFO - 17:24:48: ...  51%|█████     | 62/121 [00:00<00:00, 1859.24 it/sec, obj=1]
    INFO - 17:24:48: ...  52%|█████▏    | 63/121 [00:00<00:00, 1860.34 it/sec, obj=2]
    INFO - 17:24:48: ...  53%|█████▎    | 64/121 [00:00<00:00, 1861.43 it/sec, obj=3]
    INFO - 17:24:48: ...  54%|█████▎    | 65/121 [00:00<00:00, 1862.56 it/sec, obj=4]
    INFO - 17:24:48: ...  55%|█████▍    | 66/121 [00:00<00:00, 1863.31 it/sec, obj=5]
    INFO - 17:24:48: ...  55%|█████▌    | 67/121 [00:00<00:00, 1861.07 it/sec, obj=-4]
    INFO - 17:24:48: ...  56%|█████▌    | 68/121 [00:00<00:00, 1860.95 it/sec, obj=-3]
    INFO - 17:24:48: ...  57%|█████▋    | 69/121 [00:00<00:00, 1861.04 it/sec, obj=-2]
    INFO - 17:24:48: ...  58%|█████▊    | 70/121 [00:00<00:00, 1861.13 it/sec, obj=-1]
    INFO - 17:24:48: ...  59%|█████▊    | 71/121 [00:00<00:00, 1861.84 it/sec, obj=0]
    INFO - 17:24:48: ...  60%|█████▉    | 72/121 [00:00<00:00, 1862.56 it/sec, obj=1]
    INFO - 17:24:48: ...  60%|██████    | 73/121 [00:00<00:00, 1863.57 it/sec, obj=2]
    INFO - 17:24:48: ...  61%|██████    | 74/121 [00:00<00:00, 1864.48 it/sec, obj=3]
    INFO - 17:24:48: ...  62%|██████▏   | 75/121 [00:00<00:00, 1862.02 it/sec, obj=4]
    INFO - 17:24:48: ...  63%|██████▎   | 76/121 [00:00<00:00, 1861.95 it/sec, obj=5]
    INFO - 17:24:48: ...  64%|██████▎   | 77/121 [00:00<00:00, 1861.87 it/sec, obj=6]
    INFO - 17:24:48: ...  64%|██████▍   | 78/121 [00:00<00:00, 1862.74 it/sec, obj=-3]
    INFO - 17:24:48: ...  65%|██████▌   | 79/121 [00:00<00:00, 1863.44 it/sec, obj=-2]
    INFO - 17:24:48: ...  66%|██████▌   | 80/121 [00:00<00:00, 1864.26 it/sec, obj=-1]
    INFO - 17:24:48: ...  67%|██████▋   | 81/121 [00:00<00:00, 1864.83 it/sec, obj=0]
    INFO - 17:24:48: ...  68%|██████▊   | 82/121 [00:00<00:00, 1862.47 it/sec, obj=1]
    INFO - 17:24:48: ...  69%|██████▊   | 83/121 [00:00<00:00, 1862.15 it/sec, obj=2]
    INFO - 17:24:48: ...  69%|██████▉   | 84/121 [00:00<00:00, 1861.79 it/sec, obj=3]
    INFO - 17:24:48: ...  70%|███████   | 85/121 [00:00<00:00, 1862.64 it/sec, obj=4]
    INFO - 17:24:48: ...  71%|███████   | 86/121 [00:00<00:00, 1863.11 it/sec, obj=5]
    INFO - 17:24:48: ...  72%|███████▏  | 87/121 [00:00<00:00, 1864.05 it/sec, obj=6]
    INFO - 17:24:48: ...  73%|███████▎  | 88/121 [00:00<00:00, 1864.87 it/sec, obj=7]
    INFO - 17:24:48: ...  74%|███████▎  | 89/121 [00:00<00:00, 1865.62 it/sec, obj=-2]
    INFO - 17:24:48: ...  74%|███████▍  | 90/121 [00:00<00:00, 1863.45 it/sec, obj=-1]
    INFO - 17:24:48: ...  75%|███████▌  | 91/121 [00:00<00:00, 1863.28 it/sec, obj=0]
    INFO - 17:24:48: ...  76%|███████▌  | 92/121 [00:00<00:00, 1863.08 it/sec, obj=1]
    INFO - 17:24:48: ...  77%|███████▋  | 93/121 [00:00<00:00, 1863.69 it/sec, obj=2]
    INFO - 17:24:48: ...  78%|███████▊  | 94/121 [00:00<00:00, 1864.17 it/sec, obj=3]
    INFO - 17:24:48: ...  79%|███████▊  | 95/121 [00:00<00:00, 1864.79 it/sec, obj=4]
    INFO - 17:24:48: ...  79%|███████▉  | 96/121 [00:00<00:00, 1863.65 it/sec, obj=5]
    INFO - 17:24:48: ...  80%|████████  | 97/121 [00:00<00:00, 1861.64 it/sec, obj=6]
    INFO - 17:24:48: ...  81%|████████  | 98/121 [00:00<00:00, 1861.16 it/sec, obj=7]
    INFO - 17:24:48: ...  82%|████████▏ | 99/121 [00:00<00:00, 1860.14 it/sec, obj=8]
    INFO - 17:24:48: ...  83%|████████▎ | 100/121 [00:00<00:00, 1860.65 it/sec, obj=-1]
    INFO - 17:24:48: ...  83%|████████▎ | 101/121 [00:00<00:00, 1861.13 it/sec, obj=0]
    INFO - 17:24:48: ...  84%|████████▍ | 102/121 [00:00<00:00, 1861.69 it/sec, obj=1]
    INFO - 17:24:48: ...  85%|████████▌ | 103/121 [00:00<00:00, 1862.31 it/sec, obj=2]
    INFO - 17:24:48: ...  86%|████████▌ | 104/121 [00:00<00:00, 1862.94 it/sec, obj=3]
    INFO - 17:24:48: ...  87%|████████▋ | 105/121 [00:00<00:00, 1861.00 it/sec, obj=4]
    INFO - 17:24:48: ...  88%|████████▊ | 106/121 [00:00<00:00, 1860.93 it/sec, obj=5]
    INFO - 17:24:48: ...  88%|████████▊ | 107/121 [00:00<00:00, 1861.01 it/sec, obj=6]
    INFO - 17:24:48: ...  89%|████████▉ | 108/121 [00:00<00:00, 1861.63 it/sec, obj=7]
    INFO - 17:24:48: ...  90%|█████████ | 109/121 [00:00<00:00, 1862.18 it/sec, obj=8]
    INFO - 17:24:48: ...  91%|█████████ | 110/121 [00:00<00:00, 1862.64 it/sec, obj=9]
    INFO - 17:24:48: ...  92%|█████████▏| 111/121 [00:00<00:00, 1863.25 it/sec, obj=0]
    INFO - 17:24:48: ...  93%|█████████▎| 112/121 [00:00<00:00, 1861.81 it/sec, obj=1]
    INFO - 17:24:48: ...  93%|█████████▎| 113/121 [00:00<00:00, 1861.65 it/sec, obj=2]
    INFO - 17:24:48: ...  94%|█████████▍| 114/121 [00:00<00:00, 1861.50 it/sec, obj=3]
    INFO - 17:24:48: ...  95%|█████████▌| 115/121 [00:00<00:00, 1860.24 it/sec, obj=4]
    INFO - 17:24:48: ...  96%|█████████▌| 116/121 [00:00<00:00, 1860.29 it/sec, obj=5]
    INFO - 17:24:48: ...  97%|█████████▋| 117/121 [00:00<00:00, 1860.45 it/sec, obj=6]
    INFO - 17:24:48: ...  98%|█████████▊| 118/121 [00:00<00:00, 1860.47 it/sec, obj=7]
    INFO - 17:24:48: ...  98%|█████████▊| 119/121 [00:00<00:00, 1858.84 it/sec, obj=8]
    INFO - 17:24:48: ...  99%|█████████▉| 120/121 [00:00<00:00, 1858.61 it/sec, obj=9]
    INFO - 17:24:48: ... 100%|██████████| 121/121 [00:00<00:00, 1858.21 it/sec, obj=10]
    INFO - 17:24:48: Optimization result:
    INFO - 17:24:48:    Optimizer info:
    INFO - 17:24:48:       Status: None
    INFO - 17:24:48:       Message: None
    INFO - 17:24:48:       Number of calls to the objective function by the optimizer: 121
    INFO - 17:24:48:    Solution:
    INFO - 17:24:48:       Objective: -10.0
    INFO - 17:24:48:       Design space:
    INFO - 17:24:48:       +------+-------------+-------+-------------+---------+
    INFO - 17:24:48:       | name | lower_bound | value | upper_bound | type    |
    INFO - 17:24:48:       +------+-------------+-------+-------------+---------+
    INFO - 17:24:48:       | x[0] |      -5     |   -5  |      5      | integer |
    INFO - 17:24:48:       | x[1] |      -5     |   -5  |      5      | integer |
    INFO - 17:24:48:       +------+-------------+-------+-------------+---------+

Optimization result:
   Design variables: [-5. -5.]
   Objective function: -10.0
   Feasible solution: True

Post-process the results

execute_post(
    problem,
    "ScatterPlotMatrix",
    variable_names=["x", "f"],
    save=False,
    show=True,
)
plot simple opt 3
<gemseo.post.scatter_mat.ScatterPlotMatrix object at 0x7fccf042dd00>

Note that you can get all the optimization algorithms names:

algo_list = DOEFactory().algorithms
print("Available algorithms ", algo_list)
Available algorithms  ['CustomDOE', 'DiagonalDOE', 'OT_SOBOL', 'OT_RANDOM', 'OT_HASELGROVE', 'OT_REVERSE_HALTON', 'OT_HALTON', 'OT_FAURE', 'OT_MONTE_CARLO', 'OT_FACTORIAL', 'OT_COMPOSITE', 'OT_AXIAL', 'OT_OPT_LHS', 'OT_LHS', 'OT_LHSC', 'OT_FULLFACT', 'OT_SOBOL_INDICES', 'fullfact', 'ff2n', 'pbdesign', 'bbdesign', 'ccdesign', 'lhs']

Total running time of the script: ( 0 minutes 1.135 seconds)

Gallery generated by Sphinx-Gallery