Analytical test case # 3

In this example, we consider a simple optimization problem to illustrate algorithms interfaces and DOE libraries integration. Integer variables are used

Imports

from __future__ import annotations

from gemseo.algos.design_space import DesignSpace
from gemseo.algos.doe.doe_factory import DOEFactory
from gemseo.algos.opt_problem import OptimizationProblem
from gemseo.api import configure_logger
from gemseo.api import execute_post
from gemseo.core.mdofunctions.mdo_function import MDOFunction
from numpy import sum as np_sum

LOGGER = configure_logger()

Define the objective function

We define the objective function \(f(x)=\sum_{i=1}^dx_i\) using a MDOFunction.

objective = MDOFunction(np_sum, name="f", expr="sum(x)")

Define the design space

Then, we define the DesignSpace with GEMSEO.

design_space = DesignSpace()
design_space.add_variable("x", 2, l_b=-5, u_b=5, var_type="integer")

Define the optimization problem

Then, we define the OptimizationProblem with GEMSEO.

problem = OptimizationProblem(design_space)
problem.objective = objective

Solve the optimization problem using a DOE algorithm

We can see this optimization problem as a trade-off and solve it by means of a design of experiments (DOE), e.g. full factorial design

DOEFactory().execute(problem, "fullfact", n_samples=11**2)
    INFO - 16:37:14: Optimization problem:
    INFO - 16:37:14:    minimize f = sum(x)
    INFO - 16:37:14:    with respect to x
    INFO - 16:37:14:    over the design space:
    INFO - 16:37:14:    +------+-------------+-------+-------------+---------+
    INFO - 16:37:14:    | name | lower_bound | value | upper_bound | type    |
    INFO - 16:37:14:    +------+-------------+-------+-------------+---------+
    INFO - 16:37:14:    | x[0] |      -5     |  None |      5      | integer |
    INFO - 16:37:14:    | x[1] |      -5     |  None |      5      | integer |
    INFO - 16:37:14:    +------+-------------+-------+-------------+---------+
    INFO - 16:37:14: Solving optimization problem with algorithm fullfact:
    INFO - 16:37:14: ...   0%|          | 0/121 [00:00<?, ?it]
    INFO - 16:37:14: ...   1%|          | 1/121 [00:00<00:00, 4894.17 it/sec, obj=-10]
    INFO - 16:37:14: ...   2%|▏         | 2/121 [00:00<00:00, 3754.97 it/sec, obj=-9]
    INFO - 16:37:14: ...   2%|▏         | 3/121 [00:00<00:00, 3573.68 it/sec, obj=-8]
    INFO - 16:37:14: ...   3%|▎         | 4/121 [00:00<00:00, 3517.97 it/sec, obj=-7]
    INFO - 16:37:14: ...   4%|▍         | 5/121 [00:00<00:00, 3497.00 it/sec, obj=-6]
    INFO - 16:37:14: ...   5%|▍         | 6/121 [00:00<00:00, 3480.27 it/sec, obj=-5]
    INFO - 16:37:14: ...   6%|▌         | 7/121 [00:00<00:00, 3474.98 it/sec, obj=-4]
    INFO - 16:37:14: ...   7%|▋         | 8/121 [00:00<00:00, 3468.52 it/sec, obj=-3]
    INFO - 16:37:14: ...   7%|▋         | 9/121 [00:00<00:00, 3466.05 it/sec, obj=-2]
    INFO - 16:37:14: ...   8%|▊         | 10/121 [00:00<00:00, 3443.88 it/sec, obj=-1]
    INFO - 16:37:14: ...   9%|▉         | 11/121 [00:00<00:00, 3438.98 it/sec, obj=0]
    INFO - 16:37:14: ...  10%|▉         | 12/121 [00:00<00:00, 3436.31 it/sec, obj=-9]
    INFO - 16:37:14: ...  11%|█         | 13/121 [00:00<00:00, 3389.02 it/sec, obj=-8]
    INFO - 16:37:14: ...  12%|█▏        | 14/121 [00:00<00:00, 3385.43 it/sec, obj=-7]
    INFO - 16:37:14: ...  12%|█▏        | 15/121 [00:00<00:00, 3388.70 it/sec, obj=-6]
    INFO - 16:37:14: ...  13%|█▎        | 16/121 [00:00<00:00, 3391.91 it/sec, obj=-5]
    INFO - 16:37:14: ...  14%|█▍        | 17/121 [00:00<00:00, 3396.36 it/sec, obj=-4]
    INFO - 16:37:14: ...  15%|█▍        | 18/121 [00:00<00:00, 3398.03 it/sec, obj=-3]
    INFO - 16:37:14: ...  16%|█▌        | 19/121 [00:00<00:00, 3325.62 it/sec, obj=-2]
    INFO - 16:37:14: ...  17%|█▋        | 20/121 [00:00<00:00, 3320.77 it/sec, obj=-1]
    INFO - 16:37:14: ...  17%|█▋        | 21/121 [00:00<00:00, 3324.54 it/sec, obj=0]
    INFO - 16:37:14: ...  18%|█▊        | 22/121 [00:00<00:00, 3327.25 it/sec, obj=1]
    INFO - 16:37:14: ...  19%|█▉        | 23/121 [00:00<00:00, 3321.93 it/sec, obj=-8]
    INFO - 16:37:14: ...  20%|█▉        | 24/121 [00:00<00:00, 3322.77 it/sec, obj=-7]
    INFO - 16:37:14: ...  21%|██        | 25/121 [00:00<00:00, 3326.28 it/sec, obj=-6]
    INFO - 16:37:14: ...  21%|██▏       | 26/121 [00:00<00:00, 3314.14 it/sec, obj=-5]
    INFO - 16:37:14: ...  22%|██▏       | 27/121 [00:00<00:00, 3317.11 it/sec, obj=-4]
    INFO - 16:37:14: ...  23%|██▎       | 28/121 [00:00<00:00, 3321.47 it/sec, obj=-3]
    INFO - 16:37:14: ...  24%|██▍       | 29/121 [00:00<00:00, 3326.63 it/sec, obj=-2]
    INFO - 16:37:14: ...  25%|██▍       | 30/121 [00:00<00:00, 3330.05 it/sec, obj=-1]
    INFO - 16:37:14: ...  26%|██▌       | 31/121 [00:00<00:00, 3333.34 it/sec, obj=0]
    INFO - 16:37:14: ...  26%|██▋       | 32/121 [00:00<00:00, 3336.84 it/sec, obj=1]
    INFO - 16:37:14: ...  27%|██▋       | 33/121 [00:00<00:00, 3340.78 it/sec, obj=2]
    INFO - 16:37:14: ...  28%|██▊       | 34/121 [00:00<00:00, 3343.56 it/sec, obj=-7]
    INFO - 16:37:14: ...  29%|██▉       | 35/121 [00:00<00:00, 3346.65 it/sec, obj=-6]
    INFO - 16:37:14: ...  30%|██▉       | 36/121 [00:00<00:00, 3349.49 it/sec, obj=-5]
    INFO - 16:37:14: ...  31%|███       | 37/121 [00:00<00:00, 3346.54 it/sec, obj=-4]
    INFO - 16:37:14: ...  31%|███▏      | 38/121 [00:00<00:00, 3348.39 it/sec, obj=-3]
    INFO - 16:37:14: ...  32%|███▏      | 39/121 [00:00<00:00, 3339.69 it/sec, obj=-2]
    INFO - 16:37:14: ...  33%|███▎      | 40/121 [00:00<00:00, 3336.69 it/sec, obj=-1]
    INFO - 16:37:14: ...  34%|███▍      | 41/121 [00:00<00:00, 3338.18 it/sec, obj=0]
    INFO - 16:37:14: ...  35%|███▍      | 42/121 [00:00<00:00, 3339.54 it/sec, obj=1]
    INFO - 16:37:14: ...  36%|███▌      | 43/121 [00:00<00:00, 3340.59 it/sec, obj=2]
    INFO - 16:37:14: ...  36%|███▋      | 44/121 [00:00<00:00, 3343.16 it/sec, obj=3]
    INFO - 16:37:14: ...  37%|███▋      | 45/121 [00:00<00:00, 3346.04 it/sec, obj=-6]
    INFO - 16:37:14: ...  38%|███▊      | 46/121 [00:00<00:00, 3348.46 it/sec, obj=-5]
    INFO - 16:37:14: ...  39%|███▉      | 47/121 [00:00<00:00, 3350.48 it/sec, obj=-4]
    INFO - 16:37:14: ...  40%|███▉      | 48/121 [00:00<00:00, 3353.15 it/sec, obj=-3]
    INFO - 16:37:14: ...  40%|████      | 49/121 [00:00<00:00, 3355.83 it/sec, obj=-2]
    INFO - 16:37:14: ...  41%|████▏     | 50/121 [00:00<00:00, 3354.21 it/sec, obj=-1]
    INFO - 16:37:14: ...  42%|████▏     | 51/121 [00:00<00:00, 3355.86 it/sec, obj=0]
    INFO - 16:37:14: ...  43%|████▎     | 52/121 [00:00<00:00, 3350.65 it/sec, obj=1]
    INFO - 16:37:14: ...  44%|████▍     | 53/121 [00:00<00:00, 3343.08 it/sec, obj=2]
    INFO - 16:37:14: ...  45%|████▍     | 54/121 [00:00<00:00, 3343.56 it/sec, obj=3]
    INFO - 16:37:14: ...  45%|████▌     | 55/121 [00:00<00:00, 3345.42 it/sec, obj=4]
    INFO - 16:37:14: ...  46%|████▋     | 56/121 [00:00<00:00, 3347.93 it/sec, obj=-5]
    INFO - 16:37:14: ...  47%|████▋     | 57/121 [00:00<00:00, 3350.13 it/sec, obj=-4]
    INFO - 16:37:14: ...  48%|████▊     | 58/121 [00:00<00:00, 3352.16 it/sec, obj=-3]
    INFO - 16:37:14: ...  49%|████▉     | 59/121 [00:00<00:00, 3354.26 it/sec, obj=-2]
    INFO - 16:37:14: ...  50%|████▉     | 60/121 [00:00<00:00, 3356.43 it/sec, obj=-1]
    INFO - 16:37:14: ...  50%|█████     | 61/121 [00:00<00:00, 3358.31 it/sec, obj=0]
    INFO - 16:37:14: ...  51%|█████     | 62/121 [00:00<00:00, 3359.78 it/sec, obj=1]
    INFO - 16:37:14: ...  52%|█████▏    | 63/121 [00:00<00:00, 3362.02 it/sec, obj=2]
    INFO - 16:37:14: ...  53%|█████▎    | 64/121 [00:00<00:00, 3360.36 it/sec, obj=3]
    INFO - 16:37:14: ...  54%|█████▎    | 65/121 [00:00<00:00, 3361.61 it/sec, obj=4]
    INFO - 16:37:14: ...  55%|█████▍    | 66/121 [00:00<00:00, 3359.07 it/sec, obj=5]
    INFO - 16:37:14: ...  55%|█████▌    | 67/121 [00:00<00:00, 3358.97 it/sec, obj=-4]
    INFO - 16:37:14: ...  56%|█████▌    | 68/121 [00:00<00:00, 3360.70 it/sec, obj=-3]
    INFO - 16:37:14: ...  57%|█████▋    | 69/121 [00:00<00:00, 3362.46 it/sec, obj=-2]
    INFO - 16:37:14: ...  58%|█████▊    | 70/121 [00:00<00:00, 3363.59 it/sec, obj=-1]
    INFO - 16:37:14: ...  59%|█████▊    | 71/121 [00:00<00:00, 3364.96 it/sec, obj=0]
    INFO - 16:37:14: ...  60%|█████▉    | 72/121 [00:00<00:00, 3366.55 it/sec, obj=1]
    INFO - 16:37:14: ...  60%|██████    | 73/121 [00:00<00:00, 3367.92 it/sec, obj=2]
    INFO - 16:37:14: ...  61%|██████    | 74/121 [00:00<00:00, 3369.36 it/sec, obj=3]
    INFO - 16:37:14: ...  62%|██████▏   | 75/121 [00:00<00:00, 3370.90 it/sec, obj=4]
    INFO - 16:37:14: ...  63%|██████▎   | 76/121 [00:00<00:00, 3372.13 it/sec, obj=5]
    INFO - 16:37:14: ...  64%|██████▎   | 77/121 [00:00<00:00, 3371.28 it/sec, obj=6]
    INFO - 16:37:14: ...  64%|██████▍   | 78/121 [00:00<00:00, 3370.97 it/sec, obj=-3]
    INFO - 16:37:14: ...  65%|██████▌   | 79/121 [00:00<00:00, 3372.04 it/sec, obj=-2]
    INFO - 16:37:14: ...  66%|██████▌   | 80/121 [00:00<00:00, 3367.74 it/sec, obj=-1]
    INFO - 16:37:14: ...  67%|██████▋   | 81/121 [00:00<00:00, 3366.32 it/sec, obj=0]
    INFO - 16:37:14: ...  68%|██████▊   | 82/121 [00:00<00:00, 3365.82 it/sec, obj=1]
    INFO - 16:37:14: ...  69%|██████▊   | 83/121 [00:00<00:00, 3366.87 it/sec, obj=2]
    INFO - 16:37:14: ...  69%|██████▉   | 84/121 [00:00<00:00, 3368.24 it/sec, obj=3]
    INFO - 16:37:14: ...  70%|███████   | 85/121 [00:00<00:00, 3369.49 it/sec, obj=4]
    INFO - 16:37:14: ...  71%|███████   | 86/121 [00:00<00:00, 3370.11 it/sec, obj=5]
    INFO - 16:37:14: ...  72%|███████▏  | 87/121 [00:00<00:00, 3371.60 it/sec, obj=6]
    INFO - 16:37:14: ...  73%|███████▎  | 88/121 [00:00<00:00, 3373.08 it/sec, obj=7]
    INFO - 16:37:14: ...  74%|███████▎  | 89/121 [00:00<00:00, 3374.37 it/sec, obj=-2]
    INFO - 16:37:14: ...  74%|███████▍  | 90/121 [00:00<00:00, 3375.09 it/sec, obj=-1]
    INFO - 16:37:14: ...  75%|███████▌  | 91/121 [00:00<00:00, 3373.83 it/sec, obj=0]
    INFO - 16:37:14: ...  76%|███████▌  | 92/121 [00:00<00:00, 3374.75 it/sec, obj=1]
    INFO - 16:37:14: ...  77%|███████▋  | 93/121 [00:00<00:00, 3375.45 it/sec, obj=2]
    INFO - 16:37:14: ...  78%|███████▊  | 94/121 [00:00<00:00, 3372.23 it/sec, obj=3]
    INFO - 16:37:14: ...  79%|███████▊  | 95/121 [00:00<00:00, 3372.77 it/sec, obj=4]
    INFO - 16:37:14: ...  79%|███████▉  | 96/121 [00:00<00:00, 3373.77 it/sec, obj=5]
    INFO - 16:37:14: ...  80%|████████  | 97/121 [00:00<00:00, 3374.73 it/sec, obj=6]
    INFO - 16:37:14: ...  81%|████████  | 98/121 [00:00<00:00, 3375.28 it/sec, obj=7]
    INFO - 16:37:14: ...  82%|████████▏ | 99/121 [00:00<00:00, 3376.53 it/sec, obj=8]
    INFO - 16:37:14: ...  83%|████████▎ | 100/121 [00:00<00:00, 3377.52 it/sec, obj=-1]
    INFO - 16:37:14: ...  83%|████████▎ | 101/121 [00:00<00:00, 3378.48 it/sec, obj=0]
    INFO - 16:37:14: ...  84%|████████▍ | 102/121 [00:00<00:00, 3379.54 it/sec, obj=1]
    INFO - 16:37:14: ...  85%|████████▌ | 103/121 [00:00<00:00, 3380.47 it/sec, obj=2]
    INFO - 16:37:14: ...  86%|████████▌ | 104/121 [00:00<00:00, 3381.56 it/sec, obj=3]
    INFO - 16:37:14: ...  87%|████████▋ | 105/121 [00:00<00:00, 3380.27 it/sec, obj=4]
    INFO - 16:37:14: ...  88%|████████▊ | 106/121 [00:00<00:00, 3377.34 it/sec, obj=5]
    INFO - 16:37:14: ...  88%|████████▊ | 107/121 [00:00<00:00, 3374.59 it/sec, obj=6]
    INFO - 16:37:14: ...  89%|████████▉ | 108/121 [00:00<00:00, 3373.64 it/sec, obj=7]
    INFO - 16:37:14: ...  90%|█████████ | 109/121 [00:00<00:00, 3368.84 it/sec, obj=8]
    INFO - 16:37:14: ...  91%|█████████ | 110/121 [00:00<00:00, 3367.62 it/sec, obj=9]
    INFO - 16:37:14: ...  92%|█████████▏| 111/121 [00:00<00:00, 3368.29 it/sec, obj=0]
    INFO - 16:37:14: ...  93%|█████████▎| 112/121 [00:00<00:00, 3369.09 it/sec, obj=1]
    INFO - 16:37:14: ...  93%|█████████▎| 113/121 [00:00<00:00, 3369.88 it/sec, obj=2]
    INFO - 16:37:14: ...  94%|█████████▍| 114/121 [00:00<00:00, 3370.61 it/sec, obj=3]
    INFO - 16:37:14: ...  95%|█████████▌| 115/121 [00:00<00:00, 3371.60 it/sec, obj=4]
    INFO - 16:37:14: ...  96%|█████████▌| 116/121 [00:00<00:00, 3358.45 it/sec, obj=5]
    INFO - 16:37:14: ...  97%|█████████▋| 117/121 [00:00<00:00, 3341.60 it/sec, obj=6]
    INFO - 16:37:14: ...  98%|█████████▊| 118/121 [00:00<00:00, 3338.33 it/sec, obj=7]
    INFO - 16:37:14: ...  98%|█████████▊| 119/121 [00:00<00:00, 3334.93 it/sec, obj=8]
    INFO - 16:37:14: ...  99%|█████████▉| 120/121 [00:00<00:00, 3333.93 it/sec, obj=9]
    INFO - 16:37:14: ... 100%|██████████| 121/121 [00:00<00:00, 3334.37 it/sec, obj=10]
    INFO - 16:37:14: Optimization result:
    INFO - 16:37:14:    Optimizer info:
    INFO - 16:37:14:       Status: None
    INFO - 16:37:14:       Message: None
    INFO - 16:37:14:       Number of calls to the objective function by the optimizer: 121
    INFO - 16:37:14:    Solution:
    INFO - 16:37:14:       Objective: -10.0
    INFO - 16:37:14:       Design space:
    INFO - 16:37:14:       +------+-------------+-------+-------------+---------+
    INFO - 16:37:14:       | name | lower_bound | value | upper_bound | type    |
    INFO - 16:37:14:       +------+-------------+-------+-------------+---------+
    INFO - 16:37:14:       | x[0] |      -5     |   -5  |      5      | integer |
    INFO - 16:37:14:       | x[1] |      -5     |   -5  |      5      | integer |
    INFO - 16:37:14:       +------+-------------+-------+-------------+---------+

Optimization result:
   Design variables: [-5. -5.]
   Objective function: -10.0
   Feasible solution: True

Post-process the results

execute_post(
    problem,
    "ScatterPlotMatrix",
    variable_names=["x", "f"],
    save=False,
    show=True,
)
plot simple opt 3
<gemseo.post.scatter_mat.ScatterPlotMatrix object at 0x7fc227fd6fa0>

Note that you can get all the optimization algorithms names:

algo_list = DOEFactory().algorithms
print("Available algorithms ", algo_list)
Available algorithms  ['CustomDOE', 'DiagonalDOE', 'OT_SOBOL', 'OT_RANDOM', 'OT_HASELGROVE', 'OT_REVERSE_HALTON', 'OT_HALTON', 'OT_FAURE', 'OT_MONTE_CARLO', 'OT_FACTORIAL', 'OT_COMPOSITE', 'OT_AXIAL', 'OT_OPT_LHS', 'OT_LHS', 'OT_LHSC', 'OT_FULLFACT', 'OT_SOBOL_INDICES', 'fullfact', 'ff2n', 'pbdesign', 'bbdesign', 'ccdesign', 'lhs']

Total running time of the script: ( 0 minutes 0.681 seconds)

Gallery generated by Sphinx-Gallery