Optimization Algorithms

This is a very concise report of some algorithms used in the optimization of real circuit in the following chapters.

First are reported some one-dimensional (with respect to the decision space) algorithms, and then the multi-dimensional algorithms, with some based on the previous ones. Finally some ``non''-standard algorithms are reported, since they can be suitable for the application to digital circuit.

In the following report we focus on the algorithms that do not require the evaluation of the gradient of the objective functions, or that approximate this gradient⁹, since (see §5.1) the functions available in real circuits are not known in a closed form and almost