New release of Gradient-Free-Optimizers with two new evolutionary algorithms
The Gradient-Free-Optimizers GitHub repository offers various non-gradient optimization techniques, a user-friendly API, and supports multiple algorithms, including Bayesian optimization, with easy installation and comprehensive documentation.
Read original articleThe GitHub repository Gradient-Free-Optimizers offers a collection of optimization techniques that do not depend on gradients, suitable for numerical discrete search spaces. It features a user-friendly API for defining objective functions and search spaces, and incorporates modern optimization methods like Bayesian optimization, which are particularly effective for expensive objective functions. The library is rigorously tested, boasting over 400 tests to validate the performance of its algorithms.
The repository supports various optimization algorithms categorized into four main types: local optimization methods such as Hill Climbing and Simulated Annealing; global optimization techniques including Random Search and Grid Search; population-based methods like Particle Swarm Optimization and Genetic Algorithms; and sequential model-based optimization strategies such as Bayesian Optimization and the DIRECT algorithm.
Installation of the package is straightforward via pip, using the command "pip install gradient-free-optimizers." Additionally, the repository provides examples demonstrating the optimization of both convex and non-convex functions, as well as the optimization of machine learning hyperparameters. For further details, users can access the official documentation linked within the repository.
Related
Show HN: A Modern Palletization App
The GitHub repository for "Stack Solver" by [@VladM7] offers pallet optimization, 3D visualization, and user-friendly features. Future plans include truck loading optimization and multi-box support. Installation involves `setup.exe`. Contact for support.
Gaussian Processes
Bayesian Optimization explained with applications in Hyperparameter Optimization and Neural Architecture Search. Uses Gaussian Processes to balance exploration and exploitation, adapting iteratively for dynamic input space exploration. Versatile optimization technique with evolving applications.
Show HN: Minigrad – a small neural network lib in Golang
The GitHub repository hosts "minigrad," a Golang neural network library resembling PyTorch, featuring an autograd engine. Users can contribute via issues, pull requests, and testing. The library is MIT-licensed.
Kompute – Vulkan Alternative to CUDA
The GitHub repository for the Kompute project offers detailed insights into its principles, features, and examples. It covers Python modules, asynchronous processing, mobile optimization, memory management, unit testing, and more.
Archive of Interesting Code
The Archive of Interesting Code is a personal project featuring various algorithms and data structures implemented in C++, Java, and other languages, serving as a resource for programmers.
i find it interesting that Gradient-Free-Optimizers is used in a library for hyperparameter optimization. so in essence using a gradient-free approach to optimize a gradient-based approach
It looks like they have many of the same algorithms.
Related
Show HN: A Modern Palletization App
The GitHub repository for "Stack Solver" by [@VladM7] offers pallet optimization, 3D visualization, and user-friendly features. Future plans include truck loading optimization and multi-box support. Installation involves `setup.exe`. Contact for support.
Gaussian Processes
Bayesian Optimization explained with applications in Hyperparameter Optimization and Neural Architecture Search. Uses Gaussian Processes to balance exploration and exploitation, adapting iteratively for dynamic input space exploration. Versatile optimization technique with evolving applications.
Show HN: Minigrad – a small neural network lib in Golang
The GitHub repository hosts "minigrad," a Golang neural network library resembling PyTorch, featuring an autograd engine. Users can contribute via issues, pull requests, and testing. The library is MIT-licensed.
Kompute – Vulkan Alternative to CUDA
The GitHub repository for the Kompute project offers detailed insights into its principles, features, and examples. It covers Python modules, asynchronous processing, mobile optimization, memory management, unit testing, and more.
Archive of Interesting Code
The Archive of Interesting Code is a personal project featuring various algorithms and data structures implemented in C++, Java, and other languages, serving as a resource for programmers.