geneticml
This package contains a simple and lightweight genetic algorithm for optimization of any machine learning model.
Installation
Use pip to install the package from PyPI:
pip install geneticml
Usage
This package provides a easy way to create estimators and perform the optimization with genetic algorithms. The example below describe in details how to create a simulation with genetic algorithms using evolutionary approach to train a sklearn.neural_network.MLPClassifier. A full list of examples could be found here.
from geneticml.optimizers import GeneticOptimizer
from geneticml.strategy import EvolutionaryStrategy
from geneticml.algorithms import EstimatorBuilder
from metrics import metric_accuracy
from sklearn.neural_network import MLPClassifier
from sklearn.datasets import load_iris
# Creates a custom fit method
def fit(model, x, y):
return model.fit(x, y)
# Creates a custom predict method
def predict(model, x):
return model.predict(x)
if __name__ == "__main__":
seed = 11412
# Creates an estimator
estimator = EstimatorBuilder()\
.of(model_type=MLPClassifier)\
.fit_with(func=fit)\
.predict_with(func=predict)\
.build()
# Defines a strategy for the optimization
strategy = EvolutionaryStrategy(
estimator_type=estimator,
parameters=parameters,
retain=0.4,
random_select=0.1,
mutate_chance=0.2,
max_children=2,
random_state=seed
)
# Creates the optimizer
optimizer = GeneticOptimizer(strategy=strategy)
# Loads the data
data = load_iris()
# Defines the metric
metric = metric_accuracy
greater_is_better = True
# Create the simulation using the optimizer and the strategy
models = optimizer.simulate(
data=data.data,
target=data.target,
generations=generations,
population=population,
evaluation_function=metric,
greater_is_better=greater_is_better,
verbose=True
)
The estimator is the way you define an algorithm or a class that will be used for model instantiation
estimator = EstimatorBuilder().of(model_type=MLPClassifier).fit_with(func=fit).predict_with(func=predict).build()
You need to speficy a custom fit and predict functions. These functions need to use the same signature than the below ones. This happens because the algorithm is generic and needs to know how to perform the fit and predict functions for the models.
# Creates a custom fit method
def fit(model, x, y):
return model.fit(x, y)
# Creates a custom predict method
def predict(model, x):
return model.predict(x)
Custom strategy
You can create custom strategies for the optimizers by extending the geneticml.strategy.BaseStrategy and implementing the execute(...) function.
class MyCustomStrategy(BaseStrategy):
def __init__(self, estimator_type: Type[BaseEstimator]) -> None:
super().__init__(estimator_type)
def execute(self, population: List[Type[T]]) -> List[T]:
return population
The custom strategies will allow you to create optimization strategies to archive your goals. We currently have the evolutionary strategy but you can define your own :)
Custom optimizer
You can create custom optimizers by extending the geneticml.optimizers.BaseOptimizer and implementing the simulate(...) function.
class MyCustomOptimizer(BaseOptimizer):
def __init__(self, strategy: Type[BaseStrategy]) -> None:
super().__init__(strategy)
def simulate(self, data, target, verbose: bool = True) -> List[T]:
"""
Generate a network with the genetic algorithm.
Parameters:
data (?): The data used to train the algorithm
target (?): The targets used to train the algorithm
verbose (bool): True if should verbose or False if not
Returns:
(List[BaseEstimator]): A list with the final population sorted by their loss
"""
estimators = self._strategy.create_population()
for x in estimators:
x.fit(data, target)
y_pred = x.predict(target)
pass
Custom optimizers will let you define how you want your algorithm to optimize the selected strategy. You can also combine custom strategies and optimizers to archive your desire objective.
Testing
The following are the steps to create a virtual environment into a folder named "venv" and install the requirements.
# Create virtualenv
python3 -m venv venv
# activate virtualenv
source venv/bin/activate
# update packages
pip install --upgrade pip setuptools wheel
# install requirements
python setup.py install
Tests can be run with python setup.py test when the virtualenv is active.
Contributing
All contributions, bug reports, bug fixes, documentation improvements, enhancements, and ideas are welcome.
A detailed overview on how to contribute can be found in the contributing guide. There is also an overview on GitHub.
If you are simply looking to start working with the geneticml codebase, navigate to the GitHub "issues" tab and start looking through interesting issues. Or maybe through using geneticml you have an idea of your own or are looking for something in the documentation and thinking ‘this can be improved’...you can do something about it!
Feel free to ask questions on the mailing the contributors.
Changelog
1.0.3 - Included pytorch example
1.0.2 - Minor fixes on naming
1.0.1 - README fixes
1.0.0 - First release
6.1k Jan 5, 2023
10 Aug 30, 2022
1.4k Dec 25, 2022
136 Jan 8, 2023
149 Jan 9, 2023
150 Dec 14, 2022
1 Oct 24, 2021
9 Oct 31, 2022
19 Dec 10, 2022
203 Jan 05, 2023
1 Apr 10, 2022
47 Dec 16, 2022
6 Sep 17, 2022
40 Aug 31, 2022
98 Dec 20, 2022
11 Nov 25, 2022
31 Oct 10, 2022
7 Dec 23, 2022
615 Jan 03, 2023
80 Dec 15, 2022
543 Jan 04, 2023
6 Jul 08, 2022
199 Oct 25, 2022
152 Dec 06, 2022
19 Dec 19, 2022
43 Dec 20, 2022
181 Nov 18, 2022
6.9k Jan 03, 2023
129 Dec 30, 2022