Open-Ended Evolution of Artistic Styles in Diffusion Models via Island-Based Genetic Algorithms

This paper explores a novel approach to generative image creation by evolving prompt embeddings—the internal conditioning tensors used by diffusion models—rather than optimizing prompt text. Using SDXL-Turbo and a real-valued Genetic Algorithm within an Island Model setup, distinct artistic styles are assigned to separate islands, which evolve independently and interact via migration to stimulate stylistic influence. The goal is not to optimize a fixed objective but to explore the prompt embedding space in an open-ended manner. Evolution is guided by the Aesthetics Predictor V2 to maintain baseline visual quality, while selection pressure is kept intentionally low to preserve diversity. Image-based results demonstrate how the embedding space is traversed over generations, producing varied and sometimes unexpected combinations of artistic traits. Outputs are visualized through PCA and UMAP projections, and ancestry tracking highlights stylistic evolution. All experiments are reproducible via an open-source Jupyter Notebook accompanying this paper. The method shows that evolutionary algorithms can explore embedding spaces in a structured, interpretable way—enabling creative image generation beyond manual prompt engineering.