I'm curious whether anyone is implementing concepts from evolutionary biology into AI development. My thought is that biological evolution is deeply rooted in scarcity and the survival of species competing for limited resources. Most AI, however, is trained on specific datasets and doesn't experience life-or-death scenarios that would drive its development. Are there projects that apply Darwinian evolution models to encourage AI to adapt or evolve more efficiently? I saw that Claude Opus has given AIs specific situations to respond to, but I haven't found anything on using this evolutionary approach during the initial training phase.
4 Answers
Yeah, Genetic Algorithms need large populations and multiple iterations to be effective, which makes them challenging for training large language models given how resource-heavy they are. I think the current tech limits this approach.
Back in the 1980s, some early machine learning models utilized these methods, but they’ve largely fallen out of favor as newer techniques surfaced. While we still learn about them in academia, I'm not seeing much active application in current research or commercial settings.
Genetic Algorithms are one way to bring evolutionary concepts into AI training. They can be quite resource-intensive, though, and there's no guarantee they'll lead to the desired advancements, often getting stuck in local maxima. They're commonly used to train neural nets, but not so much for large language models due to the significant computational resources they require.
Generative Adversarial Networks (GANs) might be a parallel to what you're asking about. While they're not exactly a dramatic 'survival of the fittest' scenario, they do involve a generative model creating fake samples and a discriminator trying to tell what’s real. They train each other in a back-and-forth manner, which sorta mimics an evolutionary process. If you're interested, you can check more about it [here](https://en.wikipedia.org/wiki/Generative_adversarial_network).

Related Questions
Biggest Problem With Suno AI Audio
How to Build a Custom GPT Journalist That Posts Directly to WordPress