[OpenAI][Stanley][Evolution][LM] Intelligent Mutations in Genetic Programming: OpenAI Proposes Evolution Through Large Models
Aug 25, 2022
New research from OpenAI (senior author Ken Stanley is a good friend from grad school days) shows how evolutionary computation can be used to fine tune large language models and help them explore uncharted territories.
Quote:
-
The ELM method for efficiently evolving programs through LLMs.
-
A technique for improving ELM’s ability to search over time by fine-tuning its LLM-based mutation operator.
-
A demonstration of ELM in a domain not included in the training data of the LLM.
-
Validation that data generated through ELM can bootstrap enhanced LLMs that offer a novel path towards open-endedness.
Choe: no need to have everything to be differentiable
← Back to all articles Quick Navigation: Next:[ j ] – Prev:[ k ] – List:[ l ]