MIT have developed a technique called Self-Adapting Language Models (SEAL), which enables LLMs to continuously improve by generating their own synthetic training data and updating their internal parameters in response to new information.

ToolAlpaca, InterCode and Reflexion are taking different approaches among others.

LLMs of tomorrow will be quite different.