Yeah, there’s been a lot of debate about this on r/localllama — will there be a steady supply of new free/open models in the future?
And if not, can we simply keep augmenting “stale” models with new knowledge to keep them useful?
I’m on the pessimistic side of things on both questions.
As for the second question, obviously stale models can be augmented to an extent but it’s nowhere near a substitute for new knowledge being fully baked directly into its training.
And if not, can we simply keep augmenting “stale” models with new knowledge to keep them useful?
I’m on the pessimistic side of things on both questions.
As for the second question, obviously stale models can be augmented to an extent but it’s nowhere near a substitute for new knowledge being fully baked directly into its training.