You have a point, but I think there are some big trade-offs...
Nature uses replication, but it's also horrifically complex and we have no real idea about the specifics of how it all works, or what to do when many, many things go wrong.
Also, I think nature uses cloning, which I kind of think would be called a 'library' in this case, for single-celled organisms (archaea and bacteria). In addition many eukaryotic organisms can reproduce via cloning under special situations.
I don't know, I'm not really trying to argue one way or the other. I'm kinda' thinking out loud here... but I'd like to see LLMs used to create really great libraries, or some other abstractions, that are easy to use and also understandable. It might not happen soon, but I think that there is a lot of value in moving things that way.
> but it's also horrifically complex and we have no real idea about the specifics of how it all works, or what to do when many, many things go wrong.
Sounds a lot like neural networks.
I think libraries are a result of the human brain's limited working memory capacity , while organisms or neural networks aren't so limited in what they can focus on. Perhaps the transformer became successful in syntactic abstraction because it is limited on how many things it can focus on.
Computer libraries are equally a result of limited memory and disk. Javascript is a counterexample of what happens when computing is free (because it runs on someone else's computer)
Nature uses replication, but it's also horrifically complex and we have no real idea about the specifics of how it all works, or what to do when many, many things go wrong.
Also, I think nature uses cloning, which I kind of think would be called a 'library' in this case, for single-celled organisms (archaea and bacteria). In addition many eukaryotic organisms can reproduce via cloning under special situations.
I don't know, I'm not really trying to argue one way or the other. I'm kinda' thinking out loud here... but I'd like to see LLMs used to create really great libraries, or some other abstractions, that are easy to use and also understandable. It might not happen soon, but I think that there is a lot of value in moving things that way.