this looks incredible and exactly like something i've been wanting. is there the same amount of depth for the 9k+ characters? if this is open source, id love to build on it;i was wandering if op had posted his on github.
Only about 5K explanations now I'm still trying to polish the pipeline before covering more. Due to all these verification and associated regenerations the cost is quite high.
It's not opon source but it is completely free. Open sourcing is on the table but currently it would be additional work and distraction. Just licenses seem like a headache, from a quick poke even when ok for use on non-commercial data redistributing may not be ok. So not any time soon, but if you are working on something similar I can at least share detailed datasources, finding good ones was not easy and LLM integrate them fast.
Mostly datasets but who knows if LLMs stuff also if I'm creating a datasets with them[0]. Long story short it's a potential headache, don't want that headache for now. Plus basically two options after open sourcing: people are not using it (time and effort wasted) or people are using it and then it's a chore. But still on the table. But I'm currently not close to the table.
