> It is a service that seems to crawl a website for content and feed that content into some LLMs.
It doesn't seem to work like that at all, to me.
As far as I understand, you give it a specific URL, and it extracts content from that URL and that URL only. A "crawl" would mean it would also follow links automatically, which I don't see any evidence of being done, from the landing page at least.
It doesn't seem to work like that at all, to me.
As far as I understand, you give it a specific URL, and it extracts content from that URL and that URL only. A "crawl" would mean it would also follow links automatically, which I don't see any evidence of being done, from the landing page at least.