Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I think it's also more than just systems and data centers. it is also difficult to scrape the web the way Google does without using Google IP addresses. a lot of the web now will block you or severely throttle you if you aren't one of the well know engines that they want indexing them.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: