Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
PHP Parallel Web Scraper (perplexedlabs.com)
11 points by matticakes on Dec 18, 2008 | hide | past | favorite | 2 comments


Does this support HTTP pipelining? I've been looking for a way to efficiently retrieve several pages from the same sever simultaneously, and from what I've read pipelining is the best way to go; I just don't know if it's possible in PHP.


HTTP pipelining support was added in curl and libcurl 7.16.0:

http://freshmeat.net/projects/curl/?branch_id=1612&relea...

So it should work with PHP as well.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: