[Twisted-web] Design for HTTP client form login and scraping

David Bern odie5533 at gmail.com
Mon Jul 27 02:05:21 EDT 2009


I want to make multiple HTTP requests using the same set of cookies.
Should I call client.getPage a lot thus creating multiple factories to
do this? Should I subclass the HTTPClientFactory and put logic in
there? I am kinda lost on how to attack this. I want the program to
login to a site and run some scraping on it.

Regards,
David Bern



More information about the Twisted-web mailing list