Simon Weald 8698c21fda return from WebPage to indicate whether a link was actually crawlable and only actually crawl it if it was

2018-09-12 08:03:08 +01:00

..

__init__.py

blank __init__.py

2018-08-28 22:29:11 +01:00

helpers.py

return from WebPage to indicate whether a link was actually crawlable and only actually crawl it if it was

2018-09-12 08:03:08 +01:00