tick off gzip encoding
This commit is contained in:
1 parent
1e51e10db2
commit
17fa9f93f9
1 file changed
+2
-1
@@ -12,6 +12,7 @@
|
||||
* ~~remove base url from initial urls with and without trailing slash~~
|
||||
* ~~investigate using [tldextract](https://github.com/john-kurkowski/tldextract) to match urls~~ #wontfix
|
||||
* ~~implement parsing of [robots.txt](http://docs.w3cub.com/python~3.6/library/urllib.robotparser/)~~
|
||||
* investigate [gzip encoding](https://stackoverflow.com/questions/36383227/avoid-downloading-images-using-beautifulsoup-and-urllib-request)
|
||||
* ~~investigate [gzip encoding](https://stackoverflow.com/questions/36383227/avoid-downloading-images-using-beautifulsoup-and-urllib-request)~~
|
||||
* implement some kind of progress display
|
||||
* async
|
||||
* better exception handling
|
||||
Reference in new issue
Block a user