update with changes

This commit is contained in:
2018-09-09 10:22:18 +01:00
parent 225fd8b3ea
commit 1e51e10db2

View File

@@ -14,3 +14,4 @@
* ~~implement parsing of [robots.txt](http://docs.w3cub.com/python~3.6/library/urllib.robotparser/)~~
* investigate [gzip encoding](https://stackoverflow.com/questions/36383227/avoid-downloading-images-using-beautifulsoup-and-urllib-request)
* implement some kind of progress display
* async