misc/web-scraper
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

improve documentation

Browse Source
This commit is contained in:
Simon Weald
2018-09-16 15:53:47 +01:00
parent a926090bed
commit 524f6a45cd
2 changed files with 13 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
README.md
View File

@@ -2,7 +2,7 @@
## Requirements
This crawler was written in 3.7.0 to take advantage of the latest `asyncio` features.
This crawler requires at least Python 3.5 in order to utilise the async/await keywords from `asyncio`.
Install required modules:
@@ -13,9 +13,9 @@ pip install -r requirements.txt
Run:
```bash
python crawler.py -u https://urltocrawl.com
python crawler.py -u https://urltocrawl.com [-c 100]
```
## Results
The resulting sitemap will be output in the root of this directory as `sitemap.html`
The resulting sitemap will be output to the root of this directory as `sitemap.html`