add flags to README
This commit is contained in:
@@ -16,6 +16,13 @@ Run:
|
||||
python crawler.py -u https://urltocrawl.com [-c 100]
|
||||
```
|
||||
|
||||
Flags:
|
||||
|
||||
- -u/--url https://url.com
|
||||
- The base URL is required.
|
||||
- -c/--concurrency 100
|
||||
- Specifying concurrency value is optional (defaults to 100).
|
||||
|
||||
## Results
|
||||
|
||||
The resulting sitemap will be output to the root of this directory as `sitemap.html`
|
||||
|
||||
Reference in New Issue
Block a user