bMorgan/link-crawler
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

make crawl.conf match ini spec

Browse source
This commit is contained in:
bMorgan01 2022-09-25 11:17:35 -06:00
parent e587b58444
commit 72a195a0e7
2 changed files with 11 additions and 13 deletions
Download patch file Download diff file Expand all files Collapse all files

10
crawl.conf
View file

@ -1,5 +1,5 @@
# Target Ex: http://www.google.com
http://www.benrmorgan.com
# Ignore urls containing Ex: /files/
/files/
/images/
[Config]
; Target site
site = http://www.benrmorgan.com
; Ignore urls containing Ex: /files/
ignore = /files/, /images/