bMorgan/SpellingSpider
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

finished

Browse source
This commit is contained in:
bMorgan01 2022-09-01 11:23:17 -06:00
parent 9d2c4f631b
commit c21557e78c
2 changed files with 119 additions and 34 deletions
Download patch file Download diff file Expand all files Collapse all files

20
crawl.conf
View file

@ -3,7 +3,23 @@ benrmorgan.com
# Prefix Ex: http://www.
http://www.
# Target path Ex /var/www/html/sitemap.xml or ./sitemaps/sitemap.xml
./
./reports/report.txt
# Ignore urls containing Ex: /files/
/files/
/images/
/images/
# Custom Dictionary Ex: Strato
Strato
Rainmeter
WebinarsGUI
LON-CAPA
EMWAVE
FACQUAD
dx
dy
PATHAG
PNTSLOPE
PERPLINE
QUADRATI
kerf
toolset
cron