sitemap-crawler/crawl.conf
bMorgan01 88df737db2 oops
2022-03-29 20:08:02 -06:00

9 lines
No EOL
283 B
Text

# Domain Ex: benrmorgan.com
benrmorgan.com
# Prefix Ex: http://www.
http://www.
# Target path Ex /var/www/html/sitemap.xml or ./sitemaps/sitemap.xml
/var/www/html/sitemap.xml
# Ignore urls containing Ex: /files/
/files/
/images/