bMorgan/sitemap-crawler
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Used networks to keep track of links

Browse source
This commit is contained in:
bMorgan01 2025-07-04 08:13:23 -06:00
parent ec5ef63474
commit 9ec87b1e29
2 changed files with 173 additions and 67 deletions
Download patch file Download diff file Expand all files Collapse all files

2
crawl.conf
View file

@ -1,6 +1,6 @@
[Config]
; Target site
site = http://www.benrmorgan.com
site = https://www.benrmorgan.com
; Target path Ex /var/www/html/sitemap.xml or ./sitemaps/sitemap.xml
target = /var/www/html/sitemap.xml
; Checksums path Ex ./checksums