4bb28031b6
Allow downloading of the page index as a csv. Remove unnecessary database columns url_base and status_noindex Store list of domains at crawl so we don't need to request them every page-load; you will need to reinstall fresh because of this change |
||
---|---|---|
.. | ||
css | ||
geoip2 | ||
img | ||
js | ||
libcurlemu | ||
mustache | ||
pdfparser | ||
phpmailer | ||
admin.php | ||
config.ini.php | ||
config.php | ||
crawler.php | ||
search.php |