I needed to set a cookie via .htaccess, to ensure it was always in the browser, regardless of what the website was doing. Setting a cookie is rather easy, it will look similar to: Header set Set-Cookie “cookieName=value; Expires=Wed, 15 May 2222 07:28:00 GMT” The next morning I attempted to login to the site and
Using wget to crawl your website
April 2, 2018
If you are looking to crawl your website for something like cache warming you can do so with wget quite easily. The following wget command will crawl a site and leave nothing behind on the local filesystem afterward. wget –mirror -q -e robots=off -p -r –delete-after -nd http://www.isleofmtv.com –mirror crawls the entire site -q prevents