Webscraping (via wget)

The following wget incantation will scrape a website:

wget -m -k -K -E -l 7 -t 6 -w 5 your_website_here

(your_website_here should of course be the website URL!)

This was obtained from this stackoverflow post.

As of November 11th, 2021, a scrape of my personal website clocks in at around 41mb uncompressed. That includes the various pictures, video, audio, and other binary media I crammed in here over the years.

---

home | index