Friday 19 July 2013

Mirroring a website using wget

Every time I have to restore from my memory and man the same line of making a local copy of a website (or a part of it). But enough of that! I'll just post the line here and will never forget as long as this blog is not taken down (which may happen at some point, but who knows when and why?)

wget -N -np -r -l0 -k -p <URL>

wget -N -r -l0 -k -p -D website.edu,img.website.edu http://website.edu/stuffdir/ -I stuffdir  -H

Also, this fine man explains how to fix the tilde character converted to a hex value: http://www.kozubik.com/docs/wget_hack.txt (tldr: urlchr_table:url.c). Weird that the source Ubuntu version has it fixed while the binary package doesn't.

This post was brought to you by: a teacup of red wine.

No comments:

Post a Comment