Unix Blog !

September 30, 2003

How To – Wget

Filed under: Uncategorized — sriram003 @ 11:48 am

Download a Complete Site in u r system using Wget

wget –mirror -w 2 -p –HTML-extension –convert-links -P /home/sriram/websites/raid/mirror/ http://www.techtutorials.info

How can I make Wget ignore the robots.txt file?

wget -erobots=off http://your.site.here

Create a free website or blog at WordPress.com.