Tag Info

New answers tagged

1

I use wget -rkpN -e robots=off http://www.example.com/ -r means recursively -k means convert links. So links on the webpage will be localhost instead of example.com/bla -p means get all webpage resources so obtain images and javascript files to make website work properly. -N is to retrieve timestamps so if local files are newer than files on remote ...


0

wget -m -A * -pk -e robots=off www.mysite.com/ this will download all type of files locally and point to them from the html file and it will ignore robots file


1

Another solution, after being loggued in in the browser, if you don't want to use the firefox cookie extractor in python is to open your web inspector and check what session headers are sent. Eg. in Chrome: Remote Address:111.11.111.111:80 Request URL:http://example.com Request Method:GET Status Code:200 OK Request Headersview source ...


1

Short answer: See BashFAQ #50: I'm trying to put a command in a variable, but the complex cases always fail!. Long answer: When the shell parses a command line, it does it does things like figuring out which portions of the line are in quotes (or escaped or whatever) before it substitutes variables; thus, if you have any quotes or escapes inside the ...


0

The idiom I've used is this: cmd="some command in a string" "$cmd" Note that unlike using exec, the calling script will continue. Some modification may be required if your command includes special characters. Here's another variation I've used (I don't remember why I did it this way): cmd="some command in a string" bash -c "$cmd" Here's a complete ...


0

As you have typed it COMMAND-TO-EXECUTE is not a valid shell variable name, remove the dashes. This might give some clues: $ echo $COMMAND-TO-EXECUTE -TO-EXECUTE $ COMMAND-TO-EXECUTE=Test COMMAND-TO-EXECUTE=Test: command not found $ COMMAND_TO_EXECUTE=Test $ echo $COMMAND_TO_EXECUTE Test $ Then "foo "$1" --option1 --option2 "$2 looks a bit odd. If ...


1

You could just use lynx or some other text mode browser. You can just pass the url that you do know to it and it'll probably be able to get the file for you. If you want a more streamline way to do this then you're going to need to get the final request made to the webserver for this file. If that request is different each time then a text mode browser is ...


0

wget -c also continues partial files caused when the download has issues..... Better yet, wget -c -N seems to do both at the same time.


0

First of a brief breakdown of the command you're using. cd ~ - will descend you to your "home" directory (~ is a variable) wget -O - will download the file tar -zxf - will unpack downloaded file Try the step-by-step approach. In terminal type following: cd ~ and type pwd (your location should be something like /home/username) wget ...



Top 50 recent answers are included