Tagged Questions

0
votes
0answers
10 views

What is the best way to mirror a wiki? [duplicate]

Wget in mirror mode doesn't function as hoped. It processes every single link so you end up getting user pages, old revisions, edit pages, and so many more irrelevant things. I let wget run for over ...
1
vote
1answer
91 views

How to mirror a website on linux?

There is this abandoned blog witch can disappear any moment, and I want to make a browsable copy this site. The saved pages should contain correct on-page links, liked images and other files like ...
1
vote
0answers
54 views

Download web server structure with empty files

I want to make a mirror of a Web server, but downloading the actual files will take too long. So I thought of having just the directory and file structure, and when I need the actual contents of the ...
2
votes
0answers
19 views

How can I download an entire (active) SMF2 forum? [duplicate]

Possible Duplicate: How can I download an entire website? I would like to download a full copy of a Simple Machines 2 Forum. I want to make a locally browsable copy of the entire forum. The ...
0
votes
2answers
236 views

Why does wget not get all the pages when mirroring this site

I want to mirror the following web site completely: http://tinaztitiz.com I use the following wget command: wget -m http://tinaztitiz.com The web site is a custom CMS and contains lots of pages ...
2
votes
1answer
729 views

Can wget convert links within a local html document?

I know that wget can fetch a remote page and its dependencies and rewrite the html so that image src attributes reference the newly downloaded images. I am trying to convert local html files that ...
0
votes
1answer
479 views

wget mirror not getting everything

I'm running wget -mk --no-check-certificate https://singpolyma.net/ And it seems to be pulling down all the pages and resources and blog posts, but it's missing a large number of the ...
2
votes
1answer
993 views

wget recursively with -np option still ascends to parent directory

tl;dr: will `wget --no-parrent -r ' download from a directory above the given url's directory? when using wget to download, say images, recursively from example.com/a/b with the -r and -np options, ...
2
votes
3answers
2k views

Escaping query strings with wget --mirror

I'm using wget --mirror --html-extension --convert-links to mirror a site, but I end up with lots of filenames in the format post.php?id=#.html. When I try to view these in a browser it fails, because ...
2
votes
2answers
2k views

Using wget to mirror a website and everything from the first level of external sites

I need to mirror a particular website (all the pages under that particular domain) any pages (but not whole sites) that the website links to. I'm confused about the how to do this wget -r ...
2
votes
2answers
250 views

wget terminates unexpectedly

I need to periodically traverse a site to update the server cache. It is a database driven site with very many (thousands of) pages. I use wget to mirror the site locally on the same server, so I use ...
5
votes
3answers
1k views

wget not converting links

I am trying to mirror a fairly large site (20,000+ pages) prior to a major overhaul. Basically, I need a backup before cutting over to the new one in case we forgot something we need (we'll have ...
6
votes
4answers
4k views

Wget 1.12 binary for Windows, can anybody find it?

I've been trying to find a Wget v1.12 binary for Windows as it parses CSS. No success. I successfully compiled for OS X but can't do the same for Windows. Is anybody else able to find or compile?
14
votes
3answers
23k views

Save a single web page (with background images) with Wget

I want to use Wget to save single web pages (not recursively, not whole sites) for reference. Much like Firefox's "Web Page, complete". My first problem is: I can't get Wget to save background images ...