I bookmark and favorite at least 20 pages of useful information a day on stackoverflow, blogs and the web in general. I'm sure some of the advice and information I find online will be indispensable even after 20yrs (god willing stackoverflow should be alive :). Is there an easy way to mirror good websites without the hassle of going through 5-10 steps with tools like HTTrack? How do you store useful information you find in general?
migrated from programmers.stackexchange.com Feb 15 '11 at 19:22
Opera and Internet Explorer has the "Save as single web page" option, which allows you to save a complete copy with the .mht extension.
Very, very useful.
Open again with IE or Opera, depending on what you have available.
I had a recent blog post about it not too long ago. I found that Dropbox, Evernote, and Instapaper were my top choices.
Super simple file sharing that goes from any computer, online, and even a multitude of mobile devices with ease. Very easy to back something like Elements or Plain Text with Dropbox.
"Bucket" mentality with high-powered searching and tags. Makes it great for storing more then just web clips but also images and notes.
Best $5 I spend on an iOS application. Tilt scrolling and a clear paper like view of whatever web page. I moved the entire "Learn You A Haskell For Great Good" book into it and am breaking it apart in chunks.
Of the three it looks like Instapaper would be your best bet.
I use Pinboard. One of the premium features it provides is the ability to save pages forever, so once you add a link it will automatically pull the page in and keep it in long-term storage.
Another alternative is to print to PDF and store that in Dropbox, but it will require a little extra tweaking to get the name in a decent format (some sites aren't very good at setting a reasonable page title)
I used Delicious in the past but have recently moved to Springpad. Not just for bookmarking but also for arranging all manner of different things. I've got a number of research & development projects on the go at the moment and I'm adding bookmarks, checklists, notes etc. You can keep everything private or you can share it - my public stuff is here.
I imported my Delicious bookmarks without any problems too. It may not work for you (or me for that matter) and does require a HTML 5 compatible browser for some of the features.
In Google Chrome you can easily export your all bookmarks. It will save single html file on your hard disk on your desired location and just open that file in your any default browser and you will see the hyperlink of your bookmarks. Its done under the preferences>bookmarks manager or in old version hope no one is using press
It depends of the type of information and the way you want it to be searchable.
Internet is about sharing information. Google and other search engines are about searching information. Having said that, the best way is to not save useful information locally, but instead to work on your search skills.
Let's say one day I forget how to implement a singleton in C#. I can either:
No favorites - no waste of time organizing them.
Of course, things are different if you are searching for images, music, videos, since today's search engines are not powerful enough to provide an intuitive and human-friendly way of finding media content.
Another thing: expect a web resource to be available forever until you need it. For example, Stack Overflow will probably not be closed tomorrow with all information completely removed:
Of course, maybe in twenty years, there will be no Stack Overflow. But are you sure that in twenty years, you will seriously need information you've found today, and you will be completely unable to find it with a search engine?
Finally, in some circumstances, you will achieve better results by using a knowledge base instead of a search engine.
For example, you can encounter the same problems with the same products again and again: a nasty and meaningless error message in WCF for example. The first time, when you will be learning WCF, you will spend a few days solving the problem. The second time, you will know that you've seen this error months before, but you've already forgotten how to deal with it, so you'll spend a few hours switching between Google, Visual Studio and different unhelpful websites. A third time, you'll spend half of an hour again, etc.
To avoid spending time solving the same issue again and again, you would be better to have your own searchable knowledge base where you store encountered problems with their possible solution which worked and has strong chances to work again the next time.
Diigo archives bookmarked pages, though they've introduced a 30-page limit on their free plan unless you're an educator and can get 20/month for free.
You could also look into collaborating with archive.org. If you're serious about archiving all that data they could probably use your help.