Take the 2-minute tour ×
Super User is a question and answer site for computer enthusiasts and power users. It's 100% free, no registration required.

I have a ton of data on the web built just for me:

  • gmail
  • Delicious Bookmarks
  • Flickr
  • Facebook

Also, some local data that should be sent to a central index:

  • browser history

As well as some local data that I do not want to leave the machine:

  • My Documents

Is there a simple way to build a search engine for all of this data? Of course, security would be a primary concern. I would probably want something that would have the following process:

  1. Check local files' index (eg My Documents)
  2. Check my centralized index (eg gmail)
  3. Check Google
share

migration rejected from stackoverflow.com Jul 15 at 18:25

This question came from our site for professional and enthusiast programmers. Votes, comments, and answers are locked due to the question being closed here, but it may be eligible for editing and reopening on the site where it originated.

closed as too broad by Canadian Luke, Paul, Jens Erat, Kevin Panko, Excellll Jul 15 at 18:25

There are either too many possible answers, or good answers would be too long for this format. Please add details to narrow the answer set or to isolate an issue that can be answered in a few paragraphs.If this question can be reworded to fit the rules in the help center, please edit the question.

2 Answers 2

Sounds like Google desktop actually fits the bill quite well, you have to click on the Web, Web History, Gmail and Desktop tab one at a time but it does search in most of what you asked for.

I haven't found a perfect solution for myself but there are a number of tools nowadays that do search your collection of data in cloud.

Favs (OSX, iPhone) http://www.favsapp.com/

It collects all your favorite items in a nuber of web services (Google Reader starred items, Delicious/Pinboard bookmarks, Facebook statuses, Twitter favorites, Pocket, Instapaper, etc.) and make them searchable in one place. I personally use this a lot.

CloudMagic (web) https://cloudmagic.com

Search your Gmail, Outlook Exchange (email, events, docs) and Twitter stream. It's quite helpful if you use Outlook at work like I do and find Outlook's search lacking.

Otixo (web) https://app.otixo.com

Connects to a number of cloud storage (Dropbox, Google Drive, Amazon S3, etc.) and search all your files in one place.

A good place to look for these apps is through websites of the services they support. Many of those sites maintain a list of third-party apps that uses their APIs.

e.g.:

share

I built my own personal search engine.

It started as a TEXT search that displayed hi-lighted results in context or "matching lines only"

The app doesn't index. To search my PC *.txt data, first those files must be merged into one HUGE file then that is searched.

I have all my emails since 1996. I forward and paste my important emails into another huge file. Text files can be searched at up to 20,000,000 Characters Per Second.

To randomly select a video then play a random segment; first those *.mpg files must be cataloged (taking less than a minute) Same goes for *.jpg and *.mp3 files. If you don't have a search that does RANDOM... Poor you.

I use the app to store and retrieve web site URL's along with previously used google search strings etc.

This personal search engine gives you superior access to your personal information be it video audio pictures or text.

See "nobody shares knowledge better than this" (with over 2700 responses) This is how the best app on any Planet should work.

share
2  
could you share the link you refer to? –  suspectus Jul 11 at 15:45

Not the answer you're looking for? Browse other questions tagged or ask your own question.