Tagged Questions

The tag has no wiki summary.

learn more… | top users | synonyms

0
votes
0answers
30 views

Screen scraping via display port / splitter / monitor hardware

Problem Background I have a screen scraping program that identifies images on my screen and reports useful information back to me. I want to be extremely cautious around the application that I am ...
0
votes
0answers
92 views

Recommendation on Web scraping and data flow

I have a solar panel unit, and the company that set it up (Fronius) has a website where I can live stream the data collected from the solar panel (Current power, Energy today, monthly, and yearly ...
0
votes
1answer
26 views

Automatically go through pages download filtered links on a site

With DownThemAll! I can download all the links on a given page and I can filter them. lets say the site is www.google.com and I want to grab all the search results. I set up a filter: /search?q= ...
0
votes
1answer
101 views

Web scraping / crawling a particular website

I'm trying to scrape 1265 html files at once to get name and descriptions of items I have on a website. I have permission from the wholesaler to copy there data but I don't want to spend days just ...
0
votes
0answers
27 views

How to backup a bulletin board hosted by a 3rd party?

A friend has asked me to back up this forum: http://oldforums.comicbookresources.com/ It's powered by vBulletin. Something bad had happened there and the hosts no longer want to host, and are ...
1
vote
0answers
43 views

wget put all prerequisites in flat subdirectory, but not root page?

I'm trying to get wget to save a page + prerequisites in a format resembling that of a web browser: article.html article_files/img.jpg article_files/script.js I am able to get almost this behavior, ...
1
vote
2answers
677 views

Web scraping / crawling a particular Google book

For my work, I need to scrape the text from a large book on Google Books. The book in question is a very old book and is out of copyright. The book is a Gazetteer of the World. We will be putting the ...
4
votes
4answers
129 views

Save report from Windows checking removable disk?

Is there any way to save a report of the errors that Windows found and fixed in a USB key? Windows presented me this dialog, btw that is not resizable: . Some problems were found and fixed. When I ...
1
vote
0answers
394 views

How do I use AutoHotKey to read the text at the mouse location?

I can read the entire window text using WinGetText() but I am trying to get the text at the current mouse location. I've found several examples on the AutoHotKey forums but they are all very old ...
0
votes
1answer
182 views

Is it legal to screen scrape your own bank statements in the US? [closed]

I want to automatically download my bank statements. My bank charges monthly for OFX access so have considered gathering the data points by other means (scripting, screen scraping), but I want to know ...
1
vote
0answers
33 views

igoogle style page with content scraped from other pages

I'm looking for an online homepage or Chrome extension that will display an iGoogle type home page but that lets me select content from other pages. In the same way AdBlock will allow me to select a ...
0
votes
1answer
136 views

IRobot Scraping tool

I am using IRobot scraping tool to obtain some data from website but for some reason it is not comming I think the problem must be of proxy settings can anyone help me to how to change the proxy ...
4
votes
1answer
113 views

Extract data from an online atlas

There is an online atlas that I would like to extract values from. The atlas provides a tool ('Query') to extract values when you click a location or enclose a region on the map, or you can specify ...
0
votes
0answers
66 views

Programs for reading data off interactive web charts

This question is in the same vein as this one: Program for reading data off scanned graphs Recently more and more interactive charts show up on the Net. Have a look at the following one: ...
2
votes
0answers
595 views

Get Current HTML Of Page Built With AJAX Requests

So, I'm using the Chrome/Chromium browser (put could use Firefox, if need be). I'm viewing webpages which are constructed "on the fly" with (presumably) AJAX (think the how you scroll down on ...
1
vote
1answer
268 views

Alternative, more efficient scraping method for a noncoder, than Google doc's importxml and xpath?

I've searched throughout the net for a simple solution, but it seems everyone has their own unique method (coding language) of achieving this. I'm only just beginning to learn Linux, and my coding ...
1
vote
1answer
2k views

Web scraper for Outlook Web App 2010?

I've been using weboutlook for years with great success, but recently we switched from the 2007 to the 2010 version of Outlook Web App (OWA). Does anyone know of a scraper that works with the newer ...
1
vote
4answers
3k views

Is there a Firefox or Chrome plugin to automatically save images from webpage

A website has a slideshow of images, for example:This link Since the slideshow is automatic, is there anyway to save those images automatically into a folder? either by a browser plugin or by some ...
7
votes
4answers
3k views

How “legal” is site-scraping using cURL? [closed]

Recently I was experimenting with the cURL, and I found lot is possible with it. I built a small script that crawls a musical site, which plays online songs. On the way of my experiment, I found that ...
1
vote
2answers
149 views

Data Mining Software

I want to harvest some data like this http://www.newcardealers.ca/en/Dealers/List-A.aspx And insert the name, address, phone number, email, etc. into a database. Is there some software I can use that ...