up vote 5 down vote favorite
1
share [g+] share [fb]

Does anyone know of any (free) command-line web scraper?

I'm looking for something like Beautiful Soup for Python, but for the command line in Windows XP.

Like:

C:> scraper www.siteexample.com\abcde.html -find("div", {"id": "articlebody"})

Does anyone know of any program like that (or not like that, but that does the job)?

link|improve this question
1  
How about ... write a Python script using BeautifulSoup? – grawity Mar 2 '11 at 10:55
I'm having trouble working with python and BeautifulSoup in Windows (linux man here ;) ). This was for me to get some work done on M$ Windows machines. – Jhonny Goodlife Mar 2 '11 at 11:04
If you have programming experience, you can rig up something really quickly with C# or with AutoIt under Windows. – Breakthrough Mar 2 '11 at 11:53
2  
What is M$? Some old joke? :-/ – Tom Wijsman Mar 2 '11 at 11:55
feedback

2 Answers

up vote 4 down vote

You can install Python on Windows. Alternatively, use Portable Python if "command-line" means "I don't want to install anything."

link|improve this answer
feedback
up vote 0 down vote

HTTrack is the classic web scraper, and it has a windows port.

link|improve this answer
1  
HTTrack is nice software, but it's not helping with this problem (see example; finding elements from pages). Of course, it's possible to use HTTrack and then do some custom software, but alone it's not a solution. – Olli Mar 2 '11 at 13:01
feedback

Your Answer

 
or
required, but never shown
discard

Not the answer you're looking for? Browse other questions tagged or ask your own question.