Looked around for an hour but I'm not getting anyplace quickly.
I want to capture one web page weekly that has prices on it. The site is an auction site for livestock.
The twist here is that the target page name changes week to week, so, I need to be able to specify a LINK location on the home page, to get the page that I want.
I could write something in a day or two to screen scrape it, but there MUST be a program out there that does this already. I don't mind writing code, but I don't like to re-invent the wheel.
I just got HTTrack for other reasons, and if it will do it, just say so and I'll go figure it out. ( Literally just d/led it 30 minutes ago, so haven't looked at it at all yet, other than to to grab a website for a client. )
Looked at Selenium very quickly, but that appears to be overkill for what I want?
A bit more info:
It's a link in, hopefully, the same spot on the homepage.
I'd like to save it with a date pre-pended to the local filename. I'd prefer to do this all on Windows as it's what I know the best. MUST be runable via scheduler in Win 7!
Eventually, I'd like to scrape the page to gather the prices and put them into excel, so if anyone has used a tool for this, that would be even better. (I still want to save the price page locally, as a backup to any screen scraping that I might do. )