Is there any existing module to download web pages based on a given URL and given download location?
sharat - August 26, 2008 - 18:14
Hi,
I am a total newbie to drupal. Hence such a basic question...
I searched in the modules section but i could not find anything for my requirement.
My requiremnet is : I will give a URL as input to the module and it should access the web-page and download it at a specified download location
Is there any existing module that does this?
Thanks,
Sharat
So what you are saying is
So what you are saying is that you want to host your own version of somebody else's page on your site?
No actually i want to read
No actually i want to read data on a particular web-page based on some keywords and i want to store this data into my database.
The url of this web-page can change. That is it could be different web-pages at different times.
So i am thinking of using the "Swish-E Indexer" to parse the web-page and retrieve the data based on keywords. But Swish-E Indexer, i guess, works only on the files i have on my server. So i was searching for a module that would allow me to download the web-page in html format and store it at a location on my server. Then i could direct "Swish-E Indexer" to parse the web-page from this location.
Thanks,
Sharat
I realize this is outside
I realize this is outside your server, but what about using a yahoo pipes or "popfly" and somehow integrating it into your pages?