By karibou on

Hi everyone

I'm currently looking into using drupal as my new personal website.
The idea is to step up a site that would be:
- my personal blog
- my photography albums
- share my weblinks of interesting stuff
- personal knowledge manager (wiki?)

One of the features I'm looking for is the ability to store a cloned (or saved) version of a webpage.

Basically, I surf on the internet a lot. And I find a lot of interesting stuff. But most of the time I don't need this stuff right now but probably in the future. The only thing I can do now is bookmark the page. But what happens if the page disapears?
That's the first reason why I want to save this page.
The second is to make it more easily searchable (ie all the content is in there so I don't have to build keywords)

Of course this part of my future website will only be available to me (though I will post the share the links) to be sure I won't have any copyright problems.

So my question is: is there a way to easily display a saved version of a html page? (or an mht for example would be best)
Has anyone previously done this?

Thanks in advance for your help!

⋅ Categories: Drupal 5.x

Comments

dman’s picture

dman commented

Funny, I've just been doing something like that as an extension of the links package, combined with my 'wrapper' and 'import_html' projects.

I've set it up so that I can create a web directory using links.module weblinks nodes, and a feature of those nodes is that they may, on demand or on a schedule, go out and suck the useful content from their target into a drupal node for local retention.
This is NOT anything resembling a site mirror, in fact it's a semantic extractor, so if your target has scripts and stuff it's not much help, but it's just something that I investigated doing for fun.

If you really want full, working snapshots, you are better of with a mirror tool - wget, websnake ... or your browsers 'save as archive' feature.

Scripting a web spider these days with AJAX is no fun.

.dan.
How to troubleshoot Drupal | http://www.coders.co.nz/

.dan. is the New Zealand Drupal Developer working on Government Web Standards

karibou’s picture

karibou commented

Hi dman,

Thanks for your answer.

I think that wget, websnake are a bit of an overkill.

Basically what I want to do is save the webpage I'm looking at. As if I were to print it for future reference. I don't really care that the links still work. I would just like to keep the formatting and images (exactly as if I saved it as a mht archive file). I could then order those files and display them in drupal, index them and then I could search them...

So really what I'm looking for is a way of displaying mht files or anything similar to mht (copying and pasting the html source of the page works ok but I loose all the images...)

Anonymous’s picture

Anonymous (not verified) commented

Have worked on saving home page as an archive for use in demonstrating available Drupal colors. Works nicely when opened in tabs and being able to switch colors with a click. Trouble is that it works for a short while and then for a reason that I have not been able to determine, the color is lost, or more correctly, the color bar across the top disappears. The remaining colors then appear to have a washed out look. Clicking the refresh button results in no color with plain html. Any thoughts will be appreciated.

Further experimentation resulted in accomplishing virtually the same result by using screen shots.

Thank you, apero. Using Preview application, saved screenshots can all be opened and run as a slideshow which works very well.

Anthony Pero’s picture

Anthony Pero commented

Use Firefox. The PrintPDF add-on will allow you to make a pdf of the whole page. Then just save it locally. I really don't think this needs to be a drupal solution, since it's something you want to do on lots of websites.

Anthony Pero
http://limafirstmedia.com
http://anthonypero.com/booking

Anthony Pero
Project Lead
Virtuosic Media
http://www.virtuosic.me/

meh’s picture

meh commented

FireFox has a wonderful Add-On named "UnMHT" ... it can be configured to save the current page with a keystroke (I prefer Ctrl-Space) ... it retains memory of the save-to directory (I use something akin to c:\users\public\mhts) ... it has the ability to save the page with user-configurable data (e.g., the full address "http__drupal.org_comment_reply_197715_comment-form .mht" )