I've written some spidering phpcode to grab data I want to import as nodes (with things like a large number of fields and location data)
Yes, I could write the phpcode to save everything to CSV, and then use an existing node import module, but I'd rather do just one step, and allow the possiblity of 'updating' based on a unique field, even updating spidered data when a node is directly accessed to see if it's current or expired, etc...
What is the best method for doing this?
Assume that a new flexinode with correct fields exists... or can be created. Optionally: add new fields based on spidered content?
I'd like to be able to say 'go spider items 4000-4100', or at least say 'go import/update 4052', and it spiders that data and creates (or updates) the node's data fields.
I think this might be a useful generic module, with a customized 'spider this' code added by the end-admin.