Parsing thousands of feeds
dcoder - June 21, 2007 - 07:07
| Project: | Feedparser |
| Version: | 5.x-0.1-dev |
| Component: | feedaggregator_item |
| Category: | support request |
| Priority: | normal |
| Assigned: | Unassigned |
| Status: | active |
Jump to:
Description
I need to parse +4000 feeds.. how can I do it using feedparser? it's possible to set multiple cron jobs? [that could be helpful?]
maybe I can parse selected feeds in each cycle [based in their updating frequency].. but, again, how can I do something like this? this module is the best for massive feed aggregation -thinking in even more feeds-?
I don't know if here is the place for this issues, excuse any inconvenience.
thank you

#1
I need to achieve the same sort of feed aggregation myself - so am open to ideas on how to implement this. Right now I don't know what the best solution is!
#2
bump*