Parsing thousands of feeds

dcoder - June 21, 2007 - 07:07
Project:Feedparser
Version:5.x-0.1-dev
Component:feedaggregator_item
Category:support request
Priority:normal
Assigned:Unassigned
Status:active
Description

I need to parse +4000 feeds.. how can I do it using feedparser? it's possible to set multiple cron jobs? [that could be helpful?]
maybe I can parse selected feeds in each cycle [based in their updating frequency].. but, again, how can I do something like this? this module is the best for massive feed aggregation -thinking in even more feeds-?

I don't know if here is the place for this issues, excuse any inconvenience.

thank you

#1

budda - July 2, 2007 - 22:11
Priority:critical» normal

I need to achieve the same sort of feed aggregation myself - so am open to ideas on how to implement this. Right now I don't know what the best solution is!

#2

dcoder - February 13, 2008 - 17:54

bump*

 
 

Drupal is a registered trademark of Dries Buytaert.