Community Documentation

Aggregator: publishing syndicated content

Last updated May 6, 2013. Created by meitar on September 5, 2001.
Edited by mrP, batigolix, eiland, DSquaredB. Log in to edit this page.

The Aggregator module is a feed reader that is included in Drupal core. When enabled, the Aggregator module can fetch syndicated content from other websites.

The Aggregator module can gather, read, and display news, text, images, and other content from external news sites and blogs around the internet. The Aggregator module fetches content from other sites; it does not generate syndication feeds. (To enable XML syndication on your site, turn on the Syndicate block in Administer > Site Building > Blocks (Drupal 6.x or earlier) or Administer > Structure > Blocks (Drupal 7.x and 8.x).)

When used with other modules, the Aggregator module can make these feed items available from a Drupal site using common syndication formats including RSS, Atom, and RDF. (Learn more about site syndication formats.)

Uses

Users can:

  • View the latest feed content chronologically in the main news aggregator display
  • View the latest feed content by source

The default permissions for the Aggregator module must be changed to allow users to view the subscribed content.

Site administrators can:

  • Add, edit, and delete feeds
  • Choose how often Aggregator checks each individual feed for new content
  • Tag individual feeds with categories, offering selective grouping of feeds in separate displays
  • Enable or disable blocks for every feed and feed category in the block administration page
  • List the latest news for individual or categorized sources to display as blocks in the block administration page

The news aggregator requires cron to check for the latest news from the sites being aggregrated. Drupal also provides a machine-readable OPML file of all of your subscribed feeds.

In addition to providing subscribed content through the news aggregator, the Aggregator module automatically creates a module block for every feed you have subscribed to, as well as every feed category. By default, these new blocks are disabled, though an administrator can choose to enable a particular feed or category feed block by moving them to an enabled region.

To syndicate content from another website, obtain the fully-qualified URL of the remote site's syndication page. Common filename extensions for syndication pages are .rss, .xml and .rdf. Most sites that offer syndication will have an obvious link to their syndication page. Often you need only look for a red XML button, such as the one Drupal uses for site syndication, though some sites do not make their RSS feeds easy to find and not all sites offer syndication.

Comments

Hello,

I recently switched from WP to Drupal and simply loving it. I have a question about the aggregator. I'm using the Reuters feed which is looks like this for example: http://feeds.reuters.com/reuters/technologyNews

When i'm logged in as the admin the aggregator displays fine but if I login as an authenticated user or anonymous the block just disappears.

Any idea as to how to fix this? I'm on Drupal 6

**********Ignore the request above*************

Fixed this problem by going to the user permissions section in administer and enabling (checking the boxes) under aggregator section.

Strange default permissions

Thanks for posting the solution. It saved me hours searching the web!

It occurs to me that this is a strange default setting. I would have thought that the defaults would be to let all users "View news feeds"?

Obviously not.

I am using Drupal 7.

Drupal Sites: www.edenextdata.com

Disable Page?

I share items of interest in Google Reader, and use aggregator to track the RSS feed of these shared items. I just want a block displaying links to those stories, I don't want to reproduce the actual content on my website, which is the case at the moment, and it makes me uncomfortable. Unfortunately, there doesn't seem to be an option to disable this page of reproduced content. Is there a workaround? Or if you know of a module that will allow block-only display of RSS feeds, can you point me to it?

Problem with categories?

I'm able to sign a certain feed to multiple categories - but the items in the one feed only appear in a single category - Shouldn't the items in a feed appear in whatever category it is assigned to? Am I missing something?

Aggregator Module Pulling Same Link for Blogger Posts

Hi there, I have the aggregator module activated for my store's Drupal website (http://bookpassage.com/) to pull the latest 3 blog titles from my store's Blogger blog (http://blog.bookpassage.com/) & display them in a block on the homepage of the Drupal website (http://bookpassage.com/).

The 3 links appear, but they all link to the same incorrect blog post. Also, the list doesn't seem to update automatically, even though I have it set to every 15 minutes.

Anyone know how I might correct this?

Thanks

Allowing images from feed?

I'm switching to a Drupal environment from a static one. I've used an RSS feed on my old site: http://www.scholarscorner.com/movies.php
and it pulls the images from Netflix reviews into my pages. The feed aggregator on the new site pulls the text but not the images. Is there a way to activate them?
Thanks,
Jeff

Jefferis Peterson, Pres.
Web Design and Marketing
http://www.PetersonSales.com
(724)-482-2015

Got images working

Was kind of simple I just had to allow Only local images are allowed. tags in the administer/content management/aggregator/settings area

Jefferis Peterson, Pres.
Web Design and Marketing
http://www.PetersonSales.com
(724)-482-2015

Having trouble...

What tag(s) did you allow - Only local images are allowed.? I tried that, but it's still not bringing in the images. They're formatted in the XML like this:

<media:thumbnail url="http://www.bjtonline.com/uploads/tx_bjt/FINAL3_Flexjet_thumb_b.jpg"/>

Did you ever find a solution

Did you ever find a solution for the tags and getting their content shown?

Images showing up

Allow the img tag.

Some things I've learned:
You might also need to "remove" current feed items and regenerate, clear cache, run chron. Photos don't appear on all feeds. They don't appear in the URL /aggregator, nor in /aggregator/sources, but do appear in /aggregator/sources/(your source id)

I'm hoping to find ways to better control what shows and what doesn't.

Same Issue

I too am having this issue. I tried using the img tag, the media tag, and the media:thumbnail tag as allowed tags and still Drupal does not show this image.

News Aggregator

I was able to get this up and running on metaskim News Aggregator

How do you get different feeds on different pages?

Hi metaskim. I went to your site, and I notice you have set up different feeds on different pages. When I tried, I created 2 categories in aggregator, and what it did was create a Category submenu to my main feed page, but when I clicked on that and selected a different category, the feed page changed to that category and I couldn't get the other feed back on that page.

My menu looked like this

                                                               Movies
   Movie Feed Page < Categories <
                                                               Culture News

I picked culture news and it knocked Movies off the feed page.

There has to be a way of assigning different feeds to different pages?? No?

TIA,
Jeff

Jefferis Peterson, Pres.
Web Design and Marketing
http://www.PetersonSales.com
(724)-482-2015

Error messge for RSS Feeds

I two error messages when I log-in as admin. I also sometimes see this when I just go to the page. (not logged in)

• The feed from Loyalty Blog seems to be broken, because of error "Invalid document end" on line 54.
• The feed from Social Media Marketing seems to be broken, because of error "Invalid document end" on line 101.
Any help would be much appreciated!

Changing title of /aggregator/sources/# page

Hi there - driving me crazy - is it possible to change the title of the /aggregator/sources/# page. The currently reads "Sources" but I can't find it anywhere in the module code and in no settings..

:-)

Just in case

Didn't see any previous replies to your post.

On Drupal 7, just go to Structure --> Menus; and you'll be able to modify the title of the aggregator link. By changing the title of the link, you'll also change the title of the page.

Cheers!

-Rashi

"Receive with simplicity everything that happens to you."

Aggregator doesn't show URLs with ampersands - &

Hi,

It was fine two weeks ago, but then aggregator stopped reflecting URLs with this character: &
The title of the item is displayed correctly, but when you click on the link, it takes you to a blank page instead of the material.

So, for example, URL: http://...vthread&forum=2&topic=650
goes to: URL: http://...vthreadforum=2topic=650

ignoring the &

Any ideas?

Thanks

Cron brings back previously deleted feed

Hi Folks,

A while back I tried to add http://www.bjp-online.com/feeds/rss as an aggregator feed. I immediately got an error message so deleted it as normal. Unfortunately, every time cron runs it mysteriously adds the feed again to both the admin interface and the SQL database and every viewer of the site gets a pretty ugly error message as a result.

As I cannot seem to permanently delete the feed source, and because the source itself is bad i.e. causes errors, a cron run basically ruins my site and I have had to disable the aggregator module. I have tried deleting the feed from the database directly using phpMyAdmin but every time cron runs, the troublesome feed re-appears in both the drupal admin interface and the database.

I can only imagine cron is still trying to poll items for the previously deleted feed but I don't know enough about how cron or the aggregator module works to stop it from doing this.

Any advice would be greatly appreciated.

Workaround

Okay, so here's my workaround.

I've cloned the aggregator module and used a text editor to replace all references to the word 'aggregator' with [in my case] 'agggregator' and uploaded the agggregator module to the 'sites>all>modules' folder. This allows me to run two version of the aggregator module in parallel with completely independent entries in my database.

Since something had become corrupt in the interplay between the original aggregator module, cron and the database, I can now deactivate the aggregator module, activate the agggregator module and add my feed sources again - this time without the troublesome bjp-online one.

I don't know enough about the interplay between cron, the aggregator module and the database to locate the real problem, so this will have to do.

Technically this is not a core hack but it is a fork, so if you go down this road you run the risk of missing out on the very update to the aggregator module which will would have solved this problem.

aggregator display

aggregator not showing in the block administration page?

Delhiwonders
A Largest Gallery of Delhi World Heritage City
http://www.delhiwonders.com/

Issue Using Google Calendar XML Feeds

Aggregator links to incorrect Google Calender events when given an XML feed from a Google Calender.
Related issue: incorrect base url displayed at /aggregator/sources/[id]. Base url links to one of the events on the calender.

Steps to Reproduce:
1) Enable the Aggregator module
2) Add a feed from a Google Calendar
— example feed: http://www.google.com/calendar/feeds/acquia.com_kmdh29akdplrnjr7jn9r8j34...
3) Update the feed to populate items
4) Navigate to the feed page and click the item links.
5) Links lead to unpredictable places

Notes:
Tested first on multiple Drupal Gardens sites with multiple Google Calender feeds, and with other RSS and ATOM feeds. Works fine with other feeds, but always fails with Google Calender.
Also tested on a local D7 installation, in which the URLs weren't created at all at first (empty href attribute). After adding an event to the calendar, the links behaved as they did on the Gardens sites.

Is this a known issue? Are there any known workarounds?

Andrew

Sidebar like Drupal planet

Hi,
I am trying to display a list of the source feeds for my planet much like the sidebar of Drupal Planet: http://drupal.org/planet
Would you please give me some pointers on how I can

  • set up the side bar to show a list of links of sites aggregated?
  • How to set up the Site Name (feed Url) look that Planet Drupal has?

Thanks

Google Picasa RSS feed import not working

Hi, I trying to import galleries from Google Picasa, but I'm getting error: "The feed seems to be broken, 400 bad request". But feed seems OK. I'm managed to import 2 of 3 galleries from one feed, but other feeds are not working at all (for example this one: https://picasaweb.google.com/data/feed/base/user/115876312359027721167?a...). Does anybody know, what can be wrong?
Thanks. Lukas.

Twitter feed for list

On our drupal 6 site (http://invest.kilkenny.ie/), i wish to display a feed of a twitter list. We have 3 feeds, 2 are from accounts while one is a list from one of the accounts. However recently the feed for the twitter list is not working (https://twitter.com/investkilkenny/work-kilkenny). I have tried the following but to no avail.

http://api.twitter.com/1/investkilkenny/lists/work-kilkenny/statuses.atom -> Used to work. Now get error 406 Not Acceptable
http://api.twitter.com/1/statuses/user_timeline.rss?slug=work-kilkenny&o... -> 401 Unauthorized
https://api.twitter.com/1/lists/statuses.json?slug=work-kilkenny&owner_i... -> 404 Not Found
http://api.twitter.com/1/lists/statuses.json?slug=work-kilkenny&owner_sc... -> 404 Not Found

I am looking to get in contact with someone who as got their twitter list feed working and learn how they did it. Any help would be grateful.

Page status

No known problems

Log in to edit this page

About this page

Drupal version
Drupal 5.x, Drupal 6.x, Drupal 7.x, Drupal 8.x
Level
Beginner
Audience
Programmers, Site administrators, Site users
Keywords
aggregator, syndicated content

Site Building Guide

Drupal’s online documentation is © 2000-2013 by the individual contributors and can be used in accordance with the Creative Commons License, Attribution-ShareAlike 2.0. PHP code is distributed under the GNU General Public License. Comments on documentation pages are used to improve content and then deleted.
nobody click here