Create Full-Text Feeds 2.9.5 [turn on the lights]

Enter a URL

Typically this is a URL for a partial feed which we transform into a full-text feed. But it can also be a standard web page URL, in which case we'll extract its content and return it in a 1-item feed. Examples (click to insert):

Premium options (more information)
Premium access key

If you pay for premium access, enter your key here. A valid key will remove the link we insert at the end of each feed item and enables the options below.

Subscribe via PayPal — 8 € a month

  • Instant activation
  • Cancel any time
Feed item limit

Set the maximum number of feed items we should process. The smaller the number, the faster the new feed is produced.

If your URL refers to a standard web page, this will have no effect: you will only get 1 item.

Link handling

By default, links within the content are preserved. Change this field if you'd like links removed, or included as footnotes.

Item handling when extraction fails

If the extraction pattern above fails to match, we can remove the item from the feed or keep it in.

Keeping the item will keep the title, URL and original description (if any) found in the feed. In addition, we insert a message before the original description notifying you that extraction failed.

...or test the output with one of these feeds: Medialens News Unspun

Full-Text RSS 2.9.5 now available for purchase!
Read about our content extraction approach

About

This is a free software project to help people extract content from web pages. It can extract content from a standard HTML page and return a 1-item feed or it can transform an existing feed into a full-text feed. It is being developed as part of the Five Filters project to promote independent, non-corporate media.

Features

Frequently Asked Questions

What is this? How does it work? How can I use it? Why is my content appearing on other sites? See our Frequently Asked Questions page for answers.

Bookmarklet

To easily transform partial-feeds you encounter (or convert any content on a page into a 1-item feed), drag the link below to your browser's bookmarks toolbar. Then whenever you'd like a full-text feed, click the bookmarklet.

Drag this: Full-Text RSS

Compare: Free, Premium, Self-hosted

Free
we host it		Premium
we host it		Self-hosted
you host it
RSS feeds processed no limit no limit no limit
RSS items per feed 1-3 1-10 no limit
Link handling preserve preserve
add to footnotes
remove		 preserve
add to footnotes
remove
Caching 20 minutes 10 minutes disabled or
10 minutes
JSON output no no yes
Link to fivefilters.org yes no no
Yahoo Pipes accessible no yes yes
Improved Google
Reader support		 no yes no
(coming in v3.0)
Cost free 8 €/month 20 € one-off
(free updates for 1 year)
Buy Now Buy Now

If you don't like the limits associated with the free service, you can either download the source code and host it yourself or get premium access for 8 € a month and continue to use the hosted solution here on fivefilters.org.

As this service is part of a project to promote independent media, the free service will include a link to a featured article, video or website, as well as this website, at the bottom of every feed item. The current featured website is Donate to WikiLeaks.

Hosted or Self-hosted?

We want our users to be free to examine and run the code behind FiveFilters.org however they like. As such, in addition to our hosted option, we also give you the option of self-hosting.

Using the hosted service is the easiest option as we manage everything. You do not have to worry about staying up to date because we maintain the code and any changes we make will automatically be made available to you.

If, however, you have your own hosting account or manage your own server, the self-hosted option gives you the freedom to run the code and manage things yourself. It also gives developers the opportunity to examine the code and make changes.

Premium Access
hosted service — 8 €/month
Buy Now

API

To extract content from a web page or to transform an existing partial feed to full text, pass the URL (encoded) in the querystring to the following URL:

If you have premium access, add your API key to the querystring:

System Requirements

PHP 5.2 or above is required. The code has been tested on shared hosting and other environments. We recommend you download and run our simple compatibility test before purchasing. It's a single (zipped) PHP file you can upload to your server and access through your browser. It will tell you whether your server is capable of running Full-Text RSS.

Full-Text RSS has been tested on Windows and Linux using the Apache web server. If you're a Windows user, you can try it on your own machine using WampServer. We have also tested the code with paid hosting services NearlyFreeSpeech.NET and Dreamhost.

The application uses PHP, PHP Readability, SimplePie, FeedWriter, Humble HTTP Agent, Zend Cache, Text_LanguageDetect. Readability is the magic piece of code that tries to identify and extract the content block from any given web page.

Download and Installation

Current stable version: 2.9.5 — 2012-04-29 — Changelog

Full-Text RSS 2.9.5 costs 20 € and includes:

* If extraction does not work well on a particular site, contact us with details of what you're trying to extract and we'll send you a custom site config file (for one site only).

Full-Text RSS v2.9.5
zip package — 20 €
Buy Now

Need more payment options? Purchase through Avangate

After paying you will automatically receive an email with a download link to the zip package. The zip package contains a readme file with instructions for uploading the code to your web host via FTP.

Older versions can be downloaded free of charge from our code repository

Stay up to Date

If you'd like to receive email notification when we make changes to the Full-Text RSS service or new code releases, please sign up below.

Follow us on Twitter

Support

We encourage people to use our public forums for posting questions and reporting issues.

If you've purchased a copy and need support setting it up, you can also email us: help@fivefilters.org

License

AGPL logo
This web application is licensed under the AGPL version 3 — which basically means if you use the code to offer the same or similar service for your users, you are also required to share the code with your users so they can run it for themselves. (More on why this is important.)

The libraries used by the application are licensed as follows...

Author

Created by Keyvan Minoukadeh for the Five Filters project.
Email: fivefilters (at) fivefilters.org