Retrieving many RSS feeds fast?

Do you have a question? Post it now! No Registration Necessary.  Now with pictures!

Threaded View
I have a simple scripts using magpie to retrieve upto 200 RSS feeds.
Unfortunately it takes forever as the script has to sequentially get
each feeds, wait for the response, then move on. Is it possible to
retrieve them all at once or do them in parrallel?

Re: Retrieving many RSS feeds fast?

Quoted text here. Click to load it

Multithreading is not built in PHP, but you can emulate it using two
scripts and requesting one script through the other one using the
Apache ( like fopen('http://localhost/path/to/file/
second_script.php') ) and giving it the RSS feed as a parameter and
then fgets-ing the output of the script. Sorry i don't have the time
to give you more details, i'll get back to this in about an hour.

Re: Retrieving many RSS feeds fast?

OK, me again, sorry for not being more specific earlier.

You should create a script (lets say parse_rss_ext.php) that parses
the RSS and outputs the result.
Then create another script (lets say parse_rss_core) that makes calls
to the parse_rss_ext.php script providing the RSS to be parsed and
receiving the response, then doing whatever needs to be done to the

The code that emulates multi-threading in PHP is the following:

$rss_list is an array containing all the RSS feeds;

[code start]
foreach ($rss_list as $rss)

foreach ($threads as $thread_rss=>thread)
  if ($thread)
    while (!feof($thread))
[code end]

Hope this helps you. Cheers!

Site Timeline