Yahoo! Pipes for information filtering

If you’re not intimidated by this screenshot, please read on.

example pipe

Yahoo! Pipes allows you to visually design a transformation on web resources. You define input sources for pretty much anything that is available on the web. And transform that data into any form you want. You can filter data you don’t need, merge different sources and many more.

What I wanted, was a number of album review sites as input (Resident Advisor for starters) and add some sources of samples for those albums. This is what I came up with right now. Yahoo doesn’t show you the links in the preview, so you might want to take a look at the RSS version.

Take a look at the source to see how visual and easy this process is. The RSS is loaded and truncated at 5 items. For each entry, the entire article is downloaded and the cover image is extracted. The album is then searched on the Amazon site and a link is added to the image.

Currently, not every album is found on Amazon, although it is usually available, so I have some work there. I would also like to add a better sample source, as Amazon doesn’t have samples for most of this new stuff. I’m thinking Beatport, but there were some ready-made components available for Amazon.

So, keep your eye on the feed, it will get better in the near future.

If you liked this, why not share it with your friends?
    This entry was posted in Java and JavaScript. Bookmark the permalink. Both comments and trackbacks are currently closed.

    One Trackback

    1. By Streamhead » Blog Archive » Wear my badge on May 3, 2008 at 7:14 am

      [...] managed to spend a little more time with Yahoo! Pipes (previously). They now have a “badge” options, that makes it a lot easier to publish the results of [...]

    • Feedback or questions? Contact me right away.

      Comments have been disabled on my posts. Not because I don't want to hear from you, but because they were adding very little to the conversation (most of them were spam anyway). I do listen to you and try to keep as much posts as possible up-to-date and error free. So if you have a question, if something isn't working the way you hoped or you have general feedback, please use the contact form below. I guarantee an answer to every honest question or remark.
    • Get in touch
      1. (required)
      2. (valid email required)
       

      cforms contact form by delicious:days