Posts tagged rss

Gizmodo Gizmodo
image from Gizmodo
"I’d start with, at most, 10 news sites to subscribe to. This will give you a feel for how fast you want the feed to move. Too slow? Add more. To fast? Delete a few. I try to narrow things down even further: Instead of subscribing to the New York Times, which publishes dozens of items per day, I subscribe specifically to the Times’ tech section, which means I get a much more curated selection."
Seconded. And hey, I could have written this. This article has great advice for embracing the decentralized lifestyle. I personally use a self-hosted Tiny Tiny RSS with Reeder on iOS which costs about $8/month at AWS. Instead of limiting feeds, I subscribe liberally and put them in folders by subject. Then I browse by subject periodically instead of the full list of feeds and tune from there.

Newsreader Update

After the demise of Google Reader in 2013 I found the open source clone Tiny Tiny RSS and I've been using it to subscribe to websites ever since. I installed it on my own server, customized the interface quite a bit, and wrote a few plugins. And because I had put a lot of time into modifying it by editing the source files directly, I didn't upgrade it. Ever.

Tiny Tiny RSS has been evolving over the years and it's pretty ridiculous that I didn't upgrade. I probably missed 1,000+ bug fixes and performance enhancements releases in the last five years.

Earlier this week I was looking at the latest version and found that the PHP requirements changed. One does not simply upgrade PHP. "We're in the future now," I thought, "Shouldn't this all be serverless?" It's not. I did find something neat in the process though.

A company called Bitnami has an AWS image with Tiny Tiny RSS installed along with everything you need to run it. I threw this on the smallest AWS instance (a t2.micro) and had a more recent version up and running in minutes. It took a few more minutes to get a free LetsEncrypt cert going for SSL, a trifling more to run the feed updater as a service, and finally a smattering more minutes to export/import my subscriptions. But minutes none the less!

The new version means I can finally use a real iOS app to read as well. Reeder 3 for iOS is free now and works with Tiny Tiny RSS if you use the Fever API plugin. (Although it seems like the project is abandoned and I needed to add a couple lines of code to get it working; hooray open source life.)

And to top it all off I only directly edited one source file. So I'm learning. Here's to another five years of this particular version of Tiny Tiny RSS!

Amazon Feed Generator Reborn

Today I fired up a new version of the Amazon Feed Generator. It creates an RSS feed from Amazon search results so you can subscribe to them. That way you'll be alerted to new products that show up in those results.

This feed generator is one of the tools that used to live at this site. I put the original together around the time I wrote Amazon Hacks. The feed generator eventually became unnecessary because during the RSS boom of the mid-to-late 2000s, Amazon embraced feeds and offered them for many of their pages. These days they've scaled the feeds they offer way back and I still think it's handy to able to subscribe to them.

The feeds this tool generates are very simple. Each feed entry has the product name, a big image, and the new (non-used) price for the item. For example, there probably aren't too many new Bob Dylan albums coming out on vinyl, but why not subscribe to this feed just to be sure. There are a few more examples on the feed generator page.

Amazon's API has changed quite a bit over the years. My server development environment changed. Let's face it, we've all changed. So to get this running again I built it anew. I used node.js and a couple of existing packages: amazon-product-api and rss. (Those rely on other packages, which use others, and it's packages all the way down.) Thanks for sharing your code everyone! I put the code for this on Github, so you too can run your own feed generator and tweak it if you want.

There are probably bugs and I have a to-do list for things I want to clean up. So let me know if you spot something off. I'm happy another little piece of onfocus infrastructure is up and running again.

Scraping Together RSS with Node.js

The other day I was sitting around thinking about scraping a website (as one does) and I was frustrated by the complicated regex I was going to have to write to pick the data I wanted out of HTML. (Your classic two-problems problem.) So I started daydreaming about being able to scrape sites using jQuery selectors to get the elements I needed.

Then I thought, how about using a pure JavaScript environment like Node.js? I like servers and I like JavaScript, so it seems like I should like Node.js just fine. With a bit of searching I came across a great tutorial: Scraping the Web with Node.js and I was off and scraping. The cheerio module had already solved my jQuery selection problem.

At this point I could easily grab the data, but I was frustrated thinking about wrangling it into a consumable format. I was starting to get in the Node.js mindset and thought, "I bet there's a module that can help with this." A few minutes of searching later, node-rss was installed.

It took a bit of wrangling to get my first RSS feed going, but I was surprised at how quickly it all came together. It's not so different from firing up cpan and including modules in Perl scripts. But npm is just friendlier. Being able to run npm install in a new environment takes some the tedium out of your day.

So yeah, the Node.js script I wrote goes out and fetches Likes (favs, stars, hearts, etc.) from Medium, Twitter, GitHub, and Hacker News and returns RSS feeds with those likes. This lets me bring all of my favorites from those places into one spot where I can then do other things with them, hooray! I put the code up on GitHub: Recommended RSS.

Then with the help of forever I set it up as a service and I'm aggregating away. My to-do list for this little app includes caching and handling dates. I wonder if there are modules for those.


Really nice to see PRX's RadioPublic using RSS and open standards to extend podcasting rather than working to lock people into a particular client.
  • Excellent Google Reader rant. "We need to keep pushing forward without them, and do what we’ve always done before: route around the obstructions and maintain what’s great about the web."
  • One Thing Well has a nice roundup of the Google Reader fallout and commentary. The verdict: no replacement yet but many are scrambling to get something working.
  • I miss the old Google Reader sharing features too. It'll be interesting to see if this new effort will get enough users to make the sharing features work as well as they did at Google. [via waxy]
« Older posts