With the aid of RSS feeds & cross-platform e-book software like Calibre (the equivalent of iTunes podcast subscriptions applied to blogs), and the e-reader of your choice like the Kindle DX or iPad,  you can now read the best blogs as a ‘personalized newspaper’, sitting feet up in the comfort of your own couch. Yep, the age of the personalized newspaper is here now, you no longer have to wait around for it to be lobbed onto your doorstep by the paperboy.

And with 100m+ odd blogs out there,  by anyone from your favourite novelist to the zany mommy-blogger types, surely there are bound to be some superb ones?

Well here comes the difficult bit.  How do you find them?

Does looking for the best blogs make sense in any case?

Arguably it’s a stupid task to begin with, because isn’t the whole point of the web the fragmentation of audience and content, letting a thousand content flowers bloom? You no longer have to write for ‘Mr Average Interest’ because there will be someone in Guatemala who even finds the drivelry on Drivelry interesting (no offence to Guatemalans). 

Surely it’s a bit like asking ‘how do you find the best music to listen to’?

Well the unlikely you can do today -  the impossible takes a little longer. It is a reasonable question to ask where to find the best blogs. We all expect that art gallery curators can put together the best art in a particular period and it also seems reasonable that you should be able to find say, ‘the best economics blogs‘ or more narrowly even the best blogs on New York theater.

Perhaps there are even weirdos out there who would like to read a smattering of  the best economics blogs out there, coupled with best cartoons, and the best blogs on the implosion taking place in the publishing industry (a dangerously close description of my own interests).

General characteristics of the best blogs for your own personalized newspaper

Even though it may make sense to start your search (more later) in your particular subject of interest, there are a number of generic characteristics that you will need in your blogs:

1. The blog will need to have full RSS (Really Simple Syndication) feeds.  People who set up their RSS feeds to only provide the first para are not going to work for your personalized newspaper (even though it might work better for their advertising revenue). You would end up on the train with your Kindle newspaper consisting of first paras. Kinda annoying huh? When investigating a new blog go straight to the RSS feed. If it’s not a full feed, move on.
2. Blogs can’t be links to ’the best posts this week’ from other bloggers in that subject. Why bother? Again you’re after something that you can read on the run, in a plane, on the farm etc.  Sometimes it may well make sense to explore their idea of what blogs are best in a particular space - but you’ll probably end up adding that blog to your newspaper instead.
3. Blogs can’t be video blogs.  Apart from reservations that you may have anyway about  whether video suits you as an information consumer it’s simply not supported in many e-readers. Yes, it is in the iPad (albeit not Flash-based video) but that leads to a whole other discussion about whether you are using your e-reader to read (either skim reading or in-depth) or whether you are after a portable computing device. Video isn’t supported by the Kindle.
4. The blog needs to be regularly updated. One of the things you will find in your own wanderings of ‘best of blog sites’ (see below) is that half the blogs that are recommended to you were last posted to in 1996. Few bloggers heed the warning to write about what they like and you’ve got to really like your subject to keep going. For your own news service you won’t care if the blog is only published once a month (with RSS subscription software for your e-book like Calibre you can just set a retrieval interval of once a month) but once a year and you’re probably wasting your time even setting up a feed.

Best of blog directories and searches

A friend of mine who edits literary anthologies is hugely dismissive of search engines and considers that editors will always be essential and that you’ll always need an intermediary to curate information for you, “Google is useless“, she says, “it just returns so much crap!”

I have explained to her that Google partially makes decisions about what is important by looking at hypertext links created by humans to particular pieces of content (‘PageRank’) but in finding the best blogs there is an obvious flaw to Google in that ‘most popular’ – as expressed by the number of links to that content – is not necessarily ‘best’ (or we would be spending most of our time reading up on swine flu). 

Even where there is a more formal voting process for best blogs it suffers from the same issue of being driven by lowest common denominator numbers, and well known meta-blogging sites like Technorati also reflect their subject specificity (Technorati is great if you want to find out about technical blogs but not so good otherwise in my experience).

Sadly, the human-curated websites on great blogs like ‘Best of the Web’ (botw.org) or Eaton Web (eatonweb.com) seem to have a lot of out-of-date content and attempts to use these to browse interesting sites were not very successful (these days they look to me more like ‘pay to play’ linkfarms if you were going to be overly reductive).  Blogcatalog (blogcatalog.com) also seems not to live up to its home page promise “we’ve done the heavy lifting for you. Browse blogs by category to find the best in class”.

Software recommendation engines to find blogs you like

What seems logical is a recommendation engine that matches your personal subject area interests with that of others who have the same interest and which only returns recommendations to pages that are current. Two significant players in this space are Digg who introduced a recommendation engine in 2008 and an older company in this space, Stumbleupon.

A key point to keep in mind is that recommendation engines involve a hefty time investment to produce good results (you’ve got to spend time telling them what you like).  Some commentators discount Digg on the basis that their recommendation engine tends to reinforce suggestions to pages and sites that your friends like rather than finding you ‘hidden gems’  so I focused on building up a Stumbleupon profile (which you do by giving a thumbs up or thumbs down to the pages they suggest).

Results have been mixed from Stumbleupon - after what I’d estimate at 5 hours of solid recommendations (much of what you will see is collegehumour.com style graphic humour) I’ve only selected 44 favourites from the pages I’ve been shown and I estimate I’ve found about half a dozen blogs that I like (yeah it’s entirely possible I’m just hyper-critical). 

For the moment I’m keeping going with Stumbleupon, to some extent out of sympathy for what is a great concept but a terrible name – stumbling is not exactly the most useful sounding activity is it?

Conclusion: it’s just plain hard to find a good recommendation source for blogs

With the emergence of e-readers in large numbers it seems to me that there is an opportunity here for someone to produce a better human-curated selection of great blogs than some of the moribund websites mentioned above like BOTW and Eaton, and possibly there is such a site but I was not easily able to find it (let me know in the comments). 

Producing a good recommendation software engine by contrast requires a great algorithm and a lot of users (Stumbleupon after several years has 10 million+ users) but when you consider that many of them would be inactive and therefore generating little recommendation data, and that they’ve got several hundred subject categories, Stumbleupon’s source of preference data looks a lot poorer (perhaps my literary editor friend was right after all).

The best source of good blogs I found in the end was via Tweets from people I follow on Twitter, so if you can get access to Twitter’s data that looks like a great source. Whilst it appears that Facebook leads sharing of content, Twitter seems to be the only ‘open’ source of information (i.e. you don’t have to be accepted as someone’s friend to see what they recommend).

Otherwise there must be someone in an organisation out there, perhaps at Google or an ISP, who has a lot of blog content preference information.

C’mon venture capitalists! With the explosion in electronic books, creating a good blog recommendation engine is a non-trivial (i.e. barriers to entry) and potentially lucrative problem to solve.

We get most ‘news’ via a couple of magazine subscriptions, podcasts (generally consumed in the car or whilst doing the washing up) and to a less extent online.

It seems we are not alone. The newspaper sector, for example in the UK and USA, is deeply unloved at the moment by investors, with ad revenue expected to fall in the USA by 16% or so over the next 2 years. In the UK the largest news publishing group, Trinity Mirror, has seen an 80% fall in its stock price over the last 2 years.

Companies like Trinity are therefore busily trumpeting the growth of their online properties to investors out there, the line being, “our readership and ad revenue is falling but hey look at the growth of this online revenue…”

Like the much awaited demise of cinema when television came along I’m not sure that newspapers will disappear (is everyone going to obtain their news from Adsense-funded individual bloggers out there? – I doubt it). However what would really help out these guys like Trinity is if they didn’t have to spend 40% of their revenue printing and distributing a big hunk of forest every day.

But let’s face it, the computer screen sucks for casual reading. An odd thing to say really when this is a blog (Windows users hit Alt+F4 now).

I have to admit that the blogosphere hasn’t been high on my reading list either.

The likely way I would consume blogs would be by RSS feed but I don’t even have a dedicated RSS reader (and haven’t explored the Windows IE RSS functionality) although I have been vaguely thinking this is where I would like to go:  getting ever closer to the ‘my newspaper’ ideas bruited about when I was working on websites in the heady days of the millenium. A large commercial website aimed at the business sector I’m involved with gets about 3.5% of page views via RSS feed: so RSS aint there yet (RSS is only double the number of article print requests we can see on the same site).  

So my suspicion is that people who currently read blogs generally write blogs, and they’re reading blogs primarily because blog writers they link to often link back, mutually feeding their blog’s respective Google PageRank scores.

What would change all of this however is that if a decent electronic book came along. And finally, it looks like within 3-5 years that is going to happen.

Amazon's Kindle reading device

Amazon’s Nov ‘07 launch of the Kindle has supposedly sold about 350,000 units, which is quite a lot for a device less than a year old, which has ongoing subscription charges to boot. Then there’s Sony’s Reader which only has USB connectivity (presumably that means forget subscribing to a blog RSS feed) and then there is the wifi-equipped Phillips iRex.  This aint like reading text on your PDA or computer - these ‘E Ink’ screens provide very clear typeface viewable in outside light conditions from multiple angles.

Sony's version of the electronic book

However despite the availability and initially encouraging sales it looks like they’ve not learnt from the music industry and digital rights management is rampant, so unlike a paperback you can’t give a copy of your Sony ebook to a friend. And on the Kindle you have to subscribe to Amazon’s mobile data service in order to subscribe to this blog…

What I’m waiting to buy (and possibly a few other people) is an electronic reader that works offline for normal books and with wifi for online RSS subscriptions, with no digital rights management. That’s the device I’m going to be sitting in a (wifi equipped) coffee shop reading.

And at that stage reading RSS-’my newspaper’ blogs may be an increasingly mainstream activity and a larger number of blogs will make sense from an ad revenue perspective.