The biggest problem with App Store ratings is that they’re only put to use when someone considers purchasing a specific application. People look at the average rating and maybe read only two reviews. Sure, the moment when someone considers a purchase sounds significant, but what if people can’t even find good applications?

App ratings on the store are incredibly inconsistent. Take for instance my MacBook Pro. Even though I’ve had problems with it, it’s one of the best machines there is, and I wouldn’t trade it for a PC any day. Because it has one problem that kinda bugs me, does that mean I would rate it ★? No, I’d give this sucker ★★★★★ honestly. I mean, sure it has a 6bit screen, but in the end, it has Mac OS X (Snow) Leopard and runs smoothly. Even if the 6bit screen bugged me pretty bad, I can’t justify giving it ★ because all the other features inside this machine are the best available.

If people in the App Store were reviewing a MacBook Pro 13″, I could imagine reviews like this:

Only available with black keyboard ★
Could use bluray drive ★★★
Has only 2 usb ports ★
No expresscard slot WTF ★★
Not worth it, should be free ★

These ratings are given by the minority of actual users. The majority loves this machine, no doubt, but rarely go out of their way to say so. This means all the ratings about the product are most likely people who hate it. But the point I’m so desperately trying to get at is that… if the MacBook Pro 13″ is getting low ratings, what would a $400 Dell laptop be?

The Dell laptop would be at the top of the store because it sells more, even though if its a shitty product compared to the MacBook Pro. This is why we need a Top Ten list based on ratings. By sales, even by top grossing just doesn’t make any sense.

Sure, music has had top 40 lists forever and they’re based on what’s popular or most bought, but it’s hardly ever the music that’s good. Case in point, the number two song in the US iTunes Store as of writing this (was number one a few days ago): Miley Cyrus — Party in the U.S.A.

If you haven’t heard this song, do yourself a favor and don’t. It’s horrible. It’s at number one because people were like ZOMYGOD A NEW MILEY SONG!! and it rose to the top, and it becomes self-sustained up there. It’s number one so it must be good, right? Of course, being at number one, more people listen to it and more people think it’s crap, the ratings go down.

couldn’t believe this ★
ew ★
good try miley ★
ehh? ★
i like this not miley ★★★★

If there was a list on the App Store for ratings, this crap wouldn’t happen as often, and better yet, the list would change more frequently. The Top Ten Paid Apps list rarely changes, and does so slowly. Because of this, apps on the top continue to make buttloads of money, while other apps wallow near the bottom.

It’s clear that Apple has been listening to developers about the store, they’ve made some changes, and added a “Top Grossing” list, but in all honesty, how helpful is that?

Sure, developers might like it because they think it’ll help applications which cost more get the same attention as those on the Top Ten Paid Apps list. Consider this: as a consumer, do you care who is making the most money? If you do, do you also feel so inclined as to buy that product? I don’t know about you, but I don’t walk into a grocery store and wonder if a $12 item ends up grossing more than a completely different $4 item. It doesn’t matter to me at all. To a consumer, this list is completely pointless. For the many people I’ve spoken to in airports and in public who have iPhones, most people don’t even buy apps, they only get free ones. This list doesn’t solve any problems other than distracting developers until they realize it’s not useful.

The problem with ratings is not just consistency, but its how they’re not helpful for anybody. This is partly because people are only prompted to review an application when they remove it from their device. How is this a good idea? If someone’s deleting an application, they most likely don’t like it or became bored with it, their spirits are already in the crapper, and now that app is likely to get a ★ rating. But for the people who are enjoying an application, they’re never prompted to say “Hey, this app rocks my socks off!” And this is a huge problem. I’ve seen a bit of code you can put in your app to add this functionality, but Apple needs to do this themselves. I’d like them to add a feature where after a given amount of time, the app prompts the user to rate the application now, later, or never to bug them again about it. This would drastically even the odds and make reviews a little more relevant, because people would be reviewing the application as they use it instead of when they’ve gotten bored of it.

Ratings need a purpose, and that purpose is to help raise awareness of great applications.

If I had to rate the App Store itself, it’d be something like this:

Great way to distribute software, but could use a bit more ★★★★
by louiemantia - Version 2.0 - Sep 13, 2009

The App Store has given developers the opportunity to reach a larger market. But when a truly great application comes out, it may not be noticed at all. The store is littered with tons of $1 shoddy applications, but the solution is not to show who’s making the most money, it’s to show who’s making the best applications. As shrewd as some people are when they review the apps, I think it might be better to introduce a Top Rated list. BTW, the new iTune Store design is quite awesome. ♥ Louie