If you were reading through software reviews based on questions, rating answers on a 1-5 scale, what kind of questions would you expect or like to see on the review?
On a scale of 1 to 5
- extremely bad
- extremely good
How would you rate...
- the interface?
- the performance?
- the functionality?
- the workflow?
- the objectives achieved?
- the user experience?
- the installation procedure?
- the robustness?
- the Tom-Dick-Harry appeal?
- the Tom-Dick-Harry usage test?
- the installation size?
- the developers ability to respond quickly to a problem?
- the support (official or unofficial) available on the Web, or through other channels?
- the compatibility/portablity to other operating systems?
- the degree of customization allowed?
- (if you want to expand, expand on the functions breakdown of the software, e.g the performance of the compiling function, or the interface of the formatting toolbar.)
the ability to adapt to future situations?
- many many many more - depends on what exactly do you want to find out.
I always get an empty feeling from those types of reviews. When reading through the results of a survey to evaluate an application, you never get to the essence of "...but is this a good application?"
It's like when you have an incredibly average so-so meal at a restaurant and you find one of those surveys on the table:
- Was your meal hot? Yes
- Did you receive a sufficient quantity of food? Yes
- Was your order filled accurately? Yes
- Was your server prompt and courteous? Yes
Great, I just gave them a 100% rating but the meal sucked and I will not return.
That's about as useful as "Is the application skinnable?" reviews.