We all have different cloud needs

One of the things that is important to remember is not all of have the same needs. In fact even in the same company different things will be important depending on the solution you are building.

For example if you are using a cloud based backup, cost is probably important but reliability may not be that important. If the backup doesn't run at 10:00AM, then it will run when the site comes back up. If however you are running your entire sales team on salesforce.com than it absolutely has to be running or you aren't selling.

One of the things we take into account, and recommend for everyone, is to use a weighted matrix that takes into account that needs change. When we calculate a CLOUD score we take this into account and using out algorithm convert everyone to a 0-100 score, even though the needs change.

Eventually we will add the ability to use other's rankings, with your weightings to better leverage what others think. It's important to get as much data as possible and then use it properly to make sure you get the right solution.