Author of the app here. This was quickly thrown together, and something we'd like to improve on next year. Any & all feedback is welcome.
We've already been looking at the results, and it has influenced the direction of multiple vendors in the process, but of course it isn't the only thing we look at.
We're going to continue to look at this throughout the process, so it's still worth getting a list together.
Whether we can release the raw results of this (and to what degree), will involve discussion between browser vendors, so it isn't something we can commit to right now. I know that's not… great… but it's a delicate process (one that I'm still personally getting used to - it's my first year 'on the inside').
Not an expert on how this will affect the results but since the list is so long, would it be better to show visitors two random-ish features at a time and have them pick the one they care more about? Or at least offer that kind of UI as an option or the default, and the current list for those who want more control.
I know this isn't quite what you mean, but when you first hit the page, the list is in a random order, but it's then stable across reloads.
I considered the 'vs' approach, but I worried that there might be a lot of iterations where one or two of the options would be things that the person didn't understand, or didn't care about.
How do you feel about something like this: The user goes through the long list, picking what they understand and don't dislike, then the 'vs' system is there for helping determine the order of those items. Then the user gets the ranking which they can tweak.
We've already been looking at the results, and it has influenced the direction of multiple vendors in the process, but of course it isn't the only thing we look at.
We're going to continue to look at this throughout the process, so it's still worth getting a list together.
Whether we can release the raw results of this (and to what degree), will involve discussion between browser vendors, so it isn't something we can commit to right now. I know that's not… great… but it's a delicate process (one that I'm still personally getting used to - it's my first year 'on the inside').
reply