Our Program Manager has spent a great deal of time working on redesigning the program ranking. The discussion has centered on quality, activity and popularity. As I mentioned in one of my comments, I see a lot of value in a separate "activity ranking" because it does build knowledge for the reviewer. It is a different reflection of experience than the quality of reviews however.
I also realized that certain reviewers probably have worked hard to make their current rating very high based on activity and do not wish to lose their status with program revisions. I have seen "Dame Demi, Bulma, Jimbo Jones, Essin Em and AAG" as top reviewers for as long as I can remember. Given that Dame Demi has 211 reviews, Bulma 51, Jimbo Jones 41 etc... many of these are unverified reviews. I only have 23 reviews, including some unverified reviews and have been with the program since the beginning (or almost).
I respect what these reviewers have done and know. I think a separate discussion thread specifically designed to address the thoughts on activity would be beneficial.
My own (initial) thoughts.
- I do not find all activity interesting.
- I am often on my computer. It is very easy to follow up with any comments when Eden sends us email notification, and I do so. Otherwise if I'm not looking at a toy or following an issue I might not be on Eden for sometime. "Log in dates" would be meaningless and harmful.
- Activity can be reflected in a number of ways. Last time posted on a forum, last time commented on a review, last time review written,etc.
- Activity itself does not reflect quality. It's a "busy little bee" mentality.
I also realized that certain reviewers probably have worked hard to make their current rating very high based on activity and do not wish to lose their status with program revisions. I have seen "Dame Demi, Bulma, Jimbo Jones, Essin Em and AAG" as top reviewers for as long as I can remember. Given that Dame Demi has 211 reviews, Bulma 51, Jimbo Jones 41 etc... many of these are unverified reviews. I only have 23 reviews, including some unverified reviews and have been with the program since the beginning (or almost).
I respect what these reviewers have done and know. I think a separate discussion thread specifically designed to address the thoughts on activity would be beneficial.
My own (initial) thoughts.
- I do not find all activity interesting.
- I am often on my computer. It is very easy to follow up with any comments when Eden sends us email notification, and I do so. Otherwise if I'm not looking at a toy or following an issue I might not be on Eden for sometime. "Log in dates" would be meaningless and harmful.
- Activity can be reflected in a number of ways. Last time posted on a forum, last time commented on a review, last time review written,etc.
- Activity itself does not reflect quality. It's a "busy little bee" mentality.