Rank System Proposal

"Other 'usefulness' voting may count, to a smaller degree, or maybe we leave it out entirely to prevent the highly variable attention different toys and/or reviews get from affecting rank."Either way, I would still love to see a comment be made mandatory for "not useful at all" votes even if it's done anonymously. I would just really like to know what I did wrong that I could do better

"Other 'usefulness' voting may count, to a smaller degree, or maybe we leave it out entirely to prevent the highly variable attention different toys and/or reviews get from affecting rank."Either way, I would still love to see a comment be made mandatory for "not useful at all" votes even if it's done anonymously. I would just really like to know what I did wrong that I could do better

@ Maria- It would not be any staff members except for my one vote- the rest of the panel would be people who've been around and are knowledgeable, like AAG, etc. It is somewhat of a time commitment, but it's not something we can pay people to do. And yes, votes would be based on review guidelines and overall readability, etc.@ Oggins. Thanks! I thought that was an excellent idea as well (requiring comments), and will probably be implemented.

I also don't see any need to rank by popularity. This site should be about collecting good information, not friends. Obviously, it's great that there is a bit of social interacting amongst reviews, and there are a lot of interesting adn helpful people involved, but it's not the purpose.That probably won't be good for my popularity ranking...

This is just an idea, not a set plan...Rank is calculated based on number of reviews (which IS already a factor) and quality ratings only. There is a 'panel of experts' who all vote for quality of each review- say 5 people. My vote is one, and four other people volunteer to do this. That is to ensure that each review gets an equal number of votes for calculation.Other 'usefulness' voting may count, to a smaller degree, or maybe we leave it out entirely to prevent the highly variable attention different toys and/or reviews get from affecting rank.In addition, rank is calculated independently for each contributor, on the same scale as now (0-10), not on a curve. Therefore, your rank doesn't change except when you submit new/follow up reviews and they are voted on.Thoughts? Clearly, this is not a perfect system (there's no such thing), but does it sound like one that will do a better job of representing the quality and experience of each reviewer without placing too much importance on extraneous factors, such as popularity?

What's the motivation for that though? Will it help people sort, or is it just a personal satisfaction kind of factor? I really like the idea of rank by simple quality, and don't see the need or importance of also ranking by activity/popularity. But that's just me.

What about all the reviews submitted up until now? Will this 4-5 person panel be expected to rate every review that has ever been written? By my count, that's currently over 3,900 reviews. An insurmountable task, I think. If it only includes reviews from now on, then do we not get any credit for previous work?

What about all the reviews submitted up until now? Will this 4-5 person panel be expected to rate every review that has ever been written? By my count, that's currently over 3,900 reviews. An insurmountable task, I think. If it only includes reviews from now on, then do we not get any credit for previous work?

@ Jimbo- I think that old reviews would still be included in the following ways -- you do already get a certain number of points for them which would translate over. As far as quality rating, most likely we'd use a combination of the usefulness scale on each one and the internal editorial rating for that. No worries, already completed reviews will not go down the tubes with this change!@ DBD- So does that mean you'd volunteer for this task, at least for a period of time? Also, as far as the quality rating process- I imagine it would be anonymous, except for general knowledge of who the individuals are on that panel. Comment-leaving, however, is an important thing to do with a name for the same reason everywhere on the internet- personal accountability and honesty. I don't think that leaving critiquing comments is necessarily part of this voting process, though.

Yes, I'd volunteer. I think others would also. I read quickly, have the ability to write brief succinct comments when I feel like it! (Not in the forum obviously) and know I write well! I enjoy reading reviews, and I'd be willing to write honest comments anon. I think many others would as well. This activity would ONLY be reflected on a possible "activity" rating so it would not impact individual ratings. It would also minimally impact the ranking of the reviewee because everyone is part of a team and has only minor impactIt's very similar to how professional papers are reviewed.To address the point about "bias" if someone doesn't like you personally. (I actually believe that most people are above it, but let's deal with it anyway.) If the review panel is four other reviewers, randomly chosen for each review... Three people love it and give it extremely high marks, one person says you suck. One- they have to justify it with comments- even minimally. The simple case- that review has a rating of "pretty good" instead of outstanding. The complicated case- Eden sees three "outstanding", "one lousy" and reviews it themselves, throwing out the "lousy" you get "outstanding."That's only for one review. In reality- you probably have or will have many reviews. Unless you go around creating enemies which is incredibly unlikely, "someone" that doesn't like you personally is rarely going to be ranking your reviews. It just won't happen. They will be ranking the writing.(Bulma, if a handful of people had to actually vote for me to review- I might never make it. Except for the forum, I have NO idea who pays attention to my reviews. Nor do I care.)This is not a popularity contest to be put to a vote with the most popular reviewers rising to the top, and able to review others. Original reviews were given a "quality rating" by Eden fantasy's staff as part of your ranking. If your own reviews do not meet some standard to be developed by Eden, you should automatically not be considered as one of the possible volunteers.Another point- reviews should be randomly assigned. So that you are reading about a wide variety of products, and learning more. Not your own particular sexual kinks and favorites.(I have not had any problem with long posts though in the forum...)

Ah, I must have missed the part about 4 different individuals each voting on the same review. I thought it was going to be more like 1 individual voting on random reviews with 4 individuals doing that. I quite frequently get my wires crossed and it makes much more sense to me now. It sounds a whole lot better than what I had pictured in my head! Thanks for clearing that up!

Ah, I must have missed the part about 4 different individuals each voting on the same review. I thought it was going to be more like 1 individual voting on random reviews with 4 individuals doing that. I quite frequently get my wires crossed and it makes much more sense to me now. It sounds a whole lot better than what I had pictured in my head! Thanks for clearing that up!

@ Jimbo- I think that old reviews would still be included in the following ways -- you do already get a certain number of points for them which would translate over. As far as quality rating, most likely we'd use a combination of the usefulness scale on each one and the internal editorial rating for that. No worries, already completed reviews will not go down the tubes with this change!@ DBD- So does that mean you'd volunteer for this task, at least for a period of time? Also, as far as the quality rating process- I imagine it would be anonymous, except for general knowledge of who the individuals are on that panel. Comment-leaving, however, is an important thing to do with a name for the same reason everywhere on the internet- personal accountability and honesty. I don't think that leaving critiquing comments is necessarily part of this voting process, though.

How about getting to vote on this "panel?" I would feel a lot better if the people on the panel were picked by the contributors, or else kept completely anonymous. For example a thread could be started for people to cast nominations for other reviewers they would like to see on the panel. Just list 4 people, excluding self, that they would like to be on the panel. Then have the 10 people who were nominated the most be put up for vote. Everyone would then vote from that list of 10, for the 4 final contributors to be on the panel. After the votes were tallied up, they could be presented and the people on the list could be given the opportunity to back out if they wanted to do so. In that case the next person on the list would be selected to take their spot. Just an idea at least. I also wanted to say that people who are against activity because they don't have the time, also would not have time to be on the panel.I really want to see activity be kept track of, even if it isn't calculated into the rank. Maybe have it listed on the contributor profile, on the reviews, and maybe have a section to sort through contributors by activity. If I wanted to ask a question, I would want to ask someone who would respond within a few days. If someone is only on the site once per month, then there is no point in asking them questions or seeking advice from that person. I don't care so much about the activity affecting rank, however I do think we will see number of comments die off. Anyways, those are my 2 cents.Over all, great plan. I think my concerns are the same as many others' on here. Thank you all for working so hard on this I bet the end product will be great.Just wanted to add that I have been timed out twice while typing a message in here in the last 10 minutes. I am starting to not bother commenting in the forums because I have to keep logging in so often. It is really annoying, and I've started copying the message to the clipboard before I click on "Post" just in case I was logged out and my comment gets flushed...super annoying.