Rating System- The Details

rouin rouin
Quote:
Originally posted by Program Manager
The rating system currently rests on two variables: activity and popularity.Activity is calculated using points allotted for four inputs: reviews (20 pts.), follow up reviews (10), comment you post on other reviews (1), comment you post in response ... More
It is interesting but seems a little too much for people to do. Like the other's state how can we assure people wont vote for themselves? Will not some people have the upper hand compared to new reviewers?
09/05/2008
Maria Maria
Quote:
Originally posted by Epiphora
I see what you mean, but I think they're trying to make our ratings about more than just our reviews. They're trying to make our ratings be about ourselves as members of the EdenFantasys community. And that is great with me, because I have a lot of ... More
That's why right now, I'm leaning toward having two separate ratings--one to rate just the usefulness of the reviews, and one to rate participation/populari ty. So if you want to look at the stuff the really active people are doing, you can--and if you're rather just look at the top reviews regardless of how active the contributers are, you can do that too.
09/05/2008
BeeLeaveMe BeeLeaveMe
Quote:
Originally posted by Epiphora
I see what you mean, but I think they're trying to make our ratings about more than just our reviews. They're trying to make our ratings be about ourselves as members of the EdenFantasys community. And that is great with me, because I have a lot of ... More
This is way out of control! I feel like we're all arguing politics and your right it is getting depressing. I know that the program manager would really like our opinion on all of this but ultimately it's Eden's decision.

I personally feel a little disappointed that I've invested quite a bit of time on the site not necessarily writing reviews and haven't seen my ranking budge. It would be nice to be rewarded for being active member not just writing reviews. I love chatting with other members as well as commenting on other reviews. It's wonderful that everyone is getting rewarded for their time and effort they put into Eden. They deserve all of it! I know that if we just did away with rankings it would be a bit of a let down to me. It makes me really happy to see others rankings go up when I know they deserve it.

Yes, I know I'm selfless. It makes me happy when others are! I think Dame Demi deserves a pizza party for all the hard work she does not just a ranking!
09/05/2008
Epiphora Epiphora
Quote:
Originally posted by Maria
That's why right now, I'm leaning toward having two separate ratings--one to rate just the usefulness of the reviews, and one to rate participation/populari ty. So if you want to look at the stuff the really active people are doing, you can--and if ... More
Yes! That's a great idea.
09/05/2008
Program Manager Program Manager
Quote:
Originally posted by Dragon
I agree... Eden is not promoting honest, quality reviews. They seem to have different goals. The goal of showing a website with a lot of interaction that exists for the "non-reviewing" customer to see...
We're actually committed to providing both honest and high-quality reviews. I commonly get emails from people worried about giving mediocre or bad feedback on a product that was free, and I always tell them to be straightforward about it. That's the point of this program, after all; we expend both money and time to provide this level of feedback on the site.

As for the quality level of reviews, we are trying to balance and maintain solid quality while the program continues to expand. The goal of the rating system is to accurately reflect, to both reviewers and random shoppers, the quality of the writer behind a review- level of experience, knowledge, investment in providing quality information and feedback, etc. There is a wide range in the reviewer demographic, and it would be counter-intuitive to take all reviews at equal face value.
09/05/2008
Program Manager Program Manager
It's true, I did want opinions and input- thank you to everyone for that! It does seem to be getting a little out of hand, but this has been a useful thread for me to read and all these ideas are going into the planning process.
09/05/2008
Dame Demi Dame Demi
Quote:
Originally posted by BeeLeaveMe
This is way out of control! I feel like we're all arguing politics and your right it is getting depressing. I know that the program manager would really like our opinion on all of this but ultimately it's Eden's decision.I personally feel a little ... More
"Yes, I know I'm selfless. It makes me happy when others are! I think Dame Demi deserves a pizza party for all the hard work she does not just a ranking! "

I feel so loved! Thank you so much! I've been kind of out of it lately, but hopefully will be back full blast soon! And really, that was a very sweet comment!
09/05/2008
Josmoseph Josmoseph
Quote:
Originally posted by Program Manager
The rating system currently rests on two variables: activity and popularity.Activity is calculated using points allotted for four inputs: reviews (20 pts.), follow up reviews (10), comment you post on other reviews (1), comment you post in response ... More
It might be that several people who know each other get together and work on popularity. I am not sure it really makes a Hugh difference unless you begin handing out assignments based on ratings. Otherwise it is just an ego matter.
09/06/2008
Butterkups Butterkups
Quote:
Originally posted by Program Manager
The rating system currently rests on two variables: activity and popularity.Activity is calculated using points allotted for four inputs: reviews (20 pts.), follow up reviews (10), comment you post on other reviews (1), comment you post in response ... More
you folks have never been anything but kind and fair to me. I trust what you do and like how you do it. Thanks for letting me be part of helping others enjoy the adult toy market. I feel priviledged
09/06/2008
Dragon Dragon
Quote:
Originally posted by Sleeping Dreamer
But is our rating MAINLY for our reviews? I was under the impression that my rating was strictly for my reviews not for the activity I have on ALL aspects of the site. How far off-base will our ratings get if we try to encompass so many different ... More
They currently are NOT. Or my rating would not be so low.
09/06/2008
Dragon Dragon
Quote:
Originally posted by ToyQuest
I have to agree with nearly all of what Devilbluedress says. Most of my reviews don't have very many comments on them. I'd like to think it's because I wrote a complete and thorough review. But aside from that, making this a popularity contest is ... More
I'm working a Master's degree, writing a thesis, have two kids and working full time. Busy?- yeah.
09/06/2008
Dragon Dragon
Quote:
Originally posted by rouin
It is interesting but seems a little too much for people to do. Like the other's state how can we assure people wont vote for themselves? Will not some people have the upper hand compared to new reviewers?
It's more than just voting for themselves to increase your own status. It actually negatively affects others... That's just assine.
09/06/2008
Program Manager Program Manager
Hm. This has been a good, if slightly stressful, discussion. It sounds like a good move would be to include number of reviews/length of time with program, as well as changing the calculation to be independent of other reviewer numbers (not do it on a curve).
09/07/2008
Dragon Dragon
I woke up this morning with a thought. I'd be happy to have my rating and my history used as an example. Claire are you willing to conduct an analysis to show everyone exactly how my rating is calculated- given the length of time and number of reviews I've published, and how low it currently is.

Even more illustrative would be how it would look under the new system as well.

Anyone else interested?
09/07/2008
Beautiful Dreamer Beautiful Dreamer
Quote:
Originally posted by Dragon
I woke up this morning with a thought. I'd be happy to have my rating and my history used as an example. Claire are you willing to conduct an analysis to show everyone exactly how my rating is calculated- given the length of time and number of ... More
That would be helpful. Especially if your willing to volunteer yourself.
My rating has never been high (it sat at 3.5 forever... while my boyfriend had a 4.2 in the first week!). I'm not too concerned about it, but it would be nice to be able to understand how its rated. I also liked your suggestion for being able to search for reviewers by number of reviews wrote.
09/07/2008
His scarlett His scarlett
i don't understand the rating system either - i read the original post about points but still don't get how it relates to the actual scores against our names

i am 3.6 which i assume means i am not doing a good job and i would like to improve it but i understand how difficult it is to get all the assignments out - i have been waiting for my next one for some time but am not getting impatient
09/07/2008
Beautiful Dreamer Beautiful Dreamer
Quote:
Originally posted by His scarlett
i don't understand the rating system either - i read the original post about points but still don't get how it relates to the actual scores against our namesi am 3.6 which i assume means i am not doing a good job and i would like to improve it but i ... More
All but one of my reviews were not assignments. That seems to help a lot!
09/07/2008
Dragon Dragon
Quote:
Originally posted by Beautiful Dreamer
That would be helpful. Especially if your willing to volunteer yourself. My rating has never been high (it sat at 3.5 forever... while my boyfriend had a 4.2 in the first week!). I'm not too concerned about it, but it would be nice to be able to ... More
Absolutely willing to volunteer myself and my rating. With as much detail as reviews, comments, type of activity- everything.

I don't care about the ratings. I do believe that mine does not accurately reflect my time at Eden, so it would be an interesting analysis to see what everyone else feels.
09/07/2008
Dragon Dragon
Quote:
Originally posted by Beautiful Dreamer
That would be helpful. Especially if your willing to volunteer yourself. My rating has never been high (it sat at 3.5 forever... while my boyfriend had a 4.2 in the first week!). I'm not too concerned about it, but it would be nice to be able to ... More
He had a rating of 4.2 in the first week- probably because he just posted a review, commented. Whatever.

I think at one point in time my rating was close to 4.8. But when you don't post- possibly due to no fault of your own, or lots of comments- then your rating will go DOWN. (Not everyone can afford endless sex toys of their own to write reviews on).

It goes up because of activity and some random thing called "popularity."
09/07/2008
Kaleidescope Kaleidescope
Quote:
Originally posted by Dragon
I woke up this morning with a thought. I'd be happy to have my rating and my history used as an example. Claire are you willing to conduct an analysis to show everyone exactly how my rating is calculated- given the length of time and number of ... More
Yeah, I would do volunteer. I get to sign in a few times a week but don't always get a chance to look at anyone else's reviews. Before this whole rating thing got put in I was at 4.1. Now I am at 3.5.
09/07/2008
His scarlett His scarlett
i would be interested to see a breakdown - just to see if that would make it clearer - easier - to understand

thanks for volunteering!
09/07/2008
Beautiful Dreamer Beautiful Dreamer
Quote:
Originally posted by Kaleidescope
Yeah, I would do volunteer. I get to sign in a few times a week but don't always get a chance to look at anyone else's reviews. Before this whole rating thing got put in I was at 4.1. Now I am at 3.5.
I don't believe anything has been changed with the rating system yet. A change is in the works, thus the reason for the thread.
09/07/2008
His scarlett His scarlett
Quote:
Originally posted by Beautiful Dreamer
All but one of my reviews were not assignments. That seems to help a lot!
thanks Beautiful Dreamer - i have four reviews on the site - half of which were assignments - i appreciate your advise and will definitely do some more reviews which are not assignments to see how that affects my rating! thanks!
09/07/2008
Beautiful Dreamer Beautiful Dreamer
Quote:
Originally posted by His scarlett
thanks Beautiful Dreamer - i have four reviews on the site - half of which were assignments - i appreciate your advise and will definitely do some more reviews which are not assignments to see how that affects my rating! thanks!
Glad I could help. I'm really new to the site. I just signed up in May and have only had one verified review (I got it last month- yay!). I've learned a lot by asking other reviewers and by trial. I enjoy reading and writing the reviews.
09/07/2008
Program Manager Program Manager
Quote:
Originally posted by Beautiful Dreamer
I don't believe anything has been changed with the rating system yet. A change is in the works, thus the reason for the thread.
Right- there has been no change made yet. We will, of course, notify when that happens, and hopefully include many of the ideas expressed here.
09/08/2008
Program Manager Program Manager
Quote:
Originally posted by Dragon
I woke up this morning with a thought. I'd be happy to have my rating and my history used as an example. Claire are you willing to conduct an analysis to show everyone exactly how my rating is calculated- given the length of time and number of ... More
I think that's a good idea
I'll talk to the boss about it and see what we can do.
09/09/2008
Dragon Dragon
How did we go from 9 pages to 3? It doesn't look like anything was deleted...
09/09/2008
Neuron Geek Neuron Geek
We have increased number of posts on a page from 10 to 30.
09/09/2008
Dragon Dragon
Quote:
Originally posted by Greathouse2008
I think we just need to remember that this is a site to help people. Yes it is nice to get rewarded and yes people will cheat and try to be the number one. But at less for me, I come on here to get some advice and to have fun and stay safe. The ... More
No, the ranking does NOT just tell how many products a person has reviewed. I need to take a look at how many I have that are VERIFIED...
09/09/2008
Dragon Dragon
Quote:
Originally posted by Neuron Geek
We have increased number of posts on a page from 10 to 30.
Thank you!
09/09/2008
Total posts: 105
Unique posters: 43