Welcome GUEST!      CREATE ACCOUNT - Forgot Password?

Create an account to share your experiences and more!

E-MAIL   PASS  

Auto Log-in Future Sessions (on this computer).
  
Forum Thread A note about the site and any replies from other users.
Porn Users Forum » Please be objective with scoring
1-37 of 37 Posts Page 1
 
Thread Nav :  Refresh Page  |   First Post  |   Last Post  |   Porn Forum Home

11-27-08  09:15am - 5869 days Original Post - #1
Tree Rodent (0)
Active User



Posts: 708
Registered: Oct 29, '08
Location: UK
Please be objective with scoring

I don't want to be another soap boxer. The reviews on here and on TBP are great. But there is one criticism that I think is deserved, and that is the marking. I can understand why TBP gives such high marks. Nearly all review sites do this. They give higher marks than is maybe deserved. All review sites earn their income from porn sites. I don't mind that in the slightest, and I think everyone realises this and doesn't mind as long as the review is fair.

A score of 90-99 means near perfect. I can't think of ANY sites out there that are near perfect, at least not from the reviews, and all the cons that are listed against even the best sites. TBP started marking a lot of sites in the high 80's and 90's. This meant that the people at PU also marked along the same lines. The bar was already very high. Too high in my opinion. TBP is a great site, I just learned to read between the lines and realise a score in the 90's did not necessarily mean a site was that great.

I think we need a new sort of scoring, or at least adjustment in scoring so that the very best sites stick out. Okay, this is just my opinion and no offence is meant to TBP. They were usually the first reviews I would go to, and I still think it's the fairest and best site for reviews. It's just with so many scores in the 90's there is nowhere to go, in scoring, for those sites that are unique and truly deserving of a 90 (a near perfect site). The scoring is already so high that a score of 95 now doesn't mean a lot, or at least not as much as it should do.

This for me is the one negative about TBP and PU. It is not a great negative, because if you read the reviews, you can make up your own mind without really worrying about the score too much. What do you think? Edited on Nov 27, 2008, 10:10am

11-27-08  01:31pm - 5869 days #2
messmer (0)
Disabled User



Posts: 2,582
Registered: Sep 12, '07
Location: Canada
Just a small observation. When doing a review you not only have to be fair to the site but also to all the competing sites in a particular niche. That's why two of my ratings were over 90. Both Abby Winters and Girls Out West are the best in their field you have to rate them higher than the many inferior sites in the Amateur niche, even if they are not perfect.

11-27-08  04:11pm - 5868 days #3
Cybertoad (0)
Disabled User



Posts: 2,158
Registered: Jan 01, '08
Location: Wash
Originally Posted by messmer:


Just a small observation. When doing a review you not only have to be fair to the site but also to all the competing sites in a particular niche. That's why two of my ratings were over 90. Both Abby Winters and Girls Out West are the best in their field you have to rate them higher than the many inferior sites in the Amateur niche, even if they are not perfect.


Just had to poke my two cents i here :-)
I actually do not think abby winter was all that great :-)

My point being , that being fair to one site may not be fair to another.

I take only my own point of view in consideration when placing a review. I have taken great inputs on how to go about a review. But why ia m fair the niche and how goo they are only plays a small part for me, i am more concerned how they do what they do.

Again just my input and two cents. Since 2007

11-27-08  04:27pm - 5868 days #4
mbaya (0)
Suspended



Posts: 891
Registered: Jul 07, '08
Location: new jersey
I have posted 38 reviews and 12 ratings so far. Only 1 I rated as 90. I agree most definitely that sites in the 90's are very rare. I definitely agree that Abby Winters is not worthy of a 90, in spite of its many good qualities. I don't think Video Box is in that category either, as many if not all the videos are too slick and commercial. I found the quantity incredible, but very few interesting videos. I much prefer niche content that is unusual and exclusive. Those sites have a lot more personality, but rarely deserve a great score. In other words great scoring sites generally appeal to a broad cross section, but don't work well for everyone.

11-27-08  05:18pm - 5868 days #5
lk2fireone (0)
Active User



Posts: 3,618
Registered: Nov 14, '08
Location: CA
I think people are getting too hung up over the idea of perfect, and they are forgetting the recommended rating guidelines that PU offers. Also, the rating guidelines are only guidelines, and you are not required to follow them, which PU clearly states.

Below are the quoted guidelines that PU offers:

"Recommended rating guidelines, not required to follow:

Score Title Description
100 Perfect Site is perfect, could do little to improve. Top recommendation.
90-99 Excellent Site is near perfect, best in it's class. Highly recommended.
80-89 Very Good Enjoyable site, but could improve in key areas. Recommended.
70-79 Average Does some things good, some things poor. Might recommend.
60-69 Needs Work Does more things wrong than right. Low recommendation.
50-59 Poor Site Offers very little, needs serious work. Not recommended."



If you think a site is perfect, fine, give it 100.
A lot of PU members will disagree, because they "know" no site is perfect.
But if you believe a site is perfect, give it a 100 score, anyway.

But for "best in class", you can give a 90+ rating. That's your opinion, that it's best in class. Who cares what the other PU members think? If they don't realize that that is your opinion, you can kindly point out to them that your score is subjective, based on your opinion, and not on their opinion.

If they don't like your score, they have the right to post a reply that indicates why they don't like your score. Or they can write their own review, and put their very own score with the review.

80+ Very good. It's all subjective opinion anyway.

70+ Average. Maybe worth joining. But not as good as a higher rated site, in your opinion.

60+ Below average. Probably not worth your money.

50+ Definitely a waste of money.

I'm a newbie, had some problems with the idea of scoring, and finally decided: A score is what I say it is. That's my opinion of the site.

Somebody else rates the site, they will probably come up with a different score.

On top of which, the score for a site is only part of how PU members will value the site. The personal tastes of each member, what turns him/her on, is more important than the "quality" or score of a site.

I've said before, and I will say again, I've seen [pay] sites scored 90+ that I would not watch for free. The score might be solidly based on what the site is offering to the reviewing member. But if the site contents don't appeal to me, it's a waste of my time and my money to join that site.

11-27-08  05:57pm - 5868 days #6
lk2fireone (0)
Active User



Posts: 3,618
Registered: Nov 14, '08
Location: CA
TheSquirrel, you should not be ashamed to be a soap boxer. That's a fine English tradition, which is the basis of free speech.
In the USA, we have soap box racing, because Americans have been devoted to racing at least since the early days of automobiles.

I can understand your frustration with the scoring system, but you have to remember, we are only human. The ideal might be an objective scoring system, but really, I think we would be more comfortable with a subjective scoring system that is based on our opinions, as well as solid details that describe the content of a site.

I am interested in sites that score high, as possible sites I might join. But more important than the score, is whether the site contents appeal to me.

And then I look at the price, which some members say is irrelevant to score. Because I have limited porn dollars to spend.

I think I'm making sense, even if it could be expressed more clearly.

11-27-08  06:06pm - 5868 days #7
messmer (0)
Disabled User



Posts: 2,582
Registered: Sep 12, '07
Location: Canada
Originally Posted by Cybertoad:


Just had to poke my two cents i here :-)
I actually do not think abby winter was all that great :-)

My point being , that being fair to one site may not be fair to another.

I take only my own point of view in consideration when placing a review. I have taken great inputs on how to go about a review. But why ia m fair the niche and how goo they are only plays a small part for me, i am more concerned how they do what they do.

Again just my input and two cents.



Fair enough, re. Abby Winters, that's where subjectivity comes in again. I rated it by its faithfulness to its niche. I don't know of any other site with the exception of another Oz site, Girls Out West, whose amateurs look like amateurs. Most other "amateur" sites take the amateurs and then make them up to look like pros. That's one of the reasons why AW got a high mark from me. There were others as well, of course, the lay-out, a very good search engine, an abundance of models. I will grant you that a site that true to its niche can sometimes become boring if you stay longer than a month but I still stick by my assessment of it! :-)

11-27-08  06:30pm - 5868 days #8
pat362 (0)
Active User



Posts: 3,575
Registered: Jan 23, '07
Location: canada
I don't think I'm being to naive in saying that I believe that for the most part we all give honest scores to our reviews. We may not agree on the actual number, but that is why it's very important to have a detailed review to justify that score. Of course if the score and the review
don't seem to make sense then I tend to assume that this particular reviewer as an ulterior motive. For me a 100% score is not possible, because I don't believe there is never a possibility of improving something. Long live the Brown Coats.

11-27-08  06:32pm - 5868 days #9
messmer (0)
Disabled User



Posts: 2,582
Registered: Sep 12, '07
Location: Canada
Originally Posted by pat362:


I don't think I'm being to naive in saying that I believe that for the most part we all give honest scores to our reviews. We may not agree on the actual number, but that is why it's very important to have a detailed review to justify that score. Of course if the score and the review
don't seem to make sense then I tend to assume that this particular reviewer as an ulterior motive. For me a 100% score is not possible, because I don't believe there is never a possibility of improving something.


Totally agree!

11-27-08  10:04pm - 5868 days #10
PinkPanther (0)
Active User



Posts: 1,136
Registered: Jan 08, '07
Location: Oakland, CA
While I think this discussion is fine, I also think that it's illogical to ask for objectivity when judging sites that have so much connection to sexual tastes. People are going to give high marks to sites that turn then on. People are going to give low marks to sites that fail to turn them on or frustrate them in other ways - poor navigation, poor quality, poor customer service.

I think that the Comment section on reviews is a good place to wrangle over the grading and other issues and gives other users a better idea of how reasonable the reviewer is being.

Personally I haven't given a "No trust" rating to someone, but I recently made it clear, I hope, that I didn't trust the rating of a reviewer who reviewed a network of sites, said that he would have given 1 portion of that network a 75 on its own and liked other parts of the network as well, and then gave a grade of less than 75 to the whole network - that's not reasonable to me.

PU is good at giving guidance to reviewers and I think that people that stick around get better at using that guidance. That's good and we all should encourage new members to use the guidance in order to do better reviews.

At the same time, it's important to have the input of as many reviewers as possible and that's going to mean a lot of new people giving very high scores, most likely, to the sites that they love.

11-27-08  11:11pm - 5868 days #11
Cybertoad (0)
Disabled User



Posts: 2,158
Registered: Jan 01, '08
Location: Wash
Originally Posted by messmer:


Fair enough, re. Abby Winters, that's where subjectivity comes in again. I rated it by its faithfulness to its niche. I don't know of any other site with the exception of another Oz site, Girls Out West, whose amateurs look like amateurs. Most other "amateur" sites take the amateurs and then make them up to look like pros. That's one of the reasons why AW got a high mark from me. There were others as well, of course, the lay-out, a very good search engine, an abundance of models. I will grant you that a site that true to its niche can sometimes become boring if you stay longer than a month but I still stick by my assessment of it! :-)



hehehe :-) the beauty ofthis site is exactly that . Since 2007

11-28-08  03:19am - 5868 days #12
Drooler (0)
Disabled User



Posts: 1,831
Registered: Mar 11, '07
Location: USA
Originally Posted by pat362:


I don't think I'm being to naive in saying that I believe that for the most part we all give honest scores to our reviews. We may not agree on the actual number, but that is why it's very important to have a detailed review to justify that score. Of course if the score and the review
don't seem to make sense then I tend to assume that this particular reviewer as an ulterior motive. For me a 100% score is not possible, because I don't believe there is never a possibility of improving something.


Yes, that sums it up well. Unless I'm familiar with the reviewer, a score that's too high or too low, especially in a review that's short on details, makes me wonder about the reviewer.

I've enjoyed sites rated in the 70's at TPB or at PU, including some I've rated under 80. Just because a site needs to improve in key areas doesn't necessarily mean it would be a waste of money. I wanted something new, so I left England for New England.

11-28-08  05:16am - 5868 days #13
jd1961 (0)
Active User



Posts: 296
Registered: Jun 07, '07
If I like a site well enough to spend multiple months as a paying customer, I grade it in the 90s.

11-28-08  06:05am - 5868 days #14
Denner (0)
Active User



Posts: 1,217
Registered: Mar 03, '07
Location: Denmark
Originally Posted by pat362:


I don't think I'm being to naive in saying that I believe that for the most part we all give honest scores to our reviews. We may not agree on the actual number, but that is why it's very important to have a detailed review to justify that score. Of course if the score and the review
don't seem to make sense then I tend to assume that this particular reviewer as an ulterior motive. For me a 100% score is not possible, because I don't believe there is never a possibility of improving something.


I'm certainly with pat. Maybe I'm naive, but I believe most users here give an honest score, an honest review to the benefit of all - if NOT - we got an after all fine trust-system that says most (except the anonymous).
But I'm also with TheSquirrel about the sometimes "strange" difference between TBP-reviews/scores and PU-scores.
That do not mean I do not trust TBP - on the contrary - I still consider the TBP-scores as the first guideline in my search for new stuff/sites. And after that it's always great to wait for PUs - or come up with a review yourself.
But bottomline: it's VERY rare that a TBP score is way-off - I got to hand that to our hosts. We all got different views for almost every site - exampel: see the latest from jd1961 for Sex Asian 18 - and all the replys.
Another bottomline is that this user depend on new PUs and their reviews untill the opposite has been proved - But ok, good sceptisism is always at place... "I don't drink anymore - I freeze it, and eat it like a popcicle"

11-28-08  06:06am - 5868 days #15
lk2fireone (0)
Active User



Posts: 3,618
Registered: Nov 14, '08
Location: CA
Originally Posted by jd1961:


If I like a site well enough to spend multiple months as a paying customer, I grade it in the 90s.


I've only done 3 reviews.
Two of the sites I scored 75.
The other site I scored 97.

But I was a member of each site for multiple months (actually, 1+ year at each of the three sites).

Just because I score a site in the 70s, does not mean it is junk or not worthwhile.

I think score is very subjective.

But my score is my estimate of what the value of that site is, in terms of content quality, quantity, and price, as the major factors.

If that does not make sense, too bad. I'm only human.

11-28-08  06:13am - 5868 days #16
Denner (0)
Active User



Posts: 1,217
Registered: Mar 03, '07
Location: Denmark
Originally Posted by lk2fireone:


I've only done 3 reviews.
Two of the sites I scored 75.
The other site I scored 97.

But I was a member of each site for multiple months (actually, 1+ year at each of the three sites).

Just because I score a site in the 70s, does not mean it is junk or not worthwhile.

I think score is very subjective.

But my score is my estimate of what the value of that site is, in terms of content quality, quantity, and price, as the major factors.



Well, bro - sure the scores at PU are subjective - what else could it possibly be? I do not think there can be anything objective in this field - every PU gives reviews and scores after their own (and hopefully) honest opinion...
I think that's the deal here. "I don't drink anymore - I freeze it, and eat it like a popcicle"

11-28-08  06:26am - 5868 days #17
Khan (0)
Suspended



Posts: 1,737
Registered: Jan 05, '07
Location: USA
You must remember, the scores from TBP are done with a fairly rigid standard. You can actually see the criteria at:
https://www.thebestporn.com/criteria.html

You can also see some remarks on the scoring at:
https://www.thebestporn.com/articles_output.html?id=12

Obviously, the Users at PU each have their own criteria. While we have given a "Recommended rating guideline", it is very much up to each user to assign a score that THEY feel is appropriate.

If discussions here have shown nothing else, they have made it abundently obvious that different users value different things in a pay site. You can also gain a little insight into a person's scoring by looking at the average score they give (in their profile). Former PornUsers Senior Administrator
Now at: MyPorn.com

"To get your ideas across use small words, big ideas, and short sentences."-John Henry Patterson

11-28-08  06:26am - 5868 days #18
jd1961 (0)
Active User



Posts: 296
Registered: Jun 07, '07
Originally Posted by Denner:


Well, bro - sure the scores at PU are subjective - what else could it possibly be? I do not think there can be anything objective in this field - every PU gives reviews and scores after their own (and hopefully) honest opinion...
I think that's the deal here.


If you get to know the members, you see what they like and dislike and how that reflects in a score. I won't criticize a high score for a BBW site, which is not my preference, if I know the user has a thing for the portly ladies!

11-28-08  06:45am - 5868 days #19
Denner (0)
Active User



Posts: 1,217
Registered: Mar 03, '07
Location: Denmark
Originally Posted by jd1961:


If you get to know the members, you see what they like and dislike and how that reflects in a score. I won't criticize a high score for a BBW site, which is not my preference, if I know the user has a thing for the portly ladies!


Exactly! Well put - I have the same thing - go after the users you normally know are in "your field". And I still think it's fine continueasly (sorry, maybe wrong english) to follow new/newer users with the same interests - I sure have some favorites there, also...users I can thank for turning my eye to (for me)unknown sites.... "I don't drink anymore - I freeze it, and eat it like a popcicle"

11-28-08  08:12am - 5868 days #20
Cybertoad (0)
Disabled User



Posts: 2,158
Registered: Jan 01, '08
Location: Wash
Originally Posted by Denner:


Exactly! Well put - I have the same thing - go after the users you normally know are in "your field". And I still think it's fine continueasly (sorry, maybe wrong english) to follow new/newer users with the same interests - I sure have some favorites there, also...users I can thank for turning my eye to (for me)unknown sites....


Also a few trsted users have helped me avoid spending my cash as well as find diamonds. thanks all that do . Since 2007

11-28-08  08:14am - 5868 days #21
lk2fireone (0)
Active User



Posts: 3,618
Registered: Nov 14, '08
Location: CA
Originally Posted by Khan:


You must remember, the scores from TBP are done with a fairly rigid standard.


https://www.thebestporn.com/articles_output.html?id=12

The "Guides & Tips Article" on scoring (at the URL above) states: "The 3 primary categories for a pay-site are "content" (60%), "navigation" (20%), and "cost" (20%)."

But I've seen major PU members (with high points ranking who gave lots of reviews) state that TBP dropped price as a factor in scoring. And they said that price should not be a factor in the score of a PU review, and that most PU members agreed with that."

Did TBP drop price as a factor in score?

Cost of membership seems to me a major factor in site score. Content is the primary factor, followed by cost. and then navigation. For me personally, navigation (site ease of use) is the least important of the 3 factors.

11-28-08  08:51am - 5868 days #22
Khan (0)
Suspended



Posts: 1,737
Registered: Jan 05, '07
Location: USA
Originally Posted by lk2fireone:


https://www.thebestporn.com/articles_output.html?id=12

The "Guides & Tips Article" on scoring (at the URL above) states: "The 3 primary categories for a pay-site are "content" (60%), "navigation" (20%), and "cost" (20%)."

Did TBP drop price as a factor in score?



The price of a site is no longer a factor in the score. The article was obviously based on the time period it was written. If you'll look at the first link I gave you, https://www.thebestporn.com/criteria.html ... that is the actual (current) criteria unless I'm badly mistaken.

But to directly answer your question, NO, the price is no longer a factor. And yes, I get that FOR YOU, it is something you consider when giving a score. That's fine, include it in scores YOU assign. We no longer do so. Former PornUsers Senior Administrator
Now at: MyPorn.com

"To get your ideas across use small words, big ideas, and short sentences."-John Henry Patterson

11-28-08  12:08pm - 5868 days #23
Cybertoad (0)
Disabled User



Posts: 2,158
Registered: Jan 01, '08
Location: Wash
Originally Posted by messmer:


Fair enough, re. Abby Winters, that's where subjectivity comes in again. I rated it by its faithfulness to its niche. [/b] true to its niche can sometimes become boring if you stay longer than a month but I still stick by my assessment of it! :-)



Looking at the replies, I am still wondering if others look at price.
Messmer said by the faithful to its niche and I agree. But what if they jacked the price up?

I am not content to leave out pricing enterely.
However it is not part of my scoring just the review.

But heres my rating system ( I actually have one lol )

*************************************************
CYBERTOADS'S SIX TO SEXXY REVIEWS LIST

1. Ease of Site.
Give me a great site I can't get to stuff and it pisses me off.
Rate:= 15%


2.
Make sure its true to what it advertises, they say things like the best HD , the biggest, and then its not what it says, or is misleading.
Rate = 20%

3. No Male Talking / Directors.
Damn it I hate these fuckers talking all the damn time.
When will they get it? Its our fantasy not yours morons.
Until your are watching for voyerism, and we are paying for it shut up.
( mostly because most sites never clue us in until too late )
Rating = 18%

4. Fast site and downloads
I give this a low percentage because I can get around
slow with a download manager.
Rate= 5%

5. Pretty Model, Nice Voice, sexy additude.
This is at the biggest part of my reviews.
Do they give me what I need bottom line.
All the above can be perfect but if they do not feed the
need. then nothing is worth it.
Rate = 40


6. Does the site update often ? or at all.
For me this is a really a do not care kina thing. If they do not update I will cancel after a month its that simple.
I do not rate this hardl at all as it will be my own choice and stupidity to pay for longer if getting nothing.
But is crucial for other to know when joining if they update.
Rate = 2%



I have a check off chart I use to give accurate reviews.
and this percentage rating system, the review part is a 3 part area with check off i made to fit the review.


Cybertoad Since 2007 Edited on Nov 28, 2008, 12:14pm

11-28-08  01:13pm - 5868 days #24
Tree Rodent (0)
Active User



Posts: 708
Registered: Oct 29, '08
Location: UK
I love the "six to sexxy reviews list." In particular how many gorgeous girls have been ruined by some dickhead in front of or behind the camera?

The reason I made the post in the first place was because of my concern that the really fantastic, individual, classy sites may not stand out because of all the high scores awarded to sites which are pretty much all the same.

To use a really ridiculous comparison, remember when Nadia Comaneci kept scoring 10.0 out of 10.0 in gymnastics? They had to change the scoring system, because quite soon after that all the girls were doing more and doing it better.

I would love to see a total overhaul of the scoring, although realistically this is not going to happen. I agree though with just about all the coments that have been made on this thread. I realise why things are the way they are. I'm not going to change them, and I really wouldn't want to anyway, simply because people seem very happy with the scoring system the way it is.

11-28-08  01:40pm - 5868 days #25
IKnoPorn (0)
Active User



Posts: 61
Registered: Jan 15, '07
Location: Los Angeles, CA
Excellent system, Cybertoad! Mind if I make a copy of your checklist and use it to help shape my own reviews? I have my own criteria but never bothered writing it down. Some days, you just can't get rid of a bomb. - Batman

11-28-08  02:12pm - 5868 days #26
Cybertoad (0)
Disabled User



Posts: 2,158
Registered: Jan 01, '08
Location: Wash
Originally Posted by IKnoPorn:


Excellent system, Cybertoad! Mind if I make a copy of your checklist and use it to help shape my own reviews? I have my own criteria but never bothered writing it down.



Sure Thing :-)
Help Your Self . Since 2007

11-28-08  07:33pm - 5867 days #27
pat362 (0)
Active User



Posts: 3,575
Registered: Jan 23, '07
Location: canada
Originally Posted by Cybertoad:


Also a few trsted users have helped me avoid spending my cash as well as find diamonds. thanks all that do .


This sums up my joy at having found TBP and then PU. Those rare gems, and the all too familiar turds. I don't know if my pocket book as come out on top, because I join as many sites now as I did in the past. At least now my satisfaction rating is greater than in the past. Long live the Brown Coats.

12-01-08  04:05am - 5865 days #28
PinkPanther (0)
Active User



Posts: 1,136
Registered: Jan 08, '07
Location: Oakland, CA
Personally, I can't take price out of the equation when grading a site because a part of grading a site is assessing the value - and if I were to compare 2 sites that had very similar amounts and style of content and 1 had a price that was $10/month higher than the other, you can bet that if I were grading both of them, I would give the less expensive site a higher grade, because it's a better value - and a better value deserves a higher grade, regardless of whether TBP wants to use it in their reviews or not - and I'm not knocking their decision to take it out of their criteria. I'm just not taking it out of mine for the reasons stated.

12-01-08  08:08am - 5865 days #29
Cybertoad (0)
Disabled User



Posts: 2,158
Registered: Jan 01, '08
Location: Wash
Originally Posted by PinkPanther:


Personally, I can't take price out of the equation when grading a site because a part of grading a site is assessing the value - and if I were to compare 2 sites that had very similar amounts and style of content and 1 had a price that was $10/month higher than the other, you can bet that if I were grading both of them, I would give the less expensive site a higher grade, because it's a better value - and a better value deserves a higher grade, regardless of whether TBP wants to use it in their reviews or not - and I'm not knocking their decision to take it out of their criteria. I'm just not taking it out of mine for the reasons stated.



Hi Pink,
I think you make great sense I agree.

But I am also guessing thats TBP is trying to stay nuetral on there reviews as possible.
Unlike you and I they do not take as much a personal view as much as we do because there is business at stake.
To make the point lets say I make Plasma Tv's and I supply Sears and Walmart, obviously Walmart would be cheaper in selling my TV, but I would never place advertising in saying so my thoughts on them should be of a nuetral point of view. This is not to say they do not take the reviews personal its to say they tend to stay clear from personal thoughts on a site too much in the review process. I have seen it though but its rare. Thats why our reviews are so important as it gives a biased based soly on one review at a at time.
I am sure TBP, has rated a site to find we all are far away from their review. But thats because we are as you say in other words putting our money on the review process.
I think the marrage between the two, being memebers and TBP is awsome. And having and open forum blows me away because they allow thoughts and questions.


It took me awhile to be a member to wonder why $$ wasnt a part of the review process. But I get it now I think.
Nuetrality is TBP to sucess. Cant affend member or site owners if you are nuetral. Since 2007

12-01-08  01:57pm - 5865 days #30
Drooler (0)
Disabled User



Posts: 1,831
Registered: Mar 11, '07
Location: USA
Originally Posted by PinkPanther:


Personally, I can't take price out of the equation when grading a site because a part of grading a site is assessing the value - and if I were to compare 2 sites that had very similar amounts and style of content and 1 had a price that was $10/month higher than the other, you can bet that if I were grading both of them, I would give the less expensive site a higher grade, because it's a better value - and a better value deserves a higher grade, regardless of whether TBP wants to use it in their reviews or not - and I'm not knocking their decision to take it out of their criteria. I'm just not taking it out of mine for the reasons stated.


I can't review without considering price, either. I was rather dumbstruck when TBP said that it no longer was going to figure price into their scoring. Well, at least they were transparent about it.

How many things get reviewed without price being a factor? Some movies, perhaps. Some books, maybe. Haute couture, to be "bien sur" sure, price being no object.

But not cars. Not appliances. Not a lot of things. With porn sites, how many of us don't care how much we get for our (name that currency)? It isn't like a video of cocksucking, cuntlapping, and hole-banging is going to be the heigth of fashion, or just simply so edifying that it's worth a few dollars more, no questions asked. I wanted something new, so I left England for New England.

12-01-08  02:35pm - 5865 days #31
Rick (0)
Suspended



Posts: 401
Registered: Jan 05, '07
Location: Las Vegas, NV
This is a good topic. I wanted to just add some facts for you guys about the reason we removed price.

I decided to paste part of the announcement when this occurred:

"The biggest change was price being removed from our scoring breakdown. Cost of a site will no longer factor into a site's overall score. There was several reasons for this, such as price being very subjective based on a user's preferences and various pricing options (trials, monthly cost, video on demand, etc). So from now on, you can judge for yourself how important price is to you. The score will be based on the site's performance!"

Another reason we did this was because of how often price changed. Whenever a site changed it's price, or let's say a special discount was made, it required a lot of work for our reviewers to go back and update their review (score and any text). We also got a lot of complaints from both webmasters and users that price was too subjective based on the users preference, which we agreed with.

Keep in mind also, it was difficult for us to define good price. Obviously say a site that was $9/month is an awesome price. But what about a site offerring say a $2 full access trial, and $29.95/mo? High monthly, low trial. Some users may only care about the cheap full access trial and consider that a great price, where the month didn't matter. Same with say a site that has a low yearly price, but standard monthly. Too many factors, all of which added it's demise.

In the end, we felt users could determine how price affects them (using our site facts), we list price everywhere in fact. It's important users keep that in mind that the TBP score doesn't factor price of course. Good thing is we haven't really had many complaints, so we're satisfied with the decision. :) The Best Porn - Ultimate Consumer Guide to Porn
Porn Users - Porn Review by the People
Ranks.com, Inc., Chief/Founder

12-01-08  07:04pm - 5864 days #32
PinkPanther (0)
Active User



Posts: 1,136
Registered: Jan 08, '07
Location: Oakland, CA
I get your points, Rick - and it's absolutely true - Femjoy's price has been rather high historically, but now they have "specials" every few months - so if TBP was going to be changing your rating to take that kind of stuff into account - and it's becoming common with many sites - you would have a hard time doing much else.

It's part of why it's worthwhile to have both TBP with the pros reviewing according to set standards and trying to be as objective as possible along with PU, which allows more for the subjective factor and a lot of wrangling.

12-05-08  12:47am - 5861 days #33
sitsat (0)
Active User

Posts: 4
Registered: Nov 28, '08
While I agree that scores will always be subjective, I really think people should try and stick to the guidelines for ratings, just so they are balanced.

Let's say, for example, that I'm using my own rating system and decide that 70 is a high score, whereas other users decide that 85 is a good score, consider the following:
-If I rate a site that has only two other reviews averaging 85 each, then I will bring the overall score down to around 75, which may be perceived by others as a 'mediocre' or perhaps 'poor' average user rating, even though none of the reviewers thought so.
-However, if fourteen others had reviewed the site and their average was 85, my score would bring the overall down to 84 (no real difference).
-Even if I thought the site was very good and gave it a score of 80, it would still have a negative impact on the overall score due to my personal scoring system. Hence, even though I might have enjoyed the site more than the average viewer, it would have been better for the site if I had not reviewed it at all.

The point I'm making is that if our scores are all over the place due to us using different systems, visitors to this site aren't going to get good feedback from us (and this will particularly affect the smaller sites with only a few user reviews).

On this basis, I use only two criteria when giving a score
1. How much did I like the site (including value for money).
2. How much do I think others will like the site (or how much would I recommend this site to others).
For this I stick to the recommended rating guidelines to keep it balanced with other Porn Users.

Just as an example, I recently reviewed SapphicErotica and KissMeGirl (two lesbian sites). I gave SE a score of 93 and KMG a score of 90, even though I gained far far more personal pleasure from the latter. However, I'm aware that others who are into lesbian porn might not put as much value on the same things as I do, therefore I gave SE the higher score because overall I would recommend it more to others. Edited on Dec 05, 2008, 12:51am

12-05-08  04:54am - 5861 days #34
Tree Rodent (0)
Active User



Posts: 708
Registered: Oct 29, '08
Location: UK
Originally Posted by sitsat:





-If I rate a site that has only two other reviews averaging 85 each, then I will bring the overall score down to around 75, which may be perceived by others as a 'mediocre' or perhaps 'poor' average user rating, even though none of the reviewers thought so.
-However, if fourteen others had reviewed the site and their average was 85, my score would bring the overall down to 84 (no real difference).
-Even if I thought the site was very good and gave it a score of 80, it would still have a negative impact on the overall score due to my personal scoring system. Hence, even though I might have enjoyed the site more than the average viewer, it would have been better for the site if I had not reviewed it at all.




I think that is an excellent point, and is one I have thought about myself. I was thinking if I reviewed a site that everyone liked, if I liked it better but gave it a lower mark, it would actually harm the site more than help it. It's something that has made me consider not reveiewing sites.

The reason I made my post in the first place was because I considered marks being awarded were too high, given the guidelines, but it's me that's out of line. So my scoring system, (which I consider accurate and fair and based on the guidelines laid down!) could do more harm than good.

12-05-08  08:00am - 5861 days #35
Cybertoad (0)
Disabled User



Posts: 2,158
Registered: Jan 01, '08
Location: Wash
Originally Posted by sitsat:


While I agree that scores will always be subjective, I really think people should try and stick to the guidelines for ratings, just so they are balanced.


Hmmm I am confused as your post, gives its own opinion as well. I am not picking on your thread, but you started off saying we should all stay on guidlenes but then mention ,money as a guidline. Unless I am missing something your idea is outside what TBP uses on ther own as well.
I again think that the purpose of our reviews is just that our reviews.
What do regular porn joes like and think about the site.

Just my opinion of course. :-) Since 2007

12-05-08  08:52am - 5861 days #36
uscue (0)
Active User

Posts: 13
Registered: Mar 01, '07
Location: USA
Figure I'll add in...nothing too groundbreaking or anything. But here goes:

I think - and I try - to follow the guidelines given by PU. If you follow the general guideline (ie. 80-89 enjoyable but could use some improvement...recommended or 100: could do little to improve or 70-79 some things good, some things bad) then the scores should all be pretty close to what they should be.

At the same time, it's individual reviews. Just like Roger Ebert and his pal may give a movie two thumbs up while the LA Times rates it as a C-, individual reviews are subject to what the individual person believes makes a good site. A movie I liked (History of Violence) did well with me, but my buddies hated it - we all had what I consider valid reasons for our likes/dislikes. Same thing with sites. I might give VideoBox something in the 90's because for what the site's purpose is, it does a really good job -- never misses an update, lots of updates a day, many types and genres to try to appeal to all, VERY affordable, the most sophisticated download options in the business. Someone else might give it something in the 70's because there's not enough niche videos, quality of some videos isn't that great. In their mind, it greatly detracts from the experience and grade while in mine, video quality is only as good as the original (they're not into making movies, they distribute movies).

Important thing is we all read the reviews and make an educated guess on if we would like it based on what people rate it and the reasons. As long as they explain the site in their review, I could care less about the actual number. I've joined sites that on here and TBP had mediocre scores but I loved. Then there's sites like Abby Winters that have high scores across the board but I'm not a fan of because of price - the content is enough to give it a high mark but the overall value is greatly diminished in my eyes because of the pricing structure.

I guess my bottom line, use the guideline to create your basis of scoring, but in the end it should be the actual review that matters.

12-05-08  04:33pm - 5860 days #37
Wittyguy (0)
Active User



Posts: 1,138
Registered: Feb 04, '08
Location: Left Coast, USA
This is an issue touched upon in the "What should a PU review contain" thread. In my book there are only two ways of minimizing the subjectiveness of scoring (it will never be, nor should be, entirely eliminated).

First, is experience. Only after having been a member at a bunch of sites, reading a lot of reviews and posting some of your own will you start getting consistent. Some reviews I did early on here will be getting rescored soon because I was judging too much on own personal likes as opposed to trying to give a more balanced analysis for the masses.

Second, is the technical side of scoring. I try to include a lot of more technical stuff (sizes, downloads, quality of content (is it professionally done), site navigation and layout, etc.) because that is part of the overall experience. Sites that have high technical merit in my book will score higher even if I'm not so big on the content. I think you'll also find the top sites on PU also score high in technical merit ... think of it like figure skating, while the free style portion (actual action) is great, you can't win the gold unless you're technically sound in the early round(s).

1-37 of 37 Posts Page 1
 
Thread Nav :  Refresh Page  |   First Post  |   Last Post  |   Porn Forum Home


Home - Sites - Users - Reviews - Comments - Categories - Forum

Contact Us - Announcements - FAQ's - Terms & Rules - Cookies - DMCA - 2257 - Porn Review - Webmasters

Protecting Minors
We are strong supporters of RTA and ICRA, two of the most recognized self labeling organizations. Our site is properly labeled to assist in the protection of minors accessing inappopriate content. For information about filtering tools, check this site.

DISCLAIMER: ALL MODELS APPEARING ON THIS WEBSITE ARE 18 YEARS OR OLDER.

To report child pornography, go directly to ASACP!  We're proud to be a corporate sponsor.
Have concerns or questions about porn addiction?  We recommend this helpful resource.

All Rights Reserved © 2003-2024 PornUsers.com.


Loaded in 0.01 seconds.