Go Back   hwbot.org > News > HWBOT Frontpage News

HWBOT Frontpage News Official HWBOT articles and frontpage news

Closed Thread
Thread Tools

Important! Opinions regarding HWBoints algorithm revision

Dear HWBot users and overclocking enthousiasts,

This newspost is to inform you, or better: inquire you, to have you share your opinion with the HWBot staff about a complicated issue regarding the HWBoints. This particular discussion could have a big effect on how points are awarded and, thus, how people are ranked as well as how your team is ranked. We would really appreciate if you could voice your opinion so that HWBot can have a better view on what people would like to happen. The issue concerns splitting up the videocard rankings based on number of used sockets instead of number of GPUs.

Underneath a summation of the discussion within HWBot.

1. What is the problem?

Over the years HWBot has had to make a great amount of decisions regarding the HWBoints and how to rate overclockers. The system as it is now works quite good and, although there are still flaws present, does give a good estimation of how ‘good’ a score is overall and within a certain category. One of the more important decisions we had to take was whether we split up the videocard sections based on PCI-Express slots or actual GPUs. Although it’s only a one-word difference, it has had quite a large effect on the rankings and, as we figured out just a few weeks ago, also on how people spend money.

First of all, let me refresh the HWBot principles:

  • Overclocking competition should be open to as much people as possible
  • A ranking on HWBot should be largely about skill, not purely about money.

So, a couple of weeks ago, we decided to check what videocards were most popular and how much different users have used what type of graphics card to submit at least ONE result. Underneath is a list with the number of submissions since 01-01-09:

As you can see, the amount of X2’s and GTX295 used for HWBOT is enormeous. The total amount of different users per graphics card, since 01-01-09, is displayed underneath:

HD4870X2 – 485
GTX295 – 434

HD4870 – 418
HD4890 – 313
GTX260 216SP – 311
HD4850 – 307
GTX285 – 270
GTX280 – 234
GF9 8800GT 512 – 217
GTX275 – 120
HD4770 – 90

What we see is that to score high at HWbot you’ll need to invest in very expensive video cards. Next to that, there’s the problem of the single-gpu extreme overclocking. Although it takes up quite a lot of money and quite a bit of modifications to have a current-gen single GPU card to run at very high clock frequencies, it is very little rewarding in terms of global points. In fact, if you go through the submissions at HWbot, you will notice that it’s possible to beat 1.2GHz single GPU’s with a stock cooled dual-gpu (GTX295 or X2) card.

So, to sum up:

  • HWbot global points are dominated by dual-gpu cards
  • Single GPU extreme overclocks are beaten by stock cooled dual-gpu.
  • Dual-GPU costs much more
  • Overclockers league is based on global points mainly
  • Overclockers league should be about skill, not money

Conclusion:

As the Overclockers League is about global points, people who want to increase their ranking have to overclock high-end hardware. As dual-gpu cards are faster on stock cooling than extreme overclocked single-gpu cards, simply buying the expensive videocard will give you an edge over anyone who pushes the single-gpu to the limit. So HWbot single video card ranking is ruled by dual-GPU cards, which grab all the points.

This is, however, not compatible with our main principles.

2. Possible actions

1. Change from single card to single GPU

  • Single-GPU and multi-GPU ranking; all dual-GPU cards will go into the multi-GPU ranking

In simple english: GTX295 and 4870X2 will move from single category to multi category. Single category will only contain cards like GTX285, GTX260, GTX275, HD4890, HD4870 and HD5870.

  • PRO: To be in the top of the single gpu rankings, you need to really push VGAs
  • PRO: No more 500$ investments needed to get ‘easy’ global points

In this case ‘easy’ stands for ‘plug and hwboint’ cards. The idea is really simple: instead of just plugging a dual gpu card, which is faster than any single gpu card by quite a margin, you will have to put more effort in overclocking and tweaking the single gpu videocard.

  • PRO: More than one card can be used to grab global points

When you go through the single GPU categories, you notice that lower end cards can actually ‘compete’ in the more high-end single gpu categories. As an example, we have compiled a table of how well a card could perform in the most popular high-end single GPU category of this moment, the HD4890.

test.png
The results are based on the TOP 3DMark03 score; the numbers indicate the place of that TOP score in the 4890 ranking. We can see that other VGA cards than the most high-end single gpu cards can compete.

  • CONTRA: In a past poll people were not in favor of change
  • CONTRA: Current points would be affected quite significantly

This is the BIGGEST issue in regards to the change and the points of some people would drop significantly. Note, however, that the drop in points is in fact not that uncommon or artificial. When a new series of graphics cards is released, you will start losing points anywho (as people will submit with the new cards).

Please share your opinion in the forum topic linked to this newspost.


Oct 29, 2009 - News - HWBOT
  #11  
Unread 10-30-2009, 15:49
ether.real ether.real is offline
maintenance bot
 
Join Date: Aug 2008
Location: UNITED STATES
Posts: 24
Default

I disagree with the change. Keep the 4870X2 in its own category as a single card. What is dominating the hwboints is not the dual-GPU cards vs. single GPU, it is that GPU intensive tests are almost solely determined by CPU clocks. It is less disturbing to me that a stock dual GPU card gets more boints than an extreme OC'd single GPU card. It is more disturbing to me that an extreme OC'd CPU with a stock GPU will get more boints than a mildly OC'd CPU with an extreme OC'd GPU.

Instead of the proposed change, I would much rather see a push to using Vantage X instead of Vantage P in hwbot league. Remove the CPU bottleneck and let GPU power be the main determinating factor in getting boints in the GPU tests.
__________________
  #12  
Unread 10-30-2009, 15:57
beleno beleno is offline
maintenance bot
 
Join Date: May 2007
Posts: 21
Send a message via MSN to beleno Send a message via Skype™ to beleno
Default

I think is a good idea, more competition and more fun
__________________
  #13  
Unread 10-30-2009, 15:58
ReverendMaynard's Avatar
ReverendMaynard ReverendMaynard is offline
construction bot
 
Join Date: Nov 2008
Location: CANADA
Posts: 80
Default

Quote:
Originally Posted by ether.real View Post
I disagree with the change. Keep the 4870X2 in its own category as a single card. What is dominating the hwboints is not the dual-GPU cards vs. single GPU, it is that GPU intensive tests are almost solely determined by CPU clocks. It is less disturbing to me that a stock dual GPU card gets more boints than an extreme OC'd single GPU card. It is more disturbing to me that an extreme OC'd CPU with a stock GPU will get more boints than a mildly OC'd CPU with an extreme OC'd GPU.

Instead of the proposed change, I would much rather see a push to using Vantage X instead of Vantage P in hwbot league. Remove the CPU bottleneck and let GPU power be the main determinating factor in getting boints in the GPU tests.

I agree 100%.
__________________
  #14  
Unread 10-30-2009, 16:04
Massman's Avatar
Massman Massman is offline
Abhorrently evil braindead kind-hearted money-driven child-hating short-sighted hardware-sharing cheating
macho nacho supreme discriminating clueless idiot boy genius with sense of humor
 
Join Date: Jul 2006
Location: Waregem, Belgium
Posts: 16,007
Send a message via MSN to Massman
Default

Quote:
Originally Posted by K404 View Post
This idea makes slightly older, cheap cards more viable for global points, which while it isnt a bad thing... it will massively increase the competition in these categories..... LN2 will be necessary for hardware points for the cards, which will push more people out ...
We are actually trying to improve the hardware points as well. This does take quite a bit of work in balancing, though.

Quote:
Originally Posted by Linuxfan2000 View Post
Sounds like it might be a good change.
One question though, how would you rank the dual card GPUs? Will there be three catagories with single card, single card dual GPU, and SLI/CF cards? I don't know how that would work out, but if we just changed the 4870X2 and GTX 295 to the dual cards ranking, they wouldn't be as good as for example 2x 4870X2 or 2x GTX 295, so there wouldn't be much of a point to bench them, right?
I get the idea though, single GPU competition for global boints sounds good!
The initial idea would be to have two rankings:

1) Single GPU
2) Multi GPU

Multi-GPU would then indeed be dominated by those who can afford multiple cards. However, it seems that in the current generation of hardware even 3D benchmarks are CPU-limited. 4 cards won't be more powerful than 3 per definition.

It's quite difficult to have a solution that works out perfect for all situations. Creating more global categories also means that people have to buy more hardware to compete at the top. Also, it puts more stress on our server.

Quote:
Originally Posted by ether.real View Post
Instead of the proposed change, I would much rather see a push to using Vantage X instead of Vantage P in hwbot league. Remove the CPU bottleneck and let GPU power be the main determinating factor in getting boints in the GPU tests.
The fact that dual GPUs are now in the 'single'-category is part of the problem of CPU-bound 3D tests. The more powerful you make the 3D part of your system (VGA), the more powerful you need to make your 2D part (CPU) to see scaling from adding VGA OC.
__________________
Where courage, motivation and ignorance meet, a persistent idiot awakens.

Things people say: Massman is a god (05-02-2102), You're a genius (25-10-2011), Massman, overlord of overclocking (07-30-2010), brain dead corporate dude that deserves to be stillborn (09-18-2010)
Things I write: Critical thinking - Should Maximus V Extreme be banned from competitive overclocking?, HWBOT Vision 2012, The Industry’s Social Responsibilities – Support the Community., In Response to Chew's Goodbye Note (the unhealthy relation between company and community), The X58A-OC, the enthusiast community and a long-term vision, The Efficiency Rating, Hardware sharing, nostra culpa?, The paradox of a fair overclocking competition, HWBOT Memory Index v0.1, AMD Thuban Voltage and Temperature Scaling, Is LN2 on GPU really worth the trouble?
  #15  
Unread 10-30-2009, 16:08
K404's Avatar
K404 K404 is offline
nVidia FTW!
 
Join Date: Jan 1970
Location: Glasgowvic, Scotistan. Great Kingdom of United Britain..
Posts: 2,692
Default

Quote:
Originally Posted by Massman View Post
We are actually trying to improve the hardware points as well. This does take quite a bit of work in balancing, though.
What ya got in mind?


random idea... not thought out and possibly inappropriate for this thread...

what if a score was removed from a hardware category if it had global points?
  #16  
Unread 10-30-2009, 16:10
Mafio's Avatar
Mafio Mafio is offline
Banned by Thebanik
 
Join Date: May 2008
Location: Italy
Posts: 230
Default

i agree, this is a good idea
  #17  
Unread 10-30-2009, 16:26
aperacer's Avatar
aperacer aperacer is offline
maintenance bot
 
Join Date: Jan 2008
Posts: 17
Default

I think you should look on the numbers of GPUs on a card and not on single or dual card
__________________
  #18  
Unread 10-30-2009, 16:30
giukey79's Avatar
giukey79 giukey79 is offline
maintenance bot
 
Join Date: Jun 2008
Location: ITALY
Posts: 25
Default

I agree with the initiative
__________________

26/05/2011. Ciao Charlie. Sarai sempre nei nostri cuori.
  #19  
Unread 10-30-2009, 16:30
7ornado 7ornado is offline
maintenance bot
 
Join Date: Jan 2009
Location: lake Como
Posts: 26
Default

i agree with the possible change. in effect, gtx295 and 4870x2 are almost like a sli/crossfire of other less power vga...so they shouldn't count as single vga
just imo
  #20  
Unread 10-30-2009, 16:31
ether.real ether.real is offline
maintenance bot
 
Join Date: Aug 2008
Location: UNITED STATES
Posts: 24
Default

So, when do we classify a Yorkfield as a "multiple" Wolfdale? Cause that makes just as much sense.

What about dual GPU cards that don't have a single GPU equivalent? How would those get classified?
__________________
Closed Thread


Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT +1. The time now is 06:27.


Powered by vBulletin® Version 3.7.1
Copyright ©2000 - 2013, Jelsoft Enterprises Ltd.
Copyright COLARDYN IT GCV 2004 - 2013