Go Back   HWBOT forum > >

Benchmark software Discuss benchmarking software.


User Tag List

Reply
Thread Tools Display Modes

New Benchmark Coming Soon: HWBOT x265 Benchmark (encoding in 1080P and 4K)

Not so long after a successful integration of the GPUPI benchmark developed by Matthias from overclockers.at, we will soon feature another new benchmark with submission API functionality: HWBOT x265 Benchmark.

The benchmark is developed by Czech overclocker Havli who is home to hw-museum.cz. The benchmarks renders a video in 1080P or 4K resolution using the x265/HEVC encoder. It can take advantage of modern CPU instructions set and multi-threaded. The benchmark is also capable of running even on old gear such as Athlon XP, be it rather slowly of course. The benchmark supports two presets: 1080P and 4K.

The integration with HWBOT is similar to GPUPI: it supports both direct submission from the application as well as saving the data file to submit at a later point in time. Currently the benchmark is in alpha phase. You can download a version from the forum thread located HERE. The alpha version has been tested by our software team (read: Genieben) and it is solid enough to soon move to the beta phase. During the beta phase we will host a small competition so the hardcore competitive overclockers can put the benchmark through its paces.

It's nice to see a real-world rendering benchmark with solid API support come to life. With the right tweaking and tuning, I'm sure it will be as successful as GPUPI!


Aug 18, 2015 - article - forum.hwbot.org
  #1  
Unread 08-15-2015
havli havli is offline
robo cop
 
Join Date: Nov 2010
Location: CZECH REPUBLIC
Posts: 258
Thanks: 36
Thanked 45 Times in 22 Posts
havli
Default HWBOT x265 Benchmark

Update:
Version 1.1.1 is online http://downloads.hwbot.org/downloads...l_portable.rar The alpha stage has been successful, it is time to move on. I've enabled Beta status, the benchmark is open for submissions. Plenty of free gold cups to take.


At the moment we have no dedicated video encoding benchmark on HWBOT. So I thought it would be nice to create one. There are plenty of video encoders available on the internet and benchmark applications for most of them already exists. I don't like reinventing the wheel... Therefore I picked the most modern encoder - H265/HEVC.
Only one benchmark exists (that I know of) and it isn't really suitable for our needs. http://x265.ru/en/x265-hd-benchmark/ My benchmark is working the same way, but GUI is used instead of command line interface. I also added some tweaks and options to get the best possible score on most computers, even very extreme ones.

HWBOT x265 Benchmark is based on the open source x265 encoder (http://x265.ru/en/). It can take advantage of modern CPUs instructions set and multithread support is also very good. However this benchmarks is also capable of running even on as old processors as Athlon XP (maybe Pentium III as well). Of course on the legacy hardware the encoding time is rather long. There are two presets available - 1080p and 4k. The main goal of both of them is to convert H264 source video to H265/HEVC and measure average fps.



Now to describe the new Benchmark options:
1. Benchmark type - 32bit or 64bit encoder. Use 64bit if possible, it is faster, on some platforms by quite a big margin.
2. Priority - priority of the encoder process, not much to say here.
3. Pmode - enables better thread utilization, improves performance on some platforms. Also can slow things down a bit, depends on CPU type.
4. Overkill mode:

For even better multithreading support it is possible to activate the overkill mode. Two or more (up to 8 in the current version) instances of the encoder will run simultaneously and when all of them are finished, the final score is sum of all sub-scores minus small compensation to avoid score gain by uneven compute time. If the sub-scores time variability is bigger than 5%, the overkill run is considered invalid and no score is generated.

The HWBOT x265 Benchmark implements security features which should block any attempt to replace external components of the benchmark (source videos, ffmpeg, x265 encoder) or score manipulation. There are two ways to upload score to HWBOT. Save the data file which contains screenshot and all necessary information. Or direct online submission from the benchmark (currently in development, will be ready in the final version).
Also this benchmark should be safe to run using Windows 8(+) - when HPET is active.

Minimum system requirements:
Athlon XP / Pentium 4 (maybe PIII)
1 GB RAM (1080p) / 2 GB (4K)
1 GB free HDD space
Windows XP SP3
Java SE 7 or later

Recommended system requirements:
AMD FX / Core 2 Quad 45nm (with SSE 4.1)
4 GB RAM
1 GB free HDD space
Windows 7 x64 (SP1 for AVX support)
Java SE 7 or later

Beta testing of v1.0.0 has been running on local PC-related forums for a week or so and no serious bugs were found. So I think the benchmark should be ready soon. There are still some features to finish. When all is done I will enable the public status.

In the meantime if you like to test the current v1.0.0 (1080p only), link to download: http://hw-museum.cz/data/hwbot/HWBOT_x265_benchmark.rar

Warning - this version (1.0.0) is meant only for testing, saved data files will not be accepted when the submit option is enabled in the future.


Known bugs / things to be improved in the final version:
- wrong Overkill mode formula is displayed. Time of each instance is shown instead of fps.
- final score will be moved below the "1080p benchmark complete" message to be more clear
- online submission feature is work in progress
- portable version of the benchmark (java included) - No need to install java, can be useful on computers where you don't have permission to install stuff
- perhaps enhance the Overkill mode to use more than 8 instances of x265. Could be useful for very large servers (more than 30 CPU cores).


Combined score table from ongoing beta testing at http://forum.cnews.cz/viewtopic.php?f=22&t=27656 and http://pctforum.tyden.cz/viewtopic.php?f=97&t=229511 You can get some inspiration here - what to expect from your CPU.

Score------------CPU--------------------Cores/Threads----------Clock-------------OS.............Tester
85,58........2x Haswell-EP ES Xeon........24/48..............3,2GHz.........Win 7 x64--------DOC-Zenith
30,03........Core i7 5820K...................6/12..............4,2GHz.........Win 10 x64-------le1tho
29,68........4x Xeon X7550................32/64.............2,0GHz.....Win Srv 2008 R2 x64--skipped1
21,81........Core i7 4770K...................4/8...............4,7GHz........Win 10 x64--------l.zdvorak
19,92........Core i5 4690K...................4/4...............4,9GHz.........Win 10 x64-------iOioo
19,44........Core i7 4790....................4/8...............4,0GHz.........Win 10 x64-------skipped1
16,05........Core i5 4670K...................4/4...............4,3GHz.........Win 10 x64-------Darth Daron
14,26........Core i5 4670K...................4/4...............3,6GHz.........Win 7 x64--------JXP
14,03........Core i7 2600K...................4/8...............4,4GHz.........Win 7 x64--------Caderom
13,39........FX-8350.........................8/8...............4,4GHz.........Win 7 x64--------husbja
12,92........Core i5 3570K...................4/4...............4,6GHz.........Win 7 x64--------NoNeStaciTi
12,51........FX-8350.........................8/8...............4,0GHz.........Win 10 x64-------berazde
12,20........Core i7 3770K...................4/8...............3,7GHz.........Win 7 x64--------Killing joke
11,85........Core i5 2500K...................4/4...............4,6GHz.........Win 10 x64-------havli
11,21........FX-8300.........................8/8...............3,6GHz.........Win 7 x64--------Mani2
10,94........Core i5 3470....................4/4...............3,8GHz.........Win 7 x64--------pohodar
10,79........Core i5 3570K...................4/4...............3,8GHz.........Win 10 x64-------Profi-Lama
6,75.........FX-6300.........................6/6...............3,6GHz.........Win 10 x64-------kolecko
6,72.........Core i7 5500U...................2/4...............2,7GHz.........Win 8.1 x64------Tomix
5,81.........A10-5700........................4/4...............3,7GHz.........Win 10 x64-------hob
4,83.........Core i5 3230M...................2/4...............3,0GHz.........Win 10 x64-------RayEndCZ
4,83.........Core i3 2100....................2/4...............3,1GHz.........Win 7 x64--------Caderom
4,45.........Xeon L5410......................4/4...............2,33GHz........Win 7 x64--------havli
4,37.........Core i5 2410M...................2/4...............2,7GHz.........Win 10 x64-------cpt.America97
3,68.........Core i5 520M....................2/4...............2,66GHz........Win 10 x64-------hob
3,05.........Phenom II X4 965..............4/4...............3,4GHz.........Win 10 x64-------cpt.America97
2,9..........Athlon 5350.....................4/4...............2,05GHz........Win 7 x64--------Tralalk
2,49.........A8-3850.........................4/4...............2,9GHz.........Win 8.1 x64------Jan Olan
2,22.........Core i3 2367M...................2/4...............1,4GHz.........Win 7 x64--------Tralalk
2,17.........2x Xeon 5110....................4/4...............2,0GHz.........Win 7 x64--------havli
2,12.........Phenom II X3 720..............3/3...............3,2GHz.........Win 10 x64-------siddhi
1,42.........Atom Z3740......................4/4...............1,86GHz........Win 8.1 x64------Jan Olan
1,16.........VIA U4650E......................4/4...............1,0GHz.........Win 7 x64--------Tralalk
0,71.........Core 2 Duo T5500..............2/2...............1,66GHz........Win XP-----------melkor unlimited
0,38.........Pentium 4 640...................1/2...............3,2GHz.........Win XP-----------skipped1
__________________

Last edited by havli; 08-19-2015 at 21:36. Reason: update
Reply With Quote
The Following User Says Thank You to havli For This Useful Post:
Atlas Rush (10-01-2015)
  #2  
Unread 08-15-2015
havli havli is offline
robo cop
 
Join Date: Nov 2010
Location: CZECH REPUBLIC
Posts: 258
Thanks: 36
Thanked 45 Times in 22 Posts
havli
Default Re: HWBOT x265 Benchmark

Oh, one more thing - I am really curious how good Skylake is in this benchmark.
If you have one, please post a screenshot. Preferably using Windows 8 / 8.1 / 10 with HPET enabled and disabled (so I can check whether timer detection works on socket 1151 platform).
__________________
Reply With Quote
  #3  
Unread 08-15-2015
Lucky_n00b's Avatar
Lucky_n00b Lucky_n00b is offline
transformer
 
Join Date: Mar 2008
Location: INDONESIA
Posts: 660
Thanks: 131
Thanked 125 Times in 70 Posts
Lucky_n00b is on a distinguished road
Default Re: HWBOT x265 Benchmark

Nice benchmark, will test this next week
__________________
Reply With Quote
  #4  
Unread 08-17-2015
trodas's Avatar
trodas trodas is offline
robot overlord
 
Join Date: Jan 1970
Location: Czech republic
Posts: 1,138
Thanks: 91
Thanked 6 Times in 6 Posts
trodas is an unknown quantity at this point
Send a message via ICQ to trodas Send a message via AIM to trodas Send a message via MSN to trodas Send a message via Skype™ to trodas
Default Re: HWBOT x265 Benchmark

Care for PIII test? Got one, but it is a lazy suxxka... very slow
__________________
"It is dangerous to be right in matters on which the established authorities are wrong." - Voltaire
"I believe that all the people who stand to profit by a war and who help provoke it should be shot on the first day it starts..." - Hemingway my config - my caps
Reply With Quote
  #5  
Unread 08-17-2015
havli havli is offline
robo cop
 
Join Date: Nov 2010
Location: CZECH REPUBLIC
Posts: 258
Thanks: 36
Thanked 45 Times in 22 Posts
havli
Default Re: HWBOT x265 Benchmark

Yeah, if it works, then I will update the minimum system requirements.

Also the final version is almost ready. All the mentioned "Known bugs / things to be improved in the final version" things are fixed / implemented.
__________________
Reply With Quote
  #6  
Unread 08-17-2015
trodas's Avatar
trodas trodas is offline
robot overlord
 
Join Date: Jan 1970
Location: Czech republic
Posts: 1,138
Thanks: 91
Thanked 6 Times in 6 Posts
trodas is an unknown quantity at this point
Send a message via ICQ to trodas Send a message via AIM to trodas Send a message via MSN to trodas Send a message via Skype™ to trodas
Default Re: HWBOT x265 Benchmark

Well, it work It mention that it use CPU features: MMX2, SSE and Cache32 (whatever that means) and 3% progress suggest that it works. I would wait for the final score, but seems that there is not any problem, even on highly nonstandard machine like the Dell OptiPlex GX110 is. (it use 24bit resolution depths - cannot have 32bit, so... even GPU-Z is buggy there, lol)
(pay no attention to the not detected ram frequency, that don't even latest CPU-Z detect well, as you see on the HWbot prime screenshot)

I downloaded a latest release 7 Java from there:
https://edelivery.oracle.com/akam/ot...ndows-i586.exe
(for those, who did not have a Oracle account and not feeling like one, there are alternatives by me:
http://depositfiles.com/files/ulsoty1uf
http://www.mediafire.com/?vvg5k5nonuqwoip
http://rapidgator.net/file/190288e66..._7.80.exe.html )

...and at first, I give a HWbot prime a try. Worked:

(see the GPU-Z bug? Low level programming sometimes fail, expecting 32bit, where 24bits happen )

So I try the x265 and it is running now. Albeit slowly, but that is somewhat expected on 512MB SDRAM running at "whooping" 100MHz. And even I gathered good 2-2-2-5 SDRAM chips, they all come to vain, as the FSB bus 133MHz is divided in the chipset to 100MHz for rams and that kill any chance of speed...



There is no swapping (witch is good, because the old 80G clunker would have a hard time and the PATA to SATA interface refused to work with 30G Corsair Nova2 SSD and better SSDs are currently busy with other tests...), so a 512MB of fresh WinXP SP3 install (just disabled the Security center service).

I understand that I slow down a bit the run when going for the screenshot and copying it over network to another PC, but all in all I doubt it will have any serious impact, as we all can predict that this is going to be the slowest run ever made yet And you deserve to see that it does work. Hopefully the menu frontend can be done without dreaded Java in the future, either by using other programming language or at least including few need libs and that will be it.
Benchmarks should be standalone, IMHO.

Pretty good work, mate!
__________________
"It is dangerous to be right in matters on which the established authorities are wrong." - Voltaire
"I believe that all the people who stand to profit by a war and who help provoke it should be shot on the first day it starts..." - Hemingway my config - my caps

Last edited by trodas; 08-17-2015 at 21:54.
Reply With Quote
  #7  
Unread 08-17-2015
havli havli is offline
robo cop
 
Join Date: Nov 2010
Location: CZECH REPUBLIC
Posts: 258
Thanks: 36
Thanked 45 Times in 22 Posts
havli
Default Re: HWBOT x265 Benchmark

Cool, so it works on PIII after all. And even with 512 MB RAM.

Unfortunately Java is the only suitable language for me. My c++ or c# skills are way too low for complicated project like this. The final version however will be a portable benchmark with built-in java...

Thank you for the testing.

btw - little reminder - no need to waste more power and time continuing this run (unless you are curious what the final score will be ). The result file is not valid for (future) submission.
__________________
Reply With Quote
  #8  
Unread 08-17-2015
trodas's Avatar
trodas trodas is offline
robot overlord
 
Join Date: Jan 1970
Location: Czech republic
Posts: 1,138
Thanks: 91
Thanked 6 Times in 6 Posts
trodas is an unknown quantity at this point
Send a message via ICQ to trodas Send a message via AIM to trodas Send a message via MSN to trodas Send a message via Skype™ to trodas
Default Re: HWBOT x265 Benchmark

Yep, I'm curious and I know that more people are curious too. And it did not even swap. 18% is done, so I wait for the final - overnight it will do the trick. The only time it start swapping was, when screensaver kick it. I have to go and disable it, lol.

Given the number of Java security holes I think that you should learn C/C++ I know, easier to say that done, but maybe for next version? Nevermind. I will report by the morning what is the result. Currently 0.06fps and 19.33% Not bad, we are almost in 1/5 done!
__________________
"It is dangerous to be right in matters on which the established authorities are wrong." - Voltaire
"I believe that all the people who stand to profit by a war and who help provoke it should be shot on the first day it starts..." - Hemingway my config - my caps
Reply With Quote
  #9  
Unread 08-17-2015
GENiEBEN's Avatar
GENiEBEN GENiEBEN is offline
Never send a human to do a machine's job.
 
Join Date: Nov 2009
Location: MATRIX
Posts: 3,108
Thanks: 21
Thanked 68 Times in 40 Posts
GENiEBEN
Send a message via MSN to GENiEBEN Send a message via Skype™ to GENiEBEN
Default Re: HWBOT x265 Benchmark

Quote:
Originally Posted by havli View Post
My c++ or c# skills are way too low for complicated project like this. The final version however will be a portable benchmark with built-in java...
If it's open source I can look into porting it.
__________________
www.deusex.uk
Reply With Quote
  #10  
Unread 08-18-2015
trodas's Avatar
trodas trodas is offline
robot overlord
 
Join Date: Jan 1970
Location: Czech republic
Posts: 1,138
Thanks: 91
Thanked 6 Times in 6 Posts
trodas is an unknown quantity at this point
Send a message via ICQ to trodas Send a message via AIM to trodas Send a message via MSN to trodas Send a message via Skype™ to trodas
Wink Re: HWBOT x265 Benchmark

Hopefully it will be made Open Source... or at least closed source between you two?

So, my result is - 0.08fps (it get faster when I did not take screens/screensaver don't run):



The resulting file is rather big, 512k in size, so there it is:
http://depositfiles.com/files/zpjnjf80g

(backups: http://www.mediafire.com/?fvuar520p60dukc
http://rapidgator.net/file/4d0330c7b...fps.hwbot.html
https://mega.co.nz/#!LFMBkZrK!0_aCBZ...ynq2Mtw1igBFzo )

Hopefully that helps
__________________
"It is dangerous to be right in matters on which the established authorities are wrong." - Voltaire
"I believe that all the people who stand to profit by a war and who help provoke it should be shot on the first day it starts..." - Hemingway my config - my caps
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Windows 8 Benchmark Records No Longer Accepted At HWBOT - Benchmark Result Veracity Compromised Massman HWBOT Frontpage News 123 11-13-2014 12:31
HWBOT Application API - How to get your benchmark a HWBOT ranking! flanker HWBOT Frontpage News 1 01-12-2013 01:24
HWBOT Unigine Heaven Benchmark Flying Toilet Benchmark software 0 04-20-2011 09:10
HWBOT Releases First In-house Benchmark: HWBOT Unigine Heaven Benchmark jabski HWBOT Frontpage News 31 02-06-2011 10:28


All times are GMT +1. The time now is 18:33.


Powered by vBulletin® Version 3.8.4
Copyright ©2000 - 2017, Jelsoft Enterprises Ltd.
Search Engine Optimisation provided by DragonByte SEO (Lite) - vBulletin Mods & Addons Copyright © 2017 DragonByte Technologies Ltd.
User Alert System provided by Advanced User Tagging (Lite) - vBulletin Mods & Addons Copyright © 2017 DragonByte Technologies Ltd.
Copyright HWBOT 2004 - 2015
watch GOTS0701 usa news today