Hardware recommendations

brodie

didn't know that. but just tried it out and you are right! wonderful!

another thought: we have to ask people who do the test to shut down all other software. otherwise the results may be influenced negatively...

[Edit] and yet another thought: does all the grafical calculations like styles and shadows solely depend on the gpu? meaning that the cpu only has to calculate any geometry modifications. can't you seperate the processes like this?
(sorry if this question sounds stupid. but I have no idea of how such things work... )

That's pretty much my understanding. I've been running my own benchmarks lately using a model I did that's 3.3MB. In the ruby console I run Test.time_display and it'll rotate around your model 360 degrees in exactly 72 frames. Afterwords it gives you a little report w/ some useful info. I'm finding it very handy to see exactly what kind of performance hits SU takes from tweaking various things (clock speed, resolution, hardware acceleration, fast feedback, anti-aliasing, etc.). I write down my settings and then run 4 tests (all 4 combos of textures on/off & shadows on/off).

I'm running on a 3.4Ghz Intel Pentium 4 HT w/ 2 gigs of RAM and an nVidia 8800GT graphics card at 1600x1200 resolution.

Here are just a couple results which should address your question.

Hardware Accel. turned ON in SU.
Textures: OFF
Shadows: OFF
23.3 frames/second

Textures: OFF
Shadows: ON
1.2 frames/second

Textures: ON
Shadows: OFF
18.6 frames/second

Textures: ON
Shadows: ON
1.1 frames/second

Hardware Accel. turned OFF in SU.
Textures: OFF
Shadows: OFF
7.2 frames/second

Textures: OFF
Shadows: ON
0.2 frames/second

At this point I stopped testing w/ hardware accel turned off because that last test took almost 7 minutes, whereas the other one's were either taking about 4 seconds (w/ shadows off) up to a minute (w/ shadows on).

Before doing this test I'd heard that the graphics card basically just does shadows and textures while the CPU does the geometry. Nevertheless, unless I'm missing something (?) the graphics card helps out a ton even w/o textures and shadows turned on.

-Brodie

brodie

As a side note, I'm going to run some tests on a coworkers computer when I get a chance. He has the same setup as me with 3 gigs of processor speed instead of 2. Be interesting to see what difference that makes.

-Brodie

brodie

Couple other odd things I've found so far...

Overclocking my card didn't really do anything. Some results were slightly worse, some slightly better. Probably well within the margin of error.
Turning Fast Feedback OFF actually improved my FPS by about 30%
Turning my anti-aliasing up (from x0 to x4) either didn't affect performance or may have actually improved it slightly.

These are all pretty counterintuitive to me but I've yet to be able to explain them away given the results I'm getting.

-Brodie

brodie

@plot-paris said:

we just need someone to write a script that puts the framerate in a text-file (I have unfortunately not the slightest idea of how to do anything in ruby).
the best way to put it, would be something like:

scene1 to scene2 = 76 fps

scene2 to scene3 = 44 fps

scene3...

and then we need a nice test-file that not only tests your hardware, but also makes testing enjoyable (like starting with a small village with few simple houses, going to a city of decent size and finishing with a huge capital (loads of polygons) with a big castle or cathedral in the centre...

(that is a nice idea for the competition thread)

[Edit] I just used an old model to demonstrate, how such a scene could look like. of course it would be much more enjoyable, if you had a bit more variety... but as I said, this is only a first idea[]

I just spotted a problem (I think). how much do components affect cpu and ram? because the file size should be rather small for fast download - therefore should consist of components... but can we test all necessary information with that?

[Edit] I just used an old model to demonstrate, how such a scene could look like. of course it would be much more enjoyable, if you had a bit more variety... but as I said, this is only a first idea[]

[attachment=0:2l8h71rs]benchmark_test.skp[/attachment:2l8h71rs]

I'd missed this post before with your benchmark file. I ran the ruby I mentioned ( Test.time_display ) with shadows and textures on (although I don't think there are any textures) a few times and got an fps between 23.0 and 23.5 in scene 1. In scene 7 I got a 0.2 fps which took an agonizing 404 seconds to cycle through. Even without shadows on I only got a 0.5 fps which took 158 seconds.

-Brodie

plot-paris

wonderful, thanks a lot for sharing your test results, Brodie.

I think that is bringing us a huge step closer to what we want. did you just type the command into the ruby console? so this function is already implemented? then it should be really easy (for a ruby guru of course ) to automate this process...

oh, and you pointed out another important thing for the test file - textures and styles...
and the hardware settings (acceleration, fast feedback, anti aliasing - I don't think you can change those with a ruby script. perhaps everyone has to go to the same settings or at least report which settings are active, when he runs the test)

I will try and run the file with this test as soon as I get into the office...

Jackson

@unknownuser said:

In the ruby console I run Test.time_display and it'll rotate around your model 360 degrees in exactly 72 frames. Afterwords it gives you a little report w/ some useful info.

How did you find out about that? That's fantastic! I attach a quick test file- no point making it huge as that'll just bring older machines to a standstill. Just follow the instructions in the file and post the third test result here. Anyone know why it runs slow the first two times then evens out after that?

SU FPS Test.jpg SU Frame Rate Test File 080710.skp

I got 12.1 fps, my very average machine spec is in my signature below.

plot-paris

this is true, after the discovery of this very useful command (Test.time_display) we dont need to have big models anymore. it is rather helpful to play with different style settings to find out how they influence the performance.
of course it still makes sense to have some scenes with different poly counts to check if the performance speed decreases proportional to the model complexity or if there are differences in hardware (for example that one crafic card is exactly the same speed as others with low poly but is much faster with hight poly)

anyway, my test results wit the city model:
(Core2Duo 3.00 GHz, 2 GB Ram, nVidia Quadro FX 1700)
(Hardware Acceleration, Fast Feedback, Anti Aliasing 4x)

Scene 1: 30.9 fps

Scene 7: 0.4 fps

and in Jackson's Cube model:

(17.1; 16.8) 16.8 fps

ps: nevertheless we should design a beautyful model that makes the whole process fun to watch. I think we first have to set up such a file, where we mind every factor that is important to know (textures, styles (like profiles), transparency (faster, nicer), low-/high-poly count, beauty ,...) and then we have to ask a ruby coder to write an automated script that runs the "Test.time_display" command, saves the result, proceeds to the next scene... finally displays all the gathered info in a window (like it does now after every test).
oh yes, is it possible to read out the hardware settings with ruby (or even the hardware components of the computer?)

Jackson

@plot-paris said:

ps: nevertheless we should design a beautyful model that makes the whole process fun to watch. I think we first have to set up such a file, where we mind every factor that is important to know (textures, styles (like profiles), transparency (faster, nicer), low-/high-poly count, beauty

Why? I'm not sure anyone is bothered about how pretty a 6 second fps test is. We know textures slow down a model, we know shadows slow down a model, etc, etc. They have almost no relevance to judging overall how user's PCs and Macs cope with SU orbiting. I'd say the simpler and smaller the file size the better, otherwise we'll just see loads of confused and confusing results.

plot-paris

why not but the test in a beautyful wrapping that pleases your eye?

but probably you are right - I am looking at it from an architects/artists point of fiew - this is a test solely for technical reasons...

chango70

Wow I can't believe my suggestion bore fruit so quickly! Thanks guys!!! The Ruby suggestion sounds great! Incidentally I am thinking of getting a quadro FX 1700. Whats the biggest model anyone's done with it?

chango70

Plot-Paris

Are you using a Intel Xeon processor?

juju

Using Jackson's model, on the third run using "Test.time_display" typed in the ruby console I got 17.2 fps.

Intel Q6600, DFI P35 "Blood Iron", 4x OCZ 1GB DDR2-800, nVidia FX 3500 256MB (driver: 169.96_quadro_winxp2k_international_whql), programs HDD = WD 36GB Raptor (10000RPM), data HDD = WD 250GB Caviar (7200RPM), 22" Samsung 226BW at 1600x1050. Hardware acceleration and Fast feedback on.

plot-paris

@chango70 said:

Plot-Paris

Are you using a Intel Xeon processor?

no, it is the Intel core 2 Duo E6850

plot-paris

I just played arround a bit with the cube-test model.

at first I achieved 18.6 fps(1.8 slower than this morning, when my computer was relaxed )
then I grouped all the cubes, with no significant difference.
then I created a component out of all the cubes. now I got 16.4 fps
I made 24 copies of this component, put it in a hidden layer. now the result was 17.5 fps

now I am completely confused does anyone have an explanation for that?

remus

Id suggest that there is a degree of random (or seemingly random) error in the test. i.e. having the components on a hidden layer doesnt really affect the results, its just a bit of +/- either way. The same would explain the difference between your first test (when your comp was relaxed ) and the second test.

plot-paris

I just did some tests and found out, that the consistency increases immensly with the poly count.

some figures:

my city-model, scene 1 (3.328 polygons):

framerate differed from 53.7 fpsto 56.9 fps(maximum difference in time 0.093 seconds)

the same model, scene 2 (180.496 polygons; more than 50 x bigger):

framerate always was 2.5 fps(maximum difference in time 0.067 seconds)

here we see, that the dime was more precise than in the low poly scene...

brodie

@jackson said:

How did you find out about that? That's fantastic!

It came from some random little post on these boards actually. I think I'd searched for "benchmark" or something and in a conspicuous thread about benchmark's someone was just like...um, why don't you just run this ruby? Didn't look like anyone even took note of it at the time.

-Brodie

brodie

@plot-paris said:

I just did some tests and found out, that the consistency increases immensly with the poly count.

some figures:

my city-model, scene 1 (3.328 polygons):

framerate differed from 53.7 fpsto 56.9 fps(maximum difference in time 0.093 seconds)

the same model, scene 2 (180.496 polygons; more than 50 x bigger):

framerate always was 2.5 fps(maximum difference in time 0.067 seconds)

here we see, that the dime was more precise than in the low poly scene...

I think that would be my reason for wanting a semi-complex benchmark. I like your idea about having a number of scenes with varying complexities and a script that would run the Test.time_display script, log the results, cycle to next scene, etc. and give you a final report at the end (in a txt file would be great). Also like you said, in conjunction something that could along with that log your settings would be fabulous.

I'm thinking 8 scenes. First 4 would be a pretty simple model which would run the 4 combos of textures and shades on/off. The next 4 scenes would be the same thing but with a more complex model.

I think something like your city model would be fine although I think all those punched openings are probably more intensive than necessary for the shadows. Also adding textures so we could get a feel for that as well.

I think what that would do would give us a better idea of the affect that the CPU and GPU have on the varying geometry, materials, and shadows.

As far as settings the following is what I'd consider standard...

GPU Settings
Clock Speed: Default
Fan Speed: 100%
3D Settings: Default

SU Settings
Anti-Aliasing: x0 (or perhaps x4?)
Hardware Acceleration: ON

Display Settings
Resolution: 1200x1024

CPU Settings
External Programs Running: NONE

-Brodie

brodie

@unknownuser said:

I'd missed this post before with your benchmark file. I ran the ruby I mentioned ( Test.time_display ) with shadows and textures on (although I don't think there are any textures) a few times and got an fps between 23.0 and 23.5 in scene 1. In scene 7 I got a 0.2 fps which took an agonizing 404 seconds to cycle through. Even without shadows on I only got a 0.5 fps which took 158 seconds.

-Brodie

I'm beginning to question my sanity. Nothing seems to make sense with my results. On my home home computer which is in every way inferior to my work computer I actually got better results. On scene 7, for example, my fps was still 0.2 but it took 377s instead of 404s which is noticable.

The only thing I can think of is maybe there's a fair sized difference in performance in running on a lower screen resolution. I'll test that later and see what I get.

-Brodie

bellwells

On the city block test, I got 9.1 fps on scene 1 and .2 fps over 451 seconds on scene 7. On the cube test all three runs were generally the same for me: 5.4-5.6 fps and 12.95-13.06 seconds.

Looks like I'm the slow kid on the block with my 4 year old Sony Laptop, 1.73 Ghz, 1Gb, GeForce Go 6200, hardware and feedback turned on and AA at 4x.