Does 3DMark Predict Game Performance?

aendeuryu writes "Sidhian has up an interesting op-ed and summary piece on whether or not graphics benchmarks like 3dMark are helpful in determining the suitability of a video card for gameplay. It goes on to show how certain tests correlate to specific cards and game engines. The article is from last month, but Sidhian's pretty good for refreshingly frank hardware articles, and this might be good background information for evaluating ATI's upcoming Crossfire line of dual-izable video cards."

The proof is in the pudding

[Dancin_Santa]

Obviously benchmarks try to measure as much as possible, but there are limits. The most significant limit is that the benchmarks simply can't emulate every aspect of every game.

We've got NVidia releasing their new card [slashdot.org], but ATI is planning their next one soon too.

However, more horsepower is always good and this year's chips are faster than last year's, so unless you're trying to differentiate between a few microseconds difference in processing time between equivalent competing cards, you're better off ju

incomplete article

[fireduck]

the author rightly points out that the benchmark may not be accurately testing the right things. he lists different criteria for different types of games, using FPSs and racing games as the extreme examples. However, he doesn't really explain why the hair's breadth of a difference observed between nVidia and ATI in the benchmark translates to the very dramatic differences in real world performance and more importantly, he never really fully addresses the issue of different games (as the only directX game examined was HL2). If you're going to mention racing games and GTA, why not test GTA? A much more convincing article would have looked at several games spanning the genres (and graphical demands).

Benchmarks: Where are the details?

[Bellum Aeternus]

One of the things that has always irked me about benchmark testing is the lack of detail on exactly what they did. If you've ever read a scientific paper, then you know what I'm talking about. Oh sure, they need the dumbed down version for when gandma is buying bill a "new-fangled computer card", but what about the rest of us?

There's also the issue that some of us play games or use apps that are not DirectX, but OpenGL. Where are the solid benchmarks for that?

Re:Benchmarks: Where are the details?

[UnknownSoldier]

> One of the things that has always irked me about benchmark testing is the lack of detail on exactly what they did.

I agree -- this annoys me too.

Give me a link to the timedemo's, maps, and utils so I can run the exact same test on my current hardware.

A benchmark should be more then bragging rights -- it should be about letting people validate dem apples :)

Tomshardware

[superpulpsicle]

Benchmarks are overrated and full of overclocking. I know of someone who bought an exact same system tested by sites like tomshardware.com. They can never achieve the same frames-per-second as their benchmarks.

Re:Tomshardware

[Hack Jandy]

That probably has more to do with THG than benchmarks. But I digress..

Synthetic

[DeadBugs]

I prefer the use of actual games when benchmarking a card. The synthetic benchmarks from 3dMark do not tell me anything other than how the card will perform in 3Dmark. With various game engines using a wide range of features such as OpenGL, DirectX, SM3.0, HDR, etc. you need to benchmark by using a wide range of "actual" games.

Hardocp dropped 3Dmark benchmarks along time ago for this reason (among others)
http://www.hardforum.com/showthread.php?t=816850&p age=1&pp=20 [hardforum.com]

Doom Clones

[77Punker]

I get somewhere around 102937898123704 FPS when playing Doom! I rule! It only goes down slightly when playing Doom II.

Re:Synthetic

[LinuxRulz]

I prefer the use of actual games when benchmarking a card.

Right! There's nothing like running Doom to have an idea of how the card performs in Doom. If we look the comparisons on tomshardware [tomshardware.com], all of them uses different progs and games to see the performance and every card has soooo much performance difference between one and another prog.

My brain can do that.

[ultramkancool]

Even my brain can predict game performance:

Bzzatt....
That game will perform like crap!

Simple awnser

[FidelCatsro]

No
These tests are next to useless , unless of course you want to see how well your PC does running the test in question.
They are only comparable with themselves , Sure there may be some correlation between game performance and the score on these tests ,but that is for very obvious reasons and give you no real idea of the actual real world (or should i say fake world)abilities.
Perhaps they are of use in contemplation , but they pale in comparison to any real tests (using rl applications with purposes beyond

3dmark only measures...

[SynapseLapse]

how well 3dmark runs on your computer. Case in point, I recently picked up the eVga 6800 (Non-ultra) card recently, and very happy with it BTW. And, after a bit of tuning, I managed to get a score of 85xx with 3dmark03. Next, I successfully unlocked the extra shader pipes with RivaTuner bringing the total number of active pipes to 16. Well, when I reran the test, in the opening sequence "Battle of Proxycon," the FPS jumped from ~55Fps to ~75fps during the first elevator shot. The rest of the demo also r

Re:3dmark only measures...

[SynapseLapse]

mental note: Check break returns in preview mode BEFORE I hit submit...