Wine vs Windows Benchmarks 286
PeterBrett writes "Tom Wickline recently posted to the Wine development list announcing that he'd done some benchmarks comparing Windows XP to Wine. They should be taken with the requisite dose of salt, but Wine has certainly come a long way."
on a dev list (Score:5, Insightful)
chris
Maybe a grain of salt, but it's what I'd predict (Score:5, Insightful)
Congrats to the Wine devs!
wine or driver test? (Score:5, Insightful)
i think a wider suite of tests would be required.. and not just the preformance/gaming orinted stuff.
Note that XP Wins the Tests that Count (Score:2, Insightful)
Re:on a dev list (Score:5, Insightful)
Strange choice of benchmarks... (Score:3, Insightful)
If this is the case, the results in regard to game performance are out-dated at best.
amount of work done (Score:1, Insightful)
Re:on a dev list (Score:3, Insightful)
This is only half the story. Our research group tries to get our bleeding edge algorithms into existing software (e.g. text algorithms in scribus, connector routing and graph layout in inkscape). One thing we've found is that when you are developing some code it's easy to get trained into only trying certain pathways through the code. In each case we've found that once you let fools play with your foolproof algorithm, they find things you hadn't tried. If these stats are standard tests used by wine devels they will only contain well tested pathways, and if you leave those pathways things misbehave or run slowly.
DirectLinux (Score:2, Insightful)
I have a feeling that unless some major changes are made to the X Window System (and maybe Linux drivers) that WINE will not catch up with WindowsXP and DirectX, but that just means I would need a faster computer.
WINE doesn't need to be the fastest. As long as it will run my older games (which Windows 2000 does not always do well) it may be more useful to me than an actual install of Windows.
---
This is just my opinion, please don't flame me just because you like Windows.
Re:Funny statistics (Score:3, Insightful)
WINE not a Windows replacement (Score:5, Insightful)
no salt, but lies and damned stats (Score:5, Insightful)
Nobody said they were doctored; the slashdot editor said "take it with a grain of salt". I see a lot of reasons to do so:
Honestly? The results probably aren't manipulated, but the presentation is very clearly set up with a number of tricks (perhaps without him/her realizing it) to give the impression that Wine "kicked some serious ass", when for the most part, it did horribly.
Re:Maybe a grain of salt, but it's what I'd predic (Score:2, Insightful)
They often do things under very specific conditions and are useless elsewhere. If you're not a compiler expert (which I definately am not), it's unlikely you'll have any apreciable performance gain. It's quite possible that you'll see a performance loss if things aren't done correctly. Even an expert may or may not get a gain.
I love Gentoo myself, but I'm not delusional about performance gains. I do it for the customizability it offers. For instance, last I checked, you could get a Debian package that contained the Perl bindings for Vim, or the Python bindings for Vim, but not both. With Gentoo, I can easily instruct Portage to build in both.
Re: Very Impressive! (Score:3, Insightful)
You might understand it that way, but you'd be wrong. All Wine does is implement the published API of Windows using Linux commands. Absolutely no reverse engineering is done.
Re:Note that XP Wins the Tests that Count (Score:3, Insightful)
Before you go and say "well run Ventrilo under wine!" let me tell you that i have tried and it did not work. I dont know why it did not work and i dont care. Even if it was a relativly easy tweak I am not willing to do it. Its not that I can't get it to work, but why not use windows which "just works".
Again before you guys go off about how Windows doesn't "just work" let me tell you it DOES for me on my gaming machine. My spare time these days is spent raiding instead of tweaking my computer and i prefer it that way.
Re:Compatibility more important than speed! (Score:4, Insightful)
At some point you have to ask yourself why you are running Linux at all.
-matthew
Re:no salt, but lies and damned stats (Score:5, Insightful)
Re:no salt, but lies and damned stats (Score:3, Insightful)
My first guess would be that WINE is inconsistent. Especially in the areas where it falls behind. After all, it is still a beta and has not achieved 100% compatibility yet, so the developers might not care too much about optimization at this point.
But Linux or even Windows are also possible culprits. Maybe the guys at Redmond also have a few sub-optimal routines buried in their codebase?
Re:amount of work done (Score:3, Insightful)
To say that Wine developers have it easy is shamefully disrespectful to their efforts. (Unless you take the viewpoint that not having to work with MS code simplifies the work!) For Wine to work at all is commendable - to be (sometimes) faster is truly amazing, IMHO.
Don't be silly (Score:5, Insightful)
almost classic (Score:2, Insightful)
Shame it was not "Spelling Check" but on still quite amusing.
In all seriousness, interesting and makes me want to revist Wine as it looks a lot better than when I last tried it (given I run pretty low spec hardware, performance is key rather than stability).
Though I do think "Wine or XP aborted on 18 tests" was a bit cheeky as it was 3 XP aborts, 15 Wine aborts...
Re:no salt, but lies and damned stats (Score:4, Insightful)
Re:no salt, but lies and damned stats (Score:3, Insightful)
Then there's basic stuff that you can't explain - why the "CPU speed" benchmark is better under wine? A CPU test will, uh, do things with the CPU, it will be CPU bound and the windows api shouldn't involved in that code path.
Also notice that wine doesn't implement the win32 API completely. How you know that, say, "Game 2 - Adventure - Low Detail" tried to detect the card's features and since wine doesn't implement everything the game reduced the game quality to match the capabilities detected under wine? I say this because wine doesn't looks that good in the Quake, UT2004 and GL benchmarks
Anyway, I do not care how fast wine is. I care about API compliance. This is 2006, Microsoft has rewritten half of the OS with longhorn and I continue without being able to run many windows apps created years ago. Wine is far from being a true windows replacement for windows apps today....
Re:on a dev list (Score:5, Insightful)
That is the key phrase(but you have to look literally). The point is that you need to test the output of the benchmarks, not just look at the frame rates. You can create a REAL FAST benchmark by not implementing some api functions. The output might look reasonable, but if you zoom into some edges you might find additional oddities. That is the main point what is mising in this benchmark.
Rememeber driver writers made some unacceptable shortcuts in the past to increase performance.
Re:no salt, but lies and damned stats (Score:5, Insightful)
This benchmark isn't a Wine vs. XP contest, it's a test to see if Wine is at least as good as XP, and it failed in 81 categories, which means there's still some work to be done.
Re:What do you think reverse engineering is ? (Score:5, Insightful)
Throughout most of my career, I've understood reverse engineering to be what you do when you DON'T have the source code. I think the wikipedia entry mentions that this is the most common interpretation. It can be extremely difficult and time consuming. I've done it on major projects a few times in my career. It is neither easy nor efficient, but sometimes the only choice you have.
It's also common to talk about reverse engineering hardware, where the innards of a chip may be deduced by observing its inputs and outputs. I worked on a project at a startup where we had to do that, because the original hardware developers were long gone, and no VHDL could be discovered, yet we had to write drivers for their (buggy) chips in order to make a deadline. At the same company we had to reverse engineer the workings of a (buggy) Fiber Channel PCI card, because the manufacturer would not give us the support we needed to make our deadlines. They were rather surprised when we talked to them about the details of their (proprietary, embedded in an ASIC) DMA engine that we deduced via logic analyzers and oscilloscopes.
Those projects were SO difficult compared to reading (even obscure) code, that I really think that using the one phrase for both activities is confusing and sometimes even deceptive.
Re:no salt, but lies and damned stats (Score:3, Insightful)
If I read it right, Wine didn't finish 15 of the tests, and Windows XP didn't finish 3, leading to 18 "no-comparsion" blue results...
But yeah - that Wine should crash out on a DivX compression or a Web Page Rendering(??!!?) test is
Re:no salt, but lies and damned stats (Score:1, Insightful)
Maybe you should run the linux version of firefox and openoffice?
No? Oh well..
Re:Maybe a grain of salt, but it's what I'd predic (Score:4, Insightful)
Gentoo evokes that era for me, and you can't have a go at people for breaking something when they're busy learning. So what if they over-optimise compiler flags and break things? When they fix them up they're learning a valuable lesson, and that lesson isn't 'next time use a binary distro'
Anyway, today's school-age gentoo n00bs are tomorrow's crop of system admins.
Re: Reverse engineering is... (Score:3, Insightful)
Reverse engineering is in fact almost always used for cloning. However, that's exactly what Wine is: a clone of various Windows components.
> All that Wine does is create a blackbox that works like the Windows API from the point of view of a Windows application but using totally different internals.
Reverse engineering isn't concerned with the internals, it's concerned with the effect.
> Reverse engineering would be if they had recreated the internals more or less exactly using components replicated as far as possible from the originals in which case they would have to recreate the Windows source code from binaries somehow.
No, that's not what reverse engineering means. Reverse engineering means "I'm want to make a thingy that works just like your thingy, but I don't have your blueprints, so I'm going to poke and prod your thingy as a black box, and mimic whatever behavior I observe."
> You could also point to the AMD processors that implement the x86 instruction set, internally they are radically different from the Intel originals but to Windows they function the same. If that was reverse engineering I somehow suspect AMD would have gotten it's pants sued of by now.
Intel did in fact sue whoever first cloned their x86 chips, but lost because the reverse-engineered chips did not violate any patents or copyrights.
One of the dangers of keeping trade secrets rather than patenting them is that someone can reverse engineer your goodies and market them without paying you anything.
Re:no salt, but lies and damned stats (Score:2, Insightful)