Slashdot Log In
First Look At the ACID3 Browser Test
Posted by
kdawson
on Fri Jan 11, 2008 09:42 AM
from the turn-on-tune-in-render dept.
from the turn-on-tune-in-render dept.
ddanier writes "Now that all major browsers have mastered the ACID2 test (at least in some preview versions), work on ACID3 has begun. The new test will focus on ECMAScript, DOM Level 3, Media Queries, and data: URLs. 100 tests will be put into functions each returning either true or false depending on the result of the test. The current preview of ACID3 is still missing 16 tests."
Related Stories
[+]
Konqueror Passes the Acid2 Test Too 372 comments
An anonymous reader writes "A month after Safari , and after a lot of controversy, Allan Sandfeld Jensen announced today that Konqueror passes the Acid2 test too. Half of the patches could be merged from Apple's Webcore, the rest needed to be rewritten from scratch."
[+]
Opera 9.0 Fully Passes ACID2 Test 418 comments
Rytis writes "Opera has just become the second browser after Safari to be able to pass completely the famous ACID2 test. Mark Wilton-Jones is running a little article on the history of the Opera and ACID tests. Of course, it includes a screenshot of Opera 9 showing the nice happy face saying "Hello world!"."
[+]
IT: IE 8 Passes Acid2 Test 555 comments
notamicrosoftlover writes to tell us Channel9 is reporting that Internet Explorer 8 has correctly rendered the Acid2 page in "standards mode". "With respect to standards and interoperability, our goal in developing Internet Explorer 8 is to support the right set of standards with excellent implementations and do so without breaking the existing web. This second goal refers to the lessons we learned during IE 7. IE7's CSS improvements made IE more compliant with some standards and less compatible with some sites on the web as they were coded. Many sites and developers have done special work to work well with IE6, mostly as a result of the evolution of the web and standards since 2001 and the level of support in the various versions of IE that pre-date many standards. We have a responsibility to respect the work that sites have already done to work with IE. We must deliver improved standards support and backwards compatibility so that IE8 (1) continues to work with the billions of pages on the web today that already work in IE6 and IE7 and (2) makes the development of the next billion pages, in an interoperable way, much easier. We'll blog more, and learn more, about this during the IE8 beta cycle." There's also a video interview regarding IE8 development on Channel9."
This discussion has been archived.
No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
Full
Abbreviated
Hidden
Loading... please wait.
From the summary: (Score:5, Funny)
Re:From the summary: (Score:5, Funny)
Parent
Re:From the summary: (Score:5, Funny)
discourse in social choice using selective spelling excuses?
Parent
Re:From the summary: (Score:5, Funny)
Parent
I bet some devs are really pissed now (Score:2, Insightful)
Re:I bet some devs are really pissed now (Score:4, Informative)
Parent
Re:I bet some devs are really pissed now (Score:5, Informative)
Camino 1.0.3 crashes when starting the test
Safari 2.0.4 doesn't even get started. It says I need to enable JavaScript, which is enabled.
Parent
Re: (Score:2, Informative)
Re:I bet some devs are really pissed now (Score:5, Insightful)
I would be glad to receive bug reports with an easy to use test case. It saves me the trouble of determining if it is a bug or not, coming up with a test case, the pain of communicating back and forth with the customer trying to find out what they are doing and how the bug is being triggered, etc. Also, this test suite will improve compatibility with other browsers so it will reduce bug reports in the long run.
Why the heck would they be pissed?
Parent
Re: (Score:2)
Because their manager is pissed that they have to spend more money shoring up their shoddy product and is taking it out on the dev team?
Re:I bet some devs are really pissed now (Score:4, Insightful)
> Camino 1.0.3 crashes when starting the test
> Safari 2.0.4 doesn't even get started.
Those aren't the current versions of any of those browsers--not even close in the case of Camino and Safari--so that's not a terribly interesting test list.
Parent
Re:I bet some devs are really pissed now (Score:4, Informative)
Safari 3 is available for both Tiger and Leopard. The 10.4.11 update [apple.com] includes Safari 3.
Parent
Re:I bet some devs are really pissed now (Score:5, Informative)
After prompting me if I wanted to open empty.txt, it segfaulted my Konqueror with this backtrace:
Using host libthread_db library "/lib/tls/i686/cmov/libthread_db.so.1".[Thread debugging using libthread_db enabled]
[New Thread -1232832304 (LWP 8079)]
[KCrash handler]
#6 0xb609a9a1 in ?? () from
#7 0xb5f325d4 in ?? () from
#8 0x081e1f38 in ?? ()
#9 0xbfcde5a4 in ?? ()
#10 0xbfcde588 in ?? ()
#11 0xb60fe4fd in DOM::NodeFilter::acceptNode () from
Backtrace stopped: frame did not save the PC
I think we have a zeroday on our hands boys!
Parent
Re:I bet some devs are really pissed now (Score:5, Insightful)
The ACID3 test won't be a test for standards compliance either. The way I see it it's just a tool to motivate developers to work TOWARDS standards compliance.
The ACID3 test should, therefore, not be seen as a new set of standards. It's just a different subset of standards.
Parent
Re: (Score:3, Insightful)
AFAIK, the purpose of the ACID tests were basically to demonstrate a specific set of rendering bugs, supposedly bugs chosen because they were common complaints of web developers. So the purpose wasn't to test standards compliance, but to give browser developers a target to hit in order to help web developers with some of their more common problems.
Re: (Score:3, Insightful)
Re: (Score:3, Insightful)
It's hard enough to write one of these tests (have you seen their source code?!), let alone write it in such a way that when it fails it presents a clear message explaining why it isn't rendering correctly and giving helpful hints to the rendering engine developers.
Re:I bet some devs are really pissed now (Score:5, Interesting)
http://hixie.ch/tests/adhoc/ [hixie.ch]
The Acid tests are easier for the less technically inclined to get a hold of. In practice, the browser vendors take Acid tests and turn them into small tests of the kind you describe before fixing them. For Acid2, I was the one who did a number of those small tests for Opera (I worked for Opera at the time) -- you can see them here:
http://www.hixie.ch/tests/evil/acid/002/opera001.html [hixie.ch]
http://www.hixie.ch/tests/evil/acid/002/opera002.html [hixie.ch]
http://www.hixie.ch/tests/evil/acid/002/opera003.html [hixie.ch]
http://www.hixie.ch/tests/evil/acid/002/opera004.html [hixie.ch]
http://www.hixie.ch/tests/evil/acid/002/opera005.html [hixie.ch]
http://www.hixie.ch/tests/evil/acid/002/opera006.html [hixie.ch]
http://www.hixie.ch/tests/evil/acid/002/opera007.html [hixie.ch]
http://www.hixie.ch/tests/evil/acid/002/opera008.html [hixie.ch]
http://www.hixie.ch/tests/evil/acid/002/opera009.html [hixie.ch]
http://www.hixie.ch/tests/evil/acid/002/opera010.html [hixie.ch]
http://www.hixie.ch/tests/evil/acid/002/opera011.html [hixie.ch]
They're not as exciting as the smiley face, so they don't get the media's attention in the same way.
Parent
Re: (Score:3, Insightful)
Not quite a new "subset" ... (Score:3, Insightful)
Re:I bet some devs are really pissed now (Score:5, Informative)
http://www.webdevout.net/browser-support-summary?IE7=on&FX2=on&OP9=on&uas=CUSTOM [webdevout.net]
Parent
Re:I bet some devs are really pissed now (Score:5, Insightful)
Parent
Re:I bet some devs are really pissed now (Score:5, Informative)
Which is why the GP shouldn't be modded as "Insightful."
The ACID Tests are meant to test certain parts of the proposed standards.
Passing the Test doesn't imply standards compliance.
BUT
Standards compliances DOES imply passing the tests.
Parent
Re: (Score:2)
>:O
Re: (Score:3, Informative)
Everything in the ACID3 test is at an implementable stage (look at Anne's blog post in the summary (i.e., RTFA)), and has been since 2004.
Various Scores (Score:5, Informative)
Final scores of course are subject to change on the final test:
* - script takes long enough to run that browser prompts you to kill it.
Re:Various Scores (Score:5, Informative)
Parent
Re:Various Scores (Score:5, Informative)
I don't know what versions you're using, but at least for elinks (and links), they both support javascript. Just has to be compiled in.
eix elinks
* www-client/elinks
Available versions: 0.11.2 0.11.2-r1 0.11.3 {X bittorrent bzip2 debug finger ftp gopher gpm guile idn ipv6 javascript lua nls nntp perl ruby ssl unicode zlib}
Homepage: http://elinks.or.cz/ [elinks.or.cz]
Description: Advanced and well-established text-mode web browser
eix ^links$
[I] www-client/links
Available versions: (2) 2.1_pre26 2.1_pre28-r1
{X directfb fbcon gpm javascript jpeg livecd png sdl ssl svga tiff unicode}
Installed versions: 2.1_pre28-r1(2)(21:18:19 11/07/07)(javascript ssl tiff unicode -X -directfb -fbcon -gpm -jpeg -livecd -png -sdl -svga)
Homepage: http://links.twibright.com/ [twibright.com]
Description: links is a fast lightweight text and graphic web-browser
So while they do support javascript, they don't support iframes, and the test uses 3 of those.
Parent
Re: (Score:2)
Re: (Score:2)
IE6 IS 100% OF THE STANDARDS!!!!1111 (Score:2, Funny)
Re: (Score:2)
Re:Various Scores (Score:4, Informative)
Safari 3.0.4 on Windows using WebKit-r29380 (today's nightly build), Safari scores a 70/100.
Parent
Konqi 3.5.8 crashes, Firefox 2.0.11 fails at 59... (Score:3, Interesting)
Safari 3.0.4 (Windows) hangs at 60, Internet Explorer 7.0.5730.11 messes up so badly the result can't be read...
The test looks interesting, for sure. And it's going to raise the game for standards compliance!
Firefox 3 Beta 2 (Windows) gets to 62 (Score:3, Informative)
... and looks somewhat like the reference image...
Opera 9.2.4 (Windows) reaches 55 (but looks horrible)...
Firefox 3 looks like the best shot at it so far.
Where is the reference image from? (Score:5, Interesting)
Re:Where is the reference image from? (Score:5, Funny)
Parent
Re: (Score:3)
I don't know if you're trying to be Funny(sarcastic) or Informative.
Re: (Score:2)
Re:Where is the reference image from? (Score:5, Interesting)
You don't
I remember an article by the Apple guy who made ACID2 work on Safari (I think this was the first browser to make it work). One of the steps to get it working was to fix a bug in the test, when he couldn't make the reference result fit with what the test HTML said.
Parent
Re:Where is the reference image from? (Score:5, Informative)
http://weblogs.mozillazine.org/hyatt/archives/2005_04.html#008011 [mozillazine.org] details the bug (in this case, it was the test itself that was wrong -- not the reference). The reference rendering for Acid3 is likely correct as the actual rendering isn't overly complex (the complexity is in the ECMAScript and DOM support), though with the complexity of some tests there could easily be bugs in the test again.
Parent
Re: (Score:2)
You're not supposed to question Faith
So.... (Score:2, Flamebait)
Re:So.... (Score:5, Informative)
Parent
ECMAScript, DOM Level 3 (Score:3, Informative)
Since when is vaporware acceptable as proof? (Score:3, Interesting)
When Firefox makes news on this there are daily builds to test, source code to inspect and compile. One can see the progress first-hand.
There is no build of Microsoft Internet Explorer 8 to test. You are accepting something unverifiable as reality and thus talking about these browsers as if they're all on the same level. This suggests a new low: believing the illegal monopolist who tells you that their vaporware behaves in accordance with published publicly-implementable standards.
Re: (Score:2, Funny)
If it can't hold up, maybe it needs some work...
Re: (Score:2, Insightful)
Re: (Score:3, Insightful)
Testing is the best we have (Score:2)
Yes, testing can never prove a program correct. On the other hand, do you think you'd get anywhere trying to prove that anything about any browser is correct using formal methods? Especially when the source code for most browsers is not even publicly available.
The Acid tests are also not really about finding obscure bugs, but about demonstrating which basic features work and which ones do not work. After all major browsers pass an Acid test, web developers can attempt to use the features tested by the Acid