MathML Test Suite: Combined Results

Contents

Systems tested

MathPlayer

Client: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; MathPlayer 2.10c; .NET CLR 1.1.4322; .NET CLR 2.0.50727; InfoPath.2; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648)

Tue Jul 29 00:28:03 CEST 2008

Name: Neil Soiffer

Company: Design Science

Goals: MathPlayer dev version

Comments: not quite done

Software: MathPlayer

Software Details: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; MathPlayer 2.10c; .NET CLR 1.1.4322; .NET CLR 2.0.50727; InfoPath.2; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648)

pmml2tex

Client: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9) Gecko/2008052906 Firefox/3.0

Mon Jul 14 00:25:51 CEST 2008

Name: David Carlisle

Company: NAG

Goals: rendering via conversion via OpenMath to Presentation mathml and TeX

Software: pmml2tex

Software Details: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9) Gecko/2008052906 Firefox/3.0 cmml2om.xsl om2pmml.xsl pmml2tex.xsl pdflatex

ff-ctop

Client: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1

Mon Jul 21 16:50:39 CEST 2008

Name: David Carlisle

Company: NAG

Software: FF2-ctop

Software Details: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.1) Gecko/2008070208 Firefox/3.0.1 with ctop2 user script

FF2-Win

Client: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14

Thu Jun 19 09:13:53 CEST 2008

Name: Ron Ausbrooks

Company: MacKichan Software, Inc.

Goals: Testing Firefox 2 under Windows XP

Comments: it was porky long to do - decidedly.

Software: Firefox 2.0.0.14

Software Details: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14

FF2-Linux

Client: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.14) Gecko/20080416 Fedora/2.0.0.14-1.fc8 Firefox/2.0.0.14

Tue Jul 01 17:49:26 CEST 2008

Name: Bruce Miller

Company: NIST

Comments: Sent separately...

Software: Firefox 2 on Fedora 8

Software Details: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.14) Gecko/20080416 Fedora/2.0.0.14-1.fc8 Firefox/2.0.0.14

FF2-Mac

Client: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14

Fri Jun 06 18:57:15 CEST 2008

Name: Andrew Smith

Company: Maplesoft

Goals: Run-through of all tests available using Mac OS X 10.5 and Firefox 2.

Comments: Presentation MathML generally not bad, but there are a handful of problems that lead to multiple failures or partial passes. For example, in most integral expressions, the differential 'd' overlaps the variable of integration, sometimes obscuring it completely. Most content MathML tests fail completely.

Software: Firefox 2/Mac OS X.

Software Details: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14

Dadzilla-2008-07-18

Client: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.6b) Gecko/20060228

Wed Jul 16 20:22:01 CEST 2008

Name: Azzeddine Lazrek

Company: UCAM

Software: Dadzilla

Opera-9.5-Win

Client: Opera/9.50 (Windows NT 5.1; U; en)

Thu Jun 12 13:27:54 CEST 2008

Name: Giorgi Chavchanidze

Company: Opera Software ASA

Goals: Tested in Opera 9.5 on WinXP

Software: Opera browser

Software Details: Opera/9.50 (Windows NT 5.1; U; en)

Opera-9.5-Mac

Client: Opera/9.50 (Macintosh; Intel Mac OS X; U; fr)

Thu Jun 19 22:25:52 CEST 2008

Name: Paul Libbrecht

Company: DFKI

Goals: Opera full test.

Comments: Well... the implementation of Opera has an amount of good results but has a few major issues. - Several characters seem "missing" or badly interpreted (in particular the d of dx of integrals) - mfenced's children are ignored except of the first one - stretchy characters fail - table width and any css styling seems ignored - mstyle seems ignored.

Software: Opera 9.5

Software Details: Opera/9.50 (Macintosh; Intel Mac OS X; U; fr) Fonts installed: standard (MacOSX 10.5), STIX beta, Mathematica MathML fonts.

Results

⊕ Test File MathPlayer pmml2tex ff-ctop FF2-Win FF2-Linux FF2-Mac Dadzilla-2008-07-18 Opera-9.5-Win Opera-9.5-Mac Summary Comments
  Re-enter test-runner MathPlayer pmml2tex ff-ctop FF2-Win FF2-Linux FF2-Mac Dadzilla-2008-07-18 Opera-9.5-Win Opera-9.5-Mac    
− testsuite 57% 70% 63% 22% 25% 14% 28% 7% 10% 82%  
− Characters 8% 0% 0% 7% 51% 0% 0% 0% 16% 23%  
+ EntityNames 26% 0% 0% 23% 0% 0% 0% 0% 0% 19%  
+ NumericRefs 0% 0% 0% 0% 84% 0% 0% 0% 34% 34%  
+ UTF8 0% 0% 0% 0% 69% 0% 0% 0% 15% 15%  
− Content 98% 90% 64% 0% 1% 0% 0% 0% 0% 94%  
+ ArithmeticAlgebraLogic 100% 87% 1% 0% 0% 0% 0% 0% 0% 87%  
+ BasicContentElements 100% 86% 63% 0% 0% 0% 0% 0% 0% 86%  
+ Calculus 100% 100% 95% 0% 0% 0% 0% 0% 0% 100%  
+ ConstantsAndSymbols 80% 100% 86% 0% 0% 0% 0% 0% 0% 100%  
+ ElementaryFunctions 100% 97% 100% 0% 0% 0% 0% 0% 0% 100%  
+ LinearAlgebra 100% 100% 66% 0% 0% 0% 0% 0% 0% 100%  
+ Relations 92% 100% 64% 0% 0% 0% 0% 0% 0% 100%  
+ SemanticMappingElements 100% 0% 100% 0% 0% 0% 0% 0% 0% 100%  
+ SequencesAndSeries 100% 50% 95% 0% 0% 0% 0% 0% 0% 95%  
+ Statistics 100% 100% 100% 0% 0% 0% 0% 0% 0% 100%  
+ TheoryOfSets 97% 91% 58% 0% 0% 0% 0% 0% 0% 94%  
+ TokenElements 77% 88% 88% 33% 44% 11% 0% 11% 0% 88%  
− ErrorHandling 90% 0% 4% 33% 19% 0% 0% 0% 42% 52%  
+ BadAttribs 75% 0% 25% 75% 75% 0% 0% 0% 75% 100%  
+ BadChildren 85% 0% 0% 0% 14% 0% 0% 0% 0% 14%  
+ BadEntities 100% 0% 0% 0% 0% 0% 0% 0% 100% 100%  
+ BadTags 100% 0% 0% 100% 0% 0% 0% 0% 100% 100%  
+ NumChildren 100% 0% 0% 16% 0% 0% 0% 0% 33% 33%  
− General 100% 52% 82% 70% 0% 0% 94% 41% 41% 100%  
+ Clipboard 100% 0% 0% 0% 0% 0% 100% 0% 0% 100%  
+ GenAttribs 100% 62% 87% 62% 0% 0% 87% 50% 50% 100%  
+ Math 100% 57% 100% 100% 0% 0% 100% 42% 42% 100%  
− Presentation 89% 53% 82% 75% 81% 72% 71% 25% 30% 89%  
+ DynamicExpressions 100% 100% 100% 50% 100% 100% 100% 100% 0% 100%  
+ GeneralLayout 93% 57% 90% 83% 91% 72% 85% 28% 28% 95%  
+ ScriptsAndLimits 100% 77% 100% 88% 94% 72% 94% 27% 50% 100%  
+ TablesAndMatrices 71% 17% 53% 41% 53% 51% 61% 30% 33% 71%  
+ TokenElements 90% 59% 84% 84% 80% 81% 53% 14% 27% 89%  
− StrictContent 0% 93% 75% 1% 0% 0% 38% 0% 0% 85%  
+ ArithmeticAlgebraLogic 0% 81% 80% 0% 0% 0% 89% 0% 0% 85%  
+ BasicContentElements 0% 97% 63% 13% 0% 0% 100% 0% 0% 97%  
+ Calculus 0% 87% 8% 0% 0% 0% 100% 0% 0% 87%  
+ ConstantsAndSymbols 0% 93% 86% 0% 0% 0% 0% 0% 0% 86%  
+ ElementaryFunctions 0% 100% 98% 0% 0% 0% 0% 0% 0% 98%  
+ LinearAlgebra 0% 100% 60% 0% 0% 0% 0% 0% 0% 60%  
+ Relations 0% 100% 100% 0% 0% 0% 0% 0% 0% 100%  
+ SemanticMappingElements 0% 100% 100% 0% 0% 0% 0% 0% 0% 100%  
+ SequencesAndSeries 0% 100% 37% 0% 0% 0% 0% 0% 0% 37%  
+ Statistics 0% 100% 50% 0% 0% 0% 0% 0% 0% 50%  
+ TheoryOfSets 0% 94% 91% 0% 0% 0% 0% 0% 0% 91%  
+ TokenElements 0% 88% 66% 0% 0% 0% 0% 0% 0% 66%  
− Topics 67% 45% 41% 60% 56% 12% 22% 18% 22% 73%  
+ Accents 50% 25% 75% 50% 75% 0% 0% 0% 0% 75%  
+ BiDi 0% 2% 72% 0% 61% 83% 0% 77%  
+ EmbellishedOp 100% 100% 100% 100% 100% 0% 0% 0% 0% 100%  
+ LargeOp 100% 92% 92% 74% 70% 0% 0% 14% 0% 96%  
+ LineBreak 81% 0% 0% 20% 6% 0% 0% 33% 40% 30%  
+ Nesting 100% 75% 0% 25% 50% 0% 0% 0% 25% 100%  
+ Primes 100% 0% 0% 100% 100% 0% 0% 0% 0% 100%  
+ StretchyChars 93% 72% 0% 75% 60% 36% 0% 18% 27% 93%  
+ WhiteSpace 69% 46% 0% 53% 53% 0% 0% 23% 46% 53%  
− TortureTests 100% 0% 0% 25% 62% 0% 0% 25% 25% 62%  
+ Complexity 100% 0% 0% 0% 60% 0% 0% 0% 0% 60%  
+ Size 100% 0% 0% 66% 66% 0% 0% 66% 66% 66%  

Key

Directory Entries

Each cell for a directory shows the percentaage of tests passed for that implementation. In most browsers hovering over the cell will show the number of tests passed, the number failed or not tested and the total number of tests. The colour of the cell is red if the number failed or not tested is greater than half the total, it is grey if no tests have been attempted, otherwise it is a shade of green.

Test File Entries

These show the result as reported in the test: passed, some-passed (parts of the test were passed), not-tested, broken (There is a problem with the test file). In the case of the summary column a test is considered passed if two implementations pass, it is considered not-tested if no implementation has done this test, otherwise it is considered to be failed.