zero unexpected failures on all tier 1 platforms

[simonmar]

We're often sloppy about this, so I'm making a ticket to ensure we can tag a testsuite that has zero unexpected failures on all tier 1 platforms at release time.

That may mean filing more tickets and marking some tests as expected failures.

I'll take {x86_64,x86}/Linux.

[dterei]

On Linux x64 under 'optasm' and 'optllvm' I currently get the following failures:

OVERALL SUMMARY for test run started at Thu Jan 12 15:33:24 PST 2012
    3195 total tests, which gave rise to
   15839 test cases, of which
       0 caused framework failures
   14360 were skipped

    1442 expected passes
      19 had missing libraries
      17 expected failures
       0 unexpected passes
       1 unexpected failures

Unexpected failures:
   lib/Time  T5430 [bad stdout] (optasm)

where 'T5430' fails with:

=====> T5430(optasm) 1895 of 3195 [0, 0, 0]                                                                                                                                                                          
cd ./lib/Time && '/home/davidt/Ghc/head-next/inplace/bin/ghc-stage2' -fforce-recomp -dcore-lint -dcmm-lint -dno-debug-output -no-user-package-conf -rtsopts  -fno-ghci-history -o T5430 T5430.hs -O -fasm   >T5430.comp.stderr 2>&1
cd ./lib/Time && ./T5430    </dev/null >T5430.run.stdout 2>T5430.run.stderr
Actual stdout output differs from expected:
--- ./lib/Time/T5430.stdout   2011-11-16 15:50:57.665397562 -0800
+++ ./lib/Time/T5430.run.stdout  2012-01-12 15:37:50.188034971 -0800
@@ -1 +1 @@
-001
+365
*** unexpected failure for T5430(optasm)

[dterei]

OK I fixed T5430. Output on Linux x64 is good for me (under optasm, optllvm anyway).

[simonmar]

Here's the current list for x86/Windows. I'll try to squash as many of these as I can today:

Unexpected failures:
   ../../libraries/base/tests/Numeric  num009 [bad stdout] (normal,hpc,optasm,profasm,threaded1,threaded2,dyn,profthreaded)
   ../../libraries/base/tests/Numeric  num009 [bad stdout or stderr] (ghci)
   ../../libraries/directory/tests     createDirectoryIfMissing001 [bad exit code] (threaded2)
   ../../libraries/directory/tests     getDirContents002 [bad stdout or stderr] (ghci)
   ../../libraries/hpc/tests/function  subdir/tough2 [bad stdout] (normal,hpc,optasm,threaded1,threaded2,dyn)
   ../../libraries/hpc/tests/function  tough [bad stdout] (normal,hpc,optasm,profasm,threaded1,threaded2,dyn,profthreaded)
   ../../libraries/hpc/tests/simple    hpc001 [bad stdout] (normal,hpc,optasm,profasm,threaded1,threaded2,dyn,profthreaded)
   ../../libraries/process/tests       process004 [bad stdout or stderr] (ghci)
   concurrent/should_run               3429 [bad exit code] (threaded1,threaded2,profthreaded)
   concurrent/should_run               conc036 [bad stdout] (normal)
   concurrent/should_run               foreignInterruptible [bad exit code] (ghci,threaded1,threaded2)
   driver                              5313 [bad exit code] (dyn)
   dynlibs                             T4464 [bad stderr] (normal)
   ghc-api/dynCompileExpr              dynCompileExpr [bad exit code] (dyn)
   ghci/linking                        ghcilink004 [bad exit code] (normal)
   ghci/linking                        ghcilink005 [bad exit code] (normal)
   lib/IO                              T4113 [bad stdout] (normal,hpc,optasm,profasm,threaded1,threaded2,dyn,profthreaded)
   lib/IO                              T4113 [bad stdout or stderr] (ghci)
   lib/should_run                      stableptr003 [bad stdout] (dyn)
   numeric/should_run                  numrun012 [bad stdout or stderr] (ghci)
   perf/compiler                       T4801 [stat not good enough] (normal)
   programs/barton-mangler-bug         barton-mangler-bug [exit code non-0] (dyn)
   rts                                 derefnull [bad exit code] (ghci)
   rts                                 derefnull [bad profile] (profasm,profthreaded)
   rts                                 divbyzero [bad exit code] (ghci)
   rts                                 divbyzero [bad profile] (profasm,profthreaded)
   typecheck/should_fail               T5300 [stderr mismatch] (normal)

[simonmar]

FYI, at 7.4.1 the status was

x86_64/Linux: zero

x86/Linux:

   ../../libraries/base/tests  CPUTime001 [bad stdout] (threaded2)
   rts                         5250 [bad exit code] (optllvm)

x86/Windows:

   ../../libraries/hpc/tests/function  subdir/tough2 [bad stdout] (normal,hpc,optasm,threaded1,threaded2,dyn)
   ../../libraries/hpc/tests/function  tough [bad stdout] (normal,hpc,optasm,profasm,threaded1,threaded2,dyn,profthreaded)
   ../../libraries/hpc/tests/simple    hpc001 [bad stdout] (normal,hpc,optasm,profasm,threaded1,threaded2,dyn,profthreaded)
   driver                              5313 [bad exit code] (dyn)
   dynlibs                             T4464 [bad stderr] (normal)
   ghc-api/dynCompileExpr              dynCompileExpr [bad exit code] (dyn)
   ghci/linking                        ghcilink004 [bad exit code] (normal)
   ghci/linking                        ghcilink005 [bad exit code] (normal)
   lib/IO                              T4113 [bad stdout] (normal,hpc,optasm,profasm,threaded1,threaded2,dyn,profthreaded)
   lib/IO                              T4113 [bad stdout or stderr] (ghci)
   lib/should_run                      stableptr003 [bad stdout] (dyn)
   programs/barton-mangler-bug         barton-mangler-bug [exit code non-0] (dyn)
   rts                                 derefnull [bad exit code] (ghci)
   rts                                 derefnull [bad profile] (profasm,profthreaded)
   rts                                 divbyzero [bad exit code] (ghci)
   rts                                 divbyzero [bad profile] (profasm,profthreaded)
   typecheck/should_fail               T5300 [stderr mismatch] (normal)

x86/OSX and x86_64/OSX: anyone have results for these?

[igloo]

x86/OS X:

OVERALL SUMMARY for test run started at Thu Feb  9 20:52:42 GMT 2012
    3160 total tests, which gave rise to
   13550 test cases, of which
       0 caused framework failures
    2679 were skipped

   10392 expected passes
     453 expected failures
       0 unexpected passes
      26 unexpected failures

Unexpected failures:
   ../../libraries/base/tests/Numeric  num010 [bad exit code] (ghci)
   ../../libraries/unix/tests          signals002 [bad exit code] (ghci)
   ../../libraries/unix/tests          signals004 [bad exit code] (ghci,threaded1,threaded2,profthreaded)
   driver/objc                         objc-hi [bad profile] (profthreaded)
   driver/objc                         objc-hi [bad heap profile] (profasm)
   driver/objc                         objcpp-hi [bad profile] (profthreaded)
   driver/objc                         objcpp-hi [bad heap profile] (profasm)
   lib/IO                              T4113 [bad stdout] (normal,hpc,optasm,profasm,threaded1,threaded2,dyn,profthreaded)
   lib/IO                              T4113 [bad stdout or stderr] (ghci)
   numeric/should_run                  arith005 [bad exit code] (ghci)
   perf/compiler                       T1969 [stat not good enough] (normal)
   rts                                 derefnull [bad profile] (profasm,profthreaded)
   rts                                 divbyzero [bad profile] (profasm,profthreaded)
   typecheck/should_fail               T5300 [stderr mismatch] (normal)

amd64/OSX:

OVERALL SUMMARY for test run started at Thu Feb  9 21:04:22 GMT 2012
    3160 total tests, which gave rise to
   13550 test cases, of which
       0 caused framework failures
    2672 were skipped

   10413 expected passes
     448 expected failures
       0 unexpected passes
      17 unexpected failures

Unexpected failures:
   ../../libraries/process/tests  process007 [bad exit code] (ghci)
   ../../libraries/unix/tests     signals002 [bad exit code] (ghci)
   ../../libraries/unix/tests     signals004 [bad exit code] (ghci,threaded1,threaded2,profthreaded)
   driver/objc                    objc-hi [bad profile] (profthreaded)
   driver/objc                    objc-hi [bad heap profile] (profasm)
   driver/objc                    objcpp-hi [bad profile] (profthreaded)
   driver/objc                    objcpp-hi [bad heap profile] (profasm)
   ghci.debugger/scripts          break011 [bad stderr] (ghci)
   perf/space_leaks               space_leak_001 [bad exit code] (ghci)
   rts                            derefnull [bad profile] (profasm,profthreaded)
   rts                            divbyzero [bad profile] (profasm,profthreaded)
   typecheck/should_fail          T5300 [stderr mismatch] (normal)

[nomeata]

Here are the unexpected failures on Debian, amd64, 7.4.1 with the released testsuite, FAST mode:

OVERALL SUMMARY for test run started at Mon Feb 13 20:16:45 UTC 2012
    3036 total tests, which gave rise to
   12716 test cases, of which
       0 caused framework failures
    9956 were skipped

    2714 expected passes
      42 expected failures
       0 unexpected passes
       4 unexpected failures

Unexpected failures:
   codeGen/should_run   cgrun025 [exit code non-0] (normal)
   deriving/should_run  T3087 [exit code non-0] (normal)
   lib/Concurrent       QSemN001 [bad exit code] (normal)
   lib/Regex            regex003 [exit code non-0] (normal)

=====> cgrun025(normal) 2613 of 3036 [0, 2, 0]
cd ./codeGen/should_run && '/usr/bin/ghc' -fforce-recomp -dcore-lint -dcmm-lint -dno-debug-output -no-user-package-conf -rtsopts  -fno-ghci-history -o cgrun025 cgrun025.hs  -package regex-compat  >cgrun025.comp.stderr 2>&1
Compile failed (status 256) errors were:

cgrun025.hs:8:8:
    Could not find module `Maybe'
    It is a member of the hidden package `haskell98-2.0.0.1'.
    Use -v to see a list of the files searched for.

*** unexpected failure for cgrun025(normal)


=====> T3087(normal) 2967 of 3036 [0, 3, 0]
cd ./deriving/should_run && '/usr/bin/ghc' -fforce-recomp -dcore-lint -dcmm-lint -dno-debug-output -no-user-package-conf -rtsopts  -fno-ghci-history -o T3087 T3087.hs  -package syb  >T3087.comp.stderr 2>&1
Compile failed (status 256) errors were:
[1 of 1] Compiling Main             ( T3087.hs, T3087.o )

T3087.hs:28:19:
    Ambiguous occurrence `ext2Q'
    It could refer to either `Main.ext2Q', defined at T3087.hs:20:1
                          or `Data.Generics.ext2Q',
                             imported from `Data.Generics' at T3087.hs:5:1-20
                             (and originally defined in `Data.Generics.Aliases')

T3087.hs:31:20:
    Ambiguous occurrence `ext2Q'
    It could refer to either `Main.ext2Q', defined at T3087.hs:20:1
                          or `Data.Generics.ext2Q',
                             imported from `Data.Generics' at T3087.hs:5:1-20
                             (and originally defined in `Data.Generics.Aliases')

*** unexpected failure for T3087(normal)



=====> QSemN001(normal) 1494 of 3036 [0, 0, 0]
cd ./lib/Concurrent && '/usr/bin/ghc' -fforce-recomp -dcore-lint -dcmm-lint -dno-debug-output -no-user-package-conf -rtsopts  -fno-ghci-history -o QSemN001 QSemN001.hs  -package QuickCheck  >QSemN001.comp.stderr 2>&1
cd ./lib/Concurrent && ./QSemN001    </dev/null >QSemN001.run.stdout 2>QSemN001.run.stderr
Wrong exit code (expected 0 , actual 1 )
Stdout:

Stderr:
QSemN001: user error (newQSemN: Initial quantity must be non-negative)

*** unexpected failure for QSemN001(normal)

=====> regex003(normal) 1563 of 3036 [0, 1, 0]
cd ./lib/Regex && '/usr/bin/ghc' -fforce-recomp -dcore-lint -dcmm-lint -dno-de
bug-output -no-user-package-conf -rtsopts  -fno-ghci-history -o regex003 regex
003.hs  -package regex-posix  >regex003.comp.stderr 2>&1
Compile failed (status 256) errors were:
[1 of 1] Compiling Main             ( regex003.hs, regex003.o )

regex003.hs:7:12:
    Non type-variable argument
      in the constraint: RegexContext Regex String target
    (Use -XFlexibleContexts to permit this)
    In the type signature for `x':
      x :: RegexContext Regex String target => target
    In the expression:
      let
        x :: RegexContext Regex String target => target
        x = ("abaca" =~ B.pack "(.)a")
        x' :: (RegexContext Regex String target, Monad m) => m target
        ....
      in
        do { print (x :: Bool);
             print (x :: Int);
             print (x :: [MatchArray]);
             .... }
    In an equation for `main':
        main
          = let
              x :: RegexContext Regex String target => target
              x = ("abaca" =~ B.pack "(.)a")
              ....
            in
              do { print (x :: Bool);
                   print (x :: Int);
                   .... }

regex003.hs:11:12:
    Non type-variable argument
      in the constraint: RegexContext Regex B.ByteString target
    (Use -XFlexibleContexts to permit this)
    In the type signature for `y':
      y :: RegexContext Regex B.ByteString target => target
    In the expression:
      let
        x :: RegexContext Regex String target => target
        x = ("abaca" =~ B.pack "(.)a")
        x' :: (RegexContext Regex String target, Monad m) => m target
        ....
      in
        do { print (x :: Bool);
             print (x :: Int);
             print (x :: [MatchArray]);
             .... }
    In an equation for `main':
        main
          = let
              x :: RegexContext Regex String target => target
              x = ("abaca" =~ B.pack "(.)a")
              ....
            in
              do { print (x :: Bool);
                   print (x :: Int);
                   .... }
regex003.hs:13:12:
    Non type-variable argument
      in the constraint: RegexContext Regex B.ByteString target
    (Use -XFlexibleContexts to permit this)
    In the type signature for y':
      y' :: (RegexContext Regex B.ByteString target, Monad m) => m target
    In the expression:
      let
        x :: RegexContext Regex String target => target
        x = ("abaca" =~ B.pack "(.)a")
        x' :: (RegexContext Regex String target, Monad m) => m target
        ....
      in
        do { print (x :: Bool);
             print (x :: Int);
             print (x :: [MatchArray]);
             .... }
    In an equation for `main':
        main
          = let
              x :: RegexContext Regex String target => target
              x = ("abaca" =~ B.pack "(.)a")
              ....
            in
              do { print (x :: Bool);
                   print (x :: Int);
                   .... }

*** unexpected failure for regex003(normal)

[nomeata]

Now most other Debian arches have build the testsuite ( https://buildd.debian.org/status/package.php?p=ghc-testsuite), here are the results:

 kfreebsd-amd64:

OVERALL SUMMARY for test run started at Tue Feb 14 11:44:16 UTC 2012
    3036 total tests, which gave rise to
   11974 test cases, of which
       0 caused framework failures
    9215 were skipped

    2706 expected passes
      44 expected failures
       0 unexpected passes
       9 unexpected failures

Unexpected failures:
   cabal                ghcpkg01 [bad stderr] (normal)
   codeGen/should_run   cgrun025 [exit code non-0] (normal)
   deriving/should_run  T3087 [exit code non-0] (normal)
   lib/Concurrent       QSemN001 [bad exit code] (normal)
   lib/Regex            regex003 [exit code non-0] (normal)
   perf/compiler        T3064 [stat not good enough] (normal)
   rts                  derefnull [bad stderr] (normal)
   rts                  divbyzero [bad stderr] (normal)
   rts                  exec_signals [bad stdout] (normal)

 kfreebsd-i386:

OVERALL SUMMARY for test run started at Tue Feb 14 09:30:59 UTC 2012
    3036 total tests, which gave rise to
   11974 test cases, of which
       0 caused framework failures
    9216 were skipped

    2707 expected passes
      43 expected failures
       0 unexpected passes
       8 unexpected failures

Unexpected failures:
   cabal                ghcpkg05 [bad stderr] (normal)
   codeGen/should_run   cgrun025 [exit code non-0] (normal)
   deriving/should_run  T3087 [exit code non-0] (normal)
   lib/Concurrent       QSemN001 [bad exit code] (normal)
   lib/Regex            regex003 [exit code non-0] (normal)
   rts                  derefnull [bad stderr] (normal)
   rts                  divbyzero [bad stderr] (normal)
   rts                  exec_signals [bad stdout] (normal)

 mips:

OVERALL SUMMARY for test run started at Tue Feb 14 09:42:34 UTC 2012
    3035 total tests, which gave rise to
    6890 test cases, of which
       0 caused framework failures
    4479 were skipped

    2318 expected passes
      68 expected failures
       1 unexpected passes
      24 unexpected failures

Unexpected passes:
   quasiquotation  T5204 (normal)

Unexpected failures:
   cabal/cabal04             cabal04 [bad exit code] (normal)
   codeGen/should_run        cgrun025 [exit code non-0] (normal)
   deriving/should_run       T3087 [exit code non-0] (normal)
   driver                    5313 [exit code non-0] (normal)
   driver/recomp009          recomp009 [bad exit code] (normal)
   ghc-api/dynCompileExpr    dynCompileExpr [exit code non-0] (normal)
   ghci/linking              ghcilink001 [bad exit code] (normal)
   ghci/linking              ghcilink002 [bad exit code] (normal)
   ghci/linking              ghcilink003 [bad exit code] (normal)
   ghci/linking              ghcilink004 [bad exit code] (normal)
   ghci/linking              ghcilink005 [bad exit code] (normal)
   ghci/linking              ghcilink006 [bad exit code] (normal)
   lib/Concurrent            QSemN001 [bad exit code] (normal)
   lib/Regex                 regex003 [exit code non-0] (normal)
   perf/compiler             T4801 [stat too good] (normal)
   perf/should_run           3586 [exit code non-0] (normal)
   perf/should_run           T3736 [bad stderr] (normal)
   profiling/should_run      T5559 [bad heap profile] (profasm)
   rts                       4850 [bad exit code] (normal)
   rts                       T2615 [exit code non-0] (normal)
   rts                       T5423 [bad stderr] (normal)
   safeHaskell/safeLanguage  SafeLang01 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang12 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang16 [stderr mismatch] (normal)

 mipsel:

OVERALL SUMMARY for test run started at Wed Feb 15 13:53:55 UTC 2012
    3035 total tests, which gave rise to
    6890 test cases, of which
       0 caused framework failures
    4479 were skipped

    2319 expected passes
      68 expected failures
       1 unexpected passes
      23 unexpected failures

Unexpected passes:
   quasiquotation  T5204 (normal)

Unexpected failures:
   cabal/cabal04             cabal04 [bad exit code] (normal)
   codeGen/should_run        cgrun025 [exit code non-0] (normal)
   deriving/should_run       T3087 [exit code non-0] (normal)
   driver                    5313 [exit code non-0] (normal)
   driver/recomp009          recomp009 [bad exit code] (normal)
   ghc-api/dynCompileExpr    dynCompileExpr [exit code non-0] (normal)
   ghci/linking              ghcilink001 [bad exit code] (normal)
   ghci/linking              ghcilink002 [bad exit code] (normal)
   ghci/linking              ghcilink003 [bad exit code] (normal)
   ghci/linking              ghcilink004 [bad exit code] (normal)
   ghci/linking              ghcilink005 [bad exit code] (normal)
   ghci/linking              ghcilink006 [bad exit code] (normal)
   lib/Concurrent            QSemN001 [bad exit code] (normal)
   lib/Regex                 regex003 [exit code non-0] (normal)
   perf/compiler             T4801 [stat too good] (normal)
   perf/should_run           3586 [exit code non-0] (normal)
   perf/should_run           T3736 [bad stderr] (normal)
   rts                       4850 [bad exit code] (normal)
   rts                       T2615 [exit code non-0] (normal)
   rts                       T5423 [bad stderr] (normal)
   safeHaskell/safeLanguage  SafeLang01 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang12 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang16 [stderr mismatch] (normal)

 powerpc:

OVERALL SUMMARY for test run started at Tue Feb 14 09:22:58 UTC 2012
    3035 total tests, which gave rise to
   11065 test cases, of which
       0 caused framework failures
    8591 were skipped

    2381 expected passes
      68 expected failures
       1 unexpected passes
      24 unexpected failures

Unexpected passes:
   quasiquotation  T5204 (normal)

Unexpected failures:
   cabal/cabal04             cabal04 [bad exit code] (normal)
   codeGen/should_compile    massive_array [exit code non-0] (normal)
   codeGen/should_run        cgrun025 [exit code non-0] (normal)
   codeGen/should_run        cgrun071 [bad exit code] (normal)
   deriving/should_run       T3087 [exit code non-0] (normal)
   driver                    5313 [exit code non-0] (normal)
   driver/recomp009          recomp009 [bad exit code] (normal)
   ghc-api/dynCompileExpr    dynCompileExpr [exit code non-0] (normal)
   ghci/linking              ghcilink001 [bad exit code] (normal)
   ghci/linking              ghcilink002 [bad exit code] (normal)
   ghci/linking              ghcilink003 [bad exit code] (normal)
   ghci/linking              ghcilink004 [bad exit code] (normal)
   ghci/linking              ghcilink005 [bad exit code] (normal)
   ghci/linking              ghcilink006 [bad exit code] (normal)
   lib/Concurrent            QSemN001 [bad exit code] (normal)
   lib/Regex                 regex003 [exit code non-0] (normal)
   numeric/should_run        arith011 [bad exit code] (normal)
   perf/compiler             T1969 [stat not good enough] (normal)
   perf/compiler             T4801 [stat not good enough] (normal)
   rts                       T2615 [exit code non-0] (normal)
   rts                       divbyzero [bad exit code] (normal)
   safeHaskell/safeLanguage  SafeLang01 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang12 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang16 [stderr mismatch] (normal)

 s390:

OVERALL SUMMARY for test run started at Tue Feb 14 09:23:42 UTC 2012
    3035 total tests, which gave rise to
    6890 test cases, of which
       0 caused framework failures
    4479 were skipped

    2317 expected passes
      68 expected failures
       1 unexpected passes
      25 unexpected failures

Unexpected passes:
   quasiquotation  T5204 (normal)

Unexpected failures:
   cabal/cabal04             cabal04 [bad exit code] (normal)
   codeGen/should_run        cgrun025 [exit code non-0] (normal)
   codeGen/should_run        cgrun071 [bad exit code] (normal)
   deriving/should_run       T3087 [exit code non-0] (normal)
   driver                    5313 [exit code non-0] (normal)
   driver/recomp009          recomp009 [bad exit code] (normal)
   ghc-api/dynCompileExpr    dynCompileExpr [exit code non-0] (normal)
   ghci/linking              ghcilink001 [bad exit code] (normal)
   ghci/linking              ghcilink002 [bad exit code] (normal)
   ghci/linking              ghcilink003 [bad exit code] (normal)
   ghci/linking              ghcilink004 [bad exit code] (normal)
   ghci/linking              ghcilink005 [bad exit code] (normal)
   ghci/linking              ghcilink006 [bad exit code] (normal)
   lib/Concurrent            QSemN001 [bad exit code] (normal)
   lib/Regex                 regex003 [exit code non-0] (normal)
   perf/compiler             T4801 [stat too good] (normal)
   perf/should_run           3586 [exit code non-0] (normal)
   perf/should_run           T3736 [bad stderr] (normal)
   rts                       4850 [bad exit code] (normal)
   rts                       T2615 [exit code non-0] (normal)
   rts                       T5423 [bad stderr] (normal)
   rts                       testblockalloc [bad exit code] (normal)
   safeHaskell/safeLanguage  SafeLang01 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang12 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang16 [stderr mismatch] (normal)

 s390x:

OVERALL SUMMARY for test run started at Tue Feb 14 09:22:45 UTC 2012
    3035 total tests, which gave rise to
    6890 test cases, of which
       0 caused framework failures
    4479 were skipped

    2317 expected passes
      68 expected failures
       1 unexpected passes
      25 unexpected failures

Unexpected passes:
   quasiquotation  T5204 (normal)

Unexpected failures:
   cabal/cabal04             cabal04 [bad exit code] (normal)
   codeGen/should_run        cgrun025 [exit code non-0] (normal)
   codeGen/should_run        cgrun071 [bad exit code] (normal)
   deriving/should_run       T3087 [exit code non-0] (normal)
   driver                    5313 [exit code non-0] (normal)
   driver/recomp009          recomp009 [bad exit code] (normal)
   ghc-api/dynCompileExpr    dynCompileExpr [exit code non-0] (normal)
   ghci/linking              ghcilink001 [bad exit code] (normal)
   ghci/linking              ghcilink002 [bad exit code] (normal)
   ghci/linking              ghcilink003 [bad exit code] (normal)
   ghci/linking              ghcilink004 [bad exit code] (normal)
   ghci/linking              ghcilink005 [bad exit code] (normal)
   ghci/linking              ghcilink006 [bad exit code] (normal)
   lib/Concurrent            QSemN001 [bad exit code] (normal)
   lib/Regex                 regex003 [exit code non-0] (normal)
   perf/compiler             T4801 [stat too good] (normal)
   perf/should_run           3586 [exit code non-0] (normal)
   perf/should_run           T3736 [bad stderr] (normal)
   perf/space_leaks          space_leak_001 [stat not good enough] (normal)
   rts                       4850 [bad exit code] (normal)
   rts                       T2615 [exit code non-0] (normal)
   rts                       T5423 [bad stderr] (normal)
   safeHaskell/safeLanguage  SafeLang01 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang12 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang16 [stderr mismatch] (normal)

 sparc:

OVERALL SUMMARY for test run started at Tue Feb 14 09:32:35 UTC 2012
    3036 total tests, which gave rise to
    7795 test cases, of which
       0 caused framework failures
    5100 were skipped

    2617 expected passes
      44 expected failures
       0 unexpected passes
      34 unexpected failures

Unexpected failures:
   codeGen/should_run        cgrun025 [exit code non-0] (normal)
   codeGen/should_run        cgrun057 [bad exit code] (profasm)
   codeGen/should_run        cgrun071 [bad exit code] (normal)
   deriving/should_run       T3087 [exit code non-0] (normal)
   ghci/should_run           3171 [bad stdout] (normal)
   lib/Concurrent            QSemN001 [bad exit code] (normal)
   lib/Regex                 regex003 [exit code non-0] (normal)
   perf/compiler             T4801 [stat too good] (normal)
   perf/should_run           3586 [exit code non-0] (normal)
   perf/should_run           T3736 [bad stderr] (normal)
   perf/space_leaks          space_leak_001 [bad exit code] (normal)
   profiling/should_compile  prof001 [bad exit code] (normal)
   profiling/should_compile  prof002 [bad exit code] (normal)
   profiling/should_run      2592 [bad exit code] (profasm)
   profiling/should_run      5314 [bad exit code] (profasm)
   profiling/should_run      T2552 [bad exit code] (profasm)
   profiling/should_run      T3001 [bad exit code] (prof_hb)
   profiling/should_run      T3001-2 [bad exit code] (prof_hb)
   profiling/should_run      T5363 [bad exit code] (profasm)
   profiling/should_run      T5559 [bad exit code] (profasm)
   profiling/should_run      T680 [bad exit code] (profasm)
   profiling/should_run      T949 [bad exit code] (profasm)
   profiling/should_run      callstack001 [bad exit code] (profasm)
   profiling/should_run      callstack002 [bad exit code] (profasm)
   profiling/should_run      heapprof001 [bad exit code] (profasm)
   profiling/should_run      ioprof [bad exit code] (profasm)
   profiling/should_run      prof-doc-fib [bad exit code] (profasm)
   profiling/should_run      prof-doc-last [bad exit code] (profasm)
   profiling/should_run      scc001 [bad exit code] (profasm)
   profiling/should_run      scc002 [bad exit code] (profasm)
   profiling/should_run      scc003 [bad exit code] (profasm)
   rts                       4850 [bad exit code] (normal)
   rts                       T5423 [bad stderr] (normal)
   th                        TH_spliceE5_prof [bad exit code] (normal)

It seems most of the failures happing on non-IA-architectures are due to the missing support for Template Haskell, and tests not declaring this dependency properly.