zero unexpected failures on all tier 1 platforms

[simonmar]

We're often sloppy about this, so I'm making a ticket to ensure we can tag a testsuite that has zero unexpected failures on all tier 1 platforms at release time.

That may mean filing more tickets and marking some tests as expected failures.

I'll take {x86_64,x86}/Linux.

[dterei]

On Linux x64 under 'optasm' and 'optllvm' I currently get the following failures:

OVERALL SUMMARY for test run started at Thu Jan 12 15:33:24 PST 2012
    3195 total tests, which gave rise to
   15839 test cases, of which
       0 caused framework failures
   14360 were skipped

    1442 expected passes
      19 had missing libraries
      17 expected failures
       0 unexpected passes
       1 unexpected failures

Unexpected failures:
   lib/Time  T5430 [bad stdout] (optasm)

where 'T5430' fails with:

=====> T5430(optasm) 1895 of 3195 [0, 0, 0]                                                                                                                                                                          
cd ./lib/Time && '/home/davidt/Ghc/head-next/inplace/bin/ghc-stage2' -fforce-recomp -dcore-lint -dcmm-lint -dno-debug-output -no-user-package-conf -rtsopts  -fno-ghci-history -o T5430 T5430.hs -O -fasm   >T5430.comp.stderr 2>&1
cd ./lib/Time && ./T5430    </dev/null >T5430.run.stdout 2>T5430.run.stderr
Actual stdout output differs from expected:
--- ./lib/Time/T5430.stdout   2011-11-16 15:50:57.665397562 -0800
+++ ./lib/Time/T5430.run.stdout  2012-01-12 15:37:50.188034971 -0800
@@ -1 +1 @@
-001
+365
*** unexpected failure for T5430(optasm)

[dterei]

OK I fixed T5430. Output on Linux x64 is good for me (under optasm, optllvm anyway).

[simonmar]

Here's the current list for x86/Windows. I'll try to squash as many of these as I can today:

Unexpected failures:
   ../../libraries/base/tests/Numeric  num009 [bad stdout] (normal,hpc,optasm,profasm,threaded1,threaded2,dyn,profthreaded)
   ../../libraries/base/tests/Numeric  num009 [bad stdout or stderr] (ghci)
   ../../libraries/directory/tests     createDirectoryIfMissing001 [bad exit code] (threaded2)
   ../../libraries/directory/tests     getDirContents002 [bad stdout or stderr] (ghci)
   ../../libraries/hpc/tests/function  subdir/tough2 [bad stdout] (normal,hpc,optasm,threaded1,threaded2,dyn)
   ../../libraries/hpc/tests/function  tough [bad stdout] (normal,hpc,optasm,profasm,threaded1,threaded2,dyn,profthreaded)
   ../../libraries/hpc/tests/simple    hpc001 [bad stdout] (normal,hpc,optasm,profasm,threaded1,threaded2,dyn,profthreaded)
   ../../libraries/process/tests       process004 [bad stdout or stderr] (ghci)
   concurrent/should_run               3429 [bad exit code] (threaded1,threaded2,profthreaded)
   concurrent/should_run               conc036 [bad stdout] (normal)
   concurrent/should_run               foreignInterruptible [bad exit code] (ghci,threaded1,threaded2)
   driver                              5313 [bad exit code] (dyn)
   dynlibs                             T4464 [bad stderr] (normal)
   ghc-api/dynCompileExpr              dynCompileExpr [bad exit code] (dyn)
   ghci/linking                        ghcilink004 [bad exit code] (normal)
   ghci/linking                        ghcilink005 [bad exit code] (normal)
   lib/IO                              T4113 [bad stdout] (normal,hpc,optasm,profasm,threaded1,threaded2,dyn,profthreaded)
   lib/IO                              T4113 [bad stdout or stderr] (ghci)
   lib/should_run                      stableptr003 [bad stdout] (dyn)
   numeric/should_run                  numrun012 [bad stdout or stderr] (ghci)
   perf/compiler                       T4801 [stat not good enough] (normal)
   programs/barton-mangler-bug         barton-mangler-bug [exit code non-0] (dyn)
   rts                                 derefnull [bad exit code] (ghci)
   rts                                 derefnull [bad profile] (profasm,profthreaded)
   rts                                 divbyzero [bad exit code] (ghci)
   rts                                 divbyzero [bad profile] (profasm,profthreaded)
   typecheck/should_fail               T5300 [stderr mismatch] (normal)

[simonmar]

FYI, at 7.4.1 the status was

x86_64/Linux: zero

x86/Linux:

   ../../libraries/base/tests  CPUTime001 [bad stdout] (threaded2)
   rts                         5250 [bad exit code] (optllvm)

x86/Windows:

   ../../libraries/hpc/tests/function  subdir/tough2 [bad stdout] (normal,hpc,optasm,threaded1,threaded2,dyn)
   ../../libraries/hpc/tests/function  tough [bad stdout] (normal,hpc,optasm,profasm,threaded1,threaded2,dyn,profthreaded)
   ../../libraries/hpc/tests/simple    hpc001 [bad stdout] (normal,hpc,optasm,profasm,threaded1,threaded2,dyn,profthreaded)
   driver                              5313 [bad exit code] (dyn)
   dynlibs                             T4464 [bad stderr] (normal)
   ghc-api/dynCompileExpr              dynCompileExpr [bad exit code] (dyn)
   ghci/linking                        ghcilink004 [bad exit code] (normal)
   ghci/linking                        ghcilink005 [bad exit code] (normal)
   lib/IO                              T4113 [bad stdout] (normal,hpc,optasm,profasm,threaded1,threaded2,dyn,profthreaded)
   lib/IO                              T4113 [bad stdout or stderr] (ghci)
   lib/should_run                      stableptr003 [bad stdout] (dyn)
   programs/barton-mangler-bug         barton-mangler-bug [exit code non-0] (dyn)
   rts                                 derefnull [bad exit code] (ghci)
   rts                                 derefnull [bad profile] (profasm,profthreaded)
   rts                                 divbyzero [bad exit code] (ghci)
   rts                                 divbyzero [bad profile] (profasm,profthreaded)
   typecheck/should_fail               T5300 [stderr mismatch] (normal)

x86/OSX and x86_64/OSX: anyone have results for these?

[igloo]

x86/OS X:

OVERALL SUMMARY for test run started at Thu Feb  9 20:52:42 GMT 2012
    3160 total tests, which gave rise to
   13550 test cases, of which
       0 caused framework failures
    2679 were skipped

   10392 expected passes
     453 expected failures
       0 unexpected passes
      26 unexpected failures

Unexpected failures:
   ../../libraries/base/tests/Numeric  num010 [bad exit code] (ghci)
   ../../libraries/unix/tests          signals002 [bad exit code] (ghci)
   ../../libraries/unix/tests          signals004 [bad exit code] (ghci,threaded1,threaded2,profthreaded)
   driver/objc                         objc-hi [bad profile] (profthreaded)
   driver/objc                         objc-hi [bad heap profile] (profasm)
   driver/objc                         objcpp-hi [bad profile] (profthreaded)
   driver/objc                         objcpp-hi [bad heap profile] (profasm)
   lib/IO                              T4113 [bad stdout] (normal,hpc,optasm,profasm,threaded1,threaded2,dyn,profthreaded)
   lib/IO                              T4113 [bad stdout or stderr] (ghci)
   numeric/should_run                  arith005 [bad exit code] (ghci)
   perf/compiler                       T1969 [stat not good enough] (normal)
   rts                                 derefnull [bad profile] (profasm,profthreaded)
   rts                                 divbyzero [bad profile] (profasm,profthreaded)
   typecheck/should_fail               T5300 [stderr mismatch] (normal)

amd64/OSX:

OVERALL SUMMARY for test run started at Thu Feb  9 21:04:22 GMT 2012
    3160 total tests, which gave rise to
   13550 test cases, of which
       0 caused framework failures
    2672 were skipped

   10413 expected passes
     448 expected failures
       0 unexpected passes
      17 unexpected failures

Unexpected failures:
   ../../libraries/process/tests  process007 [bad exit code] (ghci)
   ../../libraries/unix/tests     signals002 [bad exit code] (ghci)
   ../../libraries/unix/tests     signals004 [bad exit code] (ghci,threaded1,threaded2,profthreaded)
   driver/objc                    objc-hi [bad profile] (profthreaded)
   driver/objc                    objc-hi [bad heap profile] (profasm)
   driver/objc                    objcpp-hi [bad profile] (profthreaded)
   driver/objc                    objcpp-hi [bad heap profile] (profasm)
   ghci.debugger/scripts          break011 [bad stderr] (ghci)
   perf/space_leaks               space_leak_001 [bad exit code] (ghci)
   rts                            derefnull [bad profile] (profasm,profthreaded)
   rts                            divbyzero [bad profile] (profasm,profthreaded)
   typecheck/should_fail          T5300 [stderr mismatch] (normal)

[nomeata]

Here are the unexpected failures on Debian, amd64, 7.4.1 with the released testsuite, FAST mode:

OVERALL SUMMARY for test run started at Mon Feb 13 20:16:45 UTC 2012
    3036 total tests, which gave rise to
   12716 test cases, of which
       0 caused framework failures
    9956 were skipped

    2714 expected passes
      42 expected failures
       0 unexpected passes
       4 unexpected failures

Unexpected failures:
   codeGen/should_run   cgrun025 [exit code non-0] (normal)
   deriving/should_run  T3087 [exit code non-0] (normal)
   lib/Concurrent       QSemN001 [bad exit code] (normal)
   lib/Regex            regex003 [exit code non-0] (normal)

=====> cgrun025(normal) 2613 of 3036 [0, 2, 0]
cd ./codeGen/should_run && '/usr/bin/ghc' -fforce-recomp -dcore-lint -dcmm-lint -dno-debug-output -no-user-package-conf -rtsopts  -fno-ghci-history -o cgrun025 cgrun025.hs  -package regex-compat  >cgrun025.comp.stderr 2>&1
Compile failed (status 256) errors were:

cgrun025.hs:8:8:
    Could not find module `Maybe'
    It is a member of the hidden package `haskell98-2.0.0.1'.
    Use -v to see a list of the files searched for.

*** unexpected failure for cgrun025(normal)


=====> T3087(normal) 2967 of 3036 [0, 3, 0]
cd ./deriving/should_run && '/usr/bin/ghc' -fforce-recomp -dcore-lint -dcmm-lint -dno-debug-output -no-user-package-conf -rtsopts  -fno-ghci-history -o T3087 T3087.hs  -package syb  >T3087.comp.stderr 2>&1
Compile failed (status 256) errors were:
[1 of 1] Compiling Main             ( T3087.hs, T3087.o )

T3087.hs:28:19:
    Ambiguous occurrence `ext2Q'
    It could refer to either `Main.ext2Q', defined at T3087.hs:20:1
                          or `Data.Generics.ext2Q',
                             imported from `Data.Generics' at T3087.hs:5:1-20
                             (and originally defined in `Data.Generics.Aliases')

T3087.hs:31:20:
    Ambiguous occurrence `ext2Q'
    It could refer to either `Main.ext2Q', defined at T3087.hs:20:1
                          or `Data.Generics.ext2Q',
                             imported from `Data.Generics' at T3087.hs:5:1-20
                             (and originally defined in `Data.Generics.Aliases')

*** unexpected failure for T3087(normal)



=====> QSemN001(normal) 1494 of 3036 [0, 0, 0]
cd ./lib/Concurrent && '/usr/bin/ghc' -fforce-recomp -dcore-lint -dcmm-lint -dno-debug-output -no-user-package-conf -rtsopts  -fno-ghci-history -o QSemN001 QSemN001.hs  -package QuickCheck  >QSemN001.comp.stderr 2>&1
cd ./lib/Concurrent && ./QSemN001    </dev/null >QSemN001.run.stdout 2>QSemN001.run.stderr
Wrong exit code (expected 0 , actual 1 )
Stdout:

Stderr:
QSemN001: user error (newQSemN: Initial quantity must be non-negative)

*** unexpected failure for QSemN001(normal)

=====> regex003(normal) 1563 of 3036 [0, 1, 0]
cd ./lib/Regex && '/usr/bin/ghc' -fforce-recomp -dcore-lint -dcmm-lint -dno-de
bug-output -no-user-package-conf -rtsopts  -fno-ghci-history -o regex003 regex
003.hs  -package regex-posix  >regex003.comp.stderr 2>&1
Compile failed (status 256) errors were:
[1 of 1] Compiling Main             ( regex003.hs, regex003.o )

regex003.hs:7:12:
    Non type-variable argument
      in the constraint: RegexContext Regex String target
    (Use -XFlexibleContexts to permit this)
    In the type signature for `x':
      x :: RegexContext Regex String target => target
    In the expression:
      let
        x :: RegexContext Regex String target => target
        x = ("abaca" =~ B.pack "(.)a")
        x' :: (RegexContext Regex String target, Monad m) => m target
        ....
      in
        do { print (x :: Bool);
             print (x :: Int);
             print (x :: [MatchArray]);
             .... }
    In an equation for `main':
        main
          = let
              x :: RegexContext Regex String target => target
              x = ("abaca" =~ B.pack "(.)a")
              ....
            in
              do { print (x :: Bool);
                   print (x :: Int);
                   .... }

regex003.hs:11:12:
    Non type-variable argument
      in the constraint: RegexContext Regex B.ByteString target
    (Use -XFlexibleContexts to permit this)
    In the type signature for `y':
      y :: RegexContext Regex B.ByteString target => target
    In the expression:
      let
        x :: RegexContext Regex String target => target
        x = ("abaca" =~ B.pack "(.)a")
        x' :: (RegexContext Regex String target, Monad m) => m target
        ....
      in
        do { print (x :: Bool);
             print (x :: Int);
             print (x :: [MatchArray]);
             .... }
    In an equation for `main':
        main
          = let
              x :: RegexContext Regex String target => target
              x = ("abaca" =~ B.pack "(.)a")
              ....
            in
              do { print (x :: Bool);
                   print (x :: Int);
                   .... }
regex003.hs:13:12:
    Non type-variable argument
      in the constraint: RegexContext Regex B.ByteString target
    (Use -XFlexibleContexts to permit this)
    In the type signature for y':
      y' :: (RegexContext Regex B.ByteString target, Monad m) => m target
    In the expression:
      let
        x :: RegexContext Regex String target => target
        x = ("abaca" =~ B.pack "(.)a")
        x' :: (RegexContext Regex String target, Monad m) => m target
        ....
      in
        do { print (x :: Bool);
             print (x :: Int);
             print (x :: [MatchArray]);
             .... }
    In an equation for `main':
        main
          = let
              x :: RegexContext Regex String target => target
              x = ("abaca" =~ B.pack "(.)a")
              ....
            in
              do { print (x :: Bool);
                   print (x :: Int);
                   .... }

*** unexpected failure for regex003(normal)

[nomeata]

Now most other Debian arches have build the testsuite ( https://buildd.debian.org/status/package.php?p=ghc-testsuite), here are the results:

 kfreebsd-amd64:

OVERALL SUMMARY for test run started at Tue Feb 14 11:44:16 UTC 2012
    3036 total tests, which gave rise to
   11974 test cases, of which
       0 caused framework failures
    9215 were skipped

    2706 expected passes
      44 expected failures
       0 unexpected passes
       9 unexpected failures

Unexpected failures:
   cabal                ghcpkg01 [bad stderr] (normal)
   codeGen/should_run   cgrun025 [exit code non-0] (normal)
   deriving/should_run  T3087 [exit code non-0] (normal)
   lib/Concurrent       QSemN001 [bad exit code] (normal)
   lib/Regex            regex003 [exit code non-0] (normal)
   perf/compiler        T3064 [stat not good enough] (normal)
   rts                  derefnull [bad stderr] (normal)
   rts                  divbyzero [bad stderr] (normal)
   rts                  exec_signals [bad stdout] (normal)

 kfreebsd-i386:

OVERALL SUMMARY for test run started at Tue Feb 14 09:30:59 UTC 2012
    3036 total tests, which gave rise to
   11974 test cases, of which
       0 caused framework failures
    9216 were skipped

    2707 expected passes
      43 expected failures
       0 unexpected passes
       8 unexpected failures

Unexpected failures:
   cabal                ghcpkg05 [bad stderr] (normal)
   codeGen/should_run   cgrun025 [exit code non-0] (normal)
   deriving/should_run  T3087 [exit code non-0] (normal)
   lib/Concurrent       QSemN001 [bad exit code] (normal)
   lib/Regex            regex003 [exit code non-0] (normal)
   rts                  derefnull [bad stderr] (normal)
   rts                  divbyzero [bad stderr] (normal)
   rts                  exec_signals [bad stdout] (normal)

 mips:

OVERALL SUMMARY for test run started at Tue Feb 14 09:42:34 UTC 2012
    3035 total tests, which gave rise to
    6890 test cases, of which
       0 caused framework failures
    4479 were skipped

    2318 expected passes
      68 expected failures
       1 unexpected passes
      24 unexpected failures

Unexpected passes:
   quasiquotation  T5204 (normal)

Unexpected failures:
   cabal/cabal04             cabal04 [bad exit code] (normal)
   codeGen/should_run        cgrun025 [exit code non-0] (normal)
   deriving/should_run       T3087 [exit code non-0] (normal)
   driver                    5313 [exit code non-0] (normal)
   driver/recomp009          recomp009 [bad exit code] (normal)
   ghc-api/dynCompileExpr    dynCompileExpr [exit code non-0] (normal)
   ghci/linking              ghcilink001 [bad exit code] (normal)
   ghci/linking              ghcilink002 [bad exit code] (normal)
   ghci/linking              ghcilink003 [bad exit code] (normal)
   ghci/linking              ghcilink004 [bad exit code] (normal)
   ghci/linking              ghcilink005 [bad exit code] (normal)
   ghci/linking              ghcilink006 [bad exit code] (normal)
   lib/Concurrent            QSemN001 [bad exit code] (normal)
   lib/Regex                 regex003 [exit code non-0] (normal)
   perf/compiler             T4801 [stat too good] (normal)
   perf/should_run           3586 [exit code non-0] (normal)
   perf/should_run           T3736 [bad stderr] (normal)
   profiling/should_run      T5559 [bad heap profile] (profasm)
   rts                       4850 [bad exit code] (normal)
   rts                       T2615 [exit code non-0] (normal)
   rts                       T5423 [bad stderr] (normal)
   safeHaskell/safeLanguage  SafeLang01 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang12 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang16 [stderr mismatch] (normal)

 mipsel:

OVERALL SUMMARY for test run started at Wed Feb 15 13:53:55 UTC 2012
    3035 total tests, which gave rise to
    6890 test cases, of which
       0 caused framework failures
    4479 were skipped

    2319 expected passes
      68 expected failures
       1 unexpected passes
      23 unexpected failures

Unexpected passes:
   quasiquotation  T5204 (normal)

Unexpected failures:
   cabal/cabal04             cabal04 [bad exit code] (normal)
   codeGen/should_run        cgrun025 [exit code non-0] (normal)
   deriving/should_run       T3087 [exit code non-0] (normal)
   driver                    5313 [exit code non-0] (normal)
   driver/recomp009          recomp009 [bad exit code] (normal)
   ghc-api/dynCompileExpr    dynCompileExpr [exit code non-0] (normal)
   ghci/linking              ghcilink001 [bad exit code] (normal)
   ghci/linking              ghcilink002 [bad exit code] (normal)
   ghci/linking              ghcilink003 [bad exit code] (normal)
   ghci/linking              ghcilink004 [bad exit code] (normal)
   ghci/linking              ghcilink005 [bad exit code] (normal)
   ghci/linking              ghcilink006 [bad exit code] (normal)
   lib/Concurrent            QSemN001 [bad exit code] (normal)
   lib/Regex                 regex003 [exit code non-0] (normal)
   perf/compiler             T4801 [stat too good] (normal)
   perf/should_run           3586 [exit code non-0] (normal)
   perf/should_run           T3736 [bad stderr] (normal)
   rts                       4850 [bad exit code] (normal)
   rts                       T2615 [exit code non-0] (normal)
   rts                       T5423 [bad stderr] (normal)
   safeHaskell/safeLanguage  SafeLang01 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang12 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang16 [stderr mismatch] (normal)

 powerpc:

OVERALL SUMMARY for test run started at Tue Feb 14 09:22:58 UTC 2012
    3035 total tests, which gave rise to
   11065 test cases, of which
       0 caused framework failures
    8591 were skipped

    2381 expected passes
      68 expected failures
       1 unexpected passes
      24 unexpected failures

Unexpected passes:
   quasiquotation  T5204 (normal)

Unexpected failures:
   cabal/cabal04             cabal04 [bad exit code] (normal)
   codeGen/should_compile    massive_array [exit code non-0] (normal)
   codeGen/should_run        cgrun025 [exit code non-0] (normal)
   codeGen/should_run        cgrun071 [bad exit code] (normal)
   deriving/should_run       T3087 [exit code non-0] (normal)
   driver                    5313 [exit code non-0] (normal)
   driver/recomp009          recomp009 [bad exit code] (normal)
   ghc-api/dynCompileExpr    dynCompileExpr [exit code non-0] (normal)
   ghci/linking              ghcilink001 [bad exit code] (normal)
   ghci/linking              ghcilink002 [bad exit code] (normal)
   ghci/linking              ghcilink003 [bad exit code] (normal)
   ghci/linking              ghcilink004 [bad exit code] (normal)
   ghci/linking              ghcilink005 [bad exit code] (normal)
   ghci/linking              ghcilink006 [bad exit code] (normal)
   lib/Concurrent            QSemN001 [bad exit code] (normal)
   lib/Regex                 regex003 [exit code non-0] (normal)
   numeric/should_run        arith011 [bad exit code] (normal)
   perf/compiler             T1969 [stat not good enough] (normal)
   perf/compiler             T4801 [stat not good enough] (normal)
   rts                       T2615 [exit code non-0] (normal)
   rts                       divbyzero [bad exit code] (normal)
   safeHaskell/safeLanguage  SafeLang01 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang12 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang16 [stderr mismatch] (normal)

 s390:

OVERALL SUMMARY for test run started at Tue Feb 14 09:23:42 UTC 2012
    3035 total tests, which gave rise to
    6890 test cases, of which
       0 caused framework failures
    4479 were skipped

    2317 expected passes
      68 expected failures
       1 unexpected passes
      25 unexpected failures

Unexpected passes:
   quasiquotation  T5204 (normal)

Unexpected failures:
   cabal/cabal04             cabal04 [bad exit code] (normal)
   codeGen/should_run        cgrun025 [exit code non-0] (normal)
   codeGen/should_run        cgrun071 [bad exit code] (normal)
   deriving/should_run       T3087 [exit code non-0] (normal)
   driver                    5313 [exit code non-0] (normal)
   driver/recomp009          recomp009 [bad exit code] (normal)
   ghc-api/dynCompileExpr    dynCompileExpr [exit code non-0] (normal)
   ghci/linking              ghcilink001 [bad exit code] (normal)
   ghci/linking              ghcilink002 [bad exit code] (normal)
   ghci/linking              ghcilink003 [bad exit code] (normal)
   ghci/linking              ghcilink004 [bad exit code] (normal)
   ghci/linking              ghcilink005 [bad exit code] (normal)
   ghci/linking              ghcilink006 [bad exit code] (normal)
   lib/Concurrent            QSemN001 [bad exit code] (normal)
   lib/Regex                 regex003 [exit code non-0] (normal)
   perf/compiler             T4801 [stat too good] (normal)
   perf/should_run           3586 [exit code non-0] (normal)
   perf/should_run           T3736 [bad stderr] (normal)
   rts                       4850 [bad exit code] (normal)
   rts                       T2615 [exit code non-0] (normal)
   rts                       T5423 [bad stderr] (normal)
   rts                       testblockalloc [bad exit code] (normal)
   safeHaskell/safeLanguage  SafeLang01 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang12 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang16 [stderr mismatch] (normal)

 s390x:

OVERALL SUMMARY for test run started at Tue Feb 14 09:22:45 UTC 2012
    3035 total tests, which gave rise to
    6890 test cases, of which
       0 caused framework failures
    4479 were skipped

    2317 expected passes
      68 expected failures
       1 unexpected passes
      25 unexpected failures

Unexpected passes:
   quasiquotation  T5204 (normal)

Unexpected failures:
   cabal/cabal04             cabal04 [bad exit code] (normal)
   codeGen/should_run        cgrun025 [exit code non-0] (normal)
   codeGen/should_run        cgrun071 [bad exit code] (normal)
   deriving/should_run       T3087 [exit code non-0] (normal)
   driver                    5313 [exit code non-0] (normal)
   driver/recomp009          recomp009 [bad exit code] (normal)
   ghc-api/dynCompileExpr    dynCompileExpr [exit code non-0] (normal)
   ghci/linking              ghcilink001 [bad exit code] (normal)
   ghci/linking              ghcilink002 [bad exit code] (normal)
   ghci/linking              ghcilink003 [bad exit code] (normal)
   ghci/linking              ghcilink004 [bad exit code] (normal)
   ghci/linking              ghcilink005 [bad exit code] (normal)
   ghci/linking              ghcilink006 [bad exit code] (normal)
   lib/Concurrent            QSemN001 [bad exit code] (normal)
   lib/Regex                 regex003 [exit code non-0] (normal)
   perf/compiler             T4801 [stat too good] (normal)
   perf/should_run           3586 [exit code non-0] (normal)
   perf/should_run           T3736 [bad stderr] (normal)
   perf/space_leaks          space_leak_001 [stat not good enough] (normal)
   rts                       4850 [bad exit code] (normal)
   rts                       T2615 [exit code non-0] (normal)
   rts                       T5423 [bad stderr] (normal)
   safeHaskell/safeLanguage  SafeLang01 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang12 [stderr mismatch] (normal)
   safeHaskell/safeLanguage  SafeLang16 [stderr mismatch] (normal)

 sparc:

OVERALL SUMMARY for test run started at Tue Feb 14 09:32:35 UTC 2012
    3036 total tests, which gave rise to
    7795 test cases, of which
       0 caused framework failures
    5100 were skipped

    2617 expected passes
      44 expected failures
       0 unexpected passes
      34 unexpected failures

Unexpected failures:
   codeGen/should_run        cgrun025 [exit code non-0] (normal)
   codeGen/should_run        cgrun057 [bad exit code] (profasm)
   codeGen/should_run        cgrun071 [bad exit code] (normal)
   deriving/should_run       T3087 [exit code non-0] (normal)
   ghci/should_run           3171 [bad stdout] (normal)
   lib/Concurrent            QSemN001 [bad exit code] (normal)
   lib/Regex                 regex003 [exit code non-0] (normal)
   perf/compiler             T4801 [stat too good] (normal)
   perf/should_run           3586 [exit code non-0] (normal)
   perf/should_run           T3736 [bad stderr] (normal)
   perf/space_leaks          space_leak_001 [bad exit code] (normal)
   profiling/should_compile  prof001 [bad exit code] (normal)
   profiling/should_compile  prof002 [bad exit code] (normal)
   profiling/should_run      2592 [bad exit code] (profasm)
   profiling/should_run      5314 [bad exit code] (profasm)
   profiling/should_run      T2552 [bad exit code] (profasm)
   profiling/should_run      T3001 [bad exit code] (prof_hb)
   profiling/should_run      T3001-2 [bad exit code] (prof_hb)
   profiling/should_run      T5363 [bad exit code] (profasm)
   profiling/should_run      T5559 [bad exit code] (profasm)
   profiling/should_run      T680 [bad exit code] (profasm)
   profiling/should_run      T949 [bad exit code] (profasm)
   profiling/should_run      callstack001 [bad exit code] (profasm)
   profiling/should_run      callstack002 [bad exit code] (profasm)
   profiling/should_run      heapprof001 [bad exit code] (profasm)
   profiling/should_run      ioprof [bad exit code] (profasm)
   profiling/should_run      prof-doc-fib [bad exit code] (profasm)
   profiling/should_run      prof-doc-last [bad exit code] (profasm)
   profiling/should_run      scc001 [bad exit code] (profasm)
   profiling/should_run      scc002 [bad exit code] (profasm)
   profiling/should_run      scc003 [bad exit code] (profasm)
   rts                       4850 [bad exit code] (normal)
   rts                       T5423 [bad stderr] (normal)
   th                        TH_spliceE5_prof [bad exit code] (normal)

It seems most of the failures happing on non-IA-architectures are due to the missing support for Template Haskell, and tests not declaring this dependency properly.

[nomeata]

I ran the testsuite of 7.6.2-rc1 on amd64 and found these issues:

OVERALL SUMMARY for test run started at Sun Jan  6 10:53:49 UTC 2013
    3142 total tests, which gave rise to
   12420 test cases, of which
      10 caused framework failures
    9558 were skipped

    2798 expected passes
      13 had missing libraries
      34 expected failures
       0 unexpected passes
      17 unexpected failures

Unexpected failures:
   codeGen/should_run        cgrun025 [exit code non-0] (normal)
   deriving/should_run       T3087 [exit code non-0] (normal)
   ghci/scripts              ghci014 [bad stderr] (ghci)
   perf/compiler             T1969 [stat too good] (normal)
   perf/compiler             T6048 [stat not good enough] (optasm)
   safeHaskell/check/pkg01   ImpSafeOnly01 [exit code non-0] (normal)
   safeHaskell/check/pkg01   ImpSafeOnly02 [exit code non-0] (normal)
   safeHaskell/check/pkg01   ImpSafeOnly03 [stderr mismatch] (normal)
   safeHaskell/check/pkg01   ImpSafeOnly04 [exit code non-0] (normal)
   safeHaskell/check/pkg01   ImpSafeOnly05 [stderr mismatch] (normal)
   safeHaskell/check/pkg01   ImpSafeOnly06 [exit code non-0] (normal)
   safeHaskell/check/pkg01   ImpSafeOnly07 [stderr mismatch] (normal)
   safeHaskell/check/pkg01   ImpSafeOnly08 [stderr mismatch] (normal)
   safeHaskell/check/pkg01   ImpSafeOnly09 [stderr mismatch] (normal)
   safeHaskell/check/pkg01   ImpSafeOnly10 [exit code non-0] (normal)
   safeHaskell/check/pkg01   safePkg01 [bad exit code] (normal)
   typecheck/should_compile  tc191 [exit code non-0] (normal)

I’m attaching the full build log. Maybe zero failures will happen for 7.6.2?

[nomeata]

Test suite log of 7.6.2-rc1 on Debian, amd64