Ticket #632 (closed task: fixed)

Opened 6 years ago

Last modified 2 years ago

Make a 'fast' subset of the testsuite

Reported by: simonmar Owned by:
Priority: normal Milestone:
Component: None Version: 6.4.1
Keywords: Cc:
Operating System: Unknown/Multiple Architecture: Unknown/Multiple
Type of failure: Difficulty: Moderate (less than a day)
Test Case: Blocked By:
Blocking: Related Tickets:

Description

The testsuite takes a long time to run (usually over an hour, but depends on what "ways" are enabled).

It would be extremely useful to have a subset of the testsuite that runs far more quickly, and yet tests a large proportion of the "useful" tests. For example: omit all ways except normal, omit "programs", and pick a representative few from each of the test categories leaving out long-running tests. We pick a target of running the fast suite in, say, 2 minutes.

Change History

Changed 6 years ago by simonmar

  • difficulty set to Moderate (1 day)

Changed 6 years ago by simonmar

  • status changed from new to closed
  • resolution set to fixed

Done. I got it down to 4 minutes, which could probably be improved further.

Changed 3 years ago by simonmar

  • architecture changed from Unknown to Unknown/Multiple

Changed 3 years ago by simonmar

  • os changed from Unknown to Unknown/Multiple

Changed 2 years ago by simonmar

  • difficulty changed from Moderate (1 day) to Moderate (less than a day)
Note: See TracTickets for help on using tickets.