[Twisted-Python] Running tests in parallel with trial

[Free Ekanayaka]

Hey,

|--==> On Tue, 10 Aug 2010 16:07:56 +0100, Jonathan Lange <jml at mumak.net> said:

  JL> On Tue, Aug 10, 2010 at 3:58 PM, Free Ekanayaka <free at 64studio.com> wrote:
  >>Hi,
  >>
  >>is there a way to tell trial run groups of tests in parallel in
  >>different processes? Something like the "-jN" option in zope-testrunner.
  >>
  >>Or alternatively, what's the recommended way to make better use of
  >>multi-core CPUs when running a test suite with trial?
  >>

  JL> In short, no. There's a longstanding ticket about doing this:
  JL> http://twistedmatrix.com/trac/ticket/1784.

Thanks for the pointer, it looks very promising.

  JL> It would be pretty easy to kludge something together that worked for
  JL> parallelizing across cores if you're willing to sacrifice the debugger
  JL> support and a bunch of the other advanced things that disttrial aim to
  JL> achieve.
  JL>   * Add a way for trial to run tests based off a list of FQPNs in a
  JL> file, say, --from-list
  JL>   * Write something that does:
  JL>     * trial --reporter=subunit --dry-run | subunit-ls > all-tests
  JL>     * split all-tests into N sublists however you fancy
  JL>     * trial --reporter=subunit --from-list=sublistN
  JL>     * Then something that aggregates those subunit streams into a real report.

That would be indeed easy, and probably acceptable while waiting for
disttrial to get its way into Twisted trunk.

Cheers,

Free