Review Stella provider and some questions

This is a support question so let's convert it to one

4. Where is the test result? (when we use checkbox, it is under ./home/usr/.checkbox)

Test result location is defined by the launcher (typically it is /tmp/submission.xml but it can be anything you want). Have a look at the laucher source code (/usr/bin/canonical-certification-client is a good example). Also look at https://code.launchpad.net/~sylvain-pineau/checkbox/ui_profiles/+merge/211490 for a short list of available launcher settings.

Internal data is stored in ~/.cache/plainbox/sessions/ but you should not typically need to use it directly.

3. If I close "Run manger" and then re-start it and select another whitelist. does the previous test result will be deleted? or the test result will be overwritten?

Currently we delete the previous testing session when you choose to start a new session. Technically this is not required and plainbox can store arbitrarily many sessions at the same time, tracking which were exported to a file, sent somewhere or ran all the desired tests (completed). Plainbox also knows which application created each session. Currently this data is not used in any way.

1. Could all project (sutton, hp, dell) use the same provider base and build different provider for different project and put to different ppa location?

You could use stable checkbox/plainbox/provider releases from one PPA and put other providers (and launchers) into either one big ppa or many small PPAs. You have total freedom in how you want to compose the final solution.

2. In "Run Manger", I can not see the sub test case under https://bazaar.launchpad.net/~oem-qa/oem-qa-checkbox/oem-plainbox/files/head:/jobs/stella/ and all stella test case did not run

https://bazaar.launchpad.net/~oem-qa/oem-qa-checkbox/oem-plainbox/files/head:/ is clearly wrong. You need to have all job files (either .txt or .txt.in) inside the jobs/ directory (not in jobs/something/). Run ./manage info and look at the list of jobs printed. Tweak the layout until you can see all your jobs by running 'manage.py info'

5. We use lazybone to install checkbox before, could we still use lazybone by modifying the config file to install plainbox?

Perhaps, I don't know anything about lazybone. If it can enable a PPA and install packages then the answer is yes.
Hide comment
Zygmunt Krynicki (zkrynicki) wrote 2 hours ago: #6

2. In "Run Manger", I can not see the sub test case under https://bazaar.launchpad.net/~oem-qa/oem-qa-checkbox/oem-plainbox/files/head:/jobs/stella/ and all stella test case did not run

With all the providers installed please also install plainbox (the package) and run:

$ plainbox dev analyze --print-desired-job-list --print-run-list -w /path/to/the/whitelist/you/want/to/run.whitelist

And look at the output. Check if there are any jobs you expected to see but aren't there. Currently we don't have any development aids that would find typos and other simple mistakes. This is tracked as bug https://bugs.launchpad.net/plainbox/+bug/1262251

https://bazaar.launchpad.net/~oem-qa/oem-qa-checkbox/oem-plainbox/files/head:/scripts/

You should rename that directory to 'launchers' and copy some of the launcher installation code from http://bazaar.launchpad.net/~checkbox-dev/checkbox/trunk/view/head:/providers/plainbox-provider-certification-client/manage.py