aboutsummaryrefslogtreecommitdiff
path: root/buildbot_test_toolchains.py
AgeCommit message (Collapse)Author
2015-08-28Add a new option '--schedv2' so later invocation to crosperf uses the new ↵Han Shen
scheduler. This option is added to buildbot_test_toolchains.py & test_toolchains.py. TEST=None Change-Id: I8f31d0dd7b4b1db6af35759dd476f0f55e224366 Reviewed-on: https://chrome-internal-review.googlesource.com/228645 Commit-Ready: Han Shen <shenhan@google.com> Tested-by: Han Shen <shenhan@google.com> Reviewed-by: Caroline Tice <cmtice@google.com>
2015-08-26buildbot_test_toolchains.py: small refactoring.Yunlian Jiang
This is some refactoring of this script. It only copy to weeking report if the board is lumpy, which is the only board that we report weekly result. BUG=none TEST=tested manually on mobiletc-prebuild. It does not die at begining. Change-Id: Ib270e96ff2328030f316f9388cb43db97378da62 Reviewed-on: https://chrome-internal-review.googlesource.com/227832 Commit-Ready: Yunlian Jiang <yunlian@google.com> Tested-by: Yunlian Jiang <yunlian@google.com> Reviewed-by: Caroline Tice <cmtice@google.com>
2015-08-24buildbot_test_toolchains: fix a typoYunlian Jiang
BUG=none TEST=it runs with a patch parameter. Change-Id: I08437d0ec47ef27a3b88930358f3c149fd955cdc Reviewed-on: https://chrome-internal-review.googlesource.com/227861 Reviewed-by: Han Shen <shenhan@google.com> Commit-Queue: Yunlian Jiang <yunlian@google.com> Tested-by: Yunlian Jiang <yunlian@google.com>
2015-08-21buildbot_test_toolchains: fix several errorsYunlian Jiang
This fixes some errors introduced by previous patch. BUG=none TEST=the script is running fine on chrotomation2 Change-Id: Id6b49941aef5f5c8902dae9dfeefe2acc51ef310 Reviewed-on: https://chrome-internal-review.googlesource.com/227840 Reviewed-by: Caroline Tice <cmtice@google.com> Commit-Queue: Yunlian Jiang <yunlian@google.com> Tested-by: Yunlian Jiang <yunlian@google.com>
2015-08-21buildbot_test_toolchains: make patch number a parameter.Yunlian Jiang
We want to use the buildbot_test_toolchains.py to measure the performance gap between gcc and clang. So we need a different patch to create the image built with clang. BUG=none TEST=buildbot_test_toolchains.py now accepts --patch Change-Id: I45dfd79630cea217bc6134802270c6e13b4121c1 Reviewed-on: https://chrome-internal-review.googlesource.com/227806 Reviewed-by: Caroline Tice <cmtice@google.com> Commit-Queue: Yunlian Jiang <yunlian@google.com> Tested-by: Yunlian Jiang <yunlian@google.com>
2015-08-20Finish removing temporary workaround.Caroline Tice
Chrome in ChromeOS chroot for nightly buildbot tests now has a good version of telemetry, so we can remove the temporary workaround for the buildbots. BUG=None TEST=Ran telemetry by hand inside chroot & crosperf outside chroot. Change-Id: I38db7d9a2f427df3cc29418bc866d236e213247b Reviewed-on: https://chrome-internal-review.googlesource.com/227608 Commit-Queue: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Reviewed-by: Yunlian Jiang <yunlian@google.com>
2015-08-12Temporarily use good external Chrome source tree.Caroline Tice
This is to work around a problem with the current version of Chrome inside ChromeOS (telemetry is broken in that version of Chrome). This CL makes the nightly tests use an external Chrome source tree that has been verified to work properly. This will be un-done, once ChromeOS gets a good version of Chrome. BUG=None TEST=Tested crosperf on chrotomation2 using this. Change-Id: I41caef9bb1b1973c83745e3962a5c36c489d7514 Reviewed-on: https://chrome-internal-review.googlesource.com/226695 Reviewed-by: Luis Lozano <llozano@chromium.org> Commit-Queue: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2015-06-30Update all_toolchain_perf to use new recommended set.cmtice
Update the all_toolchain_perf alias to use the new recommended set of tests. Also update the default test values to include default values for the newly recommended tests. Also update the nightly tests to use the newly recommended set. BUG=None TEST=Tested new alias with crosperf. Change-Id: I603f866723646a2d5b6d86fbe1de3c4617e09046 Reviewed-on: https://chrome-internal-review.googlesource.com/220385 Reviewed-by: Han Shen <shenhan@google.com> Tested-by: Caroline Tice <cmtice@google.com> Commit-Queue: Caroline Tice <cmtice@google.com>
2015-06-23Remove temporary workaround for nightly tests locking.cmtice
Due to issues with mobiletc-prebuild not being able to access the afe locking mechanisms, the nightly tests were temporarily using the old file locking mechanism. The issues with the role account using the afe locks has been resolved, so this CL reverts the nightly tests to using the afe machine locking mechanism. BUG=None TEST=Ran crosperf tests on chrotomation2 from role account using afe locking mechanism. Change-Id: I243c28d80718c2e98913ad49d50bf5b46ff82758 Reviewed-on: https://chrome-internal-review.googlesource.com/219905 Reviewed-by: Yunlian Jiang <yunlian@google.com> Commit-Queue: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com>
2015-06-17Add automatic retries to nightly testing.Luis Lozano
Used new "retries" crosperf functionality in our nightly testing. BUG=None TEST=None (already tested in crosperf side) Change-Id: I42b9d04ef690593485df825b2a3aa41b9e2f6cc3 Reviewed-on: https://chrome-internal-review.googlesource.com/219310 Reviewed-by: Han Shen <shenhan@google.com> Commit-Queue: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2015-06-12Update nightly tests to use old file locking mechanism for now.cmtice
There are some issue with the role account using the AFE server locking mechanism, so we will temporarily revert the nightly tests to use the old file locking mechanism. This CL depends on the CL that re-enables the file locking mechanism (with a new flag). BUG=None TEST=None CQ-DEPEND=CL:219096 Change-Id: If525e4fcf292d3c57aa9c69a1b796914bd6d434c Reviewed-on: https://chrome-internal-review.googlesource.com/219088 Reviewed-by: Yunlian Jiang <yunlian@google.com> Commit-Queue: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com>
2015-05-27Update nightly tests to use mail-sheriff program for reports.cmtice
This updates the nightly buildbot and local tester programs to tell crosperf to put its results in a special directory, and to not send email. After crosperf finishes, it looks for the email information in the special directory and sends out then email using the mail-sheriff program. BUG=None TEST=Currently running buildbot test. Will not commit the change until the test passes. Since the test takes several hours to run I wanted to put this out for review now. Change-Id: Idd3d137e4a6e144b677690fc6775580dfac56af1 Reviewed-on: https://chrome-internal-review.googlesource.com/217286 Reviewed-by: Luis Lozano <llozano@chromium.org> Commit-Queue: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com>
2015-04-24Make sure latest toolchains are build in non vanilla testing.Luis Lozano
Our non-vanilla testing builds with latest compiler but it was not using --latest_toolchain argument for cbuildbot. Also, did some minor cleanup. BUG=None TEST=None (will let it test in the nightly testing) Change-Id: I7316fcd8b9548f7038b110bdf6cd4f60714f41d2 Reviewed-on: https://chrome-internal-review.googlesource.com/214363 Commit-Queue: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Caroline Tice <cmtice@google.com>
2015-02-19Only tar chromiumos_test_image.bin file, instead of all files under images ↵Han Shen
directory. Change-Id: I27ca96a5e347de6d2e5ae280cfd37a7669056679 Reviewed-on: https://chrome-internal-review.googlesource.com/199736 Reviewed-by: Caroline Tice <cmtice@google.com> Commit-Queue: Han Shen <shenhan@google.com> Tested-by: Han Shen <shenhan@google.com>
2015-02-14Mark buildbot_test_toolchains.py, test_toolchains.py, and weekly_report.py ↵Rahul Chaudhry
executable. BUG=None TEST=None Change-Id: Ia49aef079414d7072a57dc14d9b0d99fa3a75d40 Reviewed-on: https://chrome-internal-review.googlesource.com/198670 Reviewed-by: Caroline Tice <cmtice@google.com> Commit-Queue: Rahul Chaudhry <rahulchaudhry@google.com> Tested-by: Rahul Chaudhry <rahulchaudhry@google.com>
2015-02-14Add date to job descriptions; wait for pending builds.cmtice
Previously if a trybot job got put into a pending queue rather than starting immediately, we didn't notice and would end up using the previous day's trybot image. This CL fixes that. BUG=None TEST=Ran successfully from role account. Change-Id: I3dd2cf1edd639e562fa78769c86c99e4c51f3a0b Reviewed-on: https://chrome-internal-review.googlesource.com/198610 Reviewed-by: Yunlian Jiang <yunlian@google.com> Reviewed-by: Caroline Tice <cmtice@google.com> Commit-Queue: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com>
2015-02-05Make fatal errors if trybot job fails or trybot image is empty.cmtice
Update GetTrybotImage to check the final trybot job status and return an error if the job did not have a success status. Also update the nightly buildbot test jobs to fail fatally if the trybot or vanilla image names are empty. BUG=None TEST=Tested this in role account. Change-Id: I17c4ca5fa77ea488c8bf3ae4e5c225b747c90c87 Reviewed-on: https://chrome-internal-review.googlesource.com/196095 Reviewed-by: Yunlian Jiang <yunlian@google.com> Commit-Queue: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com>
2014-12-18New script for using buildbots for nightly tests.cmtice
This script could eventually replace the current test_toolchains.py script. Instead of downloading and building ChromeOS locally, it launches a buildbot to build ChromeOS with the latest mobile toolchain compiler. It then downloads the trybot image (and the corresponding vanilla image), generates the crosperf experiment file, and launches crosperf. I have been running this as a second cron job on chrotomation2, running daisy tests, and it has been working just fine. BUG=None TEST=Ran in cron jobs on chrotomation2. Change-Id: I3b17d0373e2fae359fc8f4e0188dcec2943c7b71 Reviewed-on: https://chrome-internal-review.googlesource.com/187735 Reviewed-by: Caroline Tice <cmtice@google.com> Trybot-Ready: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Commit-Queue: Caroline Tice <cmtice@google.com>
generated by cgit v1.2.3 (git 2.25.1) at 2024-07-25 17:09:55 +0000