aboutsummaryrefslogtreecommitdiff
path: root/buildbot_test_llvm.py
AgeCommit message (Collapse)Author
2018-05-25toolchain_utils: Use external chrome source tree for telemetry.Caroline Tice
When generating the nightly performance tests, specify an external Chrome source tree, since Chrome sync'ing is broken inside Chrome OS. Also remove unnecessary code that references a file that no longer exists. BUG=chromium:846508 TEST=Successfully ran nightly tests with these changes on Chrotomation2. Change-Id: I1cba94f82ad6ffb39c941a5dc3cb8f95cb833d20 Reviewed-on: https://chromium-review.googlesource.com/1072870 Commit-Ready: ChromeOS CL Exonerator Bot <chromiumos-cl-exonerator@appspot.gserviceaccount.com> Tested-by: Caroline Tice <cmtice@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2018-04-20[toolchain-utils] Update waterfall reports.Caroline Tice
This CL updates the waterfall reports to use the results of 'cros buildresult' and the new URLS. It removes the attempts to track individual test failures, as the new URL system no longer allows that. BUG=chromium:829648 TEST=launched reports from my directory. They worked fine. Tested buildbot_test_llvm.py changes with mobiletc-prebuild on chrotomation2. Change-Id: I12cf97c7960b032ec3caca636fe349f564369378 Reviewed-on: https://chromium-review.googlesource.com/1021990 Commit-Ready: Caroline Tice <cmtice@chromium.org> Tested-by: Caroline Tice <cmtice@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2018-04-19toolchain-utils: Replace kahlee by grunt.Manoj Gupta
kahlee has been superseded by grunt. BUG=None TEST=None Change-Id: Iebdb0c4d75b1b4cf49605b3f71150245487894c0 Reviewed-on: https://chromium-review.googlesource.com/1017819 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Yunlian Jiang <yunlian@chromium.org>
2018-04-16[toolchain-utils] Remove --remote-description flag.Caroline Tice
The cros tryjob command no longer recognizes this flag so we need to remove it from our scripts. BUG=chromium:833542 TEST=Tested with launching the rotating builders on chrotomation2. Change-Id: Ifcf62ae7073d84a9f58e12c29dcce5cdf9108e9f Reviewed-on: https://chromium-review.googlesource.com/1014369 Commit-Ready: Caroline Tice <cmtice@chromium.org> Tested-by: Caroline Tice <cmtice@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2018-03-15toolchain testing: Switch to different boards with better availability.Manoj Gupta
Replace some testing boards with other boards in same platform that have better availability in pool:suites. BUG=chromium:815357 TEST=None Change-Id: Icf89f00462479b5b34695442995fe5f3e3776ebd Reviewed-on: https://chromium-review.googlesource.com/964702 Commit-Queue: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Trybot-Ready: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Rahul Chaudhry <rahulchaudhry@chromium.org>
2018-03-09cros_utils/buildbot_utils: leverage `cros buildresult`Ting-Yuan Huang
Originally it sends a http request to some magic URL and parse the contents. Now there is a `cros buildresult` available for use. BUG=chromium:807029 TEST=cros_utils/buildbot_utils_unittest.py buildbot_test_toolchains.py Change-Id: I33441859afd675c1a6b70d3d1f4e2348d54cbd77 Reviewed-on: https://chromium-review.googlesource.com/954052 Commit-Ready: Ting-Yuan Huang <laszio@chromium.org> Tested-by: Ting-Yuan Huang <laszio@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org>
2018-03-08Remove lumpy from rotating builders.Caroline Tice
The buildbot configs have removed lumpy completely, so we should no longer try to run it in our rotating builders. BUG=chromium:820195 TEST=None Change-Id: I72191588cd53dfc515186c26b433b2a51984fda1 Reviewed-on: https://chromium-review.googlesource.com/955901 Commit-Ready: Caroline Tice <cmtice@chromium.org> Tested-by: Caroline Tice <cmtice@chromium.org> Reviewed-by: Yunlian Jiang <yunlian@chromium.org>
2018-01-30buildbot_test_llvm: update information about rotating boards.Rahul Chaudhry
Added information for boards that are tested by llvm-next-toolchain builders. Fixed architecture for kevin. Updated kernel version for various boards. Fixed table alignment. BUG=None TEST=None Change-Id: Ie23a2c9495787296a2da34562eaea9e2949b7047 Reviewed-on: https://chromium-review.googlesource.com/894269 Commit-Ready: Rahul Chaudhry <rahulchaudhry@chromium.org> Tested-by: Rahul Chaudhry <rahulchaudhry@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2018-01-25toolchain: Add guado_moblab to rotating builders.Manoj Gupta
Add guado_moblab to rotating builders testing. Increase daily testing jobs to 4. BUG=None TEST=guado_moblab-llvm-next-toolchain-tryjob is created. Change-Id: Iaa46c912bc0f2263d6390ef6be97a8a69e7408cd Reviewed-on: https://chromium-review.googlesource.com/887423 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org>
2018-01-23toolchain: Add more boards to rotating builders.Manoj Gupta
Add fizz and zoombini boards to rotating builders testing. BUG=None TEST=fizz-llvm-toolchain-tryjob job is created. Change-Id: Ib985a53b8a96595877801a970efea5544f797c22 Reviewed-on: https://chromium-review.googlesource.com/881701 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org>
2018-01-16toolchain: Add kahlee board to nightly llvm tests.Manoj Gupta
Kahlee is a new board using AMD stoney ridge platform. BUG=None TEST=Kahlee-llvm-toolchain-tryjob job is created. Change-Id: I2c04c482d63ba2bc1cb79ded4402a69618b4f2dc Reviewed-on: https://chromium-review.googlesource.com/869171 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org>
2017-11-27Add '-tryjob' suffix to build name.Yunlian Jiang
We got some errors like These configs are not tryjob safe: link-llvm-next-toolchain Consider these configs instead: link-llvm-next-toolchain-tryjob when lauching tryjobs to get the image. This CL fixes that. BUG=none TEST=The build name is changed. Change-Id: I56ef66dfb1071367b78ee8a7335552cdae5a5b44 Reviewed-on: https://chromium-review.googlesource.com/791391 Commit-Ready: Yunlian Jiang <yunlian@chromium.org> Tested-by: Yunlian Jiang <yunlian@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org>
2017-11-07[toolchain-utils] Fix security issue.Caroline Tice
Remove the chromeos-toolchain-credentials.json file, which should not be in a publicly visible repo. Update the buildbot_test_* scripts to take an argument for the directory containing the credentials file. Update the buildbot_utils.py file to use the credentials file argument, and to default to the location in our role account. BUG=782452 TEST=With some code commented out, did basic testing of flag/options to make sure they work as expected. Change-Id: I47a98a69b9ba8d2704d25abc37fe4447fa6ba343 Reviewed-on: https://chromium-review.googlesource.com/757901 Commit-Ready: Caroline Tice <cmtice@chromium.org> Tested-by: Caroline Tice <cmtice@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2017-09-29Rotating builders: s/reef/pyro and s/squawks/swanky/Manoj Gupta
Kernel team has rolled clang based kernel on kevin/pyro/swanky boards. We should update rotating builders to match this and catch any kernel related issues in llvm-next testing. CQ-DEPEND=CL:692633 BUG=chromium:770267 TEST=jobs are launched. Change-Id: If9f713193ec25cd0e13d7df369f09733e66ef247 Reviewed-on: https://chromium-review.googlesource.com/693135 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org>
2017-08-16Switching from cbuildbot to cros tryjobTing-Yuan Huang
BUG=chromium:756100 TEST=buildbot_test_toolchains.py, buildbot_test_llvm.py Change-Id: Ie275b960afdb2ed7183a763302af70c3f2bc1092 Reviewed-on: https://chromium-review.googlesource.com/617404 Commit-Ready: Ting-Yuan Huang <laszio@chromium.org> Tested-by: Ting-Yuan Huang <laszio@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2017-08-15Update rotating builders list to match chromeos_config.Caroline Tice
Add 3 new boards and remove 2 redundant boards from the rotating builders list, to match the complete list for the rotating builders in chromeos_config. This should (currently) represent a complete list of platforms to test before toolchain upgrades. BUG=chromium:754803 CQ-DEPEND=CL:611486 TEST=None Change-Id: Idf8da7e1660e4ad3716fd813e46f7b3c62d0bf7a Reviewed-on: https://chromium-review.googlesource.com/612215 Commit-Ready: Caroline Tice <cmtice@chromium.org> Tested-by: Caroline Tice <cmtice@chromium.org> Reviewed-by: Rahul Chaudhry <rahulchaudhry@chromium.org>
2017-06-29Add 'lakitu' and 'whirlwind' to rotating builders.Caroline Tice
BUG=chromium:736862 TEST=Successfully ran trybots on lakitu-gcc-toolchain and whirlwind-llvm-toolchain builders. Change-Id: Icce7d18d2df0747d67f84c99ed233f910790ee4b Reviewed-on: https://chromium-review.googlesource.com/557279 Commit-Ready: Caroline Tice <cmtice@chromium.org> Tested-by: Caroline Tice <cmtice@chromium.org> Reviewed-by: Yunlian Jiang <yunlian@chromium.org>
2017-04-28Add reef board to rotating builders.Manoj Gupta
Add reef board and update caroline description. Change number of boards tested daily to 3. BUG=None Test=3 jobs send to cbuildbot (print only). Change-Id: I95e7d608b81c5358158c9e8f9d467fbcba74670e Reviewed-on: https://chromium-review.googlesource.com/490637 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org>
2017-03-09Update toolchain buildbot test scripts for llvm profile removal.Manoj Gupta
Missed a small change in last commit to buildbot scripts. BUG=chromium:699594 TEST=Verified by launching dummy jobs on chrotomation2. Change-Id: I770322ac769003a06d80ca3b001aecc2a3545abb Reviewed-on: https://chromium-review.googlesource.com/452639 Commit-Queue: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Trybot-Ready: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Yunlian Jiang <yunlian@chromium.org>
2017-03-08Update toolchain buildbot test scripts for llvm profile removal.Manoj Gupta
llvm profile is no longer required. Update buildbot test scripts accordingly. BUG=chromium:699594 TEST=Verified by launching dummy jobs on chrotomation2. Change-Id: Ife411414aedd427268b5c29310fa2b15457feb52 Reviewed-on: https://chromium-review.googlesource.com/451719 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org> Reviewed-by: Yunlian Jiang <yunlian@chromium.org>
2017-01-27add caroline and kevin boards to rotation builder.Yunlian Jiang
Bug=None Test=The boards are added. Change-Id: Ie8619c84c0e4d8377153d8c14e3b3f5f7a082723 Reviewed-on: https://chromium-review.googlesource.com/434118 Commit-Ready: Yunlian Jiang <yunlian@chromium.org> Tested-by: Yunlian Jiang <yunlian@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org>
2016-11-30[toolchain-utils] Space ARM rotating builds more evenly.Caroline Tice
This CL reorders the rotating builders to space the ARM builds out more evenly, and also adds more data about each board being built. BUG=None TEST=None Change-Id: Icf158a28b4b41689ec6031e8be37c537d5836dd8 Reviewed-on: https://chrome-internal-review.googlesource.com/308295 Commit-Ready: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Reviewed-by: Yunlian Jiang <yunlian@google.com>
2016-11-07[toolchain-utils] Update rotating testers to launch asynchronously.Caroline Tice
Currently the rotating testers launch one trybot job, then wait for it to finish (to get the trybot image name) before launching the second job. Now that all the testing happens directly in the buildbot HWTest stages, this waiting in not needed. This CL removes the synchronous waiting from the rotating testers. (Allows the two jobs to run in parallel). BUG=None TEST=None Change-Id: I6c96c684dc69b205b847b584b4bbc9e10cf5313f Reviewed-on: https://chrome-internal-review.googlesource.com/302137 Commit-Ready: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Reviewed-by: Yunlian Jiang <yunlian@google.com>
2016-10-18[toolchain-utils] Fix rotating builders to work with no patches.Caroline Tice
Currently if no patch is passed to cbuildbot, it hangs; similarly if no patch is given to the rotating builder script, it dies. This CL fixes both of those. It also temporarily stops the rotating builders from sending emails until we can figure out how to fix their reports. BUG=chromium:657060 TEST=Tested changes in role account;seemed to work. Change-Id: I4ba70b562f9cb44d396361cd6461230d7080c6e9 Reviewed-on: https://chrome-internal-review.googlesource.com/297584 Commit-Ready: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Reviewed-by: Caroline Tice <cmtice@google.com> Reviewed-by: Ting-Yuan Huang <laszio@google.com>
2016-10-10[toolchain-utils] Add --hwtest flag to rotating tester builds.Caroline Tice
The rotating testers need to add --hwtest to the trybot builds to get the hwtests to actually run. This CL adds that flag. BUG=None TEST=Tested in role account. Change-Id: I6ef93f529b6616dd8d1c357743593ed369d1022a Reviewed-on: https://chrome-internal-review.googlesource.com/295075 Commit-Ready: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Reviewed-by: Ting-Yuan Huang <laszio@google.com>
2016-10-06[toolchain-utils] Update rotating testers to use new configs.Caroline Tice
This CL updates the rotating testers to use the new chromes_configs for building trybots & running HW tests. BUG=chromium:653296 TEST=Ran scripts in my directory; it worked. Change-Id: Ia60af8b921a966c86b335ef51db5372bf740ed95 Reviewed-on: https://chrome-internal-review.googlesource.com/293775 Commit-Ready: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Reviewed-by: Yunlian Jiang <yunlian@google.com>
2016-09-22rotation_tester: use toolchain-tests instead of paygen_au_canaryYunlian Jiang
BUG=None TEST=it uses toolchain-tests now. Change-Id: I5b0e350e0fc0b365be5e65587b62e022f342338e Reviewed-on: https://chrome-internal-review.googlesource.com/289837 Commit-Ready: Yunlian Jiang <yunlian@google.com> Tested-by: Yunlian Jiang <yunlian@google.com> Reviewed-by: Caroline Tice <cmtice@google.com>
2016-09-14[crosperf] Don't run kernel test in llvm rotating testsers.Caroline Tice
Update the nightly rotating testers to not run the kernel tests for the LLVM images, since the kernel is not built with LLVM BUG=None TEST=None Change-Id: Ib2efe2211d6c9e86b80db2470c428d70e30e5516 Reviewed-on: https://chrome-internal-review.googlesource.com/286800 Commit-Ready: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Reviewed-by: Yunlian Jiang <yunlian@google.com>
2016-09-08[Crosperf] Fix typo & update boards.Caroline Tice
This CL fixes a typo in the rotating tester tests, and updates the board list. Also reformats script (using tc_pyformat). BUG=None TEST=None Change-Id: I0a21bd8fd9d20d5d7dcd49e3484201c1860d352f Reviewed-on: https://chrome-internal-review.googlesource.com/285456 Commit-Ready: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Reviewed-by: Yunlian Jiang <yunlian@google.com>
2016-07-25[crosperf] Change flags to cbuildbot.Caroline Tice
The command for cbuildbot it buildbot_utils had hardcoded the '--notests' options; this was right for the normal nightly jobs, but not for the rotating tests. This CL makes that option a variable, and also allows for users to be able to add other custom flags to their cbuildbot invocations. BUG=chromium:631149 TEST=none Change-Id: Ifd2abd42808d99a28c3f7860f67a2eb2c9cd0118 Reviewed-on: https://chrome-internal-review.googlesource.com/271005 Commit-Ready: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Reviewed-by: Yunlian Jiang <yunlian@google.com>
2016-07-25[toolchain-utils] Finish switching utils/ to cros_utils/.Caroline Tice
This CL finishes switching the subdirectory from 'utils' to 'cros_utils'. It changes all the remaining import statements to use 'cros_utils'; it removes the 'cros_utils' symlink, and it renames the 'utils' subdirectory to 'cros_utils'. BUG=chromium:568195 TEST=ran crosperf & binary search tool unittests. Change-Id: I7427f8bfb2ddac3a4b6108e46782039059684382 Reviewed-on: https://chrome-internal-review.googlesource.com/270396 Commit-Ready: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Reviewed-by: Cassidy Burden <cburden@google.com> Reviewed-by: Luis Lozano <llozano@chromium.org>
2016-07-18[crosperf] Separate output for different compilers.Caroline Tice
Currently the rotating nightly tester is writing all the test output to the same directory, based on board name, so the GCC & LLVM output files for a particular are overwriting each other. This CL puts the GCC & LLVM output into different directories so that won't happen. BUG=None TEST=None Change-Id: Ifc564a51bd0f44c9a701805975cbb64325074aab Reviewed-on: https://chrome-internal-review.googlesource.com/268335 Commit-Ready: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Reviewed-by: Ting-Yuan Huang <laszio@google.com>
2016-06-27[toolchain-utils] Update rotating tester to allow GCC tests, too.Caroline Tice
BUG=None TEST=Tested on chrotomation2 with role account. Change-Id: I232df188f05a13cdc59a53173b7c46f9b1b1b282 Reviewed-on: https://chrome-internal-review.googlesource.com/266966 Commit-Ready: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Reviewed-by: Luis Lozano <llozano@chromium.org>
2016-06-21Continue test if the test for one board failed.Yunlian Jiang
We run llvm validation test for several boards in a single script. During the test, if something goes wrong and it calls logger.LogFatal(), the whole test terminates because the LogFatal calls sys.exit() and it will terminate the whole script. This CL fixes that by catching the exception raised by sys.exit(). BUG=None TEST=the SystemExit exception is handled. Change-Id: I502361d4c55bf58c4c8106067768c17e94ce8631 Reviewed-on: https://chrome-internal-review.googlesource.com/265905 Commit-Ready: Yunlian Jiang <yunlian@google.com> Tested-by: Yunlian Jiang <yunlian@google.com> Reviewed-by: Caroline Tice <cmtice@google.com>
2016-06-16Add script for llvm validation test.Yunlian Jiang
This create a script for llvm validation test. BUG=none TEST=it lanches trybot, runs test and sends out email. Change-Id: I85c5c8d1d9cdd9229a766b2cd5c307bdd35fc970 Reviewed-on: https://chrome-internal-review.googlesource.com/264996 Commit-Ready: Yunlian Jiang <yunlian@google.com> Tested-by: Yunlian Jiang <yunlian@google.com> Reviewed-by: Caroline Tice <cmtice@google.com>
generated by cgit v1.2.3 (git 2.25.1) at 2024-07-06 15:52:34 +0000