aboutsummaryrefslogtreecommitdiff
path: root/crosperf
AgeCommit message (Collapse)Author
2018-09-16Remove lumpy and parrot which eliminated from lab.Luis A. Lozano
BUG=none TEST=none Change-Id: I5c84f765e7a958e5d7055f850d7da8fa7203b384 Reviewed-on: https://chromium-review.googlesource.com/1227060 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2018-08-21crosperf: remove deprecated testsKuo-Hsin Yang
Remove the json grammar to parse the result for deprecated tests dromaeo.*, sunspider and and robohornet_pro. These tests are already removed from telemetry tests. BUG=chromium:867332 TEST=none Change-Id: I06e6e99b51181e30410000223aca1114641cace2 Reviewed-on: https://chromium-review.googlesource.com/1182715 Commit-Ready: Vovo Yang <vovoy@chromium.org> Tested-by: Vovo Yang <vovoy@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2018-07-06crosperf: remove smoothness.tough_webgl_casesTing-Yuan Huang
It is no longer available. TEST=none BUG=none Change-Id: I25437887ec2bd608ba90430a4753e4010ab8a2f5 Reviewed-on: https://chromium-review.googlesource.com/1128364 Commit-Ready: Ting-Yuan Huang <laszio@chromium.org> Tested-by: Ting-Yuan Huang <laszio@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Yunlian Jiang <yunlian@chromium.org>
2018-06-05update _estimated_stddev for speedometer2Yunlian Jiang
This updates _estimated_stddev for speedometer2. The value is collected by running speedometer2 on kevin and samus to get the maximum stddev/mean. BUG=chromium:849321 TEST=None Change-Id: If5efa962451a4f221eef4c33a408e88c7d3fee43 Reviewed-on: https://chromium-review.googlesource.com/1087347 Commit-Ready: Yunlian Jiang <yunlian@chromium.org> Tested-by: Yunlian Jiang <yunlian@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org>
2018-06-05add speedometer2 result formatYunlian Jiang
This adds the speedometer2 result format to default-telemetry-results.json. BUG=chromium:849321 TEST=run crosperf and it showed the result for speedometer2. Change-Id: I8b824b6c1739a032bb15a706cee96d1f45c444ab Reviewed-on: https://chromium-review.googlesource.com/1086292 Commit-Ready: Yunlian Jiang <yunlian@chromium.org> Tested-by: Yunlian Jiang <yunlian@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2018-06-02crosperf: add speedometer2 to toolchain perf tests.Rahul Chaudhry
BUG=None TEST=None Change-Id: I73a8893e892b2941ba1170b1606e4a17744265c5 Reviewed-on: https://chromium-review.googlesource.com/1082954 Commit-Ready: Rahul Chaudhry <rahulchaudhry@chromium.org> Tested-by: Rahul Chaudhry <rahulchaudhry@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org>
2018-05-04crosperf: Disable turbo only if enabled.Manoj Gupta
Write to no_turbo file only if the field is set to 0. BUG=chromium:839125 TEST=No more errors Change-Id: If5de67606557c21107843837afd035cf32545475 Reviewed-on: https://chromium-review.googlesource.com/1042866 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org>
2018-05-03crosperf: Ignore error when disabling turbo.Manoj Gupta
Some boards do not permit changing tubo config /sys/devices/system/cpu/intel_pstate/no_turbo Ignore the error for now so that tests can continue. Also update some formatting suggested by tc_format. BUG=chromium:839125 TEST=No more errors. Change-Id: I3a709ea2638d783dd3a3ebf70eba8a6dbc4df53a Reviewed-on: https://chromium-review.googlesource.com/1040773 Commit-Queue: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Trybot-Ready: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org>
2018-05-02toolchain-utils: Update list of toolchain boards.Manoj Gupta
Add the new boards to the list of toolchain boards so that their status can be queried. BUG=chromium:837973 TEST=None Change-Id: I9565b2d38d3e2c95f1c6b6564b148315e9d182f2 Reviewed-on: https://chromium-review.googlesource.com/1038438 Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org>
2018-04-10crosperf: filter result for jetstream and cros_ui_smoothnessYunlian Jiang
This CL removes most of data point for jetstream and cros_ui_smooothness benchmark from the final report of crosperf. It only keeps the summary numbers. BUG=none TEST=run crosperf, only summary data were shown for these two benchmarks. Change-Id: I4482e848700ee9555ad713a07095fe9db89f7747 Reviewed-on: https://chromium-review.googlesource.com/1003386 Commit-Ready: ChromeOS CL Exonerator Bot <chromiumos-cl-exonerator@appspot.gserviceaccount.com> Tested-by: Yunlian Jiang <yunlian@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2018-04-03crosperf: remove three benchmarks from test suiteYunlian Jiang
Three benchamrks were deleted in upstream, we need to remove them from our test suite. BUG=chromium:828463 TEST=uniitest passes. Change-Id: I5c92ca86217dc4bac79a75cba82dab4a793e0b3a Reviewed-on: https://chromium-review.googlesource.com/992879 Commit-Ready: Yunlian Jiang <yunlian@chromium.org> Tested-by: Yunlian Jiang <yunlian@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2018-03-08Replacing top_25_smooth with cros_ui_smoothness in crosperfKuo-Hsin Yang
top_25_smooth was replaced in CL:903246. BUG=chromium:818100 TEST=None Change-Id: I5bfe5659b06192237b0a985abb03b99139928e17 Reviewed-on: https://chromium-review.googlesource.com/954809 Commit-Ready: Vovo Yang <vovoy@chromium.org> Tested-by: Vovo Yang <vovoy@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Chung-yih Wang <cywang@google.com>
2018-03-07crosperf: restart ui instead of reboot machine.Yunlian Jiang
We restart machine to try to get a clean state for testing. But the restart beeping is anoying, as a workaround, we restart ui instead of reboot machine. BUG=None TEST=unittest passes. Change-Id: Idec234e86af661213206f954eda1fb0967c74024 Reviewed-on: https://chromium-review.googlesource.com/953864 Commit-Ready: Yunlian Jiang <yunlian@chromium.org> Tested-by: Yunlian Jiang <yunlian@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2018-01-29default_remotes: remove daisy devices that are out of service.Rahul Chaudhry
BUG=chromium:806365 TEST=None Change-Id: I5dc6b13ff184bb95dad8a4f37014d906a09a74dd Reviewed-on: https://chromium-review.googlesource.com/891661 Commit-Ready: Rahul Chaudhry <rahulchaudhry@chromium.org> Tested-by: Rahul Chaudhry <rahulchaudhry@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2017-11-30Remove droameo benchmarks from predefined sets.Luis A. Lozano
They were renamed (grouped) in chromium:777664 but, instead of using the new name, we are going to just remove them from the set. CWP data indicates these benchmarks are not representative. BUG=None TEST=None Change-Id: I034961d4f98eda0cb6ab7e706ac7309afbf23f69 Reviewed-on: https://chromium-review.googlesource.com/802714 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Ting-Yuan Huang <laszio@chromium.org>
2017-10-31Remove startup.cold.blank_page as Chrome perf team removed it.Dean Liao
startup.cold.blank_page was removed by Chrome perf team: https://chromium-review.googlesource.com/c/chromium/src/+/644107 https://bugs.chromium.org/p/chromium/issues/detail?id=575762&desc=2 BUG=chromium:779484 TEST=./run_tests.sh Change-Id: Ib4cd3c2eaed2f496b8e25ab286919895adaa7571 Reviewed-on: https://chromium-review.googlesource.com/742778 Commit-Ready: Shuo-Peng Liao <deanliao@chromium.org> Tested-by: Shuo-Peng Liao <deanliao@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2017-10-05crosperf: Add new keys used in page cycler benchmarks.Manoj Gupta
croperf wasn't able to generate reports for page cycler since the names of tracked keys have changed. BUG=chromium:770802 TEST=Crosperf shows the results again. Change-Id: I02561bf577a342d9a1f26ece19b011edbdf0776f Reviewed-on: https://chromium-review.googlesource.com/701260 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Yunlian Jiang <yunlian@chromium.org>
2017-09-29crosperf: Fix experiment_factory_unittest.Manoj Gupta
Remove x86-alex to fix crosperf unit tests. BUG=None TEST=crosperf unit tests pass. Change-Id: Ia494bb201272416b728cdd2c11d9bca712530b11 Reviewed-on: https://chromium-review.googlesource.com/693004 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Yunlian Jiang <yunlian@chromium.org>
2017-09-07crosperf: remove x86-alex machines from default_remotesYunlian Jiang
We are no longer using x86-alex machines, so we can remove them from default_remotes. This also fixes the nightly job Checking lab machines. BUG=None TEST=None Change-Id: I22e252e63b9f6f1cf46b1d5bb83c13af71fd8382 Reviewed-on: https://chromium-review.googlesource.com/655481 Commit-Ready: Yunlian Jiang <yunlian@chromium.org> Tested-by: Yunlian Jiang <yunlian@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org>
2017-07-27crosperf: remove duplicated benchmark in all_crosbolt_perfYunlian Jiang
This removes the duplicated benchmark video_PlaybackPerf.h264 in all_crosbolt_perf BUG=None TEST=the duplicated test was removed. Change-Id: Id4822fc1b82986cba2847b2e32ef825e90969c58 Reviewed-on: https://chromium-review.googlesource.com/590359 Commit-Ready: Yunlian Jiang <yunlian@chromium.org> Tested-by: Yunlian Jiang <yunlian@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2017-06-06Crosperf: Mark benchmark run as failed if it contains no results.Manoj Gupta
Sometimes telemetry tests do not fail but results are empty. In that case, mark the run as failed explicitly. BUG=chromium:729634 TEST=Tested manually on failing lummpy nightly tests. The generated report shows tests as failed as expected. Change-Id: Ia52af887e81ed630d7578f9abe93f9656c70512b Reviewed-on: https://chromium-review.googlesource.com/526392 Reviewed-by: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Commit-Queue: Manoj Gupta <manojgupta@chromium.org> Trybot-Ready: Manoj Gupta <manojgupta@chromium.org>
2017-05-17Fix results_organizer_unittest.pyCaroline Tice
Now that multiple iters inside a single run all report the correct pass/fail status, update the unittest to reflect that (is has been broken now for about a month). BUG=chromium:723807 TEST=ran unittest with fix and it passes now. Change-Id: Ie92034bbf073b73ce820f28c238f99192840197f Reviewed-on: https://chromium-review.googlesource.com/508277 Commit-Ready: Caroline Tice <cmtice@chromium.org> Tested-by: Caroline Tice <cmtice@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2017-04-08[crosperf] Fix status reporting for multiple iters inside a single run.Caroline Tice
If a single benchmark run contains multiple iterations (like BootPerfServer), then only the first internal iteration was getting the correct pass/fail status, so even though everything passed the report title would claim 1 pass and 9 fails (for 10 internal iterations). This fixes that. BUG=chromium:426960 TEST=Ran BootPerfServer with change. Now shows correct number of passes/fails for the iterations. Change-Id: I9638b39c94692fd754698e64d89cb22c10e9d479 Reviewed-on: https://chromium-review.googlesource.com/470547 Commit-Ready: Caroline Tice <cmtice@chromium.org> Tested-by: Caroline Tice <cmtice@chromium.org> Reviewed-by: George Burgess <gbiv@chromium.org> Reviewed-by: Yunlian Jiang <yunlian@chromium.org>
2017-04-08[toolchain-utils] Fix remaining lint errors in toolchain-utils.Caroline Tice
In addition to fixing the lint errors, this also fixes the Python formatting issues (ran tc_pyformat on nearly all the files). BUG=chromium:570450 TEST=Ran all crosperf & bisect tool unit tests. Ran afe_lock_machine.py (check machine status) Ran full crosperf test (octane, speedometer, BootPerf) on alex. Change-Id: Ic86f9192801ac67769f3de30f1c5f0d203ce0831 Reviewed-on: https://chromium-review.googlesource.com/471886 Commit-Ready: Caroline Tice <cmtice@chromium.org> Tested-by: Caroline Tice <cmtice@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2017-03-17Set scaling governor to performance in crosperf.Manoj Gupta
Elm seems to have stable numbers when only governor is set. Disable turbo is intel pstate thermal driver is used. Tested on squawks and lumpy. Includes some minor tc_pyformat changes. BUG=chromium:700190 TEST=Tested on elm, squawks, lumpy, kevin, falco and veyron_jaq. Change-Id: Ib368234b3bde5e54ff9b53ae3766e7384bd1df5f Reviewed-on: https://chromium-review.googlesource.com/454299 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org>
2017-03-14crosperf: update unittest for 8332364cTing-Yuan Huang
BUG=chromium:699645 TEST=./crosperf/setttings_factory_unittest.py Change-Id: Iedab40ce6d6cf4e272a080134730a175f769c4e7 Reviewed-on: https://chromium-review.googlesource.com/452540 Commit-Ready: Ting-Yuan Huang <laszio@chromium.org> Tested-by: Ting-Yuan Huang <laszio@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2017-03-10crosperf: make default iterations of benchmarks >= 2Ting-Yuan Huang
So as to get standard deviations, which are needed in ttest for p-value. TEST=none BUG=none Change-Id: If59fb46b62c0cb58610507962f8ca13ccc0b7d01 Reviewed-on: https://chromium-review.googlesource.com/452796 Commit-Ready: Ting-Yuan Huang <laszio@chromium.org> Tested-by: Ting-Yuan Huang <laszio@chromium.org> Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
2017-02-21crosperf: set recommended iterations for benchmarksTing-Yuan Huang
This CL associates estimated standard deviations to each benchmark, according to experiments. The recommended iterations can be specified by setting iterations = 0 in the experiment files. Setting it to numbers greater than 0 will override the default iterations and behaves exactly the same as before. With this change, benchmarks in all_toolchain_perf get no more than 2% margin of error within 90% of time. See crbug.com/673558 for how the standard deviations are estimated. BUG=chromium:673558 TEST=all_toolchain_perf + page_cycler_v2.typical_25 finishes in 3.5 hours for an image on chell. Change-Id: Ie2ed07878c1237ad31a8568ae3fd3fb96cd11f3b Reviewed-on: https://chromium-review.googlesource.com/424915 Commit-Ready: Ting-Yuan Huang <laszio@chromium.org> Tested-by: Ting-Yuan Huang <laszio@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org>
2017-01-24Fix frequency pinning on crosperf.Manoj Gupta
Crosperf was pinning frequency to maximum based on cpu0 information. This does not work as intended for arm Big-Little cores. Instead do it for each cpu based on its own information. BUG=chromium:680742 TEST=Tested on elm, kevin, falco, samus, peach_pit and veyron_jaq. Change-Id: I77fc76d8f1e94563fe12b3555bf08511fdbfdc32 Reviewed-on: https://chromium-review.googlesource.com/428186 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org>
2017-01-23remove perf binary from toolchain-utils.Yunlian Jiang
This reverts this CL https://chrome-internal-review.googlesource.com/#/c/157756/, because the bug in perf is gone. BUG=chromium:665988 TEST=run a crosperf with perf, the report report is correct. No 20-50% of the report attributed to 'chrome [unknown]'. run_test.sh passes. Change-Id: I4b2b18e9653d95bde5caf076114bf53a84c2a4fd Reviewed-on: https://chromium-review.googlesource.com/431234 Commit-Ready: Yunlian Jiang <yunlian@chromium.org> Tested-by: Yunlian Jiang <yunlian@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org>
2017-01-11Fix test_that run for non-telemtry tests.Manoj Gupta
Do not add the autotest_dir argument to test_that for non-telemetry tests. Minor change: Remove a leftover print from download_images unit test. BUG: chromium:679001 TEST:crosperf unit tests Change-Id: I0ff5365902af40097b61ae57d7c0d8d43ea308a8 Reviewed-on: https://chromium-review.googlesource.com/426073 Reviewed-by: Caroline Tice <cmtice@chromium.org> Commit-Queue: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Trybot-Ready: Manoj Gupta <manojgupta@chromium.org>
2017-01-11Fix some lint warning in suite_runner*.Luis A. Lozano
BUG=chromium:632113 TEST=run_tests Change-Id: I9fe070420153f5ae175db86961c95b1686ea7c8f Reviewed-on: https://chromium-review.googlesource.com/421107 Reviewed-by: Caroline Tice <cmtice@chromium.org> Commit-Queue: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2017-01-10crosperf: disable cheets benchmarks in crosboltTing-Yuan Huang
They have nothing to do with cros toolchain. TEST=none BUG=none Change-Id: Ie06ccd1cddf7233c55b52fd77e1329311fcff9d9 Reviewed-on: https://chromium-review.googlesource.com/426379 Trybot-Ready: Ting-Yuan Huang <laszio@chromium.org> Reviewed-by: Yunlian Jiang <yunlian@chromium.org> Commit-Queue: Ting-Yuan Huang <laszio@chromium.org> Tested-by: Ting-Yuan Huang <laszio@chromium.org>
2017-01-04Reduce cros_sdk calls in crosperf.Manoj Gupta
Improves crosperf performance by reducing calls to ChrootRunCommand, Instead use RunCommand. BUG: chromium:564889 TEST:crosperf unit tests Change-Id: I0705273d1126b81167d7a789514771122a71b8d3 Reviewed-on: https://chromium-review.googlesource.com/424088 Reviewed-by: Caroline Tice <cmtice@chromium.org> Commit-Queue: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org>
2016-12-09crosperf: Add all_graphics_perf and all_crosbolt_perfTing-Yuan Huang
BUG=none TEST=Run them on samus. Change-Id: I2d66351d80ce87f84924fe3bf55abf903fc54829 Reviewed-on: https://chrome-internal-review.googlesource.com/311196 Commit-Ready: Ting-Yuan Huang <laszio@google.com> Tested-by: Ting-Yuan Huang <laszio@google.com> Reviewed-by: Ting-Yuan Huang <laszio@google.com>
2016-12-07default_remotes: update device addresses after the recent move.Rahul Chaudhry
context: http://g/c-compiler-chrome/duTz8l1GR8w BUG=None TEST=Pinged the new addresses successfully. Change-Id: Ie80855629d238a55b21fe78f2fdbfe4e585e577f Reviewed-on: https://chrome-internal-review.googlesource.com/310183 Commit-Ready: Rahul Chaudhry <rahulchaudhry@google.com> Tested-by: Rahul Chaudhry <rahulchaudhry@google.com> Reviewed-by: Ting-Yuan Huang <laszio@google.com>
2016-11-22Fix crosperf generating duplicate key entries.Manoj Gupta
Fixes crosperf when reading data from cache. Fix string find check for json file. BUG: chromium:658875 TEST:crosperf unit tests Change-Id: I34529102c29ed88efd848beb0363066f3b6e50f0 Reviewed-on: https://chrome-internal-review.googlesource.com/305910 Commit-Ready: Manoj Gupta <manojgupta@google.com> Tested-by: Manoj Gupta <manojgupta@google.com> Reviewed-by: Caroline Tice <cmtice@google.com>
2016-11-21Fix crosperf generating duplicate key entries.Manoj Gupta
Fixes crosperf when reading data from cache. Find and assign result data file if it exists in cache. Fix string find check for json file. Some formatting changes required by tc_python and lint. BUG: chromium:658875 TEST:crosperf unit tests Change-Id: Ib13e083464062c16c8a2f1921446441c9973e41a Reviewed-on: https://chrome-internal-review.googlesource.com/305866 Commit-Ready: Manoj Gupta <manojgupta@google.com> Tested-by: Manoj Gupta <manojgupta@google.com> Reviewed-by: Caroline Tice <cmtice@google.com>
2016-11-15Do no exit or raise exception if autotest files are not found.Manoj Gupta
If autotest files are missing from server, just emit an warning and continue. BUG=chromium:665483 TEST=crosperf unit tests Change-Id: Ieaec9b53cbd270bc50f2c5b412b153ddc568104d Reviewed-on: https://chrome-internal-review.googlesource.com/304808 Commit-Ready: Manoj Gupta <manojgupta@google.com> Tested-by: Manoj Gupta <manojgupta@google.com> Reviewed-by: Caroline Tice <cmtice@google.com> Reviewed-by: Yunlian Jiang <yunlian@google.com>
2016-11-10Crosperf: Remove tar file after uncompressing imageManoj Gupta
Remove downloaded chromium image.tar.xz file after uncompression. Change 2 step untar and uncompress to 1. Catch exceptions during uncompression to avoid having a corrupted bin file if uncompression is interrupted. BUG: chromium:663426 TEST: crosperf unit tests pass Change-Id: I82f674a26bf99cb3491e7db770664c73c004a93b Reviewed-on: https://chrome-internal-review.googlesource.com/303875 Commit-Ready: Manoj Gupta <manojgupta@google.com> Tested-by: Manoj Gupta <manojgupta@google.com> Reviewed-by: Caroline Tice <cmtice@google.com>
2016-11-10Fix crosperf crashes when running non-telemetry test on R53 or older images.Manoj Gupta
Do not call decrease wait time for non-telemetry tests. BUG: chromium:663435 TEST:crosperf unit tests Change-Id: Ia13eb8f258ab8fc09fdfbdb4b93a6745e06b44b1 Reviewed-on: https://chrome-internal-review.googlesource.com/303736 Commit-Ready: Manoj Gupta <manojgupta@google.com> Tested-by: Manoj Gupta <manojgupta@google.com> Reviewed-by: Caroline Tice <cmtice@google.com>
2016-11-07Download autotest files with crosperf and add autotest path to test_thatManoj Gupta
when running non-telemetry tests BUG: chromium:647429 TEST:crosperf unit tests, sample experiment file that runs WebGl_Aquarium Change-Id: I067e350fee36596ce269b954773c39a3868632aa Reviewed-on: https://chrome-internal-review.googlesource.com/302296 Commit-Ready: Manoj Gupta <manojgupta@google.com> Tested-by: Manoj Gupta <manojgupta@google.com> Reviewed-by: Caroline Tice <cmtice@google.com>
2016-11-01Update formatting of files before committing changes for autotest. No ↵Manoj Gupta
functional change. BUG: chromium:647429 TEST: crosperf unit tests Change-Id: I827f9ec4d00a0d8c1ae8a9930d7832289e694dc8 Reviewed-on: https://chrome-internal-review.googlesource.com/301457 Commit-Ready: Manoj Gupta <manojgupta@google.com> Tested-by: Manoj Gupta <manojgupta@google.com> Reviewed-by: Luis Lozano <llozano@chromium.org>
2016-10-28[crosperf] Remove stumpy machines.Caroline Tice
We are decommissioning our stumpy lab machines and returning them to the ChromeStop. This CL removes the stumpy machines from the default_remotes file. BUG=chromium:660536 TEST=None Change-Id: I5ecf1536fa399ff70a89271394c8d4e6e09e64e1 Reviewed-on: https://chrome-internal-review.googlesource.com/301258 Commit-Ready: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Reviewed-by: Yunlian Jiang <yunlian@google.com>
2016-10-27[crosperf] Fix buildbot_utils for rotating tester waterfall.Caroline Tice
The rotating testers trybot waterfall location has moved. This CL updates the script to look for their build logs in the correct builder location. It also makes sure we don't crash/die because their build status is non-zero (ie. a HWTest failed). This also fixes a tiny bug in the results reporting. BUG=chromium:660085 TEST=Tested in the role account. Change-Id: I396ec0ad588e54e88bc44dcc0e72eda45d077173 Reviewed-on: https://chrome-internal-review.googlesource.com/300598 Commit-Ready: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Reviewed-by: Yunlian Jiang <yunlian@google.com>
2016-10-27[toolchain-utils] Update page_cycler in nightly tests.Caroline Tice
Currently page_cycler_v2.typical_25 tries to run too many times, causing some of the nightly builders to take nearly 24 hours to complete (they take about 6 hours without page_cycler). Also, page_cycler_v2.typical_25 cannot run locally on some boards (such as daisy). This CL removes page_cycler_v2.typical_25 from the all_toolchain_perf set, and adds it separately to the nightly tests, with only 2 iterations, no retries, and forcing it to not run locallys on the DUT. BUG=chromium:660087 TEST=Tested the new page cycler settings in a crosperf run. Change-Id: Ia68abce4e8ee29a671e58db13f269e531d31736e Reviewed-on: https://chrome-internal-review.googlesource.com/300855 Commit-Ready: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Reviewed-by: Yunlian Jiang <yunlian@google.com>
2016-10-24Handle exceptions in crosperf.Manoj Gupta
Change error message in buildbot. Catch exceptions in crosperf exceution to do a graceful exit. BUG=chromium:622875 TEST=ran run_tests Change-Id: I03093ab27edcc85e318ad43097ab8cd316792dcb Reviewed-on: https://chrome-internal-review.googlesource.com/299275 Commit-Ready: Manoj Gupta <manojgupta@google.com> Tested-by: Manoj Gupta <manojgupta@google.com> Reviewed-by: Caroline Tice <cmtice@google.com> Reviewed-by: Luis Lozano <llozano@chromium.org>
2016-10-12crosperf: update lab machine names.Ting-Yuan Huang
Two elm are added. TEST=none BUG=chromium:655227 Change-Id: I2475aeb0e7aa4964b93babfb6fb626a2de7f5dcb Reviewed-on: https://chrome-internal-review.googlesource.com/296135 Commit-Ready: Ting-Yuan Huang <laszio@google.com> Tested-by: Ting-Yuan Huang <laszio@google.com> Reviewed-by: Caroline Tice <cmtice@google.com>
2016-10-05[crosperf] Fix xbuddy to work with new -toolchain builders.Caroline Tice
The xbuddy translating code was improperly prepending to board name to the waterfall builder trybot images (the ones with the generic architecture names). This CL fixes that. BUG=chromium:653210 TEST=Tested crosperf with 'build: x86-llvm-toolchain/R55-8865.0.0-rc1'; failed without this CL, worked with it. Change-Id: I706c9d882f9c99f8af11eb1782ea6edd1eedbfe5 Reviewed-on: https://chrome-internal-review.googlesource.com/293815 Commit-Ready: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Reviewed-by: Yunlian Jiang <yunlian@google.com>
2016-10-05crosperf: fix the error unexpected keyword argument 'command'Yunlian Jiang
BUG=none TEST=the error is gone. Change-Id: I8dad69d2b45ed821be0c7be77e07b33cf0663eb9 Reviewed-on: https://chrome-internal-review.googlesource.com/293515 Reviewed-by: Yunlian Jiang <yunlian@google.com> Commit-Queue: Yunlian Jiang <yunlian@google.com> Tested-by: Yunlian Jiang <yunlian@google.com>
generated by cgit v1.2.3 (git 2.25.1) at 2024-07-11 01:56:03 +0000