aboutsummaryrefslogtreecommitdiff
path: root/pgo_tools
AgeCommit message (Collapse)Author
2020-06-02pgo_tools: update the merge script to work with recipe and buildbucketzhizhouy
Since the scheduled builder for toolchain team has been migrated to recipe and also we are launching builders manually with `bb` command, this CL updates the PGO merging and uploading script to make it work with the change. BUG=chromium:1076624 TEST=Tested with 3 different modes and exception raising. Change-Id: I993d1cbbf7ba66502e6bc6b8d82bd97cfda67b1e Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/toolchain-utils/+/2225841 Tested-by: Zhizhou Yang <zhizhouy@google.com> Reviewed-by: George Burgess <gbiv@chromium.org>
2020-02-13toolchain-utils: migrate all in-use projects to python 3Zhizhou Yang
This patch migrates all in-use projects left to python 3. BUG=chromium:1011676 TEST=Passed unittests and launched scripts manually. Change-Id: I7f2de4e1131c05bacfac80667f3064da8adaebfd Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/toolchain-utils/+/2051397 Reviewed-by: George Burgess <gbiv@chromium.org> Tested-by: Zhizhou Yang <zhizhouy@google.com> Auto-Submit: Zhizhou Yang <zhizhouy@google.com>
2019-07-16pgo_tool: Fix bugs in pgo_tool and add a README fileZhizhou Yang
In pgo_tool, we want to provide a new scenario that we don't use any profdata from the builder, but only use tryjobs. Also with tryjobs, the directory that we extracted is a little bit different from those of builders. TEST=Run it locally with different scenarios. BUG=chromium:983746 Change-Id: Id3fd66562d0d2821bde05ff4979f291c98ffd1d7 Reviewed-on: https://chromium-review.googlesource.com/1700154 Tested-by: Zhizhou Yang <zhizhouy@google.com> Commit-Ready: Zhizhou Yang <zhizhouy@google.com> Legacy-Commit-Queue: Commit Bot <commit-bot@chromium.org> Reviewed-by: George Burgess <gbiv@chromium.org>
2019-06-05pgo_tools: make the uploader check new uploadsGeorge Burgess IV
As noted by zhizhou in I26d17b6b698f14d40e7e11c55ef894afd91552f5, this script previously didn't verify that the thing we intended to upload was actually uploaded. This CL fixes that. BUG=None TEST=Temporary profile was uploaded successfully; tried to clobber it, but the script failed loudly (as it should). Change-Id: Id791cb7ecd07140eb4dfc803c9267f3824983ae3 Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/toolchain-utils/+/1638843 Tested-by: George Burgess <gbiv@chromium.org> Reviewed-by: Zhizhou Yang <zhizhouy@google.com>
2019-06-05pgo_tools: make our profile uploader use hashes in file namesGeorge Burgess IV
This CL makes us autodetect LLVM HEAD's hash from our PGO builders, and use those in the names for our profiles. Since it's cheap and otherwise a really subtle bug, this also adds a safety check where we'll complain if not all LLVM HEADs from the user's provided builds match. The way to override it is documented in `die_with_head_complaint()` form. BUG=None TEST=Stubbed out _tar_and_upload_profdata and: - provided a bogus --llvm_hash - watched the script die when conflicting LLVM hashes were given - watched the script run under normal conditions Change-Id: I26d17b6b698f14d40e7e11c55ef894afd91552f5 Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/toolchain-utils/+/1637657 Tested-by: George Burgess <gbiv@chromium.org> Reviewed-by: Zhizhou Yang <zhizhouy@google.com>
2019-05-29pgo_tools: update our merging script to point to the right botsGeorge Burgess IV
https://chromium-review.googlesource.com/c/chromiumos/chromite/+/1633331 renames our buildbots for PGO profile generation. This CL makes us use the new name. BUG=None TEST=ran the script; complained that no artifacts existed for arm-pgo-generate-llvm-next-toolchain, which is true. :) Change-Id: I444c60fbfd2fbf8ab457e0fd17c4be617c888ab4 Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/toolchain-utils/+/1633379 Reviewed-by: Manoj Gupta <manojgupta@chromium.org> Tested-by: George Burgess <gbiv@chromium.org> Legacy-Commit-Queue: Commit Bot <commit-bot@chromium.org>
2019-04-14toolchain-utils: Script to merge profdata and upload to gs bucketZhizhou Yang
This script downloads profdata from tryjob artifacts on different architectures, merges them into one llvm.profdata, make a tarball and upload it to gs bucket, so that ChromeOS toolchain can use it for PGO optimization. BUG=chromium:937903 TEST=None Change-Id: I96c31a66eaf0306c2f6d9b84541280c08edc4e7d Reviewed-on: https://chromium-review.googlesource.com/1565195 Commit-Ready: Zhizhou Yang <zhizhouy@google.com> Tested-by: Zhizhou Yang <zhizhouy@google.com> Reviewed-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: George Burgess <gbiv@chromium.org>