Age | Commit message (Collapse) | Author |
|
Prior to these changes, this script sends emails directly. These are...
not as nice to work with as bugs. Since we run this through our new
bug-filing cron bits, just make this script output to stdout/stderr &
provide a meaningful exit code. Having bugs to track when these profiles
are out-of-date is nicer than tracking N emails.
BUG=None
TEST=Unittests
Change-Id: Id5f7838340df78006bddb36c3bc128016eb2acb5
Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/toolchain-utils/+/3358469
Tested-by: George Burgess <gbiv@chromium.org>
Auto-Submit: George Burgess <gbiv@chromium.org>
Reviewed-by: Denis Nikitin <denik@chromium.org>
Commit-Queue: Denis Nikitin <denik@chromium.org>
|
|
BUG=b:200542097
TEST=None
Change-Id: I82f4011d499b323a4eceda2949e103dc1559299f
Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/toolchain-utils/+/3171413
Commit-Queue: Jaques Clapauch <jaquesc@google.com>
Commit-Queue: Chris McDonald <cjmcdonald@chromium.org>
Commit-Queue: George Burgess <gbiv@chromium.org>
Tested-by: Jaques Clapauch <jaquesc@google.com>
Auto-Submit: Jaques Clapauch <jaquesc@google.com>
Reviewed-by: Chris McDonald <cjmcdonald@chromium.org>
Reviewed-by: George Burgess <gbiv@chromium.org>
|
|
Remove dependency on pre-installed gLinux software.
gsutil.py comes from depot_tools which is part of chrotomation setup.
BUG=None
TEST=tested locally on chrotomation.mtv
Change-Id: I8fcef35a3c229ec06639a56b02c5751b4cedfc95
Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/toolchain-utils/+/2460835
Reviewed-by: George Burgess <gbiv@chromium.org>
Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
Tested-by: George Burgess <gbiv@chromium.org>
|
|
This CL lands a monitor that'll poke our mage if we have no recent LLVM
PGO profiles sitting in our bucket. The intent is to run it every few
days on chrotomation3, just like the other monitoring infra we have.
BUG=chromium:978741
TEST=unittests; ran with a very low days value, and verified the email
Change-Id: Ie7a7d44d58c260dd4f17f0759c9fc84bbf8f120d
Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/toolchain-utils/+/2346840
Tested-by: George Burgess <gbiv@chromium.org>
Reviewed-by: Tiancong Wang <tcwang@google.com>
|
|
Since the scheduled builder for toolchain team has been migrated to
recipe and also we are launching builders manually with `bb` command, this
CL updates the PGO merging and uploading script to make it work with the
change.
BUG=chromium:1076624
TEST=Tested with 3 different modes and exception raising.
Change-Id: I993d1cbbf7ba66502e6bc6b8d82bd97cfda67b1e
Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/toolchain-utils/+/2225841
Tested-by: Zhizhou Yang <zhizhouy@google.com>
Reviewed-by: George Burgess <gbiv@chromium.org>
|
|
This patch migrates all in-use projects left to python 3.
BUG=chromium:1011676
TEST=Passed unittests and launched scripts manually.
Change-Id: I7f2de4e1131c05bacfac80667f3064da8adaebfd
Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/toolchain-utils/+/2051397
Reviewed-by: George Burgess <gbiv@chromium.org>
Tested-by: Zhizhou Yang <zhizhouy@google.com>
Auto-Submit: Zhizhou Yang <zhizhouy@google.com>
|
|
In pgo_tool, we want to provide a new scenario that we don't use any
profdata from the builder, but only use tryjobs. Also with tryjobs, the
directory that we extracted is a little bit different from those of
builders.
TEST=Run it locally with different scenarios.
BUG=chromium:983746
Change-Id: Id3fd66562d0d2821bde05ff4979f291c98ffd1d7
Reviewed-on: https://chromium-review.googlesource.com/1700154
Tested-by: Zhizhou Yang <zhizhouy@google.com>
Commit-Ready: Zhizhou Yang <zhizhouy@google.com>
Legacy-Commit-Queue: Commit Bot <commit-bot@chromium.org>
Reviewed-by: George Burgess <gbiv@chromium.org>
|
|
As noted by zhizhou in I26d17b6b698f14d40e7e11c55ef894afd91552f5, this
script previously didn't verify that the thing we intended to upload was
actually uploaded. This CL fixes that.
BUG=None
TEST=Temporary profile was uploaded successfully; tried to clobber
it, but the script failed loudly (as it should).
Change-Id: Id791cb7ecd07140eb4dfc803c9267f3824983ae3
Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/toolchain-utils/+/1638843
Tested-by: George Burgess <gbiv@chromium.org>
Reviewed-by: Zhizhou Yang <zhizhouy@google.com>
|
|
This CL makes us autodetect LLVM HEAD's hash from our PGO builders, and
use those in the names for our profiles.
Since it's cheap and otherwise a really subtle bug, this also adds a
safety check where we'll complain if not all LLVM HEADs from the user's
provided builds match. The way to override it is documented in
`die_with_head_complaint()` form.
BUG=None
TEST=Stubbed out _tar_and_upload_profdata and:
- provided a bogus --llvm_hash
- watched the script die when conflicting LLVM hashes were given
- watched the script run under normal conditions
Change-Id: I26d17b6b698f14d40e7e11c55ef894afd91552f5
Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/toolchain-utils/+/1637657
Tested-by: George Burgess <gbiv@chromium.org>
Reviewed-by: Zhizhou Yang <zhizhouy@google.com>
|
|
https://chromium-review.googlesource.com/c/chromiumos/chromite/+/1633331
renames our buildbots for PGO profile generation. This CL makes us use
the new name.
BUG=None
TEST=ran the script; complained that no artifacts existed for
arm-pgo-generate-llvm-next-toolchain, which is true. :)
Change-Id: I444c60fbfd2fbf8ab457e0fd17c4be617c888ab4
Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/toolchain-utils/+/1633379
Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
Tested-by: George Burgess <gbiv@chromium.org>
Legacy-Commit-Queue: Commit Bot <commit-bot@chromium.org>
|
|
This script downloads profdata from tryjob artifacts on different
architectures, merges them into one llvm.profdata, make a tarball and
upload it to gs bucket, so that ChromeOS toolchain can use it for PGO
optimization.
BUG=chromium:937903
TEST=None
Change-Id: I96c31a66eaf0306c2f6d9b84541280c08edc4e7d
Reviewed-on: https://chromium-review.googlesource.com/1565195
Commit-Ready: Zhizhou Yang <zhizhouy@google.com>
Tested-by: Zhizhou Yang <zhizhouy@google.com>
Reviewed-by: Manoj Gupta <manojgupta@chromium.org>
Reviewed-by: George Burgess <gbiv@chromium.org>
|