aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2017-02-23Use registered users in toolchain-utils/OWNERS. am: ca171c41df am: 7091edfaa0android-wear-8.1.0_r1android-vts-8.1_r9android-vts-8.1_r8android-vts-8.1_r7android-vts-8.1_r6android-vts-8.1_r5android-vts-8.1_r4android-vts-8.1_r3android-vts-8.1_r14android-vts-8.1_r13android-vts-8.1_r12android-vts-8.1_r11android-vts-8.1_r10android-vts-8.0_r9android-vts-8.0_r8android-vts-8.0_r7android-vts-8.0_r6android-vts-8.0_r2android-vts-8.0_r13android-vts-8.0_r12android-vts-8.0_r11android-vts-8.0_r10android-vts-8.0_r1android-security-8.1.0_r93android-security-8.1.0_r92android-security-8.1.0_r91android-security-8.1.0_r90android-security-8.1.0_r89android-security-8.1.0_r88android-security-8.1.0_r87android-security-8.1.0_r86android-security-8.1.0_r85android-security-8.1.0_r84android-security-8.1.0_r83android-security-8.1.0_r82android-security-8.0.0_r54android-security-8.0.0_r53android-security-8.0.0_r52android-cts-8.1_r9android-cts-8.1_r8android-cts-8.1_r7android-cts-8.1_r6android-cts-8.1_r5android-cts-8.1_r4android-cts-8.1_r3android-cts-8.1_r25android-cts-8.1_r24android-cts-8.1_r23android-cts-8.1_r22android-cts-8.1_r21android-cts-8.1_r20android-cts-8.1_r2android-cts-8.1_r19android-cts-8.1_r18android-cts-8.1_r17android-cts-8.1_r16android-cts-8.1_r15android-cts-8.1_r14android-cts-8.1_r13android-cts-8.1_r12android-cts-8.1_r11android-cts-8.1_r10android-cts-8.1_r1android-cts-8.0_r9android-cts-8.0_r8android-cts-8.0_r7android-cts-8.0_r6android-cts-8.0_r5android-cts-8.0_r4android-cts-8.0_r3android-cts-8.0_r26android-cts-8.0_r25android-cts-8.0_r24android-cts-8.0_r23android-cts-8.0_r22android-cts-8.0_r21android-cts-8.0_r20android-cts-8.0_r2android-cts-8.0_r19android-cts-8.0_r18android-cts-8.0_r17android-cts-8.0_r16android-cts-8.0_r15android-cts-8.0_r14android-cts-8.0_r13android-cts-8.0_r12android-cts-8.0_r11android-cts-8.0_r10android-cts-8.0_r1android-8.1.0_r9android-8.1.0_r81android-8.1.0_r80android-8.1.0_r8android-8.1.0_r79android-8.1.0_r78android-8.1.0_r77android-8.1.0_r76android-8.1.0_r75android-8.1.0_r74android-8.1.0_r73android-8.1.0_r72android-8.1.0_r71android-8.1.0_r70android-8.1.0_r7android-8.1.0_r69android-8.1.0_r68android-8.1.0_r67android-8.1.0_r66android-8.1.0_r65android-8.1.0_r64android-8.1.0_r63android-8.1.0_r62android-8.1.0_r61android-8.1.0_r60android-8.1.0_r6android-8.1.0_r53android-8.1.0_r52android-8.1.0_r51android-8.1.0_r50android-8.1.0_r5android-8.1.0_r48android-8.1.0_r47android-8.1.0_r46android-8.1.0_r45android-8.1.0_r43android-8.1.0_r42android-8.1.0_r41android-8.1.0_r40android-8.1.0_r4android-8.1.0_r39android-8.1.0_r38android-8.1.0_r37android-8.1.0_r36android-8.1.0_r35android-8.1.0_r33android-8.1.0_r32android-8.1.0_r31android-8.1.0_r30android-8.1.0_r3android-8.1.0_r29android-8.1.0_r28android-8.1.0_r27android-8.1.0_r26android-8.1.0_r25android-8.1.0_r23android-8.1.0_r22android-8.1.0_r21android-8.1.0_r20android-8.1.0_r2android-8.1.0_r19android-8.1.0_r18android-8.1.0_r17android-8.1.0_r16android-8.1.0_r15android-8.1.0_r14android-8.1.0_r13android-8.1.0_r12android-8.1.0_r11android-8.1.0_r10android-8.1.0_r1android-8.0.0_r9android-8.0.0_r7android-8.0.0_r51android-8.0.0_r50android-8.0.0_r49android-8.0.0_r48android-8.0.0_r47android-8.0.0_r46android-8.0.0_r45android-8.0.0_r44android-8.0.0_r43android-8.0.0_r42android-8.0.0_r41android-8.0.0_r40android-8.0.0_r4android-8.0.0_r39android-8.0.0_r38android-8.0.0_r37android-8.0.0_r36android-8.0.0_r35android-8.0.0_r34android-8.0.0_r33android-8.0.0_r32android-8.0.0_r31android-8.0.0_r30android-8.0.0_r3android-8.0.0_r29android-8.0.0_r28android-8.0.0_r27android-8.0.0_r26android-8.0.0_r25android-8.0.0_r24android-8.0.0_r23android-8.0.0_r22android-8.0.0_r21android-8.0.0_r2android-8.0.0_r17android-8.0.0_r16android-8.0.0_r15android-8.0.0_r13android-8.0.0_r12android-8.0.0_r11android-8.0.0_r10android-8.0.0_r1security-oc-releasesecurity-oc-mr1-releaseoreo-vts-releaseoreo-security-releaseoreo-releaseoreo-r6-releaseoreo-r5-releaseoreo-r4-releaseoreo-r3-releaseoreo-r2-releaseoreo-mr1-wear-releaseoreo-mr1-vts-releaseoreo-mr1-security-releaseoreo-mr1-s1-releaseoreo-mr1-releaseoreo-mr1-devoreo-mr1-cuttlefish-testingoreo-mr1-cts-releaseoreo-m8-releaseoreo-m7-releaseoreo-m6-s4-releaseoreo-m6-s3-releaseoreo-m6-s2-releaseoreo-m5-releaseoreo-m4-s9-releaseoreo-m4-s8-releaseoreo-m4-s7-releaseoreo-m4-s6-releaseoreo-m4-s5-releaseoreo-m4-s4-releaseoreo-m4-s3-releaseoreo-m4-s2-releaseoreo-m4-s12-releaseoreo-m4-s11-releaseoreo-m4-s10-releaseoreo-m4-s1-releaseoreo-m3-releaseoreo-m2-s5-releaseoreo-m2-s4-releaseoreo-m2-s3-releaseoreo-m2-s2-releaseoreo-m2-s1-releaseoreo-m2-releaseoreo-dr3-releaseoreo-dr2-releaseoreo-dr1-releaseoreo-dr1-devoreo-devoreo-cts-releaseChih-Hung Hsieh
am: 297e39c82b Change-Id: I36f903fafc6aa3e8c37a8ad7d236a124f8732d01
2017-02-23Use registered users in toolchain-utils/OWNERS. am: ca171c41dfChih-Hung Hsieh
am: 7091edfaa0 Change-Id: I39661895ca7502e55186a63866133f57e9466901
2017-02-23Use registered users in toolchain-utils/OWNERS.android-wear-o-preview-4android-wear-o-preview-3android-o-preview-4android-o-preview-3android-o-preview-2Chih-Hung Hsieh
am: ca171c41df Change-Id: I168c7e727657c6b5de8cf44bf23748c09bd8175c
2017-02-23Use registered users in toolchain-utils/OWNERS.android-o-preview-1o-previewChih-Hung Hsieh
AOSP project owners should be registered in Gerrit Code Review. Bug: 33166666 Test: default build targets Change-Id: I1196d33f47283f2f6ba8d7373190dcf9a2d80934
2017-02-08Merge remote-tracking branch 'aosp/mirror-chromium-master' into ↵Stephen Hines
initial_import am: 870a8df6fc am: 9c6fa5f9e5 am: c5804ce784 am: 271389dd31 Change-Id: I22e657bc86117da9a6a45329a67a21096736da03
2017-02-08Merge remote-tracking branch 'aosp/mirror-chromium-master' into ↵Stephen Hines
initial_import am: 870a8df6fc am: 9c6fa5f9e5 am: c5804ce784 Change-Id: I5ff109272784db60dfef5145242a68779f7f0ccb
2017-02-08Merge remote-tracking branch 'aosp/mirror-chromium-master' into ↵Stephen Hines
initial_import am: 870a8df6fc am: 9c6fa5f9e5 Change-Id: Ie306363c46445f59e341b69121c4b0e113ad79b2
2017-02-08Merge remote-tracking branch 'aosp/mirror-chromium-master' into initial_importStephen Hines
am: 870a8df6fc Change-Id: I98e43c690589937e0db0981fc88383583c7b36d3
2017-02-07Merge remote-tracking branch 'aosp/mirror-chromium-master' into initial_importStephen Hines
Initial import of Chromium's toolchain-utils project. Bug: http://b/31321592 Test: None necessary, as this is just a helper repository. Change-Id: I61d2caaf1195da18cfaa7795706e8fc7fecff1d4
2017-02-01user_activity: Added tools for the benchmark profile collection.Evelina Dumitrescu
The scripts run the Telemetry benchmarks, collects their perf profiles, use local_cwp to do the profile symbolization and collect the hot functions and callchains with pprof. BUG=None TEST=None Change-Id: I2170e53d95924f1a3ba134bd62b1eead9e7a3077 Reviewed-on: https://chrome-internal-review.googlesource.com/288517 Reviewed-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Evelina Dumitrescu <evelinad@google.com> Commit-Queue: Evelina Dumitrescu <evelinad@google.com> Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-on: https://chromium-review.googlesource.com/435923 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_acivity: Changed the paths and names for some Chrome OS groups.Evelina Dumitrescu
BUG=None TEST=None Change-Id: I1124c62a67394f5f43e003338bad83855539e76a Reviewed-on: https://chrome-internal-review.googlesource.com/292637 Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: Luis Lozano <llozano@chromium.org> Reviewed-on: https://chromium-review.googlesource.com/435922 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_activity: Fixed a regression in ComputeScoreForBenchmarkSet.Evelina Dumitrescu
The score fraction for a group was computed wrong. The fraction should be computed as the score of the group over the score of that group in the ideal case (each CWP function matching that group should have the 1.0 value). BUG=None TEST=None Change-Id: I294b42f0c8112ab9bd6f5d983876b6d779aad5e4 Reviewed-on: https://chrome-internal-review.googlesource.com/297675 Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: Luis Lozano <llozano@chromium.org> Reviewed-on: https://chromium-review.googlesource.com/435921 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_acivity: Changed some replacing pair strings.Evelina Dumitrescu
Changed ('/build/gnawty', '/build/BOARD') to ('gnawty', 'BOARD') and ('/build/amd64-generic', '/build/BOARD') to ('amd64-generic', 'BOARD'). In the CWP data we have multiple paths containing the name of the board. For example, we have /build/gnawty, but we also have /var/cache/chromeos-chrome/chrome-src-internal/src/out_gnawty. I made the subtitution generic. BUG=None TEST=None Change-Id: Ie716a0f966b78a3c4ff85746cfa01b8b210d8b59 Reviewed-on: https://chrome-internal-review.googlesource.com/298336 Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: George Burgess <gbiv@google.com> Reviewed-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-on: https://chromium-review.googlesource.com/435920 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_activity: Moved some functions to the utils module.Evelina Dumitrescu
Moved ComputeCWPCummulativeInclusiveStatistics and ComputeCWPChildFunctionsFractions from the process_hot_functions module to the utils module. BUG=None TEST=None Change-Id: Ib5968ae722cc8a775744418f24512e3d727d3936 Reviewed-on: https://chrome-internal-review.googlesource.com/298618 Commit-Queue: Evelina Dumitrescu <evelinad@google.com> Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: Luis Lozano <llozano@chromium.org> Reviewed-on: https://chromium-review.googlesource.com/435919 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_activity: Fix regression in the benchmark_metrics_expriment.Evelina Dumitrescu
The child fractions were not computed correctly after I updated the extracted fields from the data collection scripts. BUG=None TEST=None Change-Id: I8e672e0c245696e3351f1be9a3b391f46accea9f Reviewed-on: https://chrome-internal-review.googlesource.com/298619 Commit-Queue: Evelina Dumitrescu <evelinad@google.com> Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: George Burgess <gbiv@google.com> Reviewed-on: https://chromium-review.googlesource.com/435918 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_activity: Added some parameters to the Dremel SQL scripts.Evelina Dumitrescu
Used --min_completion_ration=1.0 to to ensure that Dremel queries all available data and --sql_dialect=GoogleSQL to set up the dialect. Added session_count > 2000 to extract only the busy profiles. Added Chrome version as an argument in the command line. BUG=None TEST=None Change-Id: I990499325f8e81ec0ea583077134f1416b56797a Reviewed-on: https://chrome-internal-review.googlesource.com/294918 Tested-by: Evelina Dumitrescu <evelinad@google.com> Commit-Queue: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: Luis Lozano <llozano@chromium.org> Reviewed-on: https://chromium-review.googlesource.com/435917 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_activity: Computed the metrics for the common functions.Evelina Dumitrescu
Integrated the script with the utils module. BUG=None TEST=None Change-Id: I4c8d0bdbda6df5996eae873655cfaf355cf559a2 Reviewed-on: https://chrome-internal-review.googlesource.com/290455 Reviewed-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Evelina Dumitrescu <evelinad@google.com> Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-on: https://chromium-review.googlesource.com/435916 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_activity: Created utility module for grouping parsing functions.Evelina Dumitrescu
The modules contains the functions that do the parsing for the pprof top and tree, CWP data and Chrome OS groups files. BUG=None TEST=utils_unittest passes Change-Id: Ida94a2d456250afe4630a146349937eb0bab0767 Reviewed-on: https://chrome-internal-review.googlesource.com/291201 Reviewed-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Evelina Dumitrescu <evelinad@google.com> Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-on: https://chromium-review.googlesource.com/435915 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_activity: Added script to select the optimal benchmark set.Evelina Dumitrescu
It generates all possible combinations of benchmark sets of a given size and it computes for every set a metric. Three different metrics have been used: function count, distance variation and score. TEST=None BUG=None Change-Id: I4e4af9f46a3056cfbcdc9d89b2c1333650b41ccc Reviewed-on: https://chrome-internal-review.googlesource.com/292435 Reviewed-by: George Burgess <gbiv@google.com> Reviewed-by: Ting-Yuan Huang <laszio@google.com> Reviewed-by: Evelina Dumitrescu <evelinad@google.com> Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-on: https://chromium-review.googlesource.com/435914 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_activity: Updated the extracted fields from the data collection scripts.Evelina Dumitrescu
Added the inclusive count fields for the inclusive count statistics. Renamed inclusive_count_fraction to inclusive_count for the pairwise inclusive statistics. BUG=None TEST=None Change-Id: Iac7d9a55443448ab32765039803a9e3e069c49ac Reviewed-on: https://chrome-internal-review.googlesource.com/291203 Reviewed-by: George Burgess <gbiv@google.com> Reviewed-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Evelina Dumitrescu <evelinad@google.com> Commit-Queue: Evelina Dumitrescu <evelinad@google.com> Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-on: https://chromium-review.googlesource.com/435913 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_activity: Integrated benchmark_metrics_experiment with utils.Evelina Dumitrescu
Removed duplicate code from the process_hot_functions and benchmark_metrics_experiment. BUG=None TEST=benchmark_metrics_experiment passes Change-Id: I11ed11b4f1cbb573e1d10a2795570b4820602031 Reviewed-on: https://chrome-internal-review.googlesource.com/291202 Reviewed-by: George Burgess <gbiv@google.com> Reviewed-by: Ting-Yuan Huang <laszio@google.com> Reviewed-by: Evelina Dumitrescu <evelinad@google.com> Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-on: https://chromium-review.googlesource.com/435912 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_activity: Added implementation for the metrics experiment.Evelina Dumitrescu
The validation of the benchmark metrics is done on a pair of CWP function sets. BUG=None TEST=benchmark_metrics_validation_unittest passes Change-Id: I15cb5976ba4d9a41ff97376b0ac3320e9a798fd5 Reviewed-on: https://chrome-internal-review.googlesource.com/286160 Reviewed-by: Luis Lozano <llozano@chromium.org> Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-on: https://chromium-review.googlesource.com/435911 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_activity: Added implementation for the metrics.Evelina Dumitrescu
For every function, we compute a distance based on the sum of inclusive value fraction differences of pairs of common child functions from a sample, and reference function sets. For every function, we assign a score based on the distance, inclusive value fraction from the sample, and reference function sets. For every Chrome OS component, we compute a set of metrics consisting in the number of functions, the average, and cumulative distance and the total score of the functions matching the group. BUG=None TEST=benchmark_metrics_unittest passes Change-Id: I7810ec86bc4fa488b49ee18de3b3bda2ef95ba09 Reviewed-on: https://chrome-internal-review.googlesource.com/286161 Reviewed-by: Luis Lozano <llozano@chromium.org> Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-on: https://chromium-review.googlesource.com/435910 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_activity: Added scripts for collecting the experiment data sets.Evelina Dumitrescu
BUG=None TEST=None Change-Id: I7b00ce4359cb378e45bb673e023c12137d03e9b8 Reviewed-on: https://chrome-internal-review.googlesource.com/287959 Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: George Burgess <gbiv@google.com> Reviewed-by: Ting-Yuan Huang <laszio@google.com> Reviewed-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-on: https://chromium-review.googlesource.com/435909 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_activity: Added unit tests for benchmark metrics.Evelina Dumitrescu
BUG=None TEST=None Change-Id: I792f03a4cb76acf18691eeb1455a16a2d65537cf Reviewed-on: https://chrome-internal-review.googlesource.com/287960 Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: George Burgess <gbiv@google.com> Reviewed-by: Ting-Yuan Huang <laszio@google.com> Reviewed-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-on: https://chromium-review.googlesource.com/435908 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_activity: Added unit tests for benchmark metrics experiment.Evelina Dumitrescu
BUG=None TEST=None Change-Id: I8876f7ad4d4f05dad7e8329984f972a94df58edf Reviewed-on: https://chrome-internal-review.googlesource.com/287961 Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: George Burgess <gbiv@google.com> Reviewed-by: Ting-Yuan Huang <laszio@google.com> Reviewed-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-on: https://chromium-review.googlesource.com/435907 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org>
2017-02-01user activity: Unit tests for group extra CWP functions.Evelina Dumitrescu
BUG=None TEST=None Change-Id: I6454b4f55a3c47387b1b2cc35342358937026cfb Reviewed-on: https://chrome-internal-review.googlesource.com/282200 Commit-Queue: Evelina Dumitrescu <evelinad@google.com> Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: George Burgess <gbiv@google.com> Reviewed-by: Ting-Yuan Huang <laszio@google.com> Reviewed-on: https://chromium-review.googlesource.com/435906 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org>
2017-02-01user activity: Normalize the pathname from pprof and CWP data.Evelina Dumitrescu
I noticed that lots of files have .. symbols in the pathname. BUG=None TEST=None Change-Id: I7dbdc84b36b9496f2d8fa21ec4fafe0f1417f256 Reviewed-on: https://chrome-internal-review.googlesource.com/282197 Tested-by: Evelina Dumitrescu <evelinad@google.com> Commit-Queue: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: George Burgess <gbiv@google.com> Reviewed-by: Ting-Yuan Huang <laszio@google.com> Reviewed-on: https://chromium-review.googlesource.com/435905 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org>
2017-02-01user activity: Added group extra CWP functions functionality.Evelina Dumitrescu
Write the data of the functions that belong to a group in a CSV file, sorted by their inclusive count value, in descendant order. Create a CSV file containing the name of the groups, their common path, the total inclusive count value of all the functions declared in files that share the common path, sorted in descendant order by the inclusive count value. BUG=None TEST=process_hot_functions_unittest passes Change-Id: Ie0fe406ec0fefed02a5547dffa02e650dddd783a Reviewed-on: https://chrome-internal-review.googlesource.com/282198 Reviewed-by: George Burgess <gbiv@google.com> Reviewed-by: Ting-Yuan Huang <laszio@google.com> Tested-by: Evelina Dumitrescu <evelinad@google.com> Commit-Queue: Evelina Dumitrescu <evelinad@google.com> Reviewed-on: https://chromium-review.googlesource.com/435904 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org>
2017-02-01user activity: Dremel query to extract the top CWP hot functions.Evelina Dumitrescu
BUG=None TEST=None Change-Id: Iefa803394329f24e850e53e7db692bc004dafb51 Reviewed-on: https://chrome-internal-review.googlesource.com/282195 Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: George Burgess <gbiv@google.com> Reviewed-by: Ting-Yuan Huang <laszio@google.com> Commit-Queue: Evelina Dumitrescu <evelinad@google.com> Reviewed-on: https://chromium-review.googlesource.com/435457 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_activity_benchmarks: Added unit tests for the process_hot_functionsEvelina Dumitrescu
module. BUG=None TEST=None Change-Id: I41fb0cd89e108f96cc061bf3ac72403a7108b30b Reviewed-on: https://chrome-internal-review.googlesource.com/279955 Commit-Queue: Evelina Dumitrescu <evelinad@google.com> Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: George Burgess <gbiv@google.com> Reviewed-by: Luis Lozano <llozano@chromium.org> Reviewed-on: https://chromium-review.googlesource.com/435456 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_activity_benchmarks: Added file with function groups thatEvelina Dumitrescu
represent ChromeOS components. A function belongs to a group that is defined by a given file path if it is declared in a file that shares that path. BUG=None TEST=None Change-Id: Ic5b9fd8871d0fc53f10590b63d9277ec2fce6dd8 Reviewed-on: https://chrome-internal-review.googlesource.com/282196 Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-by: George Burgess <gbiv@google.com> Reviewed-by: Luis Lozano <llozano@chromium.org> Reviewed-on: https://chromium-review.googlesource.com/435455 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2017-02-01user_activity_benchmarks: Added tool for processing pprof and CWP data.Evelina Dumitrescu
BUG=None TEST=process_hot_functions_unitttest passes Change-Id: I9956b34e9d1ca902a23be86dd8e21208462f0117 Reviewed-on: https://chrome-internal-review.googlesource.com/278697 Reviewed-by: Luis Lozano <llozano@chromium.org> Tested-by: Evelina Dumitrescu <evelinad@google.com> Reviewed-on: https://chromium-review.googlesource.com/435454 Commit-Ready: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2017-01-31Fix WebGLAquarium fails from trybot images.Manoj Gupta
WebGLAquarium fails since it can't find autotest packages. But we don't want to download more files to chrotomation2. So reuse autotest files from vanilla image for trybot images. BUG=chromium:687262 TEST=autotest_path added to generated experiment files. Change-Id: I99b139451c2d39da928554747f714a6e536c7b40 Reviewed-on: https://chromium-review.googlesource.com/435438 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Ting-Yuan Huang <laszio@chromium.org>
2017-01-27add caroline and kevin boards to rotation builder.Yunlian Jiang
Bug=None Test=The boards are added. Change-Id: Ie8619c84c0e4d8377153d8c14e3b3f5f7a082723 Reviewed-on: https://chromium-review.googlesource.com/434118 Commit-Ready: Yunlian Jiang <yunlian@chromium.org> Tested-by: Yunlian Jiang <yunlian@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org>
2017-01-24Cleanup stale files from chrotomation2.Manoj Gupta
Remove images and autotest_files directories left in chromeos chroot *-pfq directories. Slight refactoring to avoid code duplication for release and pfq directories. Minor mandatory formatting updates. BUG=chromium:656755 TEST=Old files show up for removal in dry run Change-Id: I91230c0696148847dc408a3047f468c663b8ab8d Reviewed-on: https://chromium-review.googlesource.com/431268 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org>
2017-01-24Fix frequency pinning on crosperf.Manoj Gupta
Crosperf was pinning frequency to maximum based on cpu0 information. This does not work as intended for arm Big-Little cores. Instead do it for each cpu based on its own information. BUG=chromium:680742 TEST=Tested on elm, kevin, falco, samus, peach_pit and veyron_jaq. Change-Id: I77fc76d8f1e94563fe12b3555bf08511fdbfdc32 Reviewed-on: https://chromium-review.googlesource.com/428186 Commit-Ready: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Luis Lozano <llozano@chromium.org>
2017-01-23remove perf binary from toolchain-utils.Yunlian Jiang
This reverts this CL https://chrome-internal-review.googlesource.com/#/c/157756/, because the bug in perf is gone. BUG=chromium:665988 TEST=run a crosperf with perf, the report report is correct. No 20-50% of the report attributed to 'chrome [unknown]'. run_test.sh passes. Change-Id: I4b2b18e9653d95bde5caf076114bf53a84c2a4fd Reviewed-on: https://chromium-review.googlesource.com/431234 Commit-Ready: Yunlian Jiang <yunlian@chromium.org> Tested-by: Yunlian Jiang <yunlian@chromium.org> Reviewed-by: Caroline Tice <cmtice@chromium.org>
2017-01-11Fix test_that run for non-telemtry tests.Manoj Gupta
Do not add the autotest_dir argument to test_that for non-telemetry tests. Minor change: Remove a leftover print from download_images unit test. BUG: chromium:679001 TEST:crosperf unit tests Change-Id: I0ff5365902af40097b61ae57d7c0d8d43ea308a8 Reviewed-on: https://chromium-review.googlesource.com/426073 Reviewed-by: Caroline Tice <cmtice@chromium.org> Commit-Queue: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Trybot-Ready: Manoj Gupta <manojgupta@chromium.org>
2017-01-11Fix some lint warning in suite_runner*.Luis A. Lozano
BUG=chromium:632113 TEST=run_tests Change-Id: I9fe070420153f5ae175db86961c95b1686ea7c8f Reviewed-on: https://chromium-review.googlesource.com/421107 Reviewed-by: Caroline Tice <cmtice@chromium.org> Commit-Queue: Luis Lozano <llozano@chromium.org> Tested-by: Luis Lozano <llozano@chromium.org>
2017-01-10crosperf: disable cheets benchmarks in crosboltTing-Yuan Huang
They have nothing to do with cros toolchain. TEST=none BUG=none Change-Id: Ie06ccd1cddf7233c55b52fd77e1329311fcff9d9 Reviewed-on: https://chromium-review.googlesource.com/426379 Trybot-Ready: Ting-Yuan Huang <laszio@chromium.org> Reviewed-by: Yunlian Jiang <yunlian@chromium.org> Commit-Queue: Ting-Yuan Huang <laszio@chromium.org> Tested-by: Ting-Yuan Huang <laszio@chromium.org>
2017-01-04Reduce cros_sdk calls in crosperf.Manoj Gupta
Improves crosperf performance by reducing calls to ChrootRunCommand, Instead use RunCommand. BUG: chromium:564889 TEST:crosperf unit tests Change-Id: I0705273d1126b81167d7a789514771122a71b8d3 Reviewed-on: https://chromium-review.googlesource.com/424088 Reviewed-by: Caroline Tice <cmtice@chromium.org> Commit-Queue: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org>
2017-01-04Add llvm_next_builder to list of known builders.Caroline Tice
This will fix the problem with rotating builders; they were updated to use the llvm_next builder, but this script was not updated to use llvm_next. BUG=chromium:674804 TEST=Tested in role account on chrotomation2, launching rotating builder. Change-Id: Ifd4ba57cf403feae0b0b84c8b21accb34987ecbc Reviewed-on: https://chromium-review.googlesource.com/424893 Reviewed-by: Yunlian Jiang <yunlian@chromium.org> Commit-Queue: Caroline Tice <cmtice@chromium.org> Tested-by: Caroline Tice <cmtice@chromium.org>
2017-01-03buildbot_utils.py: do not get build_id for async build.Yunlian Jiang
The build_id is not useful for async builds, so there is no need to try to get it. BUG=chromium:674804 TEST=None Change-Id: If5781955834ca35958b1efead2dd9628e7a905de Reviewed-on: https://chromium-review.googlesource.com/424794 Reviewed-by: Ting-Yuan Huang <laszio@chromium.org> Commit-Queue: Yunlian Jiang <yunlian@chromium.org> Tested-by: Yunlian Jiang <yunlian@chromium.org>
2016-12-28Update ChromeOS Toolchain buildbot for llvm-next jobs.Manoj Gupta
Update toolchain buildbot script to report data for llvm-next builds. BUG=chromium:677317 TEST=None Change-Id: I45b25a735ee8ba956d38c1e45d0db2d8acd06e70 Reviewed-on: https://chromium-review.googlesource.com/424317 Commit-Queue: Manoj Gupta <manojgupta@chromium.org> Tested-by: Manoj Gupta <manojgupta@chromium.org> Reviewed-by: Yunlian Jiang <yunlian@chromium.org>
2016-12-15toolchain-utils: Enable to print waterfall summary by date.Yunlian Jiang
BUG=chromium:674727 TEST=the '--date' option is added. Change-Id: Ia28faa8fd41145fbb27b79065518eb68da654f90 Reviewed-on: https://chrome-internal-review.googlesource.com/311924 Commit-Ready: Yunlian Jiang <yunlian@google.com> Tested-by: Yunlian Jiang <yunlian@google.com> Reviewed-by: Caroline Tice <cmtice@google.com>
2016-12-15buildbot_test_toolchains: Use LATEST-master as control groupTing-Yuan Huang
Rather than finding the official image with exact the same version as the trybot image, let's just use the latest one since trybot always get lastest or latest + 1. This also solves the problem that the official image specified may not exist. BUG=chromium:674652 TEST=Tested ToolchainComparator._GetVanillaImageName locally. Change-Id: I44fbceb99d8f6cf3187366c075c2a9522869b5a5 Reviewed-on: https://chrome-internal-review.googlesource.com/312516 Commit-Ready: Ting-Yuan Huang <laszio@google.com> Tested-by: Ting-Yuan Huang <laszio@google.com> Reviewed-by: Caroline Tice <cmtice@google.com>
2016-12-15Remove local references to cmtice files.Manoj Gupta
Previous change to script left references to test directories in personal location. BUG=None TEST=No error when fetching files Change-Id: I33347a0fc2a09ccb66ae2e8a4b229f5adaf29aaf Reviewed-on: https://chrome-internal-review.googlesource.com/311869 Commit-Ready: Manoj Gupta <manojgupta@google.com> Tested-by: Manoj Gupta <manojgupta@google.com> Reviewed-by: Caroline Tice <cmtice@google.com>
2016-12-15Add argument options to waterfall summary report.Caroline Tice
Now there are options to generate just the main waterfall report, or just the rotating builders report, with or without the failures section; or just the failures report section. There's also the option to NOT update the data files (makes it easier to re-run reports). Also, replaces the llvm rotating builder with the llvm-next rotating builder. BUG=chromium:673833 TEST=Tested in my directory. Change-Id: If784758112c36c3d18c4b292f9229b53b047848c Reviewed-on: https://chrome-internal-review.googlesource.com/311775 Commit-Ready: Caroline Tice <cmtice@google.com> Tested-by: Caroline Tice <cmtice@google.com> Reviewed-by: Yunlian Jiang <yunlian@google.com>
2016-12-14Check for prodacess before running waterfall summary report.Manoj Gupta
Check if prodaccess has not expired. If it is expired, error out and ask to run prodacess. BUG=chromium:674218 TEST=Locally tested Change-Id: I20129c69c17956ed6edda57949ea49546c9b1d85 Reviewed-on: https://chrome-internal-review.googlesource.com/312040 Commit-Ready: Manoj Gupta <manojgupta@google.com> Tested-by: Manoj Gupta <manojgupta@google.com> Reviewed-by: Caroline Tice <cmtice@google.com>