# `android_bench_suite`

This is a Android Toolchain benchmark suite.

Where to find this suite:

This suite locates at google3, please create a google3 branch first, then run:

```
$ cd experimental/users/zhizhouy/benchtoolchain
```

Copy this directory to the place you want to put it.

To use this suite:
1.  Configure the basic envrionment in `env_setting` file.

2.  Run `./apply_patches.py`, which will:

    1.  Patch all the android benchmarks in the android tree.
        Benchmark Panorama does not exist in android tree, so perftests/
        gets copied into the top-level of android tree.

    2.  Apply patch autotest.diff to `android_root/external/autotest`, which
        includes all the test scripts for benchmarks. Copy testcases to
        related autotest directory.

    If you have applied the patch partially and hope to discard the
    patch, just run `discard_patches.py`

3.  Build and run benchmark on the device using ./run.py. You can either
    use test configuration file (-t `test_config`), or set all the variables
    manually.

4.  The raw results locate at `bench_result_*` in bench suite home
    directory.

5.  The JSON format result will be generated for crosperf report.

Utility tools:

1.  Autotest is a test framework located in android exteranl/autotest
    Before first time running it, please run
    `utils/build_externals.py` first to ensure all the environments
    and tools needed are installed.

2.  Crosperf is a report generating tool in ChromeOS toolchain utilities.
    Please look for it in chromium source:
    `src/third_party/toolchain-utils/crosperf`.