aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2017-12-08Adding PushFilePreparer to test config file to support use of --push optionHakan Lindh
Add PushFilePreparer so we can push files to device Bug: 70224816 Test: Change-Id: Iec6c8fe39357073b37cb19bdd6629ba163f6ea37
2017-12-07Manually merge changes from giant AOSP topicStephen Li
Change-Id: I52686936bebc00ebf78b1ab9949064035851711f
2017-12-07DO NOT MERGE: Merge Oreo MR1 into master am: e5aba25c43 -s oursXin Li
am: 712ac63a69 Change-Id: I4ab3958a1e83a74219f620876a420e01969369fa
2017-12-07DO NOT MERGE: Merge Oreo MR1 into masterXin Li
am: e5aba25c43 -s ours Change-Id: Ie0de0e25eb8c6cb1cfbf39b8576854727bc59df3
2017-12-06DO NOT MERGE: Merge Oreo MR1 into masterandroid-wear-p-preview-2android-wear-8.0.0_r1android-p-preview-3android-p-preview-2android-p-preview-1android-o-mr1-iot-release-1.0.1android-o-mr1-iot-release-1.0.0android-o-mr1-iot-preview-8android-o-mr1-iot-preview-7o-mr1-iot-preview-8o-mr1-iot-preview-7Xin Li
Exempt-From-Owner-Approval: Changes already landed internally Change-Id: I457f501115484af6ee75e846e981c6eac6d31959
2017-12-05Use IDisableable base class for implementationsjdesprez
Test: unit tests Bug: 62666131 Change-Id: Ifba872063005601a41a5261fcab7edae786b6bbe
2017-12-04Add preparers config for BackgroundDexOptServiceIntegrationTestsArthur Eubanks
Test: forrest --tf_verbose --tf_print_out \ --tf_binary_path="/usr/local/google/home/aeubanks/android/master/out/host/linux-x86/bin/tradefed.sh" \ test ab::4480252:walleye-userdebug:git_master \ atp:/google/src/cloud/aeubanks/deoptappstest/google3/wireless/android/test_tools/atp/config/test/framework/bgdexopt_test.gcl Change-Id: Id426d0b1df1be726c79fed2fd986903e8691860f
2017-11-29Move SetPackagesRecentlyUsed to tools/, add packages optionArthur Eubanks
Add option to specify which packages to set recently used. Test: integration test using atest Change-Id: Ieed60c939fbd406d23461c8de5c0d8b17a139cc0
2017-10-30Adding Camera test config file for Easel testsHakan Lindh
Adding config file for Camera tests on Easel builds. Bug: 67849515 Test: run google/template/local --template:map reporters google/template/reporters/rdb-run-metrics --template:map test google/test/framework/media/camera-performance-easel --test-tag camera_framework_performance_with_easel --run-command "setprop persist.camera.hdrplus.enable 1" --ru-key camera_framework_performance_with_easel_smoke --run-command "pm disable-user com.google.intelligence.sense" --run-command "settings put secure assist_gesture_enabled 0" --run-command "settings put secure assist_gesture_wake_enabled 0" --run-command "settings put secure assist_gesture_setup_complete 0" --apk-path /google/data/ro/teams/tradefed/testdata/camera/apps/CtsCameraTestCases_oc_mr1.apk --install-arg -d --install-arg -r --product-type taimen --branch git_oc-mr1-easel-release Change-Id: Idaa53d94392cc8b204c724eb8abac25d51ff7427
2017-10-23Revert "Add some target preparers and add tests"Arthur Eubanks
This reverts commit bcff3fdb8cf4eff1035261dee2b09d6af502de80. Test: m google-tradefed-all Change-Id: I66c5a7b0cd32f4ee8fd6c9193602333153ab495d
2017-10-23Merge "Revert "Fix RestartSystemServerTargetPreparer by trimming output""TreeHugger Robot
2017-10-23Merge "Revert "Add misc target preparers plus testing for contrib""TreeHugger Robot
2017-10-23Revert "Fix RestartSystemServerTargetPreparer by trimming output"Arthur Eubanks
This reverts commit 2a62cebd0fc941269ae6fd7e0193ce20197ddeaf. Change-Id: I1cf15ec2abb44e3361e67c6ad5aca355d9f02a08
2017-10-23Revert "Add misc target preparers plus testing for contrib"Julien Desprez
This reverts commit 90512d398cab5cbca6fc5ff74f4b38ed953b52de. Change-Id: Icd17b8763ca72b31535fdd4aab72f180ae62b510
2017-10-22Merge "Add misc target preparers plus testing for contrib"TreeHugger Robot
2017-10-21Add misc target preparers plus testing for contribArthur Eubanks
Add following target preparers: Fill up storage to specified amount Restart system server (no reboot) adb root device Save time to restore after test Set and reset system properties Also added tf contrib unit test suite Test: run_tradefed_tests.sh Test: atest on a custom test using all of the above target preparers Change-Id: I49d73301f6be7fa69eb0bceacf51800feb46ca10
2017-10-20Merge "ImageAnalyzer fix: Allow complete analysis along x-axis"Hakan Lindh
2017-10-19Fix RestartSystemServerTargetPreparer by trimming outputArthur Eubanks
getprop result can contain whitespace, so trim it. Test: run_tradefed_tests.sh Change-Id: I0f97dad60128b96e9059f357ea604969db3f2475
2017-10-19ImageAnalyzer fix: Allow complete analysis along x-axisHakan Lindh
Due to Dragon's fairly poor audio loopback responses, the analysis ignores a part in the beginning of the image, otherwise we would not get any data from dragon. This change restores inspection of the whole x-axis for smaller devices. Bug: 68001193 Change-Id: If4cdb1aa9bd915c021feee30e654f2e443878549 Fixes: 68001193
2017-10-18Fix RestartSystemServerTargetPreparerArthur Eubanks
Make it set sys.boot_complete to 0, then poll for when it turns to 1 before exiting. Test: run_tradefed_tests.sh Change-Id: I783d1ceaf0a849eedf5d31a4ef5dea6cecd820f5
2017-10-11Add some target preparers and add testsArthur Eubanks
One target preparer that just reboot One target preparer that restarts the system server Also added contrib tests as part of google-tradefed-all Test: run_tradefed_tests.sh Change-Id: I2a24e08e7c86199e9cab66a602417c18be0b4c1a
2017-10-03Add new configs for revised and new widevine unittestsKyle Alexander
Two unit tests were renamed, and two new tests were added to oc-mr1-dev. Need to add these "new" tests to tradefed to be executed on oc-mr1-dev or later. Test: tradefed run google/test/framework/media/widevine/tests/widevine-counter-metric-unit tradefed run google/test/framework/media/widevine/tests/widevine-distribution-metric-unit tradefed run google/test/framework/media/widevine/tests/widevine-event-metric-unit tradefed run google/test/framework/media/widevine/tests/widevine-value-metric-unit Bug: 65675252 Change-Id: If5a5aa696d776e12cbdf4ddfa879b22c7b8395d4
2017-09-26Docs: Remove deprecated docs build rule using old templates.Billy Lamberta
Promoted tradefed-ds-docs build rule to default, tradefed-docs. Test: make tradefed-docs Change-Id: I73cfca6b3d7eae5942939ea1ce3e76d31a521323
2017-09-26ImageAnalyzer fix for wave amplitude calculationsHakan Lindh
Decreasing required space between samples when determining amplitudes. Bug: 65202353 Test: run google/test/framework/media/audio-loopback-stress Change-Id: I30dc65005c88d434ff83f0f4acc2799dfb8c088f
2017-09-20Move Vp8CodecTest to RtcVideoCodecTestKyle Alexander
go/ag/2799159 changed the classname to RtcVideoCodecTestBase. Need to update the name in the gts-media test list to match. Test: Execute gts-media package in tradefederation. Bug: 65755838 Change-Id: I0b8f34c3109f750787d57ffd0b310d64c9a72386
2017-09-07 Move Media Test files from core to contribHakan Lindh
Moving media tests to contrib project - addition cl Bug: None Test: TBD Change-Id: Ie8c861a33b6b30b8f73bfd3a30a900b7152f98c3
2017-08-23Merge "Ensure resource are closed"Julien Desprez
2017-08-23[Audio Loopback] Bug fixes and image analyzer fine-tuningHakan Lindh
AudioLoopbackTest.java - If audio level (headset leve) cannot be retrieved through extractDeviceHeadsetLevelFromAdbShell, don't fail the test. AudioLoopbackImageAnalyzer.java - Fine-tuning values for wave form image recognition - Fixed bug in Amplitude calculation code - Added code to ignore starting part of graph (horizontalStart) Bug: 64848985 Bug: 62191429 Test: tradefed.sh run google/test/framework/media/audio-loopback-stress Change-Id: Iaa68f80ba6ccac7ea16f59027e24b4e66fe2b511
2017-08-18Fix for Loopback Stress test nullpointer exceptionHakan Lindh
Plugs a nullpointer exception that occurs if an individual test iteration times out. Also added check to see if result data is good before printing it to CSV file Bug: 64715529 Change-Id: I4c5aaecd32b24fca3cb684f1a2b8b1adfcdb3287 Fixes: 64715529 Test: tradefed.sh run google/test/framework/media/audio-loopback-stress --iterations 10 -s 84B0115625000809
2017-08-15Fix to AudioLoopbackStress and AdbScreenrecord testsHakan Lindh
Fixes to Glitches test; after consultation with Audio Devs, a 4 step approach is taken to run Glitches test to minimize test flakiness. Also restructures basic test flow - once an error is detected and reported, but rather than returning up the calling hierarchy, an exception is thrown. Before, the test exited incorrectly and reported values even though the test had failed. This change affects both AudioLoopbackStress and AdbScreenrecord. Bug: 64715929 Bug: 64438393 Change-Id: I518f0c21c00fb1bff0ace17655d907ebdca63207 Fixes: Test: tradefed.sh run google/test/framework/media/adb-screen-record -s 84B0115625000809 Test: tradefed.sh run google/test/framework/media/audio-loopback-stress --iterations 1 --test-type 223 --buffer-test-duration 3600 -s 84B0115625000809 Test: tradefed.sh run google/test/framework/media/audio-loopback-stress --iterations 10 -s 84B0115625000809
2017-08-15Ensure resource are closedjdesprez
Test: unit tests Bug: 62864604 Change-Id: Iaba692b222fb1c74679b98759da095aa3e042587
2017-08-11Merge "Revert "Revert "Merge prod-tests/src/com/android/media/tests/ from ↵Hakan Lindh
platform/tools/tradefederation to src/com/android/media/tests/ BUG:63819116"""
2017-08-09Move hup related files to tradefed shareable folderYuchen He
Change-Id: Icee4b7e711d464b4b9875f9029d916748b0708f3
2017-08-07Heavy user profile setup for camera startup and latencyYuchen He
Change-Id: I379dc1a5c043dca366119d6be2d0bed482912d24
2017-08-03Merge "Merge prod-tests/res/config/google/test/framework/media/ from ↵Hakan Lindh
platform/vendor/google_tradefederation to res/config/google/test/framework/media/"
2017-08-02Revert "Revert "Merge prod-tests/src/com/android/media/tests/ from ↵Kuan-Tung Pan
platform/tools/tradefederation to src/com/android/media/tests/ BUG:63819116"" This reverts commit 14672dddc6362f1ae0857ee5255ef95628cb98db. Change-Id: Ie52f8d188281ff1351b40c309c6b19ae160ded4e
2017-07-26Revert "Merge prod-tests/src/com/android/media/tests/ from ↵Julien Desprez
platform/tools/tradefederation to src/com/android/media/tests/ BUG:63819116" Causing tests failure (go/tf-tests) This reverts commit 8d9e993516f8177bc46f3bd1a177b6cdfe698540. Change-Id: I429b8d67544c1b4c46ebc85829d1069b965b584c
2017-07-25Merge prod-tests/res/config/google/test/framework/media/ from ↵kuantung
platform/vendor/google_tradefederation to res/config/google/test/framework/media/
2017-07-25Merge prod-tests/src/com/android/media/tests/ kuantung
from platform/tools/tradefederation to src/com/android/media/tests/ BUG:63819116
2017-07-11Enable tradefed error_prone rules on contrib toooreo-mr1-devjdesprez
Ensure we maintain the basic same standard in TF. Test: build with error prone Change-Id: Ib745cde06ba6bc7275ba0ce5af763a057e968d4b
2017-06-29Merge "AudioLoopback bug fixes"Hakan Lindh
2017-06-28Adb screenrecord test: feature requests implementation + bugfixHakan Lindh
Refactoring code - utilizing TestRunHelper class. Also swapping unlock() for disableKeyguard() 63060822: Need to convert field string values to numbers, otherwise it will not work with blackbox Bug: 63114860 Bug: 63060822 Fixes: 63114860 Test: tradefed.sh run google/test/framework/media/adb-screen-record -s <device serial number> Change-Id: I3c9919145868914314d0af906696445f03926691
2017-06-28AudioLoopback bug fixesHakan Lindh
b/63096300: Fixed problem with reported data to Blackbox - field name was missing prefix ("48000_Mic3_") so the fields were treated as completely new fields. b/63096300: Never seen this on my host, but in the lab I'm getting nullpointer exception when trying to open log files (code fix, AudioLoopbackTest, line 640 + line 692) b/63104260: In all exitement of creating a new test, I forgot to assemble the test data (metrics) and pass up to test harness. (added function "populateStressTestMetrics") b/63109598: Enabled more logfiles in array AudioLoopbackTest.LATENCY_TEST_LOGS for Latency test. Bug: 63096300 Bug: 63074048 Bug: 63104260 Bug: 63109598 Fixes: Test: tradefed.sh run google/test/framework/media/audio-loopback-stress --iterations 1000 -s <device serial number> Change-Id: I8026ebbe3b5d4e0133ad234fc3e99dc0d6bc69da
2017-06-26Merge "[AUDIO LOOPBACK TEST] Added Audio Latency Stress Config file"Hakan Lindh
2017-06-23Added Audio Latency Stress testHakan Lindh
Added test parameter “--iterations <nr>” so we can run a 1000 iteration stress test for Audio Latency. NOTE: For legacy reasons, not passing “--iterations” option OR passing “--iterations 1” will perform the Audio Latency and Audio Glitch tests we see on go/android-media today. For reviewer: Main entry point for test is “public void run(...)”. Test runs with screenshots are uploaded to: https://drive.google.com/drive/folders/0B-xFu1lUmgiqRldHdUhEcFRfWVU?usp=sharing TEST STRATEGY: RUN test 1000 times. In each iteration, collect result files from device, parse and collect data in a ResultData object that also keeps track of location to test files for a particular iteration. ANALYZE test results to produce statistics for 1. Latency and Confidence (Min, Max, Mean, Median) 2. Create CSV file with test run data 3. Print bad test data to host log file 4. Get number of test runs with valid data to send to dashboard 5. Produce histogram in host log file; count number of test results that fall into 1 ms wide buckets. UPLOAD test results + log files from “bad” runs; i.e. runs that is missing some or all result data + that deviates +- 2 ms from Latency Median value. Uploads up to 5 random files (MAX_NR_OF_LOG_UPLOADS) that meet criteria above. Bug: 35153171 Fixes: Test: tradefed.sh run google/test/framework/media/audio-loopback-stress --iterations 1000 -s <device serial number> Change-Id: I1521b3021bc656d77f01788748f480ce555a7430
2017-06-22Merge "Adding config file for "adb screenrecord ..." command"Hakan Lindh
2017-06-22Merge "Adding test for 'adb screenrecord'"Hakan Lindh
2017-06-22Adding test for 'adb screenrecord'Hakan Lindh
Adding test to verify that "adb screenrecord" command works. Test has optional parameters: --time-limit (seconds) --bit-rate (megabits per second) --size (e.g. 1280x720) Bug: 34596564 Fixes: Test: run google/test/framework/media/adb-screen-record [options] -s <deivce serial> Change-Id: I04b4c1406a408066c87a5691cd8c25195d740666
2017-06-19[MULTIMETER] Fix for abnormally high lipsync values + minor bug fixesHakan Lindh
b/62488246: Adding new option "debug-without-hardware" b//62460723: Supressing exception thrown when calling device.unlock() if unsupported. b/38205685: IP multimeter ignore poorly triggered lipsync times The multimeter tests have been reporting high values for lipsync max time recently. These have been tracked to single instances (per run) of a spurious black output frame. The lip sync indicator triggers off of this extra frame. Since the spurious frame comes almost a second early, the lipsync calculations for that frame turn out to be almost a second (we see 900 msec). The lipsync indicators (sound + black frame) are supposed to be every 2 seconds. This change ignores lipsync reports if they are less than 1.5 seconds after the previous one. Bug: 38205685 Bug: 62488246 Bug: 62460723 Test: atp test asit/media/video_performance Change-Id: I3bbf86fd3fe2fe60ced857aaa6e8aec639a30075
2017-06-16Merge "Update unit test configs for Widevine unit tests" into oc-dev am: ↵Kyle Alexander
7778abfb93 am: 4e851cd4cd am: 40fe5ffa2b Change-Id: I7c64f86f9761a21dadf4408efb6b99613fc5fd36
generated by cgit v1.2.3 (git 2.25.1) at 2024-07-20 09:52:34 +0000