aboutsummaryrefslogtreecommitdiff
path: root/src
AgeCommit message (Collapse)Author
2017-12-05Use IDisableable base class for implementationsjdesprez
Test: unit tests Bug: 62666131 Change-Id: Ifba872063005601a41a5261fcab7edae786b6bbe
2017-11-29Move SetPackagesRecentlyUsed to tools/, add packages optionArthur Eubanks
Add option to specify which packages to set recently used. Test: integration test using atest Change-Id: Ieed60c939fbd406d23461c8de5c0d8b17a139cc0
2017-10-23Revert "Add some target preparers and add tests"Arthur Eubanks
This reverts commit bcff3fdb8cf4eff1035261dee2b09d6af502de80. Test: m google-tradefed-all Change-Id: I66c5a7b0cd32f4ee8fd6c9193602333153ab495d
2017-10-23Merge "Revert "Fix RestartSystemServerTargetPreparer by trimming output""TreeHugger Robot
2017-10-23Merge "Revert "Add misc target preparers plus testing for contrib""TreeHugger Robot
2017-10-23Revert "Fix RestartSystemServerTargetPreparer by trimming output"Arthur Eubanks
This reverts commit 2a62cebd0fc941269ae6fd7e0193ce20197ddeaf. Change-Id: I1cf15ec2abb44e3361e67c6ad5aca355d9f02a08
2017-10-23Revert "Add misc target preparers plus testing for contrib"Julien Desprez
This reverts commit 90512d398cab5cbca6fc5ff74f4b38ed953b52de. Change-Id: Icd17b8763ca72b31535fdd4aab72f180ae62b510
2017-10-22Merge "Add misc target preparers plus testing for contrib"TreeHugger Robot
2017-10-21Add misc target preparers plus testing for contribArthur Eubanks
Add following target preparers: Fill up storage to specified amount Restart system server (no reboot) adb root device Save time to restore after test Set and reset system properties Also added tf contrib unit test suite Test: run_tradefed_tests.sh Test: atest on a custom test using all of the above target preparers Change-Id: I49d73301f6be7fa69eb0bceacf51800feb46ca10
2017-10-20Merge "ImageAnalyzer fix: Allow complete analysis along x-axis"Hakan Lindh
2017-10-19Fix RestartSystemServerTargetPreparer by trimming outputArthur Eubanks
getprop result can contain whitespace, so trim it. Test: run_tradefed_tests.sh Change-Id: I0f97dad60128b96e9059f357ea604969db3f2475
2017-10-19ImageAnalyzer fix: Allow complete analysis along x-axisHakan Lindh
Due to Dragon's fairly poor audio loopback responses, the analysis ignores a part in the beginning of the image, otherwise we would not get any data from dragon. This change restores inspection of the whole x-axis for smaller devices. Bug: 68001193 Change-Id: If4cdb1aa9bd915c021feee30e654f2e443878549 Fixes: 68001193
2017-10-18Fix RestartSystemServerTargetPreparerArthur Eubanks
Make it set sys.boot_complete to 0, then poll for when it turns to 1 before exiting. Test: run_tradefed_tests.sh Change-Id: I783d1ceaf0a849eedf5d31a4ef5dea6cecd820f5
2017-10-11Add some target preparers and add testsArthur Eubanks
One target preparer that just reboot One target preparer that restarts the system server Also added contrib tests as part of google-tradefed-all Test: run_tradefed_tests.sh Change-Id: I2a24e08e7c86199e9cab66a602417c18be0b4c1a
2017-09-26ImageAnalyzer fix for wave amplitude calculationsHakan Lindh
Decreasing required space between samples when determining amplitudes. Bug: 65202353 Test: run google/test/framework/media/audio-loopback-stress Change-Id: I30dc65005c88d434ff83f0f4acc2799dfb8c088f
2017-08-23Merge "Ensure resource are closed"Julien Desprez
2017-08-23[Audio Loopback] Bug fixes and image analyzer fine-tuningHakan Lindh
AudioLoopbackTest.java - If audio level (headset leve) cannot be retrieved through extractDeviceHeadsetLevelFromAdbShell, don't fail the test. AudioLoopbackImageAnalyzer.java - Fine-tuning values for wave form image recognition - Fixed bug in Amplitude calculation code - Added code to ignore starting part of graph (horizontalStart) Bug: 64848985 Bug: 62191429 Test: tradefed.sh run google/test/framework/media/audio-loopback-stress Change-Id: Iaa68f80ba6ccac7ea16f59027e24b4e66fe2b511
2017-08-18Fix for Loopback Stress test nullpointer exceptionHakan Lindh
Plugs a nullpointer exception that occurs if an individual test iteration times out. Also added check to see if result data is good before printing it to CSV file Bug: 64715529 Change-Id: I4c5aaecd32b24fca3cb684f1a2b8b1adfcdb3287 Fixes: 64715529 Test: tradefed.sh run google/test/framework/media/audio-loopback-stress --iterations 10 -s 84B0115625000809
2017-08-15Fix to AudioLoopbackStress and AdbScreenrecord testsHakan Lindh
Fixes to Glitches test; after consultation with Audio Devs, a 4 step approach is taken to run Glitches test to minimize test flakiness. Also restructures basic test flow - once an error is detected and reported, but rather than returning up the calling hierarchy, an exception is thrown. Before, the test exited incorrectly and reported values even though the test had failed. This change affects both AudioLoopbackStress and AdbScreenrecord. Bug: 64715929 Bug: 64438393 Change-Id: I518f0c21c00fb1bff0ace17655d907ebdca63207 Fixes: Test: tradefed.sh run google/test/framework/media/adb-screen-record -s 84B0115625000809 Test: tradefed.sh run google/test/framework/media/audio-loopback-stress --iterations 1 --test-type 223 --buffer-test-duration 3600 -s 84B0115625000809 Test: tradefed.sh run google/test/framework/media/audio-loopback-stress --iterations 10 -s 84B0115625000809
2017-08-15Ensure resource are closedjdesprez
Test: unit tests Bug: 62864604 Change-Id: Iaba692b222fb1c74679b98759da095aa3e042587
2017-08-02Revert "Revert "Merge prod-tests/src/com/android/media/tests/ from ↵Kuan-Tung Pan
platform/tools/tradefederation to src/com/android/media/tests/ BUG:63819116"" This reverts commit 14672dddc6362f1ae0857ee5255ef95628cb98db. Change-Id: Ie52f8d188281ff1351b40c309c6b19ae160ded4e
2017-07-26Revert "Merge prod-tests/src/com/android/media/tests/ from ↵Julien Desprez
platform/tools/tradefederation to src/com/android/media/tests/ BUG:63819116" Causing tests failure (go/tf-tests) This reverts commit 8d9e993516f8177bc46f3bd1a177b6cdfe698540. Change-Id: I429b8d67544c1b4c46ebc85829d1069b965b584c
2017-07-25Merge prod-tests/src/com/android/media/tests/ kuantung
from platform/tools/tradefederation to src/com/android/media/tests/ BUG:63819116
2017-06-29Merge "AudioLoopback bug fixes"Hakan Lindh
2017-06-28Adb screenrecord test: feature requests implementation + bugfixHakan Lindh
Refactoring code - utilizing TestRunHelper class. Also swapping unlock() for disableKeyguard() 63060822: Need to convert field string values to numbers, otherwise it will not work with blackbox Bug: 63114860 Bug: 63060822 Fixes: 63114860 Test: tradefed.sh run google/test/framework/media/adb-screen-record -s <device serial number> Change-Id: I3c9919145868914314d0af906696445f03926691
2017-06-28AudioLoopback bug fixesHakan Lindh
b/63096300: Fixed problem with reported data to Blackbox - field name was missing prefix ("48000_Mic3_") so the fields were treated as completely new fields. b/63096300: Never seen this on my host, but in the lab I'm getting nullpointer exception when trying to open log files (code fix, AudioLoopbackTest, line 640 + line 692) b/63104260: In all exitement of creating a new test, I forgot to assemble the test data (metrics) and pass up to test harness. (added function "populateStressTestMetrics") b/63109598: Enabled more logfiles in array AudioLoopbackTest.LATENCY_TEST_LOGS for Latency test. Bug: 63096300 Bug: 63074048 Bug: 63104260 Bug: 63109598 Fixes: Test: tradefed.sh run google/test/framework/media/audio-loopback-stress --iterations 1000 -s <device serial number> Change-Id: I8026ebbe3b5d4e0133ad234fc3e99dc0d6bc69da
2017-06-23Added Audio Latency Stress testHakan Lindh
Added test parameter “--iterations <nr>” so we can run a 1000 iteration stress test for Audio Latency. NOTE: For legacy reasons, not passing “--iterations” option OR passing “--iterations 1” will perform the Audio Latency and Audio Glitch tests we see on go/android-media today. For reviewer: Main entry point for test is “public void run(...)”. Test runs with screenshots are uploaded to: https://drive.google.com/drive/folders/0B-xFu1lUmgiqRldHdUhEcFRfWVU?usp=sharing TEST STRATEGY: RUN test 1000 times. In each iteration, collect result files from device, parse and collect data in a ResultData object that also keeps track of location to test files for a particular iteration. ANALYZE test results to produce statistics for 1. Latency and Confidence (Min, Max, Mean, Median) 2. Create CSV file with test run data 3. Print bad test data to host log file 4. Get number of test runs with valid data to send to dashboard 5. Produce histogram in host log file; count number of test results that fall into 1 ms wide buckets. UPLOAD test results + log files from “bad” runs; i.e. runs that is missing some or all result data + that deviates +- 2 ms from Latency Median value. Uploads up to 5 random files (MAX_NR_OF_LOG_UPLOADS) that meet criteria above. Bug: 35153171 Fixes: Test: tradefed.sh run google/test/framework/media/audio-loopback-stress --iterations 1000 -s <device serial number> Change-Id: I1521b3021bc656d77f01788748f480ce555a7430
2017-06-22Merge "Adding test for 'adb screenrecord'"Hakan Lindh
2017-06-22Adding test for 'adb screenrecord'Hakan Lindh
Adding test to verify that "adb screenrecord" command works. Test has optional parameters: --time-limit (seconds) --bit-rate (megabits per second) --size (e.g. 1280x720) Bug: 34596564 Fixes: Test: run google/test/framework/media/adb-screen-record [options] -s <deivce serial> Change-Id: I04b4c1406a408066c87a5691cd8c25195d740666
2017-06-19[MULTIMETER] Fix for abnormally high lipsync values + minor bug fixesHakan Lindh
b/62488246: Adding new option "debug-without-hardware" b//62460723: Supressing exception thrown when calling device.unlock() if unsupported. b/38205685: IP multimeter ignore poorly triggered lipsync times The multimeter tests have been reporting high values for lipsync max time recently. These have been tracked to single instances (per run) of a spurious black output frame. The lip sync indicator triggers off of this extra frame. Since the spurious frame comes almost a second early, the lipsync calculations for that frame turn out to be almost a second (we see 900 msec). The lipsync indicators (sound + black frame) are supposed to be every 2 seconds. This change ignores lipsync reports if they are less than 1.5 seconds after the previous one. Bug: 38205685 Bug: 62488246 Bug: 62460723 Test: atp test asit/media/video_performance Change-Id: I3bbf86fd3fe2fe60ced857aaa6e8aec639a30075
2017-06-09Add in reboot test to replace existing example test.android-vts-8.0_r2android-vts-8.0_r1oreo-devKevin Cheng
Bug: None Test: Built and ran test successfully. > tradefed.sh run commandAndExit example/reboot Change-Id: Ib1db0b1cefbd958d37eaa8636febcc32d3e484a9
2017-05-23Remove prod-tests dir.Kevin Cheng
Also move example config and test up one level to still act as an example. Bug: 38383668 Test: Manually built tradefed-all with no issues. Change-Id: I48262710b367c78afbc97a12facadb7c2c6d9b34 (cherry picked from commit 45e676c7282addf4f796949829b370c946f36b57)
2017-05-12Merge "Fix camera frame stress tests reporting."TreeHugger Robot
2017-05-10Fix camera frame stress tests reporting.Ying
Test: local run https://sponge.corp.google.com/invocation?tab=Test+Cases&show=FAILED&show=INTERNAL_ERROR&id=3b8a3ebf-6d96-4e33-ad9a-026be741aa37 Bug: 37223747 Change-Id: I89e541dcb175226e069595034fe64886bbb7e858
2017-05-09Fix camera stress test reportingjdesprez
The double extension of CollectingTestListener was hidding the new testEnded callback resulting in result not being forwarded to reporters. Test: local run http://sponge.corp.google.com/invocation?tab=Test+Cases&show=FAILED&show=INTERNAL_ERROR&id=77599989-8467-42d7-b386-05a853cbd719 Bug: 37223747 Change-Id: I922792b6c3bdef3445339656ed8966eba2d3d018
2017-05-04Seed aosp tf contrib project.Kevin Cheng
Add in example test/configs/preparer to set precedent as well as normal project stuff (makefiles, readmes, etc) to get things building (and to also make sure build files work). BUG:36556899 Test: Built and started tf with seeded config and test. Change-Id: Ia8eb408da272c424f626c8f77a91bb0eed6a656a (cherry picked from commit 68af8b89b22020ae4463a2c77003bde4133650cb)
2017-04-27Added camera burst startup test running in tf.Ying
Test: camera performance Change-Id: I5b05df9a2948ea54cfd3bdc66f34a6f277549ba9
2017-04-04Added json parser for CTS camera performance testsYing
Test: camera performance test restore ag/1273728 Change-Id: Ib5c0a67b6bb8f1d2ec06774c54bb8f51ba235cc7
2017-03-20Use less SnapshotInputStreamSourceEric Rowe
Replace `new SnapshotInputStreamSource(new FileInputStream(s))` with `new FileInputStream(s)`. Replace `new SnapshotInputStreamSource(new ByteArrayInputStream(s))` with `new ByteArrayInputStreamSource(s)` Bug: 36397380 Test: Build and run TF unit tests. Change-Id: If9ac9908539f6d1b1ede26fd2b0e759a2f92e845
2017-03-07Add a rule for equality checkJulien Desprez
- Put protos in their own target to avoid the generated files from being included in error_prone checks. Test: local run, unit tests Bug: 35864476 Change-Id: Ifcb250e7c19ddc17f9df653d71620e0811930403
2017-03-02Enforce some basic error prone build rulesJulien Desprez
Start enforcing some basic build rules against TF AOSP for starter. - Fix the string format issue. Test: error prone run Bug: 35864476 Change-Id: Ia6bb9a7acd6883e1240bf83f5451e66b3298c6f8
2017-02-20Fix build warnings for tools/tradefedJulien Desprez
Test: build locally Bug: 35471296 Change-Id: I7915b081b8055683877d957731e3f617bbb8c64b
2016-12-19Clean some code base usageJulien Desprez
Bug: 32101899 Change-Id: If900a38f79dfebd709eb7b0ced573a6ebf047570
2016-12-14Address some code base usageJulien Desprez
- close utility - cancel utility - deleteFile utility - logging of stacks Bug: 32101899 Change-Id: Id988f12ae6d05456cac3a397c01059b81cf64b02
2016-12-02Fix some clog.e mis-usageJulien Desprez
Ensure clog.e will be helpful in debugging. Bug: 32101899 Change-Id: I4005f1094c062fb50feb470a66710c6df309cd97
2016-09-07Fix for bug 30189425:Hakan Lindh
Bug: 30189425 Fixes: 30189425 Test: VideoMultimeter Change-Id: Iaaa5469f1ac2d451414fd923be00953017ae8e33 Fail test if no data was collected from Multimeter
2016-07-22modify the report format to use RdbRunMetricswshen
Change-Id: I92c6b483b2931d827b75158e3c128f57b4af7d78
2016-07-20post more metrics of stress test to dashboardwshen
Change-Id: I65dd05ae4b97d465bac7ece5244cc44935da9b7d
2016-07-05Fix project warnings for easier readabilityJulien Desprez
Fix imports, javadocs, exception warnings to improve the readability of the project in IDE. Bug: 29964378 Change-Id: Ib1b0e15ac8d281c5462147f013015039e8a2cfe1
2016-05-31DeviceNotAvailable track the serial of the deviceJulien Desprez
Required to track which device throw the exception in a multi device environment. - Deprecate the old constructor. - Update TF code base. Bug: 29043852 Change-Id: Id24fc0f01dd7e96127083b472d0fe0f2763721d0