aboutsummaryrefslogtreecommitdiff
path: root/src
AgeCommit message (Collapse)Author
2018-06-06Update Camera test interface to continue postingandroid-9.0.0_r47android-9.0.0_r46android-9.0.0_r45android-9.0.0_r44android-9.0.0_r43android-9.0.0_r42android-9.0.0_r41android-9.0.0_r40android-9.0.0_r39android-9.0.0_r38android-9.0.0_r37android-9.0.0_r36android-9.0.0_r35android-9.0.0_r34android-9.0.0_r33android-9.0.0_r32android-9.0.0_r31android-9.0.0_r30android-9.0.0_r22android-9.0.0_r21android-9.0.0_r20android-9.0.0_r19android-9.0.0_r16pie-qpr3-s1-releasepie-qpr3-releasepie-qpr3-b-releasepie-qpr2-releasepie-qpr1-s3-releasepie-qpr1-s2-releasepie-qpr1-s1-releasepie-qpr1-releasepie-dr1-devpie-devpie-b4s4-releasepie-b4s4-devJulien Desprez
Camerage tests have an odd way of reporting tests, fix the interface so results go through. Test: Url: http://sponge.corp.google.com/invocation?tab=Test+Cases&show=FAILED&show=INTERNAL_ERROR&id=0c490671-a48b-4146-b669-786abfbb725b Bug: 109667929 Change-Id: I5b7ed73471710f2303861f00c519ff899336ff02
2018-05-31Update to proto metrics testRunEndedJulien Desprez
Test: unit tests Bug: 73163359 Change-Id: I95fe3a9d62925d3ca3acfba2f57de07b722d33c4
2018-05-29Update tests to use proto metrics interfaceJulien Desprez
Test: unit tests Bug: 73163359 Change-Id: Icef16f337fa45992c46894ce072a3a42162aa357
2018-05-22Update to proto interface metricJulien Desprez
Test: unit tests Bug: 73163359 Change-Id: I4403b82ca51b42920ca3c3c9792e281574617ca4
2018-04-05Remove an unused result reporterjdesprez
also submit the project files for tf contrib. Test: unit tests Bug: 77631478 Change-Id: I6949dac87d281432b4e33bfcfc21617cf97ad830
2018-03-09add TestzipLaunchControlProviderChris Wang
Bug:74200685 Test: sponge/920a7b38-b35c-41d7-91d9-e7317e2ec9af Add a new LCP that utilizes artifacts from two independent builds. Primary build: this is the build the test triggered from, test.zip artifact will be downloaded and used. It'll also be used as the default parameters when posting to dashboard (if not overwritten). Device build: this is the build all artifacts (except test.zip) will be downloaded from. Specifically, it is the build the device will be flashed with. Change-Id: Ia0bbc5c5183843c1419979f2a422014d7dff2a56
2018-02-23Add apk installer to amperf-preparersArthur Eubanks
Also add some logging to AddWhitelistPackage Apk installer is so that whitelist will happen after packages are installed. Test: forrest Change-Id: Ia90186e7baa1e228e4f3af189eb5a634e55ef81a
2018-02-13Use whitelist instead of tempwhitelistArthur Eubanks
Test: make google-tradefed-all Test: forrest Change-Id: Iecbc53bfb11aa95c08bfa50481aa1b04bd04427f
2018-02-07replace TestIdentifier by TestDescriptionjdesprez
Large scale update of our interface. Test: build all targets Bug: 70543295 Change-Id: I17d9a0ec16e0b97ef7da906e0fd315d70653b04e
2018-01-09Add OptionClass and set default timeout for AddWhitelistPackageArthur Eubanks
Also update copyright Test: make Change-Id: I8a66c81fa999bf3a3d8668b4bf4d3fb1c6cd2776
2018-01-08Add target preparer to add packages to whitelistArthur Eubanks
Test: make google-tradefed-all Change-Id: I93254f3ad27957d225701aafa7840e45d1abf636
2017-12-05Use IDisableable base class for implementationsjdesprez
Test: unit tests Bug: 62666131 Change-Id: Ifba872063005601a41a5261fcab7edae786b6bbe
2017-11-29Move SetPackagesRecentlyUsed to tools/, add packages optionArthur Eubanks
Add option to specify which packages to set recently used. Test: integration test using atest Change-Id: Ieed60c939fbd406d23461c8de5c0d8b17a139cc0
2017-10-23Revert "Add some target preparers and add tests"Arthur Eubanks
This reverts commit bcff3fdb8cf4eff1035261dee2b09d6af502de80. Test: m google-tradefed-all Change-Id: I66c5a7b0cd32f4ee8fd6c9193602333153ab495d
2017-10-23Merge "Revert "Fix RestartSystemServerTargetPreparer by trimming output""TreeHugger Robot
2017-10-23Merge "Revert "Add misc target preparers plus testing for contrib""TreeHugger Robot
2017-10-23Revert "Fix RestartSystemServerTargetPreparer by trimming output"Arthur Eubanks
This reverts commit 2a62cebd0fc941269ae6fd7e0193ce20197ddeaf. Change-Id: I1cf15ec2abb44e3361e67c6ad5aca355d9f02a08
2017-10-23Revert "Add misc target preparers plus testing for contrib"Julien Desprez
This reverts commit 90512d398cab5cbca6fc5ff74f4b38ed953b52de. Change-Id: Icd17b8763ca72b31535fdd4aab72f180ae62b510
2017-10-22Merge "Add misc target preparers plus testing for contrib"TreeHugger Robot
2017-10-21Add misc target preparers plus testing for contribArthur Eubanks
Add following target preparers: Fill up storage to specified amount Restart system server (no reboot) adb root device Save time to restore after test Set and reset system properties Also added tf contrib unit test suite Test: run_tradefed_tests.sh Test: atest on a custom test using all of the above target preparers Change-Id: I49d73301f6be7fa69eb0bceacf51800feb46ca10
2017-10-20Merge "ImageAnalyzer fix: Allow complete analysis along x-axis"Hakan Lindh
2017-10-19Fix RestartSystemServerTargetPreparer by trimming outputArthur Eubanks
getprop result can contain whitespace, so trim it. Test: run_tradefed_tests.sh Change-Id: I0f97dad60128b96e9059f357ea604969db3f2475
2017-10-19ImageAnalyzer fix: Allow complete analysis along x-axisHakan Lindh
Due to Dragon's fairly poor audio loopback responses, the analysis ignores a part in the beginning of the image, otherwise we would not get any data from dragon. This change restores inspection of the whole x-axis for smaller devices. Bug: 68001193 Change-Id: If4cdb1aa9bd915c021feee30e654f2e443878549 Fixes: 68001193
2017-10-18Fix RestartSystemServerTargetPreparerArthur Eubanks
Make it set sys.boot_complete to 0, then poll for when it turns to 1 before exiting. Test: run_tradefed_tests.sh Change-Id: I783d1ceaf0a849eedf5d31a4ef5dea6cecd820f5
2017-10-11Add some target preparers and add testsArthur Eubanks
One target preparer that just reboot One target preparer that restarts the system server Also added contrib tests as part of google-tradefed-all Test: run_tradefed_tests.sh Change-Id: I2a24e08e7c86199e9cab66a602417c18be0b4c1a
2017-09-26ImageAnalyzer fix for wave amplitude calculationsHakan Lindh
Decreasing required space between samples when determining amplitudes. Bug: 65202353 Test: run google/test/framework/media/audio-loopback-stress Change-Id: I30dc65005c88d434ff83f0f4acc2799dfb8c088f
2017-08-23Merge "Ensure resource are closed"Julien Desprez
2017-08-23[Audio Loopback] Bug fixes and image analyzer fine-tuningHakan Lindh
AudioLoopbackTest.java - If audio level (headset leve) cannot be retrieved through extractDeviceHeadsetLevelFromAdbShell, don't fail the test. AudioLoopbackImageAnalyzer.java - Fine-tuning values for wave form image recognition - Fixed bug in Amplitude calculation code - Added code to ignore starting part of graph (horizontalStart) Bug: 64848985 Bug: 62191429 Test: tradefed.sh run google/test/framework/media/audio-loopback-stress Change-Id: Iaa68f80ba6ccac7ea16f59027e24b4e66fe2b511
2017-08-18Fix for Loopback Stress test nullpointer exceptionHakan Lindh
Plugs a nullpointer exception that occurs if an individual test iteration times out. Also added check to see if result data is good before printing it to CSV file Bug: 64715529 Change-Id: I4c5aaecd32b24fca3cb684f1a2b8b1adfcdb3287 Fixes: 64715529 Test: tradefed.sh run google/test/framework/media/audio-loopback-stress --iterations 10 -s 84B0115625000809
2017-08-15Fix to AudioLoopbackStress and AdbScreenrecord testsHakan Lindh
Fixes to Glitches test; after consultation with Audio Devs, a 4 step approach is taken to run Glitches test to minimize test flakiness. Also restructures basic test flow - once an error is detected and reported, but rather than returning up the calling hierarchy, an exception is thrown. Before, the test exited incorrectly and reported values even though the test had failed. This change affects both AudioLoopbackStress and AdbScreenrecord. Bug: 64715929 Bug: 64438393 Change-Id: I518f0c21c00fb1bff0ace17655d907ebdca63207 Fixes: Test: tradefed.sh run google/test/framework/media/adb-screen-record -s 84B0115625000809 Test: tradefed.sh run google/test/framework/media/audio-loopback-stress --iterations 1 --test-type 223 --buffer-test-duration 3600 -s 84B0115625000809 Test: tradefed.sh run google/test/framework/media/audio-loopback-stress --iterations 10 -s 84B0115625000809
2017-08-15Ensure resource are closedjdesprez
Test: unit tests Bug: 62864604 Change-Id: Iaba692b222fb1c74679b98759da095aa3e042587
2017-08-02Revert "Revert "Merge prod-tests/src/com/android/media/tests/ from ↵Kuan-Tung Pan
platform/tools/tradefederation to src/com/android/media/tests/ BUG:63819116"" This reverts commit 14672dddc6362f1ae0857ee5255ef95628cb98db. Change-Id: Ie52f8d188281ff1351b40c309c6b19ae160ded4e
2017-07-26Revert "Merge prod-tests/src/com/android/media/tests/ from ↵Julien Desprez
platform/tools/tradefederation to src/com/android/media/tests/ BUG:63819116" Causing tests failure (go/tf-tests) This reverts commit 8d9e993516f8177bc46f3bd1a177b6cdfe698540. Change-Id: I429b8d67544c1b4c46ebc85829d1069b965b584c
2017-07-25Merge prod-tests/src/com/android/media/tests/ kuantung
from platform/tools/tradefederation to src/com/android/media/tests/ BUG:63819116
2017-06-29Merge "AudioLoopback bug fixes"Hakan Lindh
2017-06-28Adb screenrecord test: feature requests implementation + bugfixHakan Lindh
Refactoring code - utilizing TestRunHelper class. Also swapping unlock() for disableKeyguard() 63060822: Need to convert field string values to numbers, otherwise it will not work with blackbox Bug: 63114860 Bug: 63060822 Fixes: 63114860 Test: tradefed.sh run google/test/framework/media/adb-screen-record -s <device serial number> Change-Id: I3c9919145868914314d0af906696445f03926691
2017-06-28AudioLoopback bug fixesHakan Lindh
b/63096300: Fixed problem with reported data to Blackbox - field name was missing prefix ("48000_Mic3_") so the fields were treated as completely new fields. b/63096300: Never seen this on my host, but in the lab I'm getting nullpointer exception when trying to open log files (code fix, AudioLoopbackTest, line 640 + line 692) b/63104260: In all exitement of creating a new test, I forgot to assemble the test data (metrics) and pass up to test harness. (added function "populateStressTestMetrics") b/63109598: Enabled more logfiles in array AudioLoopbackTest.LATENCY_TEST_LOGS for Latency test. Bug: 63096300 Bug: 63074048 Bug: 63104260 Bug: 63109598 Fixes: Test: tradefed.sh run google/test/framework/media/audio-loopback-stress --iterations 1000 -s <device serial number> Change-Id: I8026ebbe3b5d4e0133ad234fc3e99dc0d6bc69da
2017-06-23Added Audio Latency Stress testHakan Lindh
Added test parameter “--iterations <nr>” so we can run a 1000 iteration stress test for Audio Latency. NOTE: For legacy reasons, not passing “--iterations” option OR passing “--iterations 1” will perform the Audio Latency and Audio Glitch tests we see on go/android-media today. For reviewer: Main entry point for test is “public void run(...)”. Test runs with screenshots are uploaded to: https://drive.google.com/drive/folders/0B-xFu1lUmgiqRldHdUhEcFRfWVU?usp=sharing TEST STRATEGY: RUN test 1000 times. In each iteration, collect result files from device, parse and collect data in a ResultData object that also keeps track of location to test files for a particular iteration. ANALYZE test results to produce statistics for 1. Latency and Confidence (Min, Max, Mean, Median) 2. Create CSV file with test run data 3. Print bad test data to host log file 4. Get number of test runs with valid data to send to dashboard 5. Produce histogram in host log file; count number of test results that fall into 1 ms wide buckets. UPLOAD test results + log files from “bad” runs; i.e. runs that is missing some or all result data + that deviates +- 2 ms from Latency Median value. Uploads up to 5 random files (MAX_NR_OF_LOG_UPLOADS) that meet criteria above. Bug: 35153171 Fixes: Test: tradefed.sh run google/test/framework/media/audio-loopback-stress --iterations 1000 -s <device serial number> Change-Id: I1521b3021bc656d77f01788748f480ce555a7430
2017-06-22Merge "Adding test for 'adb screenrecord'"Hakan Lindh
2017-06-22Adding test for 'adb screenrecord'Hakan Lindh
Adding test to verify that "adb screenrecord" command works. Test has optional parameters: --time-limit (seconds) --bit-rate (megabits per second) --size (e.g. 1280x720) Bug: 34596564 Fixes: Test: run google/test/framework/media/adb-screen-record [options] -s <deivce serial> Change-Id: I04b4c1406a408066c87a5691cd8c25195d740666
2017-06-19[MULTIMETER] Fix for abnormally high lipsync values + minor bug fixesHakan Lindh
b/62488246: Adding new option "debug-without-hardware" b//62460723: Supressing exception thrown when calling device.unlock() if unsupported. b/38205685: IP multimeter ignore poorly triggered lipsync times The multimeter tests have been reporting high values for lipsync max time recently. These have been tracked to single instances (per run) of a spurious black output frame. The lip sync indicator triggers off of this extra frame. Since the spurious frame comes almost a second early, the lipsync calculations for that frame turn out to be almost a second (we see 900 msec). The lipsync indicators (sound + black frame) are supposed to be every 2 seconds. This change ignores lipsync reports if they are less than 1.5 seconds after the previous one. Bug: 38205685 Bug: 62488246 Bug: 62460723 Test: atp test asit/media/video_performance Change-Id: I3bbf86fd3fe2fe60ced857aaa6e8aec639a30075
2017-06-09Add in reboot test to replace existing example test.android-vts-8.0_r2android-vts-8.0_r1oreo-devKevin Cheng
Bug: None Test: Built and ran test successfully. > tradefed.sh run commandAndExit example/reboot Change-Id: Ib1db0b1cefbd958d37eaa8636febcc32d3e484a9
2017-05-23Remove prod-tests dir.Kevin Cheng
Also move example config and test up one level to still act as an example. Bug: 38383668 Test: Manually built tradefed-all with no issues. Change-Id: I48262710b367c78afbc97a12facadb7c2c6d9b34 (cherry picked from commit 45e676c7282addf4f796949829b370c946f36b57)
2017-05-12Merge "Fix camera frame stress tests reporting."TreeHugger Robot
2017-05-10Fix camera frame stress tests reporting.Ying
Test: local run https://sponge.corp.google.com/invocation?tab=Test+Cases&show=FAILED&show=INTERNAL_ERROR&id=3b8a3ebf-6d96-4e33-ad9a-026be741aa37 Bug: 37223747 Change-Id: I89e541dcb175226e069595034fe64886bbb7e858
2017-05-09Fix camera stress test reportingjdesprez
The double extension of CollectingTestListener was hidding the new testEnded callback resulting in result not being forwarded to reporters. Test: local run http://sponge.corp.google.com/invocation?tab=Test+Cases&show=FAILED&show=INTERNAL_ERROR&id=77599989-8467-42d7-b386-05a853cbd719 Bug: 37223747 Change-Id: I922792b6c3bdef3445339656ed8966eba2d3d018
2017-05-04Seed aosp tf contrib project.Kevin Cheng
Add in example test/configs/preparer to set precedent as well as normal project stuff (makefiles, readmes, etc) to get things building (and to also make sure build files work). BUG:36556899 Test: Built and started tf with seeded config and test. Change-Id: Ia8eb408da272c424f626c8f77a91bb0eed6a656a (cherry picked from commit 68af8b89b22020ae4463a2c77003bde4133650cb)
2017-04-27Added camera burst startup test running in tf.Ying
Test: camera performance Change-Id: I5b05df9a2948ea54cfd3bdc66f34a6f277549ba9
2017-04-04Added json parser for CTS camera performance testsYing
Test: camera performance test restore ag/1273728 Change-Id: Ib5c0a67b6bb8f1d2ec06774c54bb8f51ba235cc7
2017-03-20Use less SnapshotInputStreamSourceEric Rowe
Replace `new SnapshotInputStreamSource(new FileInputStream(s))` with `new FileInputStream(s)`. Replace `new SnapshotInputStreamSource(new ByteArrayInputStream(s))` with `new ByteArrayInputStreamSource(s)` Bug: 36397380 Test: Build and run TF unit tests. Change-Id: If9ac9908539f6d1b1ede26fd2b0e759a2f92e845
generated by cgit v1.2.3 (git 2.25.1) at 2024-07-20 10:55:05 +0000