42371

How much time It takes to perform all tests using Android CTS tool?

Question:

I am developing <strong>custom android device</strong> and need to execute compatibility test cases using android CTS tool.

So i just want to know how much time it will take to execute all the test cases on the android device(Android Emulator) using <strong>android-cts-2.3_r3-x86 tool</strong>.

Answer1:

The time for execution of CTS depends upon the total number of test cases and each status of the test case result. To pass a test the result must come in 5 seconds for most of test cases, otherwise the test cases is timed out. After each time out there is a gap of 5 minutes to execute next test case by CTS. So it is directly proportional to the number of timed out test cases. Many time the devices restarts, so the restart time is also counted. Now you can calculate the estimated time of CTS execution.

Answer2:

This took me almost exactly 2 hours to run the full test set on a SHIELD. The results of tests: - PASSED: 9805 - FAILED: 7 - NOT EXECUTED: 8977

Answer3:

Usually it is displayed an estimation at the beginning of the tests, like in the above example:

255522-06-07 14:32:23 I/CompatibilityTest: ======================================== 255599:06-07 14:32:23 I/CompatibilityTest: Starting a run with 362 unique modules. 255675-06-07 14:32:23 I/CompatibilityTest: ======================================== 255752-06-07 14:32:23 I/ModuleRepo: 10.10.1.113:5555 running 362 test sub-modules, expected to complete in 86h 46m 18s.

if you lost that is not a problem you can always check the logs with the command in cts-tf > cursor:

d l

shortcut for dump logs will output:

Saved log to /tmp/Invocation-134.86.122.113:5555_log_7887452889537372588.txt Saved log to /tmp/tradefed_history_log_6569426154219158581.txt Saved log to /tmp/tradefed_global_log_802202482888218382.txt

and then grep in the logs for unique and 2 lines:

cat ./Invocation-134.86.122.113:5555_log_3749453462240679705.txt | grep unique -b2

Recommend

  • Inconsistent margin between flex items on last row
  • Setting up Heroku with mongodb without using MLAB
  • SLURM: How to view completed jobs full name?
  • Incompatible heap sizes error in Sonarqube
  • How to get the optimized choice from arrays
  • Preventing execution pause when dragging game window
  • How to graph streaming data in C#
  • How to plot stacked proportional graph?
  • EJB @Schedule issue
  • ASP.NET 2.0 Session Timeout
  • how can i get floating imgs to fill all space
  • How to resize image if the image is bigger than Textbox.But it not increase scale if smaller
  • how to load css classes from my own project specfic css in Sitecore's RAD editor?
  • Prolog Ambiguous Output
  • Cross platform UI spacing/padding
  • JSR-330 support in Picocontainer : @Inject … @Named(\"xxx)
  • Creating a DropDownList
  • Who propagate bugfixes across branches (corporate development)?
  • Calculate time difference in hh:mm:ss with simple javascript/jquery
  • UWP/C# - Issue with AQS and USB Devices
  • Is it possible to open regedit and navigate to straight to a specific key using process.start?
  • Marklogic : Query response time is very high
  • print() is showing quotation marks in results
  • Atlas images wrong size on iPad iOS 9
  • Scrapy recursive link crawler
  • Q promise. Difference between .when and .then
  • Projection media query: browser support and workarounds?
  • Illegal mix of collations for operation for date/time comparison
  • How to make Safari send if-modified-since header?
  • WOWZA + RTMP + HTML5 Playback?
  • How to pass list parameters for each object using Spring MVC?
  • php design question - will a Helper help here?
  • how to add data labels for bar graph in matlab
  • retrieve vertices with no linked edge in arangodb
  • A cron job substitute?
  • AngularJs get employee from factory
  • Setting background image for body element in xhtml (for different monitors and resolutions)
  • IndexOutOfRangeException on multidimensional array despite using GetLength check
  • Authorize attributes not working in MVC 4
  • JaxB to read class hierarchy