View source for OpenArbor 10.4.7 Test Plan and Report TrickyFish 23A

From DDCIDeos

← OpenArbor 10.4.7 Test Plan and Report TrickyFish 23A

You do not have permission to edit this page, for the following reason:

The action you have requested is limited to users in the group: Users.

You can view and copy the source of this page.

[[Category:OpenArbor_Test_Reports]]

==About==
OpenArbor Windows 10.4.7<br/>
SVN Revision: r101598<br/>
SVN Branch Name: 10.4.7

==Test Schedule==

<!-- Green 00FF00, Yellow FFFF00, Red FF0000, Grey AAAAAA, White FFFFFF -->
<table border=1>
  <tr bgcolor=#AAAAAA>
    <th>Scheduled Test Runs</th>
    <th>Start Date</th>
    <th>Due Date</th>
    <th>Delivered</th>
    <th>Percentage Complete</th>
  </tr>

   <tr bgcolor=#00FF00>
    <td>Formal Run</td>
    <td align="center">'''02/02/2023'''</td>
    <td align="center">'''02/03/2023'''</td>
    <td align="center">'''02/03/2023'''</td>
    <td align="center">'''100%'''</td>
  </tr>
</table>

=Introduction=
The automated test suites for Eclipse, supports Eclipse 2020-R-12, which OpenArbor is built upon.  The tests were run the on build mentioned above.

A list of PCRs corrected for this release can be found here: [[OpenArbor_10.4.7]]

See below for a list of machines that will be used to reproduce/fix test failures.

The test logs can be viewed at:
: \\nx3000\openarbor\TestResults\Release10.4.7

=Legend=

{|border="1" cellpadding="5" style="text-align:center;"
|-
!{{yes| Pass}}
|style="text-align:left;"| The test passed.
|+

|-
!{{yes|Expected Deviation}}
|style="text-align:left;"|The test fails and a fix is not going to happen due to technical restrictions or restraints beyond our control.
|+

|-
!{{known|Known Failure}}
|style="text-align:left;"|The test fails, but we have plans to fix the problem in a future release.
|+

|-
!{{no|Fail}}
|style="text-align:left;"|The test failed.  
|+

|-
!style="background: silver"|
|style="text-align:left;"|Not scheduled to be tested for this release.  
|+

|-
!{{silver|X}}
|style="text-align:left;"|Scheduled to be tested for this release.  
|+

|-
!style="background: #444444"|
|style="text-align:left;"|Not Supported.  
|+

|}

=Test Machines=

{| class="wikitable sortable" border="1" cellpadding="5" align="center" style="text-align:center;"
|+ 

|- style = "background: white"
!      || Machine || OS || Comments
|+

|- style="background: #444444"


!{{White}}
!{{silver|OATEST}}
!{{silver|Windows 7 (64bit)}}
!{{silver|}}
|+

!{{White}}
!{{silver|OATESTLAP}}
!{{silver|Windows 10 (64bit)}}
!{{silver|}}
|+

!{{White}}
!{{silver|TESTW10E1}}
!{{silver|Windows 10 (64bit)}}
!{{silver|}}
|+


!{{White}}
!{{silver|TESTW10E2}}
!{{silver|Windows 10 (64bit)}}
!{{silver|}}
|+


!{{White}}
!{{silver|TESTW10E3}}
!{{silver|Windows 10 (64bit)}}
!{{silver|VM, slow}}
|+


!{{White}}
!{{silver|TESTW7P2}}
!{{silver|Windows 7 (64bit)}}
!{{silver|slow}}
|+

!{{White}}
!{{silver|TESTW10E4}}
!{{silver|Windows 10 (64bit)}}
!{{silver|}}
|+

|}

=Executed Formal Test Runs=

The automated OpenArbor Test Suites are executed for each entry in the table below.  The "Test Suites" column will indicate what tests were run.  The full set of OpenArbor tests are indicated by the name Launcher.  A second test suite, CompileRunDebug is used to just test compilation, linking, running and debugging the example projects.  The PlatformIntegration test suite is a small set of tests that exercise the more common operations customers use in interacting with the platform.  

{| class="wikitable" border="1" cellpadding="5" align="center" style="text-align:center;"
|+

|-
! Product || DDS Release || Timestamp || Target <br/> Architecture || Available <br/> Boards || Test Suites || Test Machine || Who || Formal <br/>Results||Comments
|+


|{{silver|Deos}}
|{{silver|DDS-trickyfish-deos-kismet-20230202}}
|{{silver|1675344521}}
|{{silver|arm}}
|{{silver|DeosSpearMX8-2 (imx8-tf)}}
|{{silver|PlatformIntegration}}
|{{silver|OATESTLAP}}
|{{silver|NH}}
|{{Known|Pass}}
|{{silver|See Testing Notes}}
|-


|}


== Testing Notes ==
{| class="wikitable sortable" border="1" cellpadding="5" style="text-align:left;"
! ID !! Priority !! OS !! PCR !! Status !! class="unsortable" | Affected Tests !! Target !! class="unsortable" | Screenshot !! class="unsortable" | Comments
|-

|1
|
|Windows
|[[PCR:14663]]
|{{known|Known Issue}}
|deos.DdsInstallerTest
|All Targets
|[[Media:trickyfish-23a-setup-log-filtered_.txt]]
|From AL: Here are the remaining items:

    mount: /tmp: Invalid argument
    configureScoreDoc.py: warning: Cannot find SCORE installation

The "mount" issue is a longstanding problem.  I could add a filter
rule for it, but some solution is probably warranted, I just don't
know what it would be.

Whether missing SCORE is an error I assume is a customer specific
issue.  The message can certainly be filtered out unconditionally if
there is some other way to ensure the content of the DDS is complete.
|-


|2
|
|Windows
|
|Expected Failure
|Debug.trasher<br>Run.trasher<br>Debug.worker<br>Run.worker
|All Targets
|[[Media:TrasherWorkerBuildFailure2.png]]
|Platform project fails to build when the Multicore-memory-pools example projects trasher and worker are integrated into the out of the box single core and/or single pool platform.<br>The MulticoreIntegration test performs the BuildAll, Run and Debug tests for the multicore memory pools examples in a multicore/multi memory pool environment.
|-

|3
|
|Windows
|[[DDCI_PCR:4593]]
|{{Known|Known Issue}}
|deos.StatusMonitor
|All Targets
|
|The StatusMonitor test needs an update. The test scenario for 'Pool Low Water Mark value changed' is consistently failing.<br>The test was recently updated to work differently when testing with multiple cores, but it appears the the setting the Reset Pad dialog for the second value is not getting properly set in the dialog (possibly).<br>Manual testing works.
|-



|}

Pages included on this page:

Return to OpenArbor 10.4.7 Test Plan and Report TrickyFish 23A.

Retrieved from "https://ddci.zapto.org/ddciWiki/OpenArbor_10.4.7_Test_Plan_and_Report_TrickyFish_23A"

View source for OpenArbor 10.4.7 Test Plan and Report TrickyFish 23A

Navigation menu

Page actions

Page actions

Personal tools

Navigation

Search

DDCI Tools & Resources

DDC-I private

Shared IP

Other

Tools