OpenArbor 13.2.0 Test Plan and Informal Report
From DDCIDeos
Jump to navigationJump to search
About
OpenArbor Windows/Linux 13.2.0
SVN Revision: r112290
SVN Branch Name: multiple-arch
Test Schedule
| Scheduled Test Runs | Start Date | Due Date | Delivered | Percentage Complete |
|---|---|---|---|---|
| Informal | 10-17-2025 | 11-26-2025 | 11-26-2025 | 100% |
Introduction
The automated test suites for Eclipse, supports Eclipse 2025-03-R, which OpenArbor is built upon. The tests were run the on build mentioned above.
A list of PCRs corrected for this release can be found here: OpenArbor_13.2.0
See below for a list of machines that will be used to reproduce/fix test failures.
The test logs can be viewed at:
- \\nx3000\openarbor\TestResults\Release13.2.0
Legend
| Pass | The test passed. |
|---|---|
| Expected Deviation | The test fails and a fix is not going to happen due to technical restrictions or restraints beyond our control. |
| Known Failure | The test fails, but we have plans to fix the problem in a future release. |
| Fail | The test failed. |
| Must Fix | The issue with this test must be fixed prior to a release to a customer. |
| Not scheduled to be tested for this release. | |
| X | Scheduled to be tested for this release. |
| Fail | The test failed. The problem causing the failure has been fixed, but the entry will remain on the report for documentation purposes. |
| Not Supported. |
Test Machines
| Machine | OS | Comments | |
|---|---|---|---|
| OATESTLAP | Windows 10 (64bit) | ||
| OATEST | Windows 11 (64bit) | ||
| TESTW10E1 | Windows 10 (64bit) | ||
| TESTW10E2 | Windows 10 (64bit) | ||
| testlinux01 | Linux (64bit) | ||
| testlinux02 | Linux (64bit) | ||
| OAWin11-01 | WSL | ||
| OAWin11-02 | WSL | ||
| OAWin11-03 | WSL | ||
| OAWin11-04 | WSL | ||
| OAWin11-05 | WSL | ||
| OALinux01 | Linux (64bit) | LCJ Linux development | |
| OALinux02 | Linux (64bit) | NH Linux development backup test machine |
|
| OALinux03 | Linux (64bit) | KT Linux development backup test machine |
|
| OALinux04 | Linux (64bit) | Actual Linux Machine - fast! | |
| OATEST-W11VM | Windows 11 (64bit) | Unusable media:oatest-w11vm.txt |
|
| TESTW10E3 | Windows 10 (64bit) | VM, slow | |
| TESTW10E4 | Windows 10 (64bit) | Unusable media:testw10e4.txt |
|
| TESTW11E1 | Windows 11 (64bit) | Unusable media:testw11e1.txt |
|
| OATEST | Windows 7 (64bit) | Retired | |
| TESTW7P2 | Windows 7 (64bit) | Retired |
Executed Formal Test Runs
The automated OpenArbor Test Suites are executed for each entry in the table below. The "Test Suites" column will indicate what tests were run. The full set of OpenArbor tests are indicated by the name Launcher. A second test suite, CompileRunDebug is used to just test compilation, linking, running and debugging the example projects. The PlatformIntegration test suite is a small set of tests that exercise the more common operations customers use in interacting with the platform.
| Product | DDS Release | Timestamp | Target Architecture |
Available Boards |
Test Suites | Test Machine | Who | Formal Results |
Comments |
|---|---|---|---|---|---|---|---|---|---|
| Deos | dds-docker-sales-deos-kismet-20250710, built with unreleased components | n/a | QEMU-AARCH64 (qemu-aarch64) | n/a | Launcher | OALinux04 | lcj | Known Failure | Failed: 30 Passed: 717 Unrun: 0 Total: 747 Not Allowed: 50 Test Suite Execution Time : 00:23:30:01 See testing notes |
| Deos | dds-docker-sales-deos-kismet-20250710, built with unreleased components | n/a | QEMU-ARM (qemu-arm) | n/a | Launcher | OALinux03 | lcj | Known Failure | Failed: 24 Passed: 723 Unrun: 0 Total: 747 Not Allowed: 50 See testing notes |
| Deos | dds-docker-sales-deos-kismet-20250710, built with unreleased components | n/a | QEMU-PPC(qemu-ppc) | n/a | Launcher | OALinux04 | lcj | Known Failure | Failed: 27 Passed: 720 Unrun: 0 Total: 747 Not Allowed: 50 Test Suite Execution Time : 01:05:04:42 See testing notes |
| Deos | dds-docker-sales-deos-kismet-20250710, built with unreleased components | n/a | QEMU-80X86_64 (qemu-80x86_64) | n/a | Launcher | OALinux02 | lcj | Known Failure | Failed: Failed: 33 Passed: 714 Unrun: 0 Total: 747 Not Allowed: 50 Test Suite Execution Time : 01:02:59:56 Completed 10-24-2025 See testing notes |
Unreleased Packages
The test runs were executed and completed on 11-26-2025. This media:bdu64-sales-script.txt was used to define the unreleased components included in the testing.
bdu64-sales --name=dds-docker-sales-deos-kismet-20250710 kismet customer-sales
Testing Notes
| ID | Priority | OS | PCR | Status | Affected Tests | Target | Screenshot | Comments |
|---|---|---|---|---|---|---|---|---|
| 1 | SS | Linux | PCR:16784 | Known Failure | BuildAll.zlib-compress BuildAll.zlib-uncompress Compile.zlib-compress Compile.zlib-uncompress Debug.zlib-compress Debug.zlib-uncompress Run.zlib-compress Run.zlib-uncompress |
QEMU-AARCH64 (qemu-aarch64) QEMU-ARM (qemu-arm) QEMU-PPC (qemu-ppc) QEMU-80X80_64 (qemu-80x86_64) |
media:sales-informal-kismet-qemu-aarch64-BuildAll-zlib-compress-log-10-20-2025.txt media:sales-informal-kismet-qemu-aarch64-BuildAll-zlib-uncompress-log-10-20-2025.txt |
Build error when examples are integrated into the platform project: Error: Process Template (zlib-compress) is using Feature (deos-zlib) in Feature Set (deos-zlib), and required parameter (processInstanceName) is not specified. |
| 2 | CP | Linux | DDCI_PCR:5444 | Known Failure | Compile.dvmsbasher-with-journaled-exfat Compile.dvmssimple-with-journaled-exfat Compile.dvmsthroughput-with-journaled-exfat |
QEMU-AARCH64 (qemu-aarch64) QEMU-ARM (qemu-arm) QEMU-PPC (qemu-ppc) QEMU-80X80_64 (qemu-80x86_64) |
media:sales-informal-kismet-qemu-aarch64-Compile-dvmsbasher-with-journaled-exfat-log-10-20-2025.txt media:sales-informal-kismet-qemu-aarch64-Compile-dvmssimple-with-journaled-exfat-log-10-20-2025.txt media:sales-informal-kismet-qemu-aarch64-Compile-dvmsthroughput-with-journaled-exfat-log-10-20-2025.txt |
When integrated with a platform project, these examples display unexpected warnings. Per CP updated examples are currently unreleased |
| 3 | MS | Linux | PCR:15793 | Known Failure | Compile.mms_partition1 Compile.mms_partition2 Compile.mms_partition3 Compile.mms_partition4 |
QEMU-AARCH64 (qemu-aarch64) QEMU-ARM (qemu-arm) QEMU-PPC (qemu-ppc) QEMU-80X80_64 (qemu-80x86_64) |
media:sales-informal-kismet-qemu-aarch64-Compile-mms_partition1-log-10-20-2025.txt | When integrated with a platform project, these examples display unexpected warnings. Per MS updated examples are currently unreleased |
| 4 | CP | Linux | DDCI_PCR:4340 - comment #23 added for this issue | Known Failure | Compile.vfile_logbook_partition1 | QEMU-AARCH64 (qemu-aarch64) QEMU-ARM (qemu-arm) QEMU-PPC (qemu-ppc) QEMU-80X80_64 (qemu-80x86_64) |
media:sales-informal-kismet-qemu-aarch64-Compile-vfile_logbook_partition1-log-10-20-2025.txt | When integrated with a platform project, these examples display unexpected warnings.Warning: Caused by feature provider content to file (./platreg.pi.xml): There is a <ownedMemoryMappedResource> that references non-existant process template (vfile_logbook_partition2). Warning: Caused by feature provider content to file (./platreg.pi.xml): There is a <ownedUnmappedResource> that references non-existant process template (vfile_logbook_partition2). CP suggests this be deferred to a later release |
| 5 | CP | Linux | DDCI_PCR:5281 (comment #54) | Known Failure | Run.vfile_logbook_partition1 | QEMU-AARCH64 (qemu-aarch64) QEMU-80X80_64 (qemu-80x86_64) |
media:sales-informal-kismet-qemu-aarch64-vfile_logbook_partition1-10-20-2025.txt] | Unexpected output:
Arinc 653 Logbook Partition 1 Test Volume: /mount/hd0 formatting...OK OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK,Line Number 302 - NOT OK! - ret_code: 0, OK,Read Msg = ing, Testing! Exp Msg = Testing, Testing! Msg Size = 104 Exp = 17 Line Number 302 - NOT OK! - ret_code: -1 |
| 6 | Linux | PCR:15789 | Known Failure | deos.ConfigureRapita | QEMU-AARCH64 (qemu-aarch64) QEMU-ARM (qemu-arm) QEMU-PPC (qemu-ppc) QEMU-80X80_64 (qemu-80x86_64) |
media:sales-informal-kismet-qemu-aarch64-ConfigureRapita-log-10-20-2025.txt | Rapita RVS Root is not installed. | |
| 7 | Linux | PCR:16634 | Known Failure | gdb.GdbVariables.Deos653 | QEMU-AARCH64 (qemu-aarch64) QEMU-ARM (qemu-arm) QEMU-PPC (qemu-ppc) QEMU-80X80_64 (qemu-80x86_64) |
media:sales-informal-kismet-qemu-aarch64-GdbVariables-Deos653-log-10-20-2025.txt | ||
| 8 | Linux | PCR:16633 | Known Failure | gdb.GdbVariables.MultipleThreadsRMA gdb.GdbVariables.OneThreadRMA |
QEMU-AARCH64 (qemu-aarch64) QEMU-PPC (qemu-ppc) |
media:sales-informal-kismet-qemu-aarch64-GdbVariables-MultipleThreadsRMA-log-10-20-2025.txt media:sales-informal-kismet-qemu-aarch64-GdbVariables-OneThreadRMA-log-10-20-2025.txt |
l_tl_var1's value is empty, when it shouldn't be. This is due to an issue with gdb -- local scoped thread_local variables could not correctly be looked up to display in the variables view. Global thread_local variables were not affected by the issue. | |
| 9 | Linux | DDCI_PCR:16300 | Known Failure | gdb.GdbVariables.Rtems | QEMU-AARCH64 (qemu-aarch64) QEMU-ARM (qemu-arm) QEMU-PPC (qemu-ppc) QEMU-80X80_64 (qemu-80x86_64) |
media:sales-informal-kismet-qemu-aarch64-GdbVariables-Rtems-log-10-20-2025.txt | ||
| 10 | Linux | DDCI_PCR:4922 | Known Failure | managedBuild.ManagedBuild.BareAarch64Test managedBuild.ManagedBuild.testLinkWithCdt managedBuild.ManagedBuildProperties.BareAarch64PropertiesTest managedBuild.ManagedBuild.BareX86_64Test |
QEMU-AARCH64 (qemu-aarch64) QEMU-80X86_64 (qemu-80x86_64) |
media:sales-informal-kismet-qemu-aarch64-BareAarch64Test-log-10-20-2025.txt | 64-bit managed builds are not yet supported | |
| 11 | Linux | n/a | Known Failure | other.AboutDDCITools | QEMU-AARCH64 (qemu-aarch64) QEMU-ARM (qemu-arm) QEMU-PPC (qemu-ppc) QEMU-80X80_64 (qemu-80x86_64) |
media:sales-informal-kismet-qemu-aarch64-AboutDDCITools-log-10-20-2025.txt | Testing with unreleased OA, not a DDS made with populateDDS script. The label.txt file is not included in the docker image. | |
| 12 | AL/KT | Linux | DDCI_PCR:4844 | Known Failure | MinimalFileSystem.hello-world-mfs | QEMU-AARCH64 (qemu-aarch64) QEMU-ARM (qemu-arm) QEMU-PPC (qemu-ppc) QEMU-80X80_64 (qemu-80x86_64) |
Media:sales-informal-kismet-qemu-aarch64-MinimalFileSystem-hello-world-mfs-log-10-20-2025.txt | cproc updates needed for expected error conditions |
| 13 | AL/GK | Linux | PCR:16422 | Known Failure | MinimalFileSystem.multiple-exes | QEMU-AARCH64 (qemu-aarch64) QEMU-ARM (qemu-arm) QEMU-PPC (qemu-ppc) QEMU-80X80_64 (qemu-80x86_64) |
Media:sales-informal-kismet-qemu-aarch64-MinimalFileSystem-multiple-exes-log-10-20-2025.txt | multiple exe's with the same name, configured in different mfs' is not supported in this release. |
| 14 | CP | Linux | DDCI_PCR:5518 | Known Failure | Debug.dvmsthroughput-with-journaled-exfat | QEMU-PPC (qemu-ppc) | media:sales-informal-kismet-qemu-ppc-Debug-dvmsthroughput-with-journaled-exfat-log-12-04-2025.txt media:sales-informal-kismet-qemu-ppc-Debug-dvmsthroughput-with-journaled-exfat-log-12-04-2025.png |
CP suggests this be deferred to a later release. The example is a slack consumer and runs to completion while consuming as much slack as possible, thus potentially starving network threads and thus the debugger. [lcj 12-04] Updated test to report actual failure a little bit better. Updated screenshots. |
| 15 | RDR | Linux | PCR:16388 | Known Failure | Debug.mms_partition4 | QEMU-80X86_64 (qemu-80x86_64) | media:sales-informal-kismet-qemu-80x86_64-Debug-mms_partition4-log-10-24-2025.txt | norm-proc4 was NOT found in the video stream RDR: Was able to confirm that this works on vm/real x86_64; however, will likely require a regex similar to #8 and video-stream is part of the threads which do not run. |
| 16 | RDR | Linux | PCR:16388 | Known Failure | compileRunDebug.MulticoreIntegration | QEMU-80X86_64 (qemu-80x86_64) | media:sales-informal-kismet-qemu-80x86_64-MulticoreIntegration-log-11-26-2025.txt | Expected output from running ipc-partition1 was not displayed when integrated for mulit-core. |
| 17 | RDR | Linux | PCR:16388 | Known Failure | Run.blackboard_event | QEMU-80X86_64 (qemu-80x86_64) | media:sales-informal-kismet-qemu-80x86_64-Run-blackboard_event-log-10-24-2025.txt | Blackboard empty was NOT found in the video stream RDR: Confirmed to be a QEMU x86_64 timing issue. |
| 18 | RDR | Linux | PCR:16388 | Known Failure | Run.interrupt | QEMU-80X86_64 (qemu-80x86_64) | media:sales-informal-kismet-qemu-80x86_64-Run-interrupt-log-11-26-2025.txt | Expected output from running the interrupt example was not displayed. |
