OpenArbor 13.2.1 Test Plan and Report Zhangmen Kismet D3
About
OpenArbor Windows/Linux 13.2.1
SVN Revision: r112319
SVN Branch Name: 13.2.1
Test Schedule
| Scheduled Test Runs | Start Date | Due Date | Delivered | Percentage Complete |
|---|---|---|---|---|
| Formal | 12-15-2025 | 12-17-2025 | 12-16-2025 | 100% |
Introduction
The automated test suites for Eclipse, supports Eclipse 2025-03-R, which OpenArbor is built upon. The tests were run the on build mentioned above.
A list of PCRs corrected for this release can be found here: OpenArbor_13.2.1
See below for a list of machines that will be used to reproduce/fix test failures.
The test logs can be viewed at:
- \\nx3000\openarbor\TestResults\Release13.2.1
Legend
| Pass | The test passed. |
|---|---|
| Expected Deviation | The test fails and a fix is not going to happen due to technical restrictions or restraints beyond our control. |
| Known Failure | The test fails, but we have plans to fix the problem in a future release. |
| Fail | The test failed. |
| Must Fix | The issue with this test must be fixed prior to a release to a customer. |
| Not scheduled to be tested for this release. | |
| X | Scheduled to be tested for this release. |
| Fail | The test failed. The problem causing the failure has been fixed, but the entry will remain on the report for documentation purposes. |
| Not Supported. |
Test Machines
| Machine | OS | Comments | |
|---|---|---|---|
| OATESTLAP | Windows 10 (64bit) | ||
| OATEST | Windows 11 (64bit) | ||
| TESTW10E1 | Windows 10 (64bit) | ||
| TESTW10E2 | Windows 10 (64bit) | ||
| testlinux01 | Linux (64bit) | ||
| testlinux02 | Linux (64bit) | ||
| OAWin11-01 | WSL | ||
| OAWin11-02 | WSL | ||
| OAWin11-03 | WSL | ||
| OAWin11-04 | WSL | ||
| OAWin11-05 | WSL | ||
| OALinux01 | Linux (64bit) | LCJ Linux development | |
| OALinux02 | Linux (64bit) | NH Linux development backup test machine |
|
| OALinux03 | Linux (64bit) | KT Linux development backup test machine |
|
| OALinux04 | Linux (64bit) | Actual Linux Machine - fast! | |
| OATEST-W11VM | Windows 11 (64bit) | Unusable media:oatest-w11vm.txt |
|
| TESTW10E3 | Windows 10 (64bit) | VM, slow | |
| TESTW10E4 | Windows 10 (64bit) | Unusable media:testw10e4.txt |
|
| TESTW11E1 | Windows 11 (64bit) | Unusable media:testw11e1.txt |
|
| OATEST | Windows 7 (64bit) | Retired | |
| TESTW7P2 | Windows 7 (64bit) | Retired |
Executed Formal Test Runs
The automated OpenArbor Test Suites are executed for each entry in the table below. The "Test Suites" column will indicate what tests were run. The full set of OpenArbor tests are indicated by the name Launcher. A second test suite, CompileRunDebug is used to just test compilation, linking, running and debugging the example projects. The PlatformIntegration test suite is a small set of tests that exercise the more common operations customers use in interacting with the platform.
| Product | DDS Release | Timestamp | Target Architecture |
Available Boards |
Test Suites | Test Machine | Who | Formal Results |
Comments |
|---|---|---|---|---|---|---|---|---|---|
| Deos | DDS-docker-zhangmen-deos-kismet-20251212 | kismet-1765546420 | aarch64 | DeosS32G274A-2 (s32g2-aarch64) | BSP examples | OAWin11-01 (WSL) | LCJ | Fail | Failed: 2 Passed: 8 Unrun: 0 Total: 10 Not Allowed: 0 See Testing Notes |
| Deos | DDS-docker-zhangmen-deos-kismet-20251212 | kismet-1765546420 | 80x86_64 | DeosCOMe-cTL6-1 (come-ctl6-x86_64) | loadPlatformIntegration | OALinux04 (Linux) | LCJ | Fail | Failed: 18 Passed: 183 Unrun: 0 Total: 201 Not Allowed: 31 See Testing Notes |
| Deos | DDS-docker-zhangmen-deos-kismet-20251212 | kismet-1765546420 | 80x86_64 | DeosCOMe-cTL6-1 (come-ctl6-x86_64) | Workspace Checkout (Use Workspace on https://deos.ddci.com/svn/DDCI/support/zhangmen/00002740-scheduling-GPU-driver-integration/) | OALinux04 (Linux) | LCJ | Fail | No workspace exists to checkout |
| Deos | DDS-docker-zhangmen-deos-kismet-20251212 | kismet-1765546420 | 80x86_64 | DeosS32G274A-2 (s32g2-aarch64) | Workspace Checkout (Use Workspace on https://deos.ddci.com/svn/DDCI/support/zhangmen/2794-driver-S32G2/) | OALinux04 (Linux) | LCJ | Pass | See testing notes |
Testing Notes
| ID | Priority | OS | PCR | Status | Affected Tests | Target | Screenshot | Comments |
|---|---|---|---|---|---|---|---|---|
| 1 | Linux | DDCI_PCR:5524 | Known Failure | Debug.ar429-holt-filter Debug.ar429-holt-interrupt Debug.ar429-holt-multi-part1 Debug.ar429-holt-schedule Run.ar429-holt-filter |
DeosCOMe-cTL6-1 (come-ctl6-x86_64) | media:zhangmen-kismet-come-ctl6-x86_64-Debug-ar429-holt-filter-log-12-16-2025.txt media:zhangmen-kismet-come-ctl6-x86_64-Debug-ar429-holt-interrupt-log-12-16-2025.txt media:zhangmen-kismet-come-ctl6-x86_64-Debug-ar429-holt-multi-part1-log-12-16-2025.txt media:zhangmen-kismet-come-ctl6-x86_64-Debug-ar429-holt-schedule-log-12-16-2025.txt |
Error: No rule to make target '../../../in.csv', needed by '../../../output/desk/etc/in.csv'. Stop. [lcj 12-17] Per WH, these examples should only be tested with the DeosS32G274A-2 (s32g2-aarch64) | |
| 2 | Linux | DDCI_PCR:5524 | Known Failure | Debug.ar429-holt-multi-part2 Run.ar429-holt-multi-part2 |
DeosCOMe-cTL6-1 (come-ctl6-x86_64) | media:zhangmen-kismet-come-ctl6-x86_64-Debug-ar429-holt-multi-part2-log-12-16-2025.txt | Error: Process Template (ar429-holt-multi-part2) uses feature set (ar429-holt), which is not present. Error: Process Template (ar429-holt-multi-part2) uses feature set (spi-nxp), which is not present. | |
| 3 | SS | Linux | PCR:16784 | Known Failure | Debug.zlib-compress Debug.zlib-uncompress Run.zlib-compress Run.zlib-uncompress |
DeosCOMe-cTL6-1 (come-ctl6-x86_64) | media:zhangmen-kismet-come-ctl6-x86_64-Debug-zlib-compress-log-12-16-2025.txt media:zhangmen-kismet-come-ctl6-x86_64-Debug-zlib-uncompress-log-12-16-2025.txt |
Build error when examples are integrated into the platform project: Error: Process Template (zlib-compress) is using Feature (deos-zlib) in Feature Set (deos-zlib), and required parameter (processInstanceName) is not specified. |
| 5 | CP | Linux | DDCI_PCR:5281 (comment #54) | Known Failure | Run.vfile_logbook_partition1 | DeosCOMe-cTL6-1 (come-ctl6-x86_64) | media:zhangmen-kismet-come-ctl6-x86_64-vfile_logbook_partition1-12-16-2025.txt] | Unexpected output:
Arinc 653 Logbook Partition 1 Test Volume: /mount/hd0 formatting...OK OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK, OK,Line Number 302 - NOT OK! - ret_code: 0, OK,Read Msg = ing, Testing! Exp Msg = Testing, Testing! Msg Size = 104 Exp = 17 Line Number 302 - NOT OK! - ret_code: -1 |
| 6 | Linux | PCR:16078 | Known Failure | DeosABCTest.multi DeosABCTest.one |
DeosCOMe-cTL6-1 (come-ctl6-x86_64) | media:zhangmen-kismet-come-ctl6-x86_64-DeosABCTest.multi-log-12-16-2025.txt media:zhangmen-kismet-come-ctl6-x86_64-DeosABCTest.one-log-12-16-2025.txt |
*** FAIL Mon Dec 15 22:58:01 MST 2025: Exception during playback org.eclipse.swtbot.swt.finder.exceptions.WidgetNotFoundException: ambiguous results | |
| 7 | Linux | DDCI_PCR:4593 | Known Failure | StatusMonitor | DeosCOMe-cTL6-1 (come-ctl6-x86_64) | media:zhangmen-kismet-come-ctl6-x86_64-StatusMonitor-log-12-16-2025txt.txt | *** FAIL Mon Dec 15 22:51:18 MST 2025: Pool Low Water Mark value changed | |
| 8 | Linux | PCR:16715 | Known Failure | BuildAll.pal-extension Compile.pal-extension |
DeosS32G274A-2 (s32g2-aarch64) | media:zhangmen-kismet-s32g2-aarch64-BuildAll-pal-extension-log-12-16-2025.txt media:zhangmen-kismet-s32g2-aarch64-Compile-pal-extension-log-12-16-2025.txt |
cdproc-makefile: Warning: kernelFile libpal-ext.so has multiple host filenames: $(DESK_DIR)/aarch64/appbin/libpal-ext.so != $(PROJECT_DIR.pal-extension)/output/desk/aarch64/appbin/dbg/libpal-ext.so cdproc-makefile: Error: <kernelFile> 'libpal-ext.so' provided by multiple components: ['-kernelFile=libpal-ext.so,$(DESK_DIR)/aarch64/appbin/libpal-ext.so', '-kernelFile=libpal-ext.so,$(PROJECT_DIR.pal-extension)/output/desk/aarch64/appbin/dbg/libpal-ext.so'] | |
| 9 | Linux | Pass | Workspace Checkout (Use Workspace on https://deos.ddci.com/svn/DDCI/support/zhangmen/2794-driver-S32G2/) | DeosS32G274A-2 (s32g2-aarch64) | media:zhangmen-kismet-s32g2-aarch64-workspace-build-log-12-16-2025.txt |
