OpenArbor 8.6.6 Test Plan and Report Durants3 C1A2

About

OpenArbor Windows 8.6.6
SVN Revision: r87485
SVN Branch Name: 8.6.6

Test Schedule

Scheduled Test Runs	Start Date	Due Date	Delivered	Percentage Complete
Formal Run	03-08-2019	03-12-2019	03-12-2019	100%

Introduction

The automated test suites for Eclipse, supports Eclipse 4.4.7, which OpenArbor is built upon. The tests were run the on build mentioned above.

A list of PCRs corrected for this release can be found here: OpenArbor_8.6.6

See below for a list of machines that will be used to reproduce/fix test failures.

The test logs can be viewed at:

\\nx3000\openarbor\TestResults\Release8.6.6

Legend

Pass	The test passed.
Expected Deviation	The test fails and a fix is not going to happen due to technical restrictions or restraints beyond our control.
Known Failure	The test fails, but we have plans to fix the problem in a future release.
Fail	The test failed.
	Not scheduled to be tested for this release.
X	Scheduled to be tested for this release.
	Not Supported.

Test Machines

	Machine	OS
	OATEST	Windows 7 (64bit)
	TESTW7P1	Windows 7 (64bit)
	TESTW7P2	Windows 7 (64bit)
	HOFFMAN	Windows 7 (64bit)
	TESTW10E1	Windows 10 (64bit)
	T3400DELL	Windows 7 (32bit)

Executed Formal Test Runs

The automated OpenArbor Test Suites are executed for each "X" marked in the table below. There are currently two test suites. One suite, Launcher is focused toward executing the entire OpenArbor interface. The second test suite, CompileRunDebug is used to just test compilation, linking, running and debugging the example projects.

Product	DDS Release	Timestamp	Target Architecture	Available Boards	Test Suites	Test Machine	Who	Formal Results	Comments
Deos	DDS-durants3-deos-indie-20190312	1552391040	arm	DeosIMX8QM (imx8qm)	loadPlatformIntegration	OATEST	LCJ	Pass	See testing notes
Deos	DDS-durants3-deos-indie-20190312	1552391040	arm	DeosZCU102-1 (zcu102)	loadPlatformIntegration	TESTW7P2	LCJ	Pass	See testing notes
Deos	DDS-durants3-deos-indie-20190312	1552391040	arm	QEMU-ARM	Launcher	TESTW7P1	LCJ	Pass	See testing notes

Testing Notes

ID	PCR	Status	Affected Tests	Target	Screenshot	Comments
1	PCR:10779	Known Issue	timemap-wat-example	imx8qm, zcu102, qemu-arm	Media:timemap-WAT-failure.txt	timemap-wat-example does not build, removed from the test workspace
2	n/a	Test Update Needed	DeosABCTest.one DeosABCTest.multi	imx8qm	Media:AbcTest-imx8qm.txt Media:StepsToReproduceImx8qm.txt	coverageSummary.html file not generated. Error suggested hitmap wasn't cleared, but it was. need to use release version of the PAL. The imx8qm PAL uses the hitmap area as a dprintf memory buffer. Therefore, you must test with the release variant of pal. In general I think using the release variant of the PAL is a decent solution across all platforms, so I would consider this as needing an OA test update PCR.
3	n/a	PCR:11181	DeosOptionTabs.bootImageTabTest	qemu-arm, zcu102	Media:bootImageTabTest_Failure.txt	Hypdump fails when boot image name is modified
4	n/a	Known Issue	BuildAll.trasher BuildAll.worker Debug.trasher Debug.worker Run.trasher Run.worker	qemu-arm	Media:TrasherWorkerBuildFailure2.png	Platform project fails to build when the Multicore-memory-pools example projects trasher and worker are integrated into the out of the box single core and/or single pool platform. The MulticoreIntegration test performs the BuildAll, Run and Debug tests for the multicore memory pools examples in a multicore/multi memory pool environment.
5	PCR:11547	Known issue	Debugging the ipc-653-partitions_configuration example projects fail (ipc-partition1,2,3,4)	qemu-arm	Media:ipcDebugFailures.png Media:DebugIpc653ReproductionSteps.txt	Launching the debugger on ipc-partition1.exe was successful, but launching on ipc-partition2.exe resulted is "Read timed out" error dialog. Subsequent launching of debugging sessions resulted in "Connection timed out: connect" dialog.
6	DDCI_PCR:3548	Known bug	Deos653fp test	All tested targets		This test, as written, will fail on a multicore DDS. Test needs review for it's actual purpose.
7	[[PCR:11547]	Known issue	Running the ipc-653-partitions_configuration example projects fail.	qemu-arm		Connection to Video Stream (or Status Monitor when debugging) is refused. Waiting a few extra seconds before attempting to connect helps.
8	DDCI_PCR:3550	Unsupported feature	compileRunDebug.SelectiveBuild	All tested targets		Selective Build for folders is not supported in this release of OA.
9	PCR:10778,PCR:10777	Known limitation	CacheTrasher	Indie Multicore		Cache Trashing not supported by the platform.
10	DDCI_PCR:2608	Known bug	VariablesAndExpressionsViews test	All tested targets		Assignment fails
11	n/a	Test Update needed	MultiThread	zcu102		Line 101: getting the values from the Variables tree view results in an IndexOutOfBoundsException.