OpenArbor 5.3.0 Test Plan and Report
About
OpenArbor Windows 5.3.0
SVN Revision: r35698
SVN Branch Name: 5.3.0
Test Schedule
| Scheduled Test Runs | Start Date | Due Date | Delivered | Percentage Complete |
|---|---|---|---|---|
| [1]Dry Run | Feb 03, 2014 | Feb 21, 2014 | Feb 20, 2014 | 100% |
| [2]Formal Run | Feb 20, 2014 | Feb 28, 2014 | Feb 27, 2014 | 100% |
Introduction
The automated test suites for Eclipse, supports Eclipse 3.7, which OpenArbor is built upon. The tests were run the on build mentioned above.
A list of PCRs corrected for this release can be found here: OpenArbor_5.3.0
See below for a list of machines that will be used to reproduce/fix test failures.
The test logs can be viewed at:
- \\nx3000\openarbor\TestResults\Release_5.3.0
Legend
| Pass | The test passed. |
|---|---|
| Expected Deviation | The test fails and a fix is not going to happen due to technical restrictions or restraints beyond our control. |
| Known Failure | The test fails, but we have plans to fix the problem in a future release. |
| Fail | The test failed. |
| Not scheduled to be tested for this release. | |
| X | Scheduled to be tested for this release. |
| Not Supported. |
Test Machines
| Machine | OS | |
|---|---|---|
| OATEST | Windows XP | |
| TESTW7P1 | Windows 7 (64bit) | |
| TESTW7P2 | Windows 7 (64bit) | |
| OPTIPLEX755 | Windows 7 (32bit) | |
| HOFMANN | Windows 7 (32bit) |
Executed Formal Test Runs
The automated OpenArbor Test Suites are executed for each "X" marked in the table below. There are currently two test suites. One suite, Launcher is focused toward executing the entire OpenArbor interface. The second test suite, CompileRunDebug is used to just test compilation, linking, running and debugging the example projects.
| Product | DDS Release | setup-timestamp | Target Architecture |
Available Boards |
Test Suites | Test Machine | Who | Dry Run Results |
Formal Results |
Comments |
|---|---|---|---|---|---|---|---|---|---|---|
| Deos Chino | DDS-chino-deos-fourpeaks-20140220 | unavailable | MIPS | QEMU | Launcher | OPTIPLEX755 | BH | Pass | Pass | |
| Deos Granite | DDS-granite-deos-fourpeaks-20140220 | unavailable | 80x86 | QEMU | Launcher | HOFMANN | LCJ | Pass | Pass | |
| Deos Kalbi | DDS-kalbi-deos-fourpeaks-20140226 | 1393547194 | 80x86 | DeosKalbi | Launcher | TESTW7P1 | LCJ | CFFS Failures | Pass | |
| Deos Maple | DDS-maple-deos-fourpeaks-20140220 | unavailable | PowerPC | DeosMaple1 | Launcher | TESTW7P2 | LCJ | Pass | Pass | |
| GCC Standalone | DDS-ppc-ppcspe-gcc-gcc46-20140220 | 1392908146 | PowerPC | PSIM | Launcher | OATEST | LCJ | Pass | Pass | |
| SCORE | DDS-1750a-score-score31-20140220 | 1392908146 | 1750a | 1750a_sim | Launcher | TESTW7P1 | LCJ | Pass | Pass | |
| SCORE | DDS-c4x-score-score31-20140220 | 1392908146 | C3x4x | CSIM | Launcher | HOFMANN OATEST |
LCJ | Pass | Pass | |
| SCORE | DDS-x86-score-score31-20140220 | 1392908146 | 80x86 | Intel 80x86 Laptop | Launcher | TESTW7P2 | JW | Pass | Pass | |
| SCORE | DDS-win32-score-score31-20140220 | 1392908146 | Native | Native | Launcher | OATEST | LCJ | Pass | Pass | |
| SCORE | DDS-ppc-ppcspe-score-score31-20140220 | 1392908146 | PowerPC | PSIM | Launcher | TESTW7P1 | LCJ | Pass | Pass | |
| HeartOS | DDS-ppc-heartos-mainline-20140220 | 1392908146 | PowerPC | PSIM | Launcher | HOFMANN OPTIPLEX755 |
LCJ | Pass | Pass |
Testing Notes
| ID | PCR | Status | Affected Tests | Target | Comments |
|---|---|---|---|---|---|
| 1 | DDCI_PCR:2484 | Known Bug | SelectiveBuild | Standalone | Score link errors not handled |
| 2 | DDCI_PCR:2235 | Known Bug | Suspend | Score CSIM | Suspend/Pause ignored by target |
| 3 | DDCI_PCR:2644 | Bug | RegistersView | All | |
| 4 | DDCI_PCR:2608 | Known bug | VariablesAndExpressionsView test | All | Assignment fails. |
| 5 | DDCI_PCR:2373 | Known bug | ProjectConverter test fails | All | Need to revisit starting point for conversions. |
| 6 | DDCI_PCR:2278 | Known bug | com.ddci.openarbortests.compileRunDebug.Build.testasm com.ddci.openarbortests.compileRunDebug.BuildAll.testasm |
SCORE 1750a | |
| 7 | DDCI_PCR:1382 | Bug | com.ddci.openarbortests.compileRunDebug.buildAll.testAsm | HeartOS | Can't instrument a HeartOS project that contains assembly files |
| 8 | DDCI_PCR:2729 | Bug | com.ddci.openarbortests.projectOptions.launch.debug.DebugOptionsAdditionalOptions
com.ddci.openarbortests.deos.DeosLaunchConfigurations.commonTabs |
All | Specifying an invalid option to MLD causes process to hang. |
| 9 | DDCI_PCR:2532 | Bug | com.ddci.openarbortests.mld.commands.BreakAndTraceCommands | HeartOS | Go To Main followed by Restart causes StackFrame to not have focus. |
| 10 | DDCI_PCR:2730 | Bug | com.ddci.openarbortests.projectOptions.ada.link.AdaLinkOutputs | when PowerPC BookE is installed alongside other targets |
S Record widget gets stuck on "various values" when PowerPC BookE is installed |
| 11 | DDCI_PCR:2731 | Bug | ExecuteSubprogram.sub32 | Any that supports RESTART (not Deos) |
RESTART followed by other commands in a subprogram can hang the debug session |
