Verification Team

From DDCIDeos
Jump to navigationJump to search

Information center to help every verification engineer become a little bit more awesome.

Useful Links

Agenda Items

Kismet Project

Platform List

Processor
32-bit
64-bit
ARM X X
PPC X
X86 X
  • Shaka (32 and 64-bit arm)
    • 32-bit: BSP imxqm on the DeosIMX8QM board
    • 64-bit: BSP imxqm-arch64 on the deosShakaMX8-1 board
  • Santan (32-bit arm)
    • BSP ls1088a on the DeosLS1088ARDB-1 board
  • TBD (X86-64)
    • BSP come-ctl6-x86_64 on the DeosCOMe-cTL6-2 board

Kismet Status

The following is a summary of the testing status on the components.

BLOCKING ISSUE: Waiting on qemu-x86_64 unrelease
To enable instrumentation on qemu-x86_64, add the following to configure.ac:

 xHitMapAddressX8664=0x001F8000


Column meanings:

  • Rehost Complete - The initial (e.g. 64-bit conversion for Kismet) rehost effort is complete. New tests will be tracked normally via the component status wiki (see Review Status Link column).
  • CI/CD Ready - The component can be included in the set of components for CI/CD testing
  • Req Test Complete - All requirements-based testing is complete
  • Struct Cov Complete - The structural coverage testing is complete
Component Version Assignee Rehost Complete CI/CD Ready Req Test Complete Struct Cov Complete Review Status Link Comments
ANSI 4.10.2 RDR Yes Yes Yes In Work [ANSI] Blocking issue: PCR:12087 Add strtoll and strtoull tests

PCR:13822 Move X86 tests to X86_64
Future: Additional/substantial effort will be needed for verf on 64-bit platforms (ref PCR:13822#c8)

cffs-api653p2 3.1.0 MAS Yes Yes Yes In Work [cffs-api653p2] Blocking issues for RFS:

- ONE structural coverage hole in x86_64 for instrumented_optimized
- Waiting on reviews to be completed

cffs-ecl 2.0.0 RDR Yes N/A
Regress not supported
Yes In Work [cffs-ecl] Only potential issue is cffs-server changes.
cffs-server 7.3.0 RDR Yes Yes Yes In Work [cffs-server] Investigating/resolving coverage holes.
deosname (DAL-E) 6.11.0 MAS Yes Yes N/A N/A None N/A
deos653p1 6.0.1-1 MAS Yes Yes In Work No

[deos653p1]

Known timing issues on all X86-64 platforms and most qemus (aarch64, arm, and x86_64).

New tests are needed for the new/updated requirements Structural coverage needs to be investigated

desk-cdproc (tool) 1.3.0 RDR Yes N/A N/A N/A N/A various
dvms (core) 2.5.0 Everyone No No No No TBD New development
dvms (exfat) 2.3.0 Everyone No No No No TBD New development
dvms (journal) 2.1.0 Everyone No No No No TBD New development
dvms (sata-ahci) 3.0.1 Everyone No No No No TBD New development
dvms (dvms-api653p2) 3.1.0 Everyone No No No No TBD New development
GCC Startup 7.8.1 MAS Yes Yes
Regress not supported
Yes Yes

[GCC Startup]

NA
GNU Language 1.5.4 MAS Yes Yes In Work In Work [GNU Language] Blocking issues for RFS:

- need new tests for kill_dependency() requirements
- test failure on qemu-arm instrumented_optimized (tpl011) to be investigated - waiting on next abc-tool update
- structural coverage holes need to be fully investigated

IOI API 5.0.1 MAS Yes Yes Yes In Work [IOI API] Blocking issues for RFS:

- tpioi0002 fails on x86_64 instrumented
- Waiting on next abc-tool release
- structural coverage holes need to be fully investigated

IOI Ring Buffer 5.0.1 TBD Yes Yes No No [IOI Ringbuffer] Waiting on abc-tool release
Kernel 11.6.0 stable Everyone In Work No No No [kernel] Blocking issue: PCR:15322 VAS Layout

Only about 1/2 of the tests build/run at this time. See Porting Activities for blocking issues.

Math 3.1.0 TBD Yes Yes No No [math] N/A
MTL 2.7.1 MAS Yes Yes Yes No [MTL] Waiting on abc-tool release
SAL 5.2.0 MAS Yes Yes Yes No [SAL] Waiting on abc-tool release
Time 4.1.2 RDR Yes Yes Yes No

[time]

NOTE: test results are on virtual hardware
Vfile Core 7.4.0-12 ERG Yes No In Work No [vfile] Requires unrelease vfileconfig version 1.12.0

- PCR:16372 tpv025 and 26 have failures
- tpv051 needs a rewrite/redesign to use new kernel intercept functions to set/read time system time values and requires kernel 11.5.0 or newer for prlLoadOrder.

Useful Docker Commands

To generate the list of unreleased components, and then to install one component, use the following steps:

sudo apt update
unrelease list --annotate --with-version
unrelease --sudo remove [package-name]
unrelease --sudo install [package-name]

Colored svn diff for docker:

sudo apt-get install colordiff
svn diff --diff-cmd colordiff
-or-
svn diff --diff-cmd colordiff | less -R