SFS Supplemental Test Review Project

From Deos
Jump to navigationJump to search



Due to deficiencies found on June 8th, 2006 during the First Flight Review (FFR) of the PDMC, re-review of all the SFS Version 51.0.1 (aka Chia) test cases and test procedures will be necessary. Note that this version of SFS is only used on/by the PDMC_Program.

Description

When performing a 'slice' review starting with requirement DDD_SFS_OPEN_210, Airbus discovered that its test case objective (tcf019.htm Test Case 180) *did not* address the requirement (despite review evidence). Furthermore, it was discovered that the test procedure for tcf019.htm Test Case 180 did more than what was described in Test Case 180's objective. This second fact, combined with test procedure review, was another opportunity (in Airbus's opinion) to correct tcf019.htm Test Case 180's objective.

Therefore, Airbus is requesting that we re-review all test cases and test procedures used on/by SFS Version 51.0.1. The scope of the re-review is to ensure that: 1) Test Case Objectives fully address requirements to which they trace; 2) Test Procedures fulfills the objective of each test case; and 3) Test Procedures do not go beyond the scope of their objective (i.e., this is a cross-check on the completeness of the test case objective).

News

  • 2006-08-31 from Chris Southern "We managed to handle the review, using the data referenced in the Wiki,

so we don't need your support. Sorry for needlessly requesting your support. The good news is that Cyril has accepted both the SFS supplemental test review and CVT qualification support activities. Regards, Chris"

  • 2006-08-06: Results of weekend teleconferences with - Calcagni, Kevin (SWCOE); Balasubramanyam, Ravindranath (IE10); Sunil,Rao V (IE10); Anil Kumar, Pandit (IE10); Sridhar, Sampath (IE10); Bharat, Chaudhary (IE10); Mallikarjun, Kande (IE10); Cronk, Bill (SWCOE); Jongsma, Ken (SWCOE); Diethelm, Matt (SWCOE).
  1. The Issues have been addressed.
  2. PCRs have been written.
  3. Files are ready to be checked-in (some have been), Reviewers will complete review packets (some are filled-out), review packets will be committed to the certification archive by start of bussiness Monday, 07-AUG-2006 in North America. Note: NetMeeting session occured in order to walk through the configuration-management-howto Installing Required Tools and Checkout and Commit sections thereby ensureing all at HTSL have the ability to interact with the certification archive.
  • 2006-08-04: "Test re-review comments/ PCR discussion" Teleconference occurred with - Calcagni, Kevin (SWCOE); Balasubramanyam, Ravindranath (IE10); Sunil,Rao V (IE10); Anil Kumar, Pandit (IE10); Sridhar, Sampath (IE10); Bharat, Chaudhary (IE10); Mallikarjun, Kande (IE10); Cronk, Bill (SWCOE); Jongsma, Ken (SWCOE).
    1. Clarity was reached with regards to the information and units displayed on this page.
    2. The Issues documented below will be addressed *before* any further action is taken. Toward that end HTSL team members submitted requests for svn/buggzilla account activations during the teleconference. SW RTOS COE members will activate those accounts today.
    3. Questions, with regards to test case reviews, were asked/addressed such that the team now feels they are able to complete this task.
    4. The plan is to write two PCRs (note that one - PCR:3985 - already exists). One PCR will document must fix items while the other will document items which can/will be deferred (i.e., addressed at a later time). This work can now begin (per the above).
    5. Regarding resource loading/planning:
      • Mallik currently has six individuals committed working 50% time on task. Mallik will attempt to increase the time on task for the existing individuals as well as try to add two more.
      • Bill will be adding two full-time individuals to join as soon as test *procedure* review can commence (coordination will occur, as per process, via the status file).
      • The team (composed per the above) will be working everyday (including weekends) until the task is completed.
    6. Daily (including weekends) teleconferences will occur at 6:30pm IST in order to ensure successfully transfer of work flow between time zones. If this is deemed insufficient another daily teleconference at IST start-of-business will be added (i.e., we will go two-a-days).
  • 2006-07-11: Sunil Rao has been added to the SHARP File System access list for Bugzilla and Subversion.
  • 2006-07-10: E-mail, From: Mallikarjun, Kande (IE10); Sent: Monday, July 10, 2006 6:32 AM; To: Cronk, Bill (SWCOE); Subject: RE: A380 Sharp File System; Mallik shared the following:
  1. Dipal has been added to the team of Sunil, Sridhar, Bharat and Balu. Discussion are on-going for the addition of Anil.
  2. Needs a PO from the PDMC team for this effort.
  • 2006-06-30: "A380 Sharp File System" teleconference occurred with Calcagni, Kevin (SWCOE); Harrison, Pete (EPS CoE); Mallikarjun, Kande (IE10); Balasubramanyam, Ravindranath (IE10); Sunil,Rao V (IE10); Southern, Chris (EPS CoE); Bharat, Chaudhary (IE10); Sridhar, Sampath (IE10). Mallikarjun, Kande (IE10) indicating the following:
  1. Sunil, Sridhar, Bharat and Balu are pulled in part time, and started Thursday, 29th June 2006. Sunil will co-ordinate to assign appropriate files to review members.
  2. We will identify more members to carry out this work in order speed up the review process in the coming week.
  3. We have to work out detailed plan based on the availability members for schedule and effort.
  4. Bill will co-ordinate all the project management activity along with SCM.
  • 2006-06-26: "A380 Looming S/W Problems Part 6!!" teleconference occurred. The 'Due Date' for review activities is now 21-JUL-2006 (as reflected below). This date has been picked in order to highlight the fact that *if* reviews uncover a must fix that impacts executable object code, these issues must be addressed in time for PDMC to incorporate a new SFS version.
  • 2006-06-23: Received Subj: RE: A380 Sharp File System, Sent: Fri 6/23/2006 5:06 AM, from Mallikarjun, Kande (IE10) indicating the following:
  1. Sunil, Sridhar, Bharat and Balu are pulled in part time, starting this Monday, 26th June 2006. Sunil will co-ordinate to assign appropriate files to review members.
  2. We will identify more members to carry out this work in order speed up the review process in the coming week.
  3. We have to work out detailed plan based on the availability members for schedule and effort.
  4. Bill will co-ordinate all the project management activity along with SCM.
  • 2006-06-20: "SFS - Discussions" teleconference occurred. Mallik to forward plan (Resources assigned, transition dates and percentages) on June 21. SW COE RTOS group to provide Planning, coordination and oversight.
  • 2006-06-13: Attempting to resurrect SFS Test Review Team.
  • 2006-06-08: PDMC FFR - Action to perform the above and get back to Airbus by 2006-06-15 with an estimated completion date.

Tasks

Initial Budget: $19,084

YTD: $6,723 + (need SW COE data)

Current ETC: $0

Current EAC: $6,723 + (need SW COE data)

Milestones Due Date Estimated Delivery Delivered Percentage Complete
All Test Cases Reviewed and Accepted 07-AUG-2006 07-AUG-2006 07-AUG-2006 100%
Requirements Coverage Analysis 07-AUG-2006 11-AUG-2006 11-AUG-2006 100%
All Test Procedures Reviewed and Accepted 09-AUG-2006 11-AUG-2006 11-AUG-2006 100%
3.3 Compiler Assessment, RFS & SCA 11-AUG-2006 13-AUG-2006 12-AUG-2006 100%
PCRs Addressed 12-AUG-2006 14-AUG-2006 Only Needed by Redmond 50%
All work complete (audits and docs) 12-AUG-2006 14-AUG-2006 14-AUG-2006 100%


Note: Unless noted otherwise, all estimates below are in terms of effort hours.

Task Breakdown

Task Assignee Risk Original Estimate Current Estimate Elapsed Remaining
PCR:3896 User:bill.cronk@honeywell.com None 8 2 2 0
PCR:3897 SFS Team Only Needed by Redmond 8 8 - -
Test Case Review SFS Team None 96 96 ? 0
Requirements Coverage Analysis User:bill.cronk@honeywell.com None 8 22 22 0
Test Procedure Review SFS Team and SW COE Team None 192 192 ? 0
3.3 Compiler Assessment SFS Team TBD 8 8 ? 0
Run-for-Score SFS Team TBD 8 8 ? 0
Structural Coverage Analysis SFS Team TBD 8 8 ? 0
Software Conformity Audit User:bill.cronk@honeywell.com None 8 8 4 0
'Back-end' Activities (SCI, SLECI, SAS) User:bill.cronk@honeywell.com None 8 8 8 0
Verification Audit User:bill.cronk@honeywell.com None 8 8 8 0
Totals 352 368 ? 0


Task Burndown

  • NOTE: Files to be reviewed as well as the status files to track review progress are located under the following tree in the
    VSS sharp-middleware database: $/sfs/releases/chia
  • NOTE: Review evidence should be captured in the certification archive (as required by process).
Code Files Requirements Test Files Analyses Totals
Not ready for review: 0 0 0 0 0
Ready for review: 0 0 0 0 0
In review: 0 0 0 0 0
Total Incomplete: 0 0 0 0 0
Total Complete: 33 49 138 7 227
Total Files: 33 49 138 7 227
Percentage Complete: 100% 100% 100% 100% 100%
 Files in review, by author:

Risks

  • None currently.

Timesite Administrivia

Note: For now, record time here: Deployment_and_Support_time_keeping

See Timesite_Codes