SFS Supplemental Test Review Project
Due to deficiencies found on June 8th, 2006 during the First Flight Review (FFR) of the PDMC, re-review of all the SFS Version 51.0.1 (aka Chia) test cases and test procedures will be necessary. Note that this version of SFS is only used on/by the PDMC_Program.
Description
When performing a 'slice' review starting with requirement DDD_SFS_OPEN_210, Airbus discovered that its test case objective (tcf019.htm Test Case 180) *did not* address the requirement (despite review evidence). Furthermore, it was discovered that the test procedure for tcf019.htm Test Case 180 did more than what was described in Test Case 180's objective. This second fact, combined with test procedure review, was another opportunity (in Airbus's opinion) to correct tcf019.htm Test Case 180's objective.
Therefore, Airbus is requesting that we re-review all test cases and test procedures used on/by SFS Version 51.0.1. The scope of the re-review is to ensure that: 1) Test Case Objectives fully address requirements to which they trace; 2) Test Procedures fulfills the objective of each test case; and 3) Test Procedures do not go beyond the scope of their objective (i.e., this is a cross-check on the completeness of the test case objective).
News
- 2006-08-31 from Chris Southern "We managed to handle the review, using the data referenced in the Wiki,
so we don't need your support. Sorry for needlessly requesting your support. The good news is that Cyril has accepted both the SFS supplemental test review and CVT qualification support activities. Regards, Chris"
- 2006-08-06: Results of weekend teleconferences with - Calcagni, Kevin (SWCOE); Balasubramanyam, Ravindranath (IE10); Sunil,Rao V (IE10); Anil Kumar, Pandit (IE10); Sridhar, Sampath (IE10); Bharat, Chaudhary (IE10); Mallikarjun, Kande (IE10); Cronk, Bill (SWCOE); Jongsma, Ken (SWCOE); Diethelm, Matt (SWCOE).
- The Issues have been addressed.
- PCRs have been written.
- Files are ready to be checked-in (some have been), Reviewers will complete review packets (some are filled-out), review packets will be committed to the certification archive by start of bussiness Monday, 07-AUG-2006 in North America. Note: NetMeeting session occured in order to walk through the configuration-management-howto Installing Required Tools and Checkout and Commit sections thereby ensureing all at HTSL have the ability to interact with the certification archive.
- 2006-08-04: "Test re-review comments/ PCR discussion" Teleconference occurred with - Calcagni, Kevin (SWCOE); Balasubramanyam, Ravindranath (IE10); Sunil,Rao V (IE10); Anil Kumar, Pandit (IE10); Sridhar, Sampath (IE10); Bharat, Chaudhary (IE10); Mallikarjun, Kande (IE10); Cronk, Bill (SWCOE); Jongsma, Ken (SWCOE).
- Clarity was reached with regards to the information and units displayed on this page.
- The Issues documented below will be addressed *before* any further action is taken. Toward that end HTSL team members submitted requests for svn/buggzilla account activations during the teleconference. SW RTOS COE members will activate those accounts today.
- Questions, with regards to test case reviews, were asked/addressed such that the team now feels they are able to complete this task.
- The plan is to write two PCRs (note that one - PCR:3985 - already exists). One PCR will document must fix items while the other will document items which can/will be deferred (i.e., addressed at a later time). This work can now begin (per the above).
- Regarding resource loading/planning:
- Mallik currently has six individuals committed working 50% time on task. Mallik will attempt to increase the time on task for the existing individuals as well as try to add two more.
- Bill will be adding two full-time individuals to join as soon as test *procedure* review can commence (coordination will occur, as per process, via the status file).
- The team (composed per the above) will be working everyday (including weekends) until the task is completed.
- Daily (including weekends) teleconferences will occur at 6:30pm IST in order to ensure successfully transfer of work flow between time zones. If this is deemed insufficient another daily teleconference at IST start-of-business will be added (i.e., we will go two-a-days).
- 2006-07-11: Sunil Rao has been added to the SHARP File System access list for Bugzilla and Subversion.
- 2006-07-10: E-mail, From: Mallikarjun, Kande (IE10); Sent: Monday, July 10, 2006 6:32 AM; To: Cronk, Bill (SWCOE); Subject: RE: A380 Sharp File System; Mallik shared the following:
- Dipal has been added to the team of Sunil, Sridhar, Bharat and Balu. Discussion are on-going for the addition of Anil.
- Needs a PO from the PDMC team for this effort.
- 2006-06-30: "A380 Sharp File System" teleconference occurred with Calcagni, Kevin (SWCOE); Harrison, Pete (EPS CoE); Mallikarjun, Kande (IE10); Balasubramanyam, Ravindranath (IE10); Sunil,Rao V (IE10); Southern, Chris (EPS CoE); Bharat, Chaudhary (IE10); Sridhar, Sampath (IE10). Mallikarjun, Kande (IE10) indicating the following:
- Sunil, Sridhar, Bharat and Balu are pulled in part time, and started Thursday, 29th June 2006. Sunil will co-ordinate to assign appropriate files to review members.
- We will identify more members to carry out this work in order speed up the review process in the coming week.
- We have to work out detailed plan based on the availability members for schedule and effort.
- Bill will co-ordinate all the project management activity along with SCM.
- 2006-06-26: "A380 Looming S/W Problems Part 6!!" teleconference occurred. The 'Due Date' for review activities is now 21-JUL-2006 (as reflected below). This date has been picked in order to highlight the fact that *if* reviews uncover a must fix that impacts executable object code, these issues must be addressed in time for PDMC to incorporate a new SFS version.
- 2006-06-23: Received Subj: RE: A380 Sharp File System, Sent: Fri 6/23/2006 5:06 AM, from Mallikarjun, Kande (IE10) indicating the following:
- Sunil, Sridhar, Bharat and Balu are pulled in part time, starting this Monday, 26th June 2006. Sunil will co-ordinate to assign appropriate files to review members.
- We will identify more members to carry out this work in order speed up the review process in the coming week.
- We have to work out detailed plan based on the availability members for schedule and effort.
- Bill will co-ordinate all the project management activity along with SCM.
- 2006-06-20: "SFS - Discussions" teleconference occurred. Mallik to forward plan (Resources assigned, transition dates and percentages) on June 21. SW COE RTOS group to provide Planning, coordination and oversight.
- 2006-06-13: Attempting to resurrect SFS Test Review Team.
- 2006-06-08: PDMC FFR - Action to perform the above and get back to Airbus by 2006-06-15 with an estimated completion date.
Tasks
Initial Budget: $19,084
YTD: $6,723 + (need SW COE data)
Current ETC: $0
Current EAC: $6,723 + (need SW COE data)
| Milestones | Due Date | Estimated Delivery | Delivered | Percentage Complete |
|---|---|---|---|---|
| All Test Cases Reviewed and Accepted | 07-AUG-2006 | 07-AUG-2006 | 07-AUG-2006 | 100% |
| Requirements Coverage Analysis | 07-AUG-2006 | 11-AUG-2006 | 11-AUG-2006 | 100% |
| All Test Procedures Reviewed and Accepted | 09-AUG-2006 | 11-AUG-2006 | 11-AUG-2006 | 100% |
| 3.3 Compiler Assessment, RFS & SCA | 11-AUG-2006 | 13-AUG-2006 | 12-AUG-2006 | 100% |
| PCRs Addressed | 12-AUG-2006 | 14-AUG-2006 | Only Needed by Redmond | 50% |
| All work complete (audits and docs) | 12-AUG-2006 | 14-AUG-2006 | 14-AUG-2006 | 100% |
Note: Unless noted otherwise, all estimates below are in terms of effort hours.
Task Breakdown
| Task | Assignee | Risk | Original Estimate | Current Estimate | Elapsed | Remaining |
|---|---|---|---|---|---|---|
| PCR:3896 | User:bill.cronk@honeywell.com | None | 8 | 2 | 2 | 0 |
| PCR:3897 | SFS Team | Only Needed by Redmond | 8 | 8 | - | - |
| Test Case Review | SFS Team | None | 96 | 96 | ? | 0 |
| Requirements Coverage Analysis | User:bill.cronk@honeywell.com | None | 8 | 22 | 22 | 0 |
| Test Procedure Review | SFS Team and SW COE Team | None | 192 | 192 | ? | 0 |
| 3.3 Compiler Assessment | SFS Team | TBD | 8 | 8 | ? | 0 |
| Run-for-Score | SFS Team | TBD | 8 | 8 | ? | 0 |
| Structural Coverage Analysis | SFS Team | TBD | 8 | 8 | ? | 0 |
| Software Conformity Audit | User:bill.cronk@honeywell.com | None | 8 | 8 | 4 | 0 |
| 'Back-end' Activities (SCI, SLECI, SAS) | User:bill.cronk@honeywell.com | None | 8 | 8 | 8 | 0 |
| Verification Audit | User:bill.cronk@honeywell.com | None | 8 | 8 | 8 | 0 |
| Totals | 352 | 368 | ? | 0 | ||
Task Burndown
- NOTE: Files to be reviewed as well as the status files to track review progress are located under the following tree in the
VSS sharp-middleware database: $/sfs/releases/chia - NOTE: Review evidence should be captured in the certification archive (as required by process).
| Code Files | Requirements | Test Files | Analyses | Totals | |
|---|---|---|---|---|---|
| Not ready for review: | 0 | 0 | 0 | 0 | 0 |
| Ready for review: | 0 | 0 | 0 | 0 | 0 |
| In review: | 0 | 0 | 0 | 0 | 0 |
| Total Incomplete: | 0 | 0 | 0 | 0 | 0 |
| Total Complete: | 33 | 49 | 138 | 7 | 227 |
| Total Files: | 33 | 49 | 138 | 7 | 227 |
| Percentage Complete: | 100% | 100% | 100% | 100% | 100% |
Files in review, by author:
Risks
- None currently.
Timesite Administrivia
Note: For now, record time here: Deployment_and_Support_time_keeping
See Timesite_Codes