Constellations, Launch, New Space and more…
News

IG Criticizes NASA’s Decision to Allow SpaceX, Orbital ATK to Conduct Own Accident Investigations

By Doug Messier
Parabolic Arc
June 29, 2016
Filed under , , , , , , , , , , , , ,
Dragon capsule separated from Falcon 9 launch vehicle.

Dragon capsule separated from Falcon 9 launch vehicle.

By Douglas Messier
Managing Editor

NASA’s Inspector General (OIG) has criticized the agency’s practice of allowing SpaceX and Orbital ATK to lead investigations into their own launch failures involving commercial cargo ships, citing a lack of independence and the potential for serious conflicts of interest.

“While not required in the CRS-1 [Commercial Resupply Services-1] contract, this lack of independence does not meet Government best practice standards for NASA, NTSB, and USAF investigations and could impact the board’s ability to identify the root cause and make corrective actions,” the OIG said in an audit released on Tuesday.

“NASA’s official policy for investigations requires all official Mishap Investigation Boards to be independent,” the report adds. “NTSB and USAF have similar requirements. In contrast with these best practices, the CRS-1 contract and FAA license requires SpaceX to conduct its own investigation but does not require company investigation boards to screen for conflicts of interest or maintain independence.”

The criticisms are contained in a new OIG audit, “NASA’s Response to SpaceX’s June 2015 Launch Failure: Impacts on Commercial Resupply of the International Space Station.”

The failure of SpaceX’s Falcon 9 booster sent a Dragon supply ship bound for the space station to the bottom of the Atlantic Ocean. Eight months earlier, an Orbital ATK Antares rocket exploded shortly after launch, destroying a Cygnus cargo vehicle headed for the station.

The Inspector General found that not only was SpaceX allowed to investigate its own failure, but that 11 of the 12 voting members of the investigation board were SpaceX employees. The report acknowledges that expert knowledge is required to investigate failure, but said there were other ways to obtain it.

“We acknowledge SpaceX’s investigation was transparent and the observers from FAA, ISS, LSP, NTSB, and USAF had access to the investigation’s data and analysis,” the report concluded. “However, an investigation led by the employee responsible for the SPX-7 launch and run by the contractor responsible for the failure raises questions about inherent conflicts of interest.”

The report also criticized NASA for not having a clear policy on how commercial cargo failures should be investigated. This has resulted in the space agency deciding on how to conduct accident inquiries on an “ad-hoc’ basis.

“As such, for the SPX-7 launch failure there were up to seven possible investigation authorities depending on when the failure occurred and the extent of damage to coordinate and prioritize,” the report states. “Due to a lack of standardization or NASA policy, the contractor and NASA investigations into the SPX-7 and Orb-3 failures had different scopes and produced varying findings and corrective actions.”

SpaceX’s investigation concluded the “most probable cause for the mishap was a strut assembly failure in the rocket’s second stage. Specifically, the failed strut assembly released a helium tank inside the liquid oxygen tank, causing a breach in the oxygen tank’s dome and the release of gas that in turn disabled the avionics and caused release of the Dragon 1 capsule and break-up of the launch vehicle….

“The company’s post-mishap testing of strut parts from the same purchase order as those used on SPX-7 found material flaws due to casting defects, ‘out of specification’ materials, and improper heat treatment,” the report states.

NASA’s Launch Services Program (LSP) conducted its own investigation into the failure.  Officials concluded there were several “credible causes” for the accident, including poor quality control at Elon Musk’s launch company.

“In addition to the material defects in the strut assembly SpaceX found during its testing, LSP pointed to manufacturing damage or improper installation of the assembly into the rocket as possible initiators of the failure,” according to the report. “LSP also highlighted improper material selection and such practices as individuals standing on flight hardware during the assembly process, as possible contributing factors.”

LSP’s findings concerned top officials at NASA, which had awarded commercial cargo and crew contracts to SpaceX to service the space station.

“In February 2016, the NASA Administrator and the Associate Administrator for the Human Exploration and Operations Mission Directorate sent a letter to SpaceX expressing concerns about the company’s systems engineering and management practices, hardware installation and repair methods, and telemetry systems based on LSP’s review of the failure,” the report read.

The report concludes that the disparate findings are likely the result of NASA’s lack of a clear policy on how to conduct commercial cargo accident investigations. This caused the two inquiries to diverge in their scope.

“The findings of the contractor-led investigation boards were generally limited to determining the “technical cause” of the failures and implementing corrective actions to replace failed parts or systems,” the report reads.

“NASA’s investigations had broader objectives, but varied in scope and purpose,” the report added. “For example, LSP not only evaluated the technical causes of the SPX-7 failure but also made findings related to the selection, use, and lack of testing of the failed strut assembly as well as a general finding recommending additional measures when using commercial grade parts on launch vehicles.”

The OIG report makes two recommendations on how NASA can improve its investigation of future accidents. The first is to improve communications and coordination with other federal agencies that deal with commercial space, including the Federal Aviation Administration (FAA), National Transportation Safety Board (NTSB), and the U.S. Air Force.

NASA’s management concurred with this recommendation. It said the four agencies are drawing up a memorandum of agreement “identifying investigative authorities, responsibility, relationships, notification procedures, coordination requirements, and reporting responsibilities of the FAA and NASA in conjunction with commercial space transportation mishap investigation.”

The OIG also recommended that NASA “determine the extent to which official NASA mishap policies apply in commercial space launches with NASA payloads”, “describe what types of investigations may occur and the processes to be followed”, and “clarify the scope and purpose of each investigation.”

NASA partly concurred with the recommendation. The space agency said it would “include an appendix on commercial space launches with NASA payloads. The annex will further define how NASA will accomplish parallel investigations to FAA licensed launch investigations.”

However, NASA said it did not want to make wholesale changes to the commercial cargo program. The agency said that “to apply significant portions of the NASA mishap policy to the current CRS contracts would be a fundamental change to the procurement and resupply strategy laid out by NASA in 2008 and which as created an ISS commercial resupply cpaability and fostered U.S. commerce in low-Earth orbit. NASA will not agree to these updates at this time.”

The relevant excerpts from the report follow.

REPORT EXCERPTS

Excerpts from
NASA Office of the Inspector General Report No. IG-16-025

NASA’s Response to SpaceX’s June 2015 Launch Failure: Impacts on Commercial Resupply of the International Space Station

NASA Could Improve Investigation Policies and Coordination for CRS-1 Launches

NASA’s official policy for mishap investigations does not directly address the process for failures of FAA-licensed commercial space launches.52 As a result, when a CRS-1 mission fails NASA determines on a case-by-case basis whether to form an ad hoc investigation through its various discretionary authorities (as shown in Appendix D, Figure 7 and Table 12). This determination is based on FAA licensing requirements, CRS-1 and LSP contract requirements, and the ISS Contingency Action Plan. As such, for the SPX-7 launch failure there were up to seven possible investigation authorities depending on when the failure occurred and the extent of damage to coordinate and prioritize.53

Due to a lack of standardization or NASA policy, the contractor and NASA investigations into the SPX-7 and Orb-3 failures had different scopes and produced varying findings and corrective actions. The findings of the contractor-led investigation boards were generally limited to determining the “technical cause” of the failures and implementing corrective actions to replace failed parts or systems.54 NASA’s investigations had broader objectives, but varied in scope and purpose. For example, LSP not only evaluated the technical causes of the SPX-7 failure but also made findings related to the selection, use, and lack of testing of the failed strut assembly as well as a general finding recommending additional measures when using commercial grade parts on launch vehicles.

While the Agency’s SPX-7 and Orb-3 investigations had elements of a traditional NASA Mishap Investigation, they were not as comprehensive as the process described in NASA policy. For example, the Orb-3 Independent Review Team made programmatic recommendations to the ISS Program, while the LSP SPX-7 Investigation did not. In addition, neither of the investigations was directed to determine all elements of a full “root cause” determination – defined by NASA as determination of the cause of the failure, including technical, organizational, and programmatic issues by reviewing the actions of the contractor and all related parties.55 Accordingly, the Orb-3 Independent Review Team used root cause analysis to develop a fault tree that included findings and recommendations related to programmatic and organizational issues, while the LSP SPX-7 investigation team stated they did not conduct root cause analysis but rather focused on the technical aspects of the failure. Had NASA undertaken an official Agency Mishap Investigation for the failures, Agency policy would have required a root cause analysis with comprehensive corrective actions directed at the contractor and the ISS Program to prevent the specific technical cause from reoccurring and to address any programmatic weaknesses that contributed to the failure. Table 7 compares the four investigations to the NASA Mishap Investigation standards.

NASA_OIG_F9_InvestigationWhile a complete NASA Mishap investigation is not required for launch failures under the terms of the CRS-1 contract, in our judgment the absence of more formal guidance for CRS investigations increases the risk that contractor corrective actions may not fully address broader contributing causes.

In addition, NASA lacks a memorandum of understanding with the FAA to coordinate and delegate accident investigation authority during CRS launches involving the FAA, NASA, NTSB, USAF, and contractor.56 After the Orb-3 failure, there was confusion among FAA, NASA, and Orbital on how to immediately respond and impound evidence. While these issues were resolved relatively quickly, NASA officials identified the need for a more formalized understanding between all the affected parties involved in an FAA-licensed commercial space launch failure. Moreover, FAA officials stated there is the potential for the FAA to relicense a company’s launch vehicle before reviewing NASA’s independent investigation of the failure. For example, although FAA officials had access to LSP meetings during the SPX-7 investigation, the FAA did not receive LSP’s final report with findings and recommendations for corrective actions before SpaceX obtained FAA approval to return to flight in December 2015. While the FAA was not required to review LSP’s findings before issuing a license, this uncoordinated approach increased the risk the FAA approved a launch without fully understanding the LSP investigation’s findings and recommended corrective actions. Moreover, according to officials from NASA’s Office of Safety and Mission Assurance, the Agency will always conduct an independent investigation of failures of commercial launches. As such, the Office is currently in the process of developing a memorandum of understanding to better coordinate with all relevant parties and is updating the NASA mishap policy to clarify the process for independent investigations.

Lack of Independence Could Inhibit Contractor-Led Investigations

In our report examining NASA’s response to the Orb-3 launch failure, we found that Orbital’s Accident Investigation Board was not independent.57 Similarly, we found SpaceX’s investigation board was not independent because 11 of the 12 voting members were SpaceX employees.58 While not required in the CRS-1 contract, this lack of independence does not meet Government best practice standards for NASA, NTSB, and USAF investigations and could impact the board’s ability to identify the root cause and make corrective actions.

NASA’s official policy for investigations requires all official Mishap Investigation Boards to be independent.59 NTSB and USAF have similar requirements.60 In contrast with these best practices, the CRS-1 contract and FAA license requires SpaceX to conduct its own investigation but does not require company investigation boards to screen for conflicts of interest or maintain independence. FAA officials stated NASA can implement additional independence requirements for contractor-led investigations through its contracts as long as they do not conflict with FAA regulations.

NASA and SpaceX officials responded that specific expertise in the failed launch vehicle is important for an accident investigation board and that this factor should be taken into consideration even though it may impact the board’s independence. We agree that engineering expertise is invaluable for determining the causes of a failure and developing corrective actions. However, other processes such as NASA’s Anomaly Engineering Board or USAF’s Engineering Analysis Group are available to obtain this expertise without compromising the independence of an investigation board.61

We acknowledge SpaceX’s investigation was transparent and the observers from FAA, ISS, LSP, NTSB, and USAF had access to the investigation’s data and analysis. However, an investigation led by the employee responsible for the SPX-7 launch and run by the contractor responsible for the failure raises questions about inherent conflicts of interest. To independently verify and review the contractor investigations, NASA created its own investigation boards for both the Orbital and SpaceX CRS-1 mission failures. While NASA, Orbital, and SpaceX, have similar incentives to safely and quickly return to flight, the structure of the contractor-led investigations may not result in a full review of all programmatic and organizational contributing factors and consequently these factors may not be fully addressed to prevent future failures.

__________

52 For failures of NASA-owned or -operated launches, Agency policy provides that NASA form a Mishap Investigation Board to determine the root cause and recommend corrective actions. However, this policy only applies to CRS-1 launches once the spacecraft reaches the proximity of the ISS.

53 We also found that four different accident investigation plans existed among NASA, the FAA, and SpaceX (see Appendix D, Figure 6).

54 Technical cause is the condition that directly resulted in the failure and is usually limited to determining what physical part or system literally caused the failure. Orbital’s investigation for Orb-3 recommended replacing the whole engine system and SpaceX’s investigation for SPX-7 recommended replacing the failed strut part.

55 Root cause is an event or condition that is an organizational factor that existed before the technical cause and directly resulted in its occurrence (thus indirectly it caused or contributed to the proximate cause and subsequent undesired outcome) and, if eliminated or modified, would have prevented the technical cause from occurring and the undesired outcome. Typically, multiple root causes contribute to an undesired outcome. Root cause analysis is a structured evaluation method that identifies the root causes for an undesired outcome and the actions adequate to prevent recurrence. Root cause analysis should continue until organizational factors have been identified or until data are exhausted.

56 In 2004, the FAA, NTSB, and USAF formed a Memorandum of Understanding, which did not include NASA, before the CRS-1 contract was initiated.

57 NASA OIG, IG-15-023.

58 SpaceX’s FAA-required investigation plan requires the chairperson and board members to be impartial in their analysis. Although there was no definition of impartiality in the investigation plan, SpaceX explained that the impartiality requirement means board members are able to evaluate evidence critically and objectively to reach conclusions without being subject to financial, political, legal, or interpersonal influences.

59 NPR 8621.1B. Specifically, the board chair must be independent of the activity, the majority of board members must be independent, and contractors cannot be voting board members. According to ISS Program officials, NASA’s official mishap investigation policy is not applicable to CRS launches.

60 In the event of a launch failure under the Evolved Expendable Launch Vehicle contract, USAF has authority to conduct the accident investigation. Depending on the situation and as outlined in the contract, a contractor could conduct an investigation, but USAF has monitoring standards for the contractor-led investigation board.

61 NASA’s official investigation policy allows for creation of a nonvoting Anomaly Engineering Board to examine technical engineering and factual issues. USAF also creates a nonvoting Engineering Analysis Group to assist its Safety Investigation Boards. LSP officials told us they had access to all required technical expertise for their analysis of the SPX-7 failure.

OIG Recommendations & Management Responses

4. Review all investigation authorities and plans during commercial launches with NASA payloads to ensure they are standardized. In particular, NASA should review the contract requirements, ISS Program Office plans, the FAA Accident Investigation Plan, and contractor submitted plans to ensure each references the other and are coordinated and incorporate programmatic and organizational root cause analysis.

NASA Management’s Response: Concur. NASA will be assigned an action through the Space Station to review all plans and recommend updates, as required.

Estimated Completion Date: August 30, 2016

In order to clarify the division of roles and responsibilities in the event of a mission failure, we recommended the Office of Safety and Mission Assurance, in conjunction with ISS Program officials:

5. Improve coordination with other Federal agencies involved in commercial space. For example, consider

a. creating a formal Memorandum of Understanding with the FAA, NTSB, and USAF to coordinate accident investigations;
b. coordinating with other Federal agencies to determine the hierarchy and roles of different investigation authorities during all phases of commercial launches with NASA payloads; and
c. communicating investigation findings and corrective actions to all interested Federal agencies to allow full and informed decisions.

NASA Management’s Response: Concur. NASA continues to improve communication with other Federal agencies involved in commercial space through ongoing cooperative agreements with NTSB, FAA, and USAF. The Quad Agency Working Group was developed to work issues with commercial launches such as, the hierarchy and the roles for mishap investigations. The FAA, NASA, and NTSB, as representatives of Quad Agency Working Group (FAA, NASA, NTSB, and USAF), are currently drafting a Memorandum of Agreement (MOA)  identifying investigative authorities, responsibility, relationships, notification procedures, coordination requirements, and reporting responsibilities of the FAA and NASA in conjunction with commercial space transportation mishap investigation, and identifying areas in which the exchange of information, data, and use of resources or services of one agency by another may be requested. The MOA will address how NASA will assist in communicating investigation findings and corrective actions to all interested Federal agencies to allow full and informed decisions. The MOA is being reviewed by the involved Agencies at this time.

Estimated Completion Date: June 30, 2017

6. Update NPR 8621.1B to include commercial space launches with NASA payloads in official mishap policies. In particular, NASA should

a. define commercial space launches with NASA payloads;
b. determine the extent to which official NASA mishap policies apply in commercial space launches with NASA payloads;
c. describe what types of investigations may occur and the processes to be followed in lieu of an Official Mishap Investigation Board, such as an independent investigation board created by NASA; and
d. clarify the scope and purpose of each investigation, such as a NASA defined root cause compared to a technical root cause analysis, and consider the inclusion of programmatic and organizational root cause analysis.

NASA Management’s Response: NASA partially concurs with this recommendation. OSMA will update NASA NPR 8621.1 Revision C to include an appendix on commercial space launches with NASA payloads. The annex will further define how NASA will accomplish parallel investigations to FAA licensed launch investigations. However, updating the NPR to apply significant portions of the NASA mishap policy to the current CRS contracts would be a fundamental change to the procurement and resupply strategy laid out by NASA in 2008 and which as created an ISS commercial resupply capability and fostered U.S. commerce in low-Earth orbit. NASA will not agree to these updates at this time.

Estimated Completion Date: August 31, 2017

Save

Save

Save

Save

Save

Save

Save

Save

Save

Save

Save

Save

Save

34 responses to “IG Criticizes NASA’s Decision to Allow SpaceX, Orbital ATK to Conduct Own Accident Investigations”

  1. Jeff Smith says:
    0
    0

    Welcome to the culture of commercial procurement!

    This is a philosophical question that the CRS companies are asking, and it’s one that deserves to be asked again in this generation: do we operate according to the time tested principles of aerospace quality and safety used by USAF/Primes/NASA/etc. – everything is qualified, serialized, tracked and acceptance tested, OR do we accept the inherent greater risk of commercial practices, quality control and fixing individual problems as they occur (as opposed to the classical “shotgun” approach of fixing all probable causes and any low hanging fruit while we’re at it)?

    These principles have been perfected by ULA and their flawless launch record. Compare this to SpaceX and OATK that have both lost vehicles in a short span of time. An organization can obviously be successful if it follows the traditional philosophy. Can an organization be successful by following this new philosophy? What customers are attracted to which philosophy? Is one more profitable than the other?

    We have several companies now that are running the experiment. Heady times indeed!

    • Douglas Messier says:
      0
      0

      Good points.

      For SpaceX, Boeing and ULA, the game is about to change radically as commercial crew tests begin. NASA isn’t particularly bothered by cargo losses. Crew flights are at a whole different level.

      The section on risk management in the OIG report is interesting. As you say, NASA took a very different path relating to risk analysis and tolerance with commercial cargo.

  2. Jeff2Space says:
    0
    0

    The government typically “self insures” in areas like this. In the long term, this saves the government money which would otherwise go towards the insurance companies (which have operating costs, profits, and etc).

    • windbourne says:
      0
      0

      In fact, that is why I continue to suggest that SpaceX should move towards self insurance. Once they have the F9 rock solid, there is no reason for spending 5-10% for insurance if they can do their own.

  3. Jeff2Space says:
    0
    0

    This is a good discussion to have. Balancing risk and cost is always difficult. But we’ve got to be careful that “safety first” doesn’t drive up costs to the point that flying is completely unaffordable.

    As for commercial crew, yes it will be quite tragic if a crew is lost and that risk is clearly non-zero.

    But, flying in general has always had risks and those risks can never be completely avoided. In the airline industry, it’s taken many decades of experience coupled with government oversight to improve safety to the (arguably quite acceptable) levels we have today. Unfortunately, based on the relatively few numbers of manned spaceflights made to date, manned spaceflight is still in its infancy and we still have a lot to learn when it comes to making spaceflight routine and lower cost.

    • Terry Rawnsley says:
      0
      0

      The idea is to do all that you can to avoid the risks. If there are time-tested and proven methods that assure safety, you use them, even if they cost more. Everything has a risk versus reward element and you are correct in that we have a relatively small number of manned flights to use as a sample. Something unexpected can always occur. When that happens, we re-design systems and procedures so that it doesn’t happen again. The OIG is right on this issue and I don’t hear SpaceX or Orbital ATK complaining. If an accident occurs, an impartial entity should conduct the investigation.

      • Jeff2Space says:
        0
        0

        Agreed that an impartial entity should investigate accidents.

        But, since companies like SpaceX and Orbital ATK have less experience with large liquid fueled launch vehicles, they no doubt have a learning curve ahead of them.

        • Terry Rawnsley says:
          0
          0

          Very true. I’m sure that each company has people that have worked for other aeronautics companies that can supply expertise that will help flatten out the curve.

        • windbourne says:
          0
          0

          To be fair, no group has done where these companies are headed.
          The landings.
          The massive new BFR coming (and we can only guess what BO will do).

          • Terry Rawnsley says:
            0
            0

            I disagree. Where they are headed is irrelevant. If their birds blow up, an impartial investigation is in order. No credit given for engineering accomplishments, lofty goals or paper vehicles.

            • windbourne says:
              0
              0

              What is to disagree with?
              I did not suggest that they should not have an investigation.
              In fact, I hope that NASA does their own as well.

              It is for this very reason that I have suggested that SLS should be kept around since BFR is likely going to have at least 1 failure, and we will need to investigate it which will take up to a year. And for anything like the BFR, it will require us to be on the moon and/or mars.

              • Terry Rawnsley says:
                0
                0

                Perhaps I misunderstood. It seemed like you were suggesting that we should cut SpaceX and BO some slack because they were developing reusable rockets. I wouldn’t hold them to a higher standard, just the same standard as ULA and Boeing. Accidents will happen when you push the boundaries. I just fundamentally agree with the IG that the manufacturers should not be allowed to run NASA, DOT or FAA investigations. I’m sure that they will wish to run internal investigations and that is fine, even expected.

              • windbourne says:
                0
                0

                Cut them slack? HELL NO.
                Just the opposite. I wish that the IG would crack down on old space. Nnew space is currently being held to MUCH higher standards than are the others, but that is the standards that all should be held to.

                None of these new space companies ran NASA, DOT, or FAA investigations. in fact, near as I can tell, SpaceX appears to regard NASA as their best friend, not as their enemies. And that would be because of all the help that they get from their big brother. OTOH, when I worked with Boeing, it was obvious that we regarded NASA and other gov groups as a necessity to get around, but also to gouge (lots of money to be made there).

                And lets be honest, NASA IS the best for a reason. They have many many decades at pushing the envelope. They have not been allowed to for quite some time, but they still have so many skills that are useful to help companies like BO, SpaceX, Bigelow, Orbital, etc

    • windbourne says:
      0
      0

      as terrible as this sounds, Musk is probably correct that we hare NOT taking enough risks when we are not losing rockets once in a very long blue moon.

      • Jeff Smith says:
        0
        0

        That’s probably right, but who’s risk? If it’s my payload, the payload risk or business risk is high enough that I don’t want someone running experiments on the launch vehicle. If the launch provider wants to pay for dedicated development flights with no payload, by all means do it! If the launch provider is running experiments on my flight, I’d demand a deep discount for accepting THEIR risk. (as in the launch is provided below cost)

        • windbourne says:
          0
          0

          SpaceX is already at far lower prices than any other group. However, I noted that SES wanted 50% off for allowing SpaceX to do a refly with their first stage.

          I am amazed that none of the lunar prize groups are going after the first stage refly.

          • Jeff Smith says:
            0
            0

            And I’m sure that’s a fair trade between SES and SpaceX. If everyone is going into the deal with eyes wide open, that’s a perfect example of a market setting a price for a service. If the model SpaceX follows gives customers the opportunity to trade price for reliability, that’s a valid strategy and I’m sure some will take it.

            As for the XPrize contestants, I would assume they don’t have the long term buying power to force lower costs. For SES, it’s good to be the king! 🙂

          • Terry Rawnsley says:
            0
            0

            The rest of the rocket has to be able to deliver the rover to the Moon – a capability that has not yet been demonstrated.

      • Terry Rawnsley says:
        0
        0

        He’s perfectly free to take all the risks he wants when he’s footing the entire bill for his R&D – and launching from his private pad in Texas.

      • Steve says:
        0
        0

        I guess it’s alright to lose valuable cargo like the IDA adapter then. If commercial crew is delayed because of it, that’s fine because we aren’t taking enough risk anyway. If a Tesla crashes into a truck when auto-drive is enabled that’s OK. We need to take more risks, because being safe is too expensive.

        • windbourne says:
          0
          0

          Hmm. U were doing good until last line. Taking risk is not about costs. In fact, musk spent more on auto-pilot development than the standard industry combined had spent. By end of next year, AP will likely be vetted for level 4 driving in America and western Europe. What that will do is save large numbers of lives. As to the seal that died, he was watching Harry Potter rather than paying attention to the situation. IOW, he was doing the equivalence of texting and driving and paid the ultimate price. However, he knew AP was not fully ready .

          The loss of the Ida adapter was also not due to risk taking on spacex’s part. That was due to a normally reliable third party sending the work to China who then cut corners. But that was risk based on greed, not about helping society.

          So there are different types and reasons for risks.

  4. Douglas Messier says:
    0
    0

    I’m working on a post about the risk section of the OIG report. It’s a fascinating read. I recommend it.

  5. patb2009 says:
    0
    0

    ““LSP also highlighted improper material selection and such practices as individuals standing on flight hardware during the assembly process, as possible contributing factors.”

    Obviously this is a comment taken out of context but a lot of stuff in a booster should be strong enough to take the weight of a worker. If you look at aircraft, the mechanics will stand or walk on chunks of the wing, but the fragile parts will be marked “No Step”… Perhaps that needs to become part of the culture of commercial launch, where more fragile stuff is marked out?

    • Hug Doug ✓ᵛᵉʳᶦᶠᶦᵉᵈ says:
      0
      0

      When doing a failure mode analysis, all possible factors that may have contributed to the failure must be taken into account, regardless of how likely they are (and it’s very important to remember that unless a failure mode has been eliminated by design, all factors have a non-zero probability of occurring). These are usually broken down into the “six Ms” (though the terms vary, these are what I was taught), Machine, Materials, Man, Method, Measurement, Mother Nature. Basically, could the machine that built it have been out of calibration? Was it made of out of spec materials? Was it mishandled or improperly installed somehow by someone? Were the correct procedures followed? Were the instruments used to make it or inspect it or were the drawings / specifications used to make it in error? And “nature” is physical exterior conditions, was it too hot or too cold or in direct sunlight or too humid or not humid enough? etc.

      The NASA assessment of the F9 failure is basically saying, “here are some possible causes, we can’t rule these things out no matter how unlikely they may be.” It seems that SpaceX determined the strut not being made to spec is the most likely cause (and they have some motivation to pin the blame anywhere other than themselves, of course), and it probably is the most likely cause. However, since we don’t have the actual failed strut to examine, one can’t really rule out that it may have been mishandled, stood on, dropped, etc. even though doing those things should not damage the structural integrity of the part.

      • P.K. Sink says:
        0
        0

        Excellent explanation. Thank you.

        “(and they have some motivation to pin the blame anywhere other than themselves, of course)”

        I don’t think so. Dodging the blame is not solving the problem. And not solving the problem is not getting SX where Elon wants it to go…Mars. Remember that he paused a lot of other projects, and put his people on the Buddy System, where everybody was in every other body’s business. That must have been entertaining.

        • Hug Doug ✓ᵛᵉʳᶦᶠᶦᵉᵈ says:
          0
          0

          It’s in SpaceX’s best interest if the blame doesn’t fall on them. Orbital did the same thing in its failure investigation – Orbital simply concluded that the turbopump failed, while Aerojet Rocketdyne’s investigation concluded that the turbopump failed due to ingestion of a foreign object, possibly a packet of dessicant left in the LOX tank by Orbital. However, avoiding the brunt of the blame doesn’t mean that they are avoiding fixing any internal problems.

          In this case, the audit report mentions that SpaceX has tightened up its QC and QA procedures and I would be surprised if they haven’t made their assembly processes better as well.

          • P.K. Sink says:
            0
            0

            Good points. I do remember AR forking over several million bucks to OA to make the finger pointing go away. I’m sooo looking forward to their August launch.

      • patb2009 says:
        0
        0

        How deep is the water where the booster went down?

        • Hug Doug ✓ᵛᵉʳᶦᶠᶦᵉᵈ says:
          0
          0

          I would guess about 1-2 miles deep. And the debris would be spread over a very large area, probably tens of square miles.

  6. Illuminati says:
    0
    0

    The explosion was caused by a strut supplied to SpaceX by an outside company. (A company which has as clients some competitors of SpaceX.) This piece should be certified to handle 10,000 lbs of force, but failed at 2,000 lbs, a five-fold difference. The company who CERTIFIED this piece is therefore guilty of causing the explosion of the Falcon 9. If this strut was manufactured internally, SpaceX would have not lost a single rocket.

    SpaceX has identified the cause of the explosion in less than an month. A NASA investigation would have lasting at least a year and cost millions of dollars.

  7. Douglas Messier says:
    0
    0

    A couple of interesting items from the OIG report.

    The SpaceX accident board included 11 SpaceX employees and a lone FAA representative.

    “In comparison, the seven-member contractor board that investigated the Orb-3 failure included four Orbital employees, two NASA employees, and one third-party expert.”

    Then there’s this:

    “Only the 11 SpaceX board members signed the final accident investigation report.”

  8. Siderite says:
    0
    0

    I would allow companies to determine their own process of learning from their mistakes. A third party investigation would no doubt add some value, but think of the costs: time delays, leaks of company secrets, political and corruption games if that third party if not completely independent. Are car accidents investigated by a third party? There is much more loss of life there. The rest of the debate is economical, where whoever chooses to employ a company or not uses a different set of parameters that are all about money.

Leave a Reply