I agree with this assessment and probably the biggest problem in the test. After that, they still have a fair way to go on Raptor reliability; I was a bit disappointed with the number of engine outs: clearly the engines have not arrived. I think the big win of the day was the overall resilience of the vehicle. It seemed to handle (what looked to be) possibly explosive engine failures and kept going and stayed intact... even through the tumbling.
I think this is a case where the engineers can look at the numbers and calculate for a limited variety of well defined (and foreseen) scenarios, but that they continue to fail to have an intuitive sense of the power of the thing that they built. Given the complexity of the real world, they can "engineer" themselves into an undue sense of certainty about what will happen when they light a rocket of this power... and I think we see the result of that. As an aside, this is precisely where I think we'll some of the biggest failings for LLM based AI... it can get you some nice words to describe a situation and may be able to do all the calculations... but having that gut feeling that maybe there's more to a situation than the numbers would have you believe is still something that humans can do better (though not SpaceX this time around).
In closing, if I had a binary choice of "successful" or "unsuccessful" for this test... I'd still probably call it successful. But only just; it's a very qualified success given some of the test parameters SpaceX had set for themselves.
(of course we could find out about even more damage to "stage 0" which might shift my assessment... but we know that they're in the process of putting in a deluge system at least already, so I'm being a bit more charitable regarding expectations than I might otherwise be.)
> After that, they still have a fair way to go on Raptor reliability
I suspect the debris from blowing a whole in the ground was the biggest contributing factor for the engines out. It looked like at lease 4 we're gone before it left the pad.
That's my thinking, but ignition is a staggered 6 second duration, so there's at least a window for adverse directional flow.
But looking at that pad and the damage to it- without deluge dampening, I bet the RC spalling might have been a bigger issue than just ground blowback.
Put a blowtorch to some concrete a and watch how quickly trapped moisture starts causing miniature explosions and flying shrapnel.
The output power of a rocket is different than a blow torch. The sound pressure alone is near or above atmospheric pressure. That concrete is being exposed to vacuum and more than 1atm pressure fairly rapidly. The heat on top of that and if the concrete has any moisture, the water inside is going to rapidly sublimate and condense several times a second. That is on top of the concrete being slammed into by an entire atmosphere of pressure in the meanwhile.
There is a reason that NASA dumps a few million liters of water under their rockets.
My understanding is that one of the Starship prototypes were damaged by flying debris during a static fire. I think the available evidence points towards it being possible.
> About 2 secs after starting engines, martyte covering concrete below shattered, sending blades of hardened rock into engine bay. One rock blade severed avionics cable, causing bad shutdown of Raptor.
is real, I guess not. What used to be in that crater couldn't just move sideways, it had to go up to get out of the hole. Engine exhaust hit the center of the crater, dislodged rocks, pushed them away radially and up the sides of the hole.
Four of the six engines later seen to have gone dark were in the outer ring. Coincidence?
Rocket "engines" aren't like engines in your car. The bell and the plumbing for it is the engine. There's not too many moving parts besides a pump. Any sort of damage to the bell can cause a failure.
The bells are cooled by pumping super cold fuel over them, a rock hitting those thin lines of fuel could rupture a line, or divert on causing a failure in the bell which eventually (seconds) ends in an engine rich fuel mixture.
> but having that gut feeling that maybe there's more to a situation than the numbers would have you believe is still something that humans can do better
In my life experience so far, humans having gut feelings it 99% of the time complete nonsense. But people forget the 99 times and that one time their gut was right they tell that story forever about how smart they were.
Correct gut feelings are just your subconscious running the numbers without bothering you about it. A human having a (correct) gut feeling that the numbers are wrong just means that the human has not chosen the correct numbers to look at, or possibly that a human has made an error in telling the computer how to calculate the numbers.
Yes, computers are really good at making calculations, but we have to tell them which calculations to make, so there's still (will always be?) a weak link in the chain.
> I was a bit disappointed with the number of engine outs
Who knows if they were controlled tests, you need failures to understand the reliability domain. Engineering is about handling failure, not success. You learn very little from success, esp with so many free variables.
Not necessarily; low gravity plus lighter weight means much, much lower thrust on landing in those locations. F9 lands on the drone ships with one engine, for example. It also looked like today's launch involved a hold-down period while they lit them all; that wouldn't be the case for landing either.
Intuitively it seems like more would be better so that in the case of that engine failing you could use the other engines to push up and maybe light another engine.
Of course, if there's two engines and one fails, it's going to tilt. Same with 3, though to a lesser degree. 4 engines lessen it even more, etc. etc.
Or maybe they can detect a bad center engine on descent (it doesn't light or flame is detectably not the right) and then go to outer engines. Or drop it in the ocean. Hope there aren't people on that one.
> Intuitively it seems like more would be better so that in the case of that engine failing you could use the other engines to push up and maybe light another engine.
The landing F9 first stage is so light even one engine at minimum throttle has a thrust-to-weight ratio greater than one; they can't throttle it down enough to hover. Three lit engines would send it shooting back up rapidly.
The booster is securely clamped to the launch stand. However the starship is only resting on top of the booster - the two parts of the ship are not clamped together.
Launch clamps are released on command of the engine computer - i.e when it detects that sufficient engines are running correctly it commands a clamp release.
Note that Starship Booster's outer engines are actually started using feeds from the launch pad. They need power and pressurized nitrogen from ground equipment to start. The outer engines are not able to restart once off the ground.
So the clamps are required to keep the vehicle in place until all the engines that will start have had a chance to do so. They're also useful if there is an abort during engine start so the vehicle remains secure.
I may be incorrect and they are now using explosive bolts. I've seen those mentioned elsewhere.
However the engines were on the whole time, producing >1G of thrust along the direction of the booster. So that force is going to hold the StarShip and the booster together. But you would expect some lateral force from air friction to push the stack apart at some point.
Might just be the thrust-to-weight being under 1 while they light the engines, but it visibly sits there for a signifcant amount of time, much more than you'd get with a landing suicide burn.
That makes sense, but on mars? Full payload, very little atmospheric drag, little atmosphere to keep the blastolith from scrubbing the bottom of the vehicle. I am talking generically since presumably the first stage won't be landing on mars.
Mars is far off enough it's entirely speculative on how they'll handle this. Drop some robot bulldozers first? Specialized landers for landing pad construction crews? Bring the heavy cargo via a separate non-atmospheric craft built in Earth orbit? Hover from height for a while to blow debris off a rocky flat spot?
I don't have the answer, but IMO cheap mass to Earth orbit is the biggie that enables a whole bunch of options.
There was an idea of adding aluminum powder to exhaust and hovering a little over the pad, so that you deposit a solid metal surface where you intend to land.
they’re not going to land with all the 30+ engines turned on and they won’t need the same amount of thrust since the first stage is gonna be mostly empty. Plus they won’t land the first stage on the moon or on mars.
And the plan is to grab the first stage before it touches ground anyway. So this is mostly an issue on liftoff.
There was a time where people questioned if 33 of them packed in like this would work at all. Pretty impressive that it does and survives multiple engine failures.
> After that, they still have a fair way to go on Raptor reliability
They seem to have worked fine individually and in smaller groups. There could be issues with the plumbing, which they seem to be iterating on quite a lot with the newer boosters.
I think this is a case where the engineers can look at the numbers and calculate for a limited variety of well defined (and foreseen) scenarios, but that they continue to fail to have an intuitive sense of the power of the thing that they built. Given the complexity of the real world, they can "engineer" themselves into an undue sense of certainty about what will happen when they light a rocket of this power... and I think we see the result of that. As an aside, this is precisely where I think we'll some of the biggest failings for LLM based AI... it can get you some nice words to describe a situation and may be able to do all the calculations... but having that gut feeling that maybe there's more to a situation than the numbers would have you believe is still something that humans can do better (though not SpaceX this time around).
In closing, if I had a binary choice of "successful" or "unsuccessful" for this test... I'd still probably call it successful. But only just; it's a very qualified success given some of the test parameters SpaceX had set for themselves.
(of course we could find out about even more damage to "stage 0" which might shift my assessment... but we know that they're in the process of putting in a deluge system at least already, so I'm being a bit more charitable regarding expectations than I might otherwise be.)