May 2008 Update
It’s been a long time since the last time I wrote an update, so I figured that now as a good time to stop and take a few minutes to go over what we’ve been up to out here in Mojave. I apologize for the long delay in posting–we’ve been fairly busy over the past month or so, and as any of you who read Selenian Boondocks may have noticed, I haven’t been in much of a blogging mood lately.
Tanks, Engines, and other XA-0.2 Progress
As many of you who have been following our progress over the past year or so may remember, one of the things that contributed to us not being able to field XA-0.2 in time for the X-Prize Cup was the problems we ran into getting custom 36″ propellant tanks fabricated. One of the ideas we came up with after XA-0.1’s last flight attempt back in December, was to build a new set of engines for XA-0.2 that ran at a much reduced chamber pressure. This would allow us to also lower the required feed pressures in the propellant tanks, which would bring them closer to what others in the alt.space community (such as Armadillo and Paragon Labs) have been doing. With the amount of work we had on our plate this year, we realized that it was going to be challenging to try and orchestrate all the parts of getting the new tanks made in addition to everything else we needed to do. So, we decided to contact Paragon and Armadillo, to see if we could work out a deal to have one of them build us a set of tanks, so we could leverage their previous investments in tank manufacturing development. While Armadillo wasn’t interested at the time, Paragon was, so a few months back we signed a contract with them for the production of a prototype tank and two flight tanks.
These tanks would be made of 5383 aluminum, and since we had lowered the required feed pressures far enough, they ended up being the same thickness and size as the hemispheres Armadillo has used on their Mod and Quad vehicles. In fact the hemispheres were made at the same company (AMS Industries), so they probably came off the same spinning dies. Interestingly enough, when the hemispheres came in, all of them exhibited little or no thinning at the equator, which was much better than the results we had gotten with the other spinning shop.
After doing a little more research, we decided to change the baffle design for these tanks, and the tanks incorporated several improvements over the previous designs. Most importantly, we knew that Paragon had invested a lot of time and money into perfecting their process for welding spherical 5383 aluminum propellant tanks.
We released the order back at the start of March, and over the weekend I got an email from Kevin letting me know that the tanks were done, and had passed the proof hydrotest (at 1.5x the maximum expected operating pressure). We’re finalizing the plans for shipping the tanks out to Mojave for fitup, hopefully sometime this next week. Once we’re done making sure the design will fit correctly with our frame, we’re going to send the tanks down to a company in Burbank (Quality Precision Cleaning) and they will do a “low-cycle fatigue” test series on the tanks. Basically, we’re going to have them cycle the tanks 1000x at slightly over the planned operating pressure. Our reasoning is that since, like Armadillo, we designed the tanks for about a 2.0 FOS over the ultimate burst pressure, we may be operating the tanks close enough to their yield stress that we might have potential low-cycle fatigue issues. Most good 5000-series aluminums have yield strengths about half of their ultimate strength in the annealed condition, which means a FOS of 2.0 over burst implies an FOS of not much more than 1.0 over yield. It’s probably paranoia on my part, but I just want to make sure I don’t have a situation where we proof test a tank to 600psi, then several cycles down the road have it fail on me at 400psi. Also, I don’t think any of the other groups working on similar tanks have done a test series like this, so it’ll be useful information for everyone to have. If we were trying to bring tanks in-house, or if we were trying some material that Paragon or AMS had never worked with before, I’d probably have done a few subscale burst tests to make sure we had our process down, but since the material and thicknesses were similar enough to what Paragon has done in the past, we felt pretty good about just doing a 1.5x over MEOP proof test on each tank, and a fatigue cycle series on the first one.
Anyhow, we’re really pleased so far with our work with Paragon. Our contract work with them has been by far our smoothest experience with outsourcing. Hopefully we get the chance to work with them again in the future.
Anyhow, here is some eyecandy:
While the progress on tanks has been great, the progress on engines has been a bit slower. We now have many of the parts in for our first test engine, but we’re still waiting on some of the main components. We ended up having to switch some of the bigger parts to a different machinist last month, since our first machinist was too overloaded with work (he also does a lot of work for XCOR and several other clients). We also found out in the process that the copper material we had designated for the chamber was actually a real pain to machine. After doing some digging, we found another alloy that I had initially overlooked that looks like it will do much better for our application. In order to make sure we had a good braze-joint design and manufacturing process, our machinist made a few sample joints and had them brazed and checked. We had to do two iterations to get the design right, but we now have a design that we’re all confident with. Hopefully we’ll have some pictures to post in the near future.
In addition to the engine itself, we also needed to overhaul our testing infrastructure. We wrapped up horizontal testing in our trailer of the 500lbf engines over a year ago now, and as we were trying to get XA-0.1 debugged and working, we had little by little cannibalized some of the parts from the trailer. Also, when we got into real testing of the vehicle, we ended up removing some of the main internal pieces like the thrust frame and a lot of the plumbing in order to use the trailer as a temporary blockhouse. So, as part of getting ready to do tests, we planned on overhauling the trailer, and fixing up a lot of the minor things that had worn out over the past few years. Our original plan had been to just throw the trailer back together the way it was, with little or no modification, however as we got into doing some of the repair work we finally decided on a bit more thorough of an overhaul.
We pulled most of the plumbing and all of the wiring from the trailer, swapped a few AC solenoids for 24DC ones (so now all of our valves in the trailer run off of 24VDC), and started thoroughly cleaning things. During our early engine testing back in 2005-2006, we had found that our uninsulated LOX tank was suffering from way too rapid of boiloff, so we decided to insulate it. At the time there was no easy way to remove the tank, so the decision was made to foam it in-place. The aesthetically pleasing result had been affectionately referred to as “Pierce’s Snot Goober” ever since–anyone who had seen our trailer would know what I’m talking about. Anyhow, once we had everything else out, I realized it would be relatively easy to pull the tank and clean up the insulation, so we did. It’s a good thing too–we ended up finding lots of areas on the back and bottom that we hadn’t been able to actually get foam on. We patched those up, trimmed the foam to as close to a spherical shape as we could get, fiberglassed the whole thing, and then painted it. It isn’t perfect, but it looks a lot nicer:
On the IPA side, we had previously had some propellant loading issues. Basically if we loaded the tank too full, insufficient ullage could cause fairly large pressure fluctuations at the beginning of the run. We had worked around the problem for a while by having a sight gage when filling the tank, but that was a bit of a kludge. While we had everything out, we pulled the top fitting going into the IPA tank, and welded on an “ullage tube”. This tube basically makes sure that you can’t easily fill the tank above a certain level. This should make our lives a bit easier.
In addition to cleaning up the trailer, and doing some maintenance and repair to the wiring and plumbing, we also decided to make one other big change to the setup. Previously, we had been using a PLC on the trailer to run the engine tests. We had used one on the igniter, and XCOR swears by them, so at the time it seemed like a good idea. The reality though was that since our engines need to be actively throttled, this ended up costing us a lot of time the first time around. So we decided that this time around, we were going to replace the PLC with the engine computer from the vehicle (the OFMS or On-board Flight Management System). This will require a little more work up-front, but should allow us to test a lot closer to how we intend to fly. Basically, from the computer’s point of view the trailer is just a tipped-over XA-0.1B with only one engine installed, no hinge actuator, and no ACS inputs. This will allow us to test out the OFMS a lot sooner than if we waited until after the engines were done.
Anyhow, we’ve still got a lot of work left to go on XA-0.2, but as you can see we’ve been slowly making a lot of progress.
New Faces, Personnel Changes, and Interns
Back in January we announced that we were trying to hire engineers and technicians to try and flesh out our staff. Part of this was precipitated by the fact that Ian Moore and Pierce Nichols both left MSS back in January. Ian moved back up to the Bay Area to be with his significant other (can’t blame him she’s a good match), and took a job as a Testing Engineer for Northrop Grumman Marine. Pierce took a job with Jacobs’ doing work for the AFRL rocket test facilities in Edwards. Pierce still stops in occasionally, and Ian has stayed in the loop, but for personal reasons it was time for both of them to move on. They were good coworkers, and it was tough to let them go, but it also has ended up freeing up enough resources for us to diversify our skillset a bit compared to our old team, and our newest employees have proven to be excellent additions to the team.
You’ve already seen several postings from Ben Brockert here on the MSS blog, and if you went to Space Access this year, you probably got to speak with him (and he probably tried to sell you our igniter). Ben’s a talented technician, with a real eye for detail. He’s the kind of guy that if he doesn’t know how to do something, he’ll go read up on it and surprise you the next day. We first met him last fall, when he stopped in at our shop looking for a job. He had decided that he wanted to get involved in the industry, so he had packed up his stuff into a van, left Iowa, and came out to Mojave looking for work. Fortunately we were able to hire him before anyone else did. Just to give you an idea what kind of person Ben is, I’ll share this anecdote: Back when we were working on the igniter cart upgrade, we got to the point where we were getting the DAQ system back up and running. I realized that with Pierce and Ian gone, neither Dave or I really know how to program LabView. I came in that Monday expecting to have to spend all of that week and most of the next getting up-to-speed on LabView. You can imagine my surprise when I found out that Ben had taken the books home over the weekend, read up on them, and then came in and already had a basic LabView VI running by the time I got there Monday. Over the past few months since he’s started he’s become our resident welder, bracket maker, electronics tech, photographer, and the list goes on.
Our other addition to the MSS team is Ian Garcia, our new GN&C dude. Ian joins us from Draper Labs out in Boston, where he did GN&C work on various programs including simulation work for RpK’s K-1 vehicle, as well as navigation work including work with GPS systems. He was also involved in Draper’s ALHAT work for NASA. Ian has also been a great addition to the team, and I’ve learned a lot about GN&C systems just from talking with him. He started at the beginning of April, right after Space Access, and has been doing a lot of work with Dave on vehicle simulation, hardware in the loop testing, and other GN&C related projects. Since we have had two other people named Ian involved with MSS, Ben had originally suggested calling Ian Garcia “IIIan” (pronounced Three-An), but he got overruled.
Here’s the current Mojave crew next to our XA-0.1B frame. Ben is in the back on the right, with Ian Garcia in front of him.:
Also, in addition to full-time hires, we’ll also be adding two interns to our numbers this summer: Richard Bell, and Wayne Neumaier Jr. Richard is joining us from University of Colorado, Boulder. Wayne is joining us from University of Illinois Urbana-Champaign. They’ll be starting next Tuesday, so we’ll probably introduce them next week, once we have pictures we can add.
While we’ve now filled our GN&C position, one of our Technician/Fabricator positions, and both of our summer internship slots, we’re still looking for people to fill some other positions, you can read more about them here. Ben will be putting up a post soon with more details on the Fall internships slots for college students looking to get involved in this community.
Igniter Sale and other Business Stuff
We wanted to bring some hardware to Space Access this year, so Ben brought our new igniter to show around. As he deadpanned during our presentation there “Yes, it is an igniter in my pocket, and I’m happy to see you.” One of the people there at the conference was sufficiently interested, that he contacted us about purchasing one, and in the end, he ended up buying an igniter and spark driver system from us. We just shipped the igniter yesterday after putting it through its paces. It was actually kind of fun writing a product user’s guide for an item that we were actually selling to someone. It may be a while before we get far enough along on a website overhaul to have a page with our rocket components that we’re selling, but if anyone is interested in the meantime, the price we’re offering is $1936.00 for one igniter, with valves and associated orifices, spark driver unit, ignition detection unit, user’s guide, and qualification tests. In the future, as we up do upgrades to the igniter (including testing it with different fuel combinations), we will offer those upgraded systems for sale as well.
Once we’ve got the bugs worked out of it, we also plan on offering our 750lbf engine both by itself as well as in a full 2-axis gimballed module. While I know a lot of groups have talked about selling custom engines, we figured it might be interesting to see if anyone was interested in buying off the shelf. It’s going to be a learning experience of course, making the engine ready for sale off-the-shelf like this, and there are going to be restrictions (for instance we’ll probably be only selling to US entities, unless we get enough demand to justify jumping through all the hoops to get ITAR approval), but we figure it’s a worthwhile exercise for the industry.
In addition to the hardware sales, once we have our test stand back up and working consistently, we’re plan on offering people access to the test stand for engine and engine component development purposes. As currently designed, the stand can support engines up to about 2000-2500lbf thrust, and has run tanks capable of holding about 20 gallons each of liquid oxygen and hydrocarbon based fuel, with feed pressures of up to 650psi. The stand has fairly significant data acquisition capabilities (lots of analog I/O, flow meters, load cells, thermocouples, etc). We’re not yet setup for handling a cryogenic fuel, but the upgrades can be made if we have someone willing to pay for them. Pricing will depend fairly strongly on what the specific project is, but if you’re interested in testing liquid fueled rocket engines inexpensively, drop us a line.
Lastly, as previously mentioned, we’re actively working on one other joint project, with the possibility of adding another one later this year. We’ll hopefully be able to say something about those projects once they’re further along.
XA-0.1B Frame, Engine Repairs, OFMS/GFMS, and Actuator Upgrades
As you can see from the picture earlier, we finished the XA-0.1B frame earlier in the month. We chose the “cop magnet yellow” color for our frame because we were looking for a light color that wouldn’t get as hot in the Mojave sun. We got both tanks mounted, and all of the pneumatically actuated valves. We had to shift focus for a few days to get our sold igniter tested, documented, and out the door, but starting again on Tuesday when the interns arrive, we’ll be completing the plumbing and starting into the electrical work. We’re reusing a lot of the valves and regulators from XA-0.1, testing as we go to make sure things are still working fine. The good news is that almost all of the plumbing survived intact, so we’ve only had to purchase a few components (mostly upgrades not replacements). I’m definitely looking forward to doing the plumbing on XA-0.2. With the new tanks that I designed and Paragon built, we’ll be able to simplify the plumbing quite a bit, so it won’t look so much like a flying pile of aluminum spaghetti.
When the structure failed on our last flight attempt of XA-0.1, the vehicle dropped from about 5 feet, landing on one of the engine modules. We took the damaged module off a few weeks ago, to survey the carnage, and found that most of the components were still in ok condition. The engine itself took a beating, with both trunnions being sheared off, and the IPA and LOX inlet tubes getting mangled. However after some cleanup work, it looks like there’s a good chance the weld repair we’re going to have done on it this next week will go off without a hitch. These engines have proven to be extremely robust, and have served us very well. Once we have it welded back together, we’ll reassemble it, and make sure its leak tight. One of the things I had made for the new set of engines is a “hydrotest plug” that we can fit up into the nozzle and hold on with a gear puller. It’ll allow us to do leak checks, and for the lower pressure engines, we can even hydrotest the setup. The ability to do quick and easy leak checks is important for rocket engines, because leaks (particularly fuel leaks) can lead to really bad days. The new nozzles are much bigger, but have the same half angle, so we should be able to use them for both sets of engines. After the engine is leak tight we’ll rebuild the frame, and fix the throttle valve actuator that got bent.
While Ben and I have been having fun with the igniter, the trailer, the frame, and other hardware stuff, Dave has been working full-time on an upgrade to our vehicle computers. As mentioned back in our January update, we’ve decided to revisit the idea of distributed computing for our engines. At least as implemented on XA-0.1, we realized that while we had lots of extra failure points, at least we didn’t have any real redundancy. Hmm… So for now, we’ve decided to pull all of the smarts in to a single central engine computer. This computer runs on a much more capable PC/104 based stack, and runs not only the engine sequencing, but also all of the vehicle valving (such as the tank pressurization and venting, prevalves, etc), and the range safety soft-abort/hard-abort functions. We’ll still have a separate ACS computer for now, because we’re using the fact that they’re separate computers for safety and redundancy purposes. We’ve had all the computer hardware in-house for a while, and Dave has been coding, running unit tests on different components, and making the Hardware-in-the-Loop simulator, among other things.
In addition to the On-board Flight Management System, we also have a Ground Flight Management System (GFMS). This system is the pilot interface. It is what sends commands to the OFMS when to open and close certain valves, when to start the engine firing sequence, and what to do from there. Dave had written the original code for this, but with all of the work that needed to be done on the OFMS, one of our angel investors who’s been more and more involved with us as of late stepped in to help with the GFMS code. His background was in computer programming and software development, and he had previously been working with Dave on making a simulator for the vehicle to try and figure out what happened when XA-0.1 crashed last year. In addition to more thoroughly testing the interfaces between the three computers (GFMS, OFMS, and ACS), our colleague has been overhauling the GFMS code. Cleaning it up, adding new functionality, and really helping out a lot. One of the changes they’ve implemented is automating the checklists. The vehicle has certain states it can be in, and it isn’t allowed to pass from one state to the next until certain items have been checked off. While we had used a checklist before, there was nothing to actually physically prevent one from getting ahead of oneself. Now, the checklist will be right there at the pilot’s finger tips, and we’re hoping that as we debug this list, this new tool will help streamline operations and improve ground safety at the same time. We’ll need to make sure that the system works correctly and doesn’t introduce any new error modes, however I have pretty high confidence that Dave, Ian, and our other colleague can make the code solid and reliable in the end. Aerospace isn’t the only industry where software mistakes can cost lives or livelihoods. In addition to automating the checklist, we’re also in the process of figuring out exactly how to handle both pilot inputs, and guidance scripting. Once we have the Hardware in the Loop testing setup a bit further along, we’ll start testing the GFMS and OFMS more thoroughly. I’m looking forward to seeing all these pieces come together over the next several weeks. Ironically, while I had originally expected the computer stuff to take the longest time, there’s a non-zero chance they’ll be waiting on me, Ben, and the interns for getting the hardware done.
I’ll get more pictures of some of this stuff as time and ITAR considerations permit.
One of the other things that precipitated the move to a central engine computer for XA-0.1B, instead of just trying to patch up what we already had for XA-0.1 and get flying ASAP, was our work on the valve and hinge actuation schemes. I haven’t been very happy with our valve actuation scheme for a while. We spent a lot of time trying to reduce the response time latency on our valves a year and a half ago, but had never been able to get anywhere near what we wanted. We were seeing response times well over a quarter of a second, even after everything we could try, so we finally figured that was the best we could get, and we decided to see what we could do with that. Back in the fall, Ian and I decided to spend a bit of time and put together a dynamic analysis of our engine, taking into account stuff like valve response time, the different fluid resistances, inertance, capacitance, etc. The big takeaway we got from that was that even in the absolute worst case, the fluid delays accounted for well under 50ms of the command-to-thrust-change lag. At that point, we had assumed that for one reason or another, our valve just wasn’t starting to move very quickly. We had speculated at that point that it must have been the amount of time it took to ramp up the current to the valve before it had enough torque to overcome the valve stiction. We thought about other actuation schemes that didn’t involve as much seal drag, but at the time we didn’t really have the resources to pursue those. Based on that information, we figured that for electromechanical ball valves we had nearly reached their limits, and that therefore it was going to be very hard to do vehicle control via differential throttling alone.
I ended up getting into a little bit of an argument with John Carmack (who BTW is a great guy, and has been very helpful over the years to what we’ve been trying to do here at MSS) about whether he would be able to fly their 4-pack MOD design with differential throttling only. During the argument, it came out that John thought his dynamic throttling was reacting much faster than ours was, and he agreed to log some data at some point in the future to prove it. True to his word, he did. What the data showed was that his valves were moving within 5ms of being commanded, and the chamber pressure was starting to rise within 50ms. Within 100ms the throttle change was mostly done. At about the same time as this, I had looked up the KZCO valves John was using, and one of the illustrations showed the actuator driving his valves looked like it is probably the same brush DC gearmotor we are using. Armed with all of this data, we realized that we had probably misunderstood where the valve motion lag was coming from, so we took a couple of days, and hooked up a bunch of data acquisition (with the help of our friend John Bergmans of Bergmans Mechatronics). What we found was that the valve controller boards we were using operated differently from the way I had thought, and had lots of inherent lag in them. When we totalled up all the different lags, we realized that if we had a direct-drive H-bridge type system, that we could probably get similar response times to what John is getting (which shouldn’t be too surprising as that’s more or less what Armadillo does). We decided to do a quick proof of concept test with some off-the-shelf H-bridges. While we were waiting for the H-bridges to arrive, Dave made a first pass at a simulator for the system, just to make sure he had some sort of intuition about what effects mattered. One of the things he found was that with the 8-bit AVR microcontrollers we were using previously, there was no way he could get such a closed loop system to work. The resolution was just so low that you tended to get a lot of overshoot. This was probably part of why we hadn’t gone with direct H-bridge control when we first investigated the idea over a year ago. Fortunately, at this point, since we were going to a much higher capability A/D setup with our new OFMS computer (all 12 and 16 bit), this was no longer a problem. We’ve done a few more integration tests with the OFMS as the code has developed, and we’re now to the point where we should be able to test position servoing in the next few days. After we’ve got that debugged, we’ll have to wait for either the trailer or the vehicle to get far enough along for us to try out a couple of dynamic throttling algorithms in the real world, but we should at least be able to try a few things out on Dave’s Hardware-in-the-Loop simulator.
In addition to the valve lag, the stepper motor setup we had for the engine hinge was also showing quite a bit of lag. It took enough time for the “acceleration” circuitry to ramp up to enough force, that we were seeing fairly serious lags in this system too. After a bit of thinking, we’re also looking at swapping out our Ultramotion Digit actuators for slightly modified Bugs (modified to be the same length as the Digits so we can just swap them out directly). Bugs are Brush DC, so we can drive them with the same H-bridge setup we’ll be using for the valves. We’ll also be able to use the same basic position servoing algorithms that Dave is working on now for the valves. By switching to direct H-bridge control, we may see as much as an order of magnitude lower lag on our hinge actuation, while possibly doubling the slew rate. With less lag and faster slew, it should make controls a lot easier and more linear. With the throttle valve upgrades, we’re also hoping to see response lags several times faster than what we have right now. Between these two changes, I’m a lot more confident in us having a robust TVC setup.
Building Blocks
One of the keys I’ve noticed for awhile to Armadillo’s ability to rapidly field new vehicles is that they’ve had all of their basic building blocks in place for several years now. Before I had even met Dave and Pierce, they already had actuator control schemes similar to what they’re using right now. I’m sure they’ve improved it incrementally since then, but that basic solution has already been figured out and solved for a while. Same with the flight control systems. On our side, I can say that we’ve got a solid building block with our engines. While we intend to upgrade them over the next several iterations, our basic design has worked robustly, with excellent performance now for several years. While progress has appeared to be slow over the past few months, we’re finally getting to the point where I feel we will soon have good building blocks in place for our actuator systems, our vehicle computers, and hopefully our flight control systems as well. With those building blocks in place, we can focus on the last building block, which is getting much better in-house fabrication capabilities. As we get those in place, I expect to see progress accelerate greatly. It remains to be seen if we’ll get all of that wrapped up in time to compete this year in the Lunar Lander Challenge, but at least I know we’re getting on a much more solid technical footing and that Masten Space Systems is going to be in this for the long-haul.

Earlier this week I did my shortest investment pitch yet. The official length was 1 minute 40 seconds. This was part of an event in Atlanta called 












