The Mars Curiosity rover has landed successfully, and one of the promo videos “7 minutes of terror” brags about there being 500,000 lines of code. It’s a complicated problem, no doubt. But that is a lot of code, surely there was a pretty big programming effort behind it. Does anyone know anything about this project? I can only imagine it’s some kind of embedded C.
16
It’s running 2.5 million lines of C on a RAD750 processor manufactured by BAE. The JPL has a bit more information but I do suspect many of the details are not publicized. It does appear that the testing scripts were written in Python.
The underlying operating system is Wind River’s VxWorks RTOS. The RTOS in question can be programmed in C, C++, Ada or Java. However, only C and C++ are standard to the OS, Ada and Java are supported by extensions. Wind River supplies a tremendous amount of detail as to the hows and whys of VxWorks.
The underlying chipset is almost absurdly robust. Its specs may not seem like much at first but it is allowed to have one and only one “bluescreen” every 15 years. Bear in mind, this is under bombardment from radiation that would kill a human many times over. In space, robustness wins out over speed. Of course, robustness like that comes at a cost. In this case, it’s a cool $200,000 to $500,000.
An Erlang programmer talks about the features of the computers and codebase on Curiosity.
34
The code is based on that of MER (Spirit and Opportunity), which were based off of their first lander, MPF (Sojourner). It’s 3.5 million lines of C (much of it autogenerated), running on an RA50 processor manufactured by BAE and the VxWorks operating system. Over a million lines were hand coded.
The code is implemented as 150 separate modules, each performing a different function. Highly coupled modules are organized into components that abstract the modules they contain, and “specify either a specific function, activity, or behavior.” These components are further organized into layers, and there are “no more than 10 top-level components.”
Source: Keynote talk by Benjamin Cichy at 2010 Workshop on Spacecraft Flight Software (FSW-10), slides, audio, and video (starts with mission overview, architecture discussion at slide 80).
Someone on Hacker News asked “Not sure what means that most of the C code is auto generated. From what?”
I’m not 100% sure, although there probably is a separate presentation in that year or a different year that describes their auto-generation process. I know that it was a popular topic in general at the FSW-11 conference.
Simulink is a possibility. It’s a MATLAB component popular among mechanical engineers, and therefore most navigation & control engineers, and allows them to ‘code’ and simulate things without thinking they’re coding.
Model-based programming is definitely a thing that the industry is slowly becoming aware of, but I don’t know how well it’s catching on at JPL or if they would have chosen to use it when the project started.
The third and most likely possibility is for the communication code. With all space systems, you need to send commands to the flight software from the ground software, and receive telemetry from the flight software and process it with the ground software. Each command/telemetry packet is a heterogeneous data structure, and is is necessary that both sides are working from the exact same packet definition, and format the packet so it is correctly formatted on the one side, and parsed on the other side. This involves getting a whole lot of things right, including data type, size, and endianness (although the latter is usually a global thing; you could have multiple processors onboard with different endianness).
But that’s just the surface. You need lots of repetitive code on both sides to handle things like logging, command/telemetry validation, limit checking, and error handling. And then you can do more sophisticated things. Say you have a command to set a hardware register value, and that value is sent back in telemetry in a particular packet. You could generate ground software that monitors that telemetry point to ensure that when this register value is set, eventually the telemetry changes to reflect the change. And of course, some telemetry points are more important than others (e.g. the main bus current) and are designated to come down in multiple packets, which involves extra copying on the flight side and data de-duplication on the ground side.
With all that, it’s much easier (in my opinion) to write one collection of static text files (in XML, CSV, or some DSL/what-have-you), run them through a Perl/Python script, and presto! Code!
I do not work at JPL, so I cannot provide any detail that is not in the video, with one exception. I’ve heard that the autogenerated C code is written by Python scripts, and the amount of autocoding in a project varies greatly depending on who the FSW lead is.
13