AI

CIMON SAYS… flies, feels, sees, hears, sings in space

Share this post:

You may remember that I wrote about the CIMON, Watson AI-powered assistant that could help the astronauts in the International Space Station (ISS), to perform experiments and to socialize a little, too.

Now that was CIMON-1.  CIMON-1 has retired and like any other astronaut, CIMON-1 will now spend his retirement, performing at events and in exhibitions, encouraging young people to study STEM and showing off his capabilities.

CIMON-2 was launched to ISS in December 2019, but what is CIMON really?

CIMON is a 3D-printed ball-shaped device with an AI inside, powered by IBM Watson.  The task for CIMON is to support astronauts during long travels and stays in space.  Not only with factual knowledge and instructions but also as a socializing, understanding, nice companion and entertainer.

CIMON-2 has successfully recently been tested by the Italian astronaut Luca Parmitano and demonstrated many of his capabilities:

  • Indoor precision navigation using his new eyes – a stereo camera
  • Autonomous flying, nodding, shaking his head with 12 internal rotors,
  • Ultrasonic sensors to prevent collision
  • Voice recognition and NLP for dialogues and understanding spoken commands
  • 8 microphones for detecting the location of sound sources
  • A ‘mouth’ in the form of loudspeaker for talking and playing music
  • Access to a large knowledge base of the space, the experiment protocols, the mission, and the space station

CIMON is powered by Watson technologies including Watson Visual RecognitionWatson Speech to TextWatson Text to SpeechWatson Assistant and Watson Tone Analyzer.

The tone analyzer enables Watson to understand the astronauts’ feelings and have an empathic dialogue.  Is she/he stressed, in a bad mood, angry?  Should CIMON say some calming words or perhaps music from someone’s favorite playlist?

DID YOU READ: THINK 2020 becomes a Digital Event Experience

The future of CIMON in space – Next stop: Mars?

CIMON will set a new record for an earthly intelligence staying in space. The plan is that he shall work in the ISS for 3 years (the longest human mission is 438 days).  It is evident that one of the future potential uses of CIMON may be to accompany long space expeditions – like Mars.

But I can also easily imagine that many of the capabilities developed for ISS could be deployed on Earth for a variety of use-cases ‘at the edge’:

  • Autonomous welfare bots in hospitals, elderly care homes, etc.?
  • Assistance to maintenance and repairs workers in dangerous, remote or perhaps subsea locations?
  • Driver assistant in semi- or fully autonomous vehicles
  • Assistant to knowledge workers
  • Compliance advisor on the manufacturing floor in regulated industries
  • Coach- / trainer / instructor in sports, education etc.

The form factor would, of course, have to be adapted and modified, and many times you may find ‘CIMON’ embedded into other types of devices or perhaps just as the intelligence in applications.

The possibilities are endless –  our fantasy is the only limit.  if you had a CIMON – what would you use him for?

Fact: CIMON stands for “Crew Interactive MObile companioN). CIMON is developed and tested by  DLR (Deutsches Zentrum für Luft- und Raumfahrt / German Aerospace Center ), Airbus, IBM and the scientific partners LMU (Ludwig-Maximilians-University-Munich).

Fun Fact: CIMON’s name is, in part, a reference to ‘Professor Simon Wright’, the robotic assistant – or ‘flying brain’ – in the Japanese science fiction series ‘Captain Future‘ from the 1940s.

If you have any further questions, please do not hesitate to contact me at andersq@dk.ibm.com

Research & Innovation Executive, IBM Research - IBM Watson

More AI stories

Private cloud or public cloud? New server technology offers more choice

In September, we launched the new IBM Power E1080 high-end server, for corporate use based on the  new Power10 architecture, the Power E1080. The server can – among many other things – handle a large number of applications and workloads securely, at scale and with highest availability. Going into the spring of 2022, we will […]

Continue reading

10 Questions regarding SDG to the company’s management and board

We have all together manged to create the most serious sustainability deficit and our greatest challenge is the ecological debt – a dept which we are running up by overusing and depleting our natural resources and thereby threatening our ability to meet the needs of future generations.  Worldwide, the strains on key resources, from fresh […]

Continue reading

New server platform with plenty of power under the hood – and future-proof security

The shutdown of companies and nations during the pandemic has opened many people’s eyes to how vulnerable a modern organization can be. Not only when fundamental assumptions change, but also when habits change in the wake of a crisis. There is little doubt, for example, that working from home and a widespread use of online […]

Continue reading