Well to be absolutely fair it is not just Musk and it is not just AI.
The concern now is military robotics. Think Terminator or Robocop, no longer a distant reality.
Musk and 116 signatories from across 26 countries including Stephen Hawking and Alphabet’s Mustafa Suleyman are calling for the ban on autonomous weapons.
It's hard to argue with this appeal though tellingly it got short shrift by the UK Government several years ago.
It just goes to show that no matter how exciting AI is, and it truly is, it will continue to throw up moral dilemmas which require public debate.
The founders wrote: “Once developed, lethal autonomous weapons will permit armed conflict to be fought at a scale greater than ever, and at timescales faster than humans can comprehend. These can be weapons of terror, weapons that despots and terrorists use against innocent populations, and weapons hacked to behave in undesirable ways.