Essentially, every artificial sweetener has been associated with some health risks. Aspertame, however, has been blamed for numerous side effects involving the brain and nervous system and is avoided by people who have experienced severe reactions to it.