I think the word you are looking for is abstain, as in... I choose to abstain from voting.
http://dictionary.reference.com/browse/abstain?s=t
Michael -- Good answer.