Yes, please get your cat to the vet for an exam. It could have constipation, or a possible urinary tract infection. Cats don't usually stay in litter boxes. They do their stuff and cover it and then get out. Good luck, and I hope your kitty gets better soon.