People get little erratic twitches too - like an eyelid, or the jerk as you're falling asleep. If it is infrequent and no harm seems to come to the cat, I'd put that on a list for an eventual vet appointment, but probably not an emergency.
If you were to see increases in frequency, duration, area, and/or severity, then I'd go to the vet because of that.