Many, many years ago I had a cat with late stage chronic kidney disease, and in addition to medication from the vet, I used slippery elm powder to help with stomach acid and nausea.
This page gives additional info and has been updated since I last needed it, which will likely be better than my memory , it has a lot of good detail. If this is an ongoing issue, you may also want to have a conversation with your vet.