Yeah, removing the drywall is a PITA when cabinets are in the mix though. Not the same as a sheet of drywall or two in a bathroom.
Slow and sure with a thin pry bar or heavy bladed spatula sort of thing is the way to do it. Get it as smooth as you can, then skin it with mud.
It stinks to do.