Mate there's no fixed rule.
You just want the gentlest transition possible for the thread to go up (and down) the blank. You just need to get rid of the 'lumpy' bits.
So on those big guides and the size of the blank where they go you probably won't have to take much, if any, off the sides.
The size C thread covers a fair bit as well.