You would only need to take a small piece, no larger than your closed fist. That shouldn't harm the integrity of the rest of the stone.

[Then he considers Golbez's size -- he's so much larger than most humans! -- and adds as an afterthought:] ...Half your fist should be enough.