No damage will come to you. Since you have opened a dispute, it is no longer in your hands but in the hands of CS. Also note, when CS cancels the order, your stats will also be affected. I will strongly advise that since you are new to Fiverr, try everything you can to please your buyers, even if it requires unlimited revisions. Your growth depends on it. Cheers!