No, I wouldn't recommend you to go outside of Fiverr. Simply report the buyer message in which he is asking to go outside of Fiverr. And, you can send him a nice detailed message that it is not allowed to go outside of Fiverr as according to TOS you can get banned.
Thank you!