The problem is that some clients begin to doubt the quality of work you deliver when the budget is too low. The clients here are just dynamic so you can't please them all
Maybe you should look at your gig image, and your gig description. Place yourself in the buyer's shoes and know if the gig image and description would attract you.
I think as a freelancer you should charge what your time is worth........ If you're comfortable doing a work for a client at a price then just go ahead but make sure you're comfortable with the price. It's very important