Saying no as a protection to your own safety (physical, spiritual, emotional, mental) is always better than saying yes for the illusion that your yes will benefit others. 

When you are not safe, you cannot help others.