You don’t have to apologise if the answer is no! Be upfront & honest when you say it. Do it for self-care. Many can’t say no because they don’t want to appear rude or ill-mannered; & they’re concerned about the opinion of others. This is harmful behaviour. You’ve got to stop it!