If you mean no, say no; that is enough. If you want to offer a reason, do. But be aware that some people will take a reason as a challenge to overcome that reason. Don’t make a wishy-washy response that may be misinterpreted. Say no if you mean no.