I turn the promise down because that time I have another promise.

=

I turned the invitation down because I already have an appointment with someone else