Calls late at night or very early in the morning are often considered inconvenient. If a time is bad for you, say so in writing. You can also ask for all communication in writing. If calls keep coming at bad times, document them and consider legal action.