No, you currently cannot. A workaround would be to navigate to Calendars, check out your schedule and return to the contact to add a meeting at a convenient date.