If you don't feel well, particularly if you have a fever and worsening symptoms, Dr. Glazier says, skip the get-together.