If commanding pet to attack will break the owner's invis, I think it would be very reasonable to allow pets to stay.
