Permissive use by the actual owner always disrupts adverse possession. However, what constitutes "permissive" varies by jurisdiction (in some, conduct can suffice; in others, a writing is required). To cover all your bases--go with a writing acknowledging the adverse possessers occupancy and that you, as true owner, grant them permission to continue.