Yes, you can't be entirely certain this person was following you. They may have been taking another path and simply happened to be going in the same direction. If you had seen the same person each time without doubt, this may be different...