According to Occultopedia.com this is the art of divination by studying the actions of the first stranger or strangers you meet. As such it falls into the general category of omens. The name is derived from the Greek xenos (stranger) and manteia (divination).
In general it was the physical actions that were studied, although it was apparently considered bad luck in Ancient Greece to encounter a priest riding a donkey.