E. Cobham Brewer 18101897. Dictionary of Phrase and Fable. 1898.
Drop in (To).
To make a casual call, not invited; to pay an informal visit. The allusion is to fruit and other things falling down suddenly, unexpectedly, or accidentally. It is the intransitive verb, not the transitive, which means to let fall.