E. Cobham Brewer 1810–1897. Dictionary of Phrase and Fable. 1898.
Fancy Man (A).
A cavalier servant or cicisbeo; one selected by a married lady to escort her to theatres, etc., to ride about with her, and to amuse her. The man she “fancies” or likes.
