E. Cobham Brewer 18101897. Dictionary of Phrase and Fable. 1898.
In a straightforward manner. Conjurers place their hands under the table when they are preparing their tricks, but above when they show them. Let all be above-board means let there be no under-hand work, but let us see everything.