E. Cobham Brewer 1810–1897. Dictionary of Phrase and Fable. 1898.
Fiddlesticks!
An exclamation signifying what you say is not worth attention. To fiddle about is to waste time, fiddling. A fiddlestick is the instrument used in fiddling, hence the fiddlestick is even less than the fiddle.
