Kenneth G. Wilson (1923). The Columbia Guide to Standard American English. 1993.
head over heels
isnt logical for upside down; heels over head was the original, the more logical, and the more graphic expression. But the cliché is head over heels these days, and its a Standard idiom.