the short end of the stick

IPA/ðə ʃˈɔːt ˈɛnd ɒvðə stˈɪk/
IPA/ðə ʃˈɔːɹt ˈɛnd ʌvðə stˈɪk/

the short end of the stick — 慣用語