There isn't a list of possible downsides (or trade-offs) analysed in the BIP, e.g. bech32 encoding results in more characters in comparison base58 and HEX.
https://github.com/bitcoin/bips.wiki.git
Deleting the wiki page "Comments:BIP 0173" cannot be undone. Continue?