You could replace the short nut with a threaded coupling, and simply bolt it to the top of the coupling, if you don't have any interference issues.
A coupling just looks like a nut, but it's 1-2" long, it's meant to join sections of threaded rod together. Many decent hardware stores have them.