I've thought of the same so I'm interested if others chime in. What fills my handgun hunting fantasies at the moment however, is a M&P 45 converted to .460 Rowland.
I havent hunted with it but I picked up a S&W 1006 for this role, I Love the way it feels in the hand and its a smooth shooter. At first I also was going to build up a Lonewolf Glock but once I found the Smith, I jumped horses and havent looked back. Are you looking at just a barrel change or the whole upper with slide?