As far as power is concerned, for me it is a matter of size and weight vs. power. Yes, the .410 buckshot loads will make lots of holes in a target, but each of those projectiles is about as powerful as a .32 S&W (short) round, maybe less. So you have multiple hits going for you, but those hits might not penetrate well enough if the attacker is large or heavily clothed. Also, as range increases, the pattern gets bigger and you start missing with some of the buckshot and hitting around the edges with others.
The .45 Colt rounds are certainly nothing to sneeze at, but most of the factory loads commonly available are low velocity rounds and probably less effective than a good .357 round that can be used in a much smaller and handier (and probably more accurate) package. For all practical purposes the .45 ACP and .45 Long Colt are identical in power, except the Long Colt cartridge can be had in more powerful loads in certain guns such as Ruger and Freedom Arms revolvers designed for hunting. In those specialized guns it can be even more powerful than a .44 Magnum. However, the Judge is not rated for such loads as far as I can determine the issue is moot with it.
You would certainly not be helpless if armed with one, but it is a big, clunky revolver that would be uncomfortable to carry and difficult to conceal compared to a "true" CCW weapon and is bigger and heavier than a .44 Magnum with only about half or less of the power.
If you like it and carry it, I won't argue, but as far as I am concerned the disadvantages are many and advantages nil.