The following calculations were done using QuickLoad, so they are only highly educated guesses. Your results will not be exactly the same, but they will follow the general patten shown below.
When filling a 300WM with 4831 under a 180gr bullet, one might expect to lose roughly 200fps. This load will give ~3080 from a 26" barrel, down to 2875fps from a barrel that is 20 inches long. (Note that the typical velocity loss of 25fps is exceeded, due to the nature of a magnum cartridge needing a longer barrel to do its job.)
A 30-'06 loaded with a full case of 4350 under the same bullet, shot from a 24" barrel, gives 2825fps. The same load from a 20" barrel clocks in right around 2700fps. I chose these lengths as being realistic, given the cartridge in question. A 24" barrel on an '06 is approximately 50fps slower than a 300WM, with a 20" barrel. Keep in mind you will need 20 more grains of powder and need to deal with tremendous muzzle blast and flash, in doing so.
A magnum rifle with a 20" barrel is like a big-block V8 with a computer shutting off half of the cylinders. Difference is, the engine will provide you with the extra power when you need it, whereas the rifle is permanently handicapped from providing its intended level of performance. My advice is to pass on it unless you really just wanted an '06, anyway.