EWestbrook,
It occurs to me the fliers might be the effect of secondary pressure spikes? They can happen if a powder is on the slow side for the bullet weight. Going to faster powder or a heavier bullet always stops it. I would try something like either IMR or H4198. QuickLOAD thinks about 22 grains will match barrel time and pressure pretty well in the middle of what you've been loading, but work up to it. If you can't stand the idea of the 60 or 70 fps you will lose with a 4198, then Reloader 10X is a good compromise. At about 23.4 grains it should, again, be in the ballpark of your other loads, but can actually beat the H335 for velocity while lowering muzzle pressure somewhere inbetween the two. It is nearer an efficiency optimum, speed-wise.
If you want to keep trying with the 335, I would knock the load down 5% and try a magnum primer (if you haven't already) as a next step. Work back up to the accuracy sweet spot. That might get it going more consistently?