If you don't use a Chronograph you are most likely handloading substandard ammo. The holy grail for Handloading is accuracy with the best optimal velocity at a cheaper price then factory ammo. Without a chronograph you are only guessing at the velocity, and you can not go by loading manual velocity numbers, as every rifle is a law unto itself. Chronos are cheap, anyone who handloads needs to have one, if for no other reason then to make sure there loads are within reason of public load data. I also use it to see if there is any difference in a new batch of powder/different lot numbers, you would be surprised how much difference there can be between different lot numbers, today it is better then it was 10 years ago for lot to lot consistency.
I would agree with you pretty strongly, if the standard of accuracy was bench-rest competition, or long-range varmint hunting. However, you make three assertions that I find false, or at least highly subjective:
1) Not having a chronograph results in substandard ammo. I disagree, wholeheartedly. If a guy is shooting sub-MOA groups at 300 yards with his 300 WM and 180gr handloads, the fact that he has no idea exactly how fast they're going is immaterial...to him OR the elk!
2) "best optimal velocity" is part of an ideal handload. I don't think this is true for most hunters, varminters or competition shooters, although some folks simply aren't happy with a load unless it is going as fast as possible. For most, the ideal is one-hole accuracy, at any reasonable velocity. Keep in mind that you cannot attain this kind of accuracy, at hunting ranges, with squib loads and that the kind of guns we're talking about will kill big game very well with velocities far lower than most people realize. (Consider the difference between a 7 WBY MAG and a 7-30 Waters...yet both kill big game consistently.)
3) Chronographs can help you determine if your "loads are within reason of ...load data". I feel this is a dangerous misconception. You stated yourself, each gun is a law unto itself. There are far too many variables, as you alluded to, in components, chambers, throats, rifling, barrel length, etc, etc, to draw ANY conclusions on load safety, simply by looking at the velocity your gun is getting. I have a 44 carbine that gets ~1400fps out of loads that are published by Winchester as 1100fps. This is because the bullets are .427" instead of .429" and they're coming out of a 20" barrel, instead of one that is 5" long. Should I conclude these loads are not safe, because my velocity is 300fps too high?
The guy who uses factory or load book handloads, and practices at the ranges he is most likely to encounter game at, has no real need to know his exact velocity. He just needs to be confident that he can place the bullet well, at those ranges. If the gun and shooter are accurate, the bullet will do its job.