If I remember correctly from history class, some musket rounds had a diameter over .6 inches. That's not low caliber in any way.
The typical musket round was .7, but it was flying relatively slowly.
Velocity is a factor in stopping power, too, not just caliber!