Everything matters.Things that don't really matter will drive you nuts.
The problem is figuring out if a thing matters enough to care about.
Most people will never know the difference between the OP's bore and any other.
Benchrest shooters who are trying to shave 0.01" off a 100-yard group would use that barrel for a tomato stake.
It all depends on your perspective.