I think you'll be fine as far as cylinder walls and internals go, I wouldn't loose any sleep over it.
Pre-
oil pressurize is an absolute MUST do for the sake of the lower end as well as just a good idea all around for any new engine. Bummer you have to re-do the cam/lifters, but it's worth the effort.