Should be fine like that. The main force is shear, although keep in mind that those bolts are also acting as the upper control arm so don't go around corners too fast
I don't remember having any problems when I did mine, but I had the whole thing out of the car. I think I used a cold chisel to break it apart.