Yes it’s a pain, I seem to remember having to gently tap mine in with a screwdriver and hammer, once they holes are just about in position you can ram a screwdriver where the wishbone bolt should go and wiggle them into position.
Where multiple are required I also smeared a small trace of contact adhesive between the shims just to keep them together long enough…