Sounds Fine... I wouldn't want to be able to hold one and spin the other... Cause to me,. that means there is play\movement... The spacer is designed to be like that, tight between the bearings, so when We torque down on the axle nut.. it will NOT put a bind in the bearings... so the way you have it sounds perfect to me..
I would still try as
mspeedman said IF you still question your job,.. remove calipers and spin the wheel... You want it to FREE Spin and or SPIN Freely!
Peace