As a suggestion you could use a slippery plastic like a PE or Delrin. If you drill the 1/2" hole in a small (1/2" thick, 3" square?) piece of the plastic at can act as the bearing. Then the plastic screws to the aluminium plate, which also allows some alignment there.