WARNING: This page is about a different car, the 2006 Nissan Titan. However, it is still accessible from the selected car via links, so may be relevant.
Check contact surfaces of shift rod and bearing for wear and damage. If any is found, replace with new one.
Fig 1: Checking Contact Surfaces Of Shift Rod And Bearing For Wear And Damage