Everybody would love to visit both Kinkaku-ji and Ginkaku-ji. But there are also people who only choose to visit one as they seem almost the same. Yes, they are. Yet still have the difference definitely!
Apparently, Kinkaku-ji is more attractive compare to Ginkaku-ji. But I feel Ginkaku-ji environment, the surrounding, is more neat and cozy.
Perhaps you may just skip visit the Ryoan-ji and visit both Kinkaku-ji and Ginkaku-ji!