Relying only on secret realms for training is the only way to shorten the time needed for cultivation, and I believe that is what Grandfather means as well.
"Grandfather, when will the Ten Desolations Ancient Realm open?"
"In three days."
Chapter 293