Because that is the territory of the God of War of Southern Frontier of Long Country.
If their whereabouts were accidentally exposed, it would likely cause massive trouble.
Therefore, they had to remain extremely low-profile and cautious.
Chapter 156