This poem is mentioned by Bashô in his Saga Diary. Saigyô also lived in the Saga area for a while, though I don't know if he lived there when he wrote this.
Japanese:
とふ人も
思ひ絶えたる
山里の
さびしさなくば
住み憂からまし
Romanization:
Tou hito mo
omoi taetaru
yamazato no
sabishisa nakuba
sumi ukaramashi
!