If Su Yang only let the people rescued from the forest leave, they might still think Su Yang intended to catch them with a long line and ultimately wanted to deceive everyone to admire him.
But now, Su Yang even let the people around him go. It shows that Su Yang is not acting; he genuinely does not intend for everyone to take risks with him.
In this situation, does Su Yang's character even need to be stated?
Even if everyone was initially wary of Su Yang, now, that wariness is gone. Moreover, Su Yang saved their lives, leaving them with nothing but admiration for him!
In fact, Su Yang indeed did not plan to have this group of people continue to follow him.
The people in the house ahead still retain their power. It's possible everything happening in this valley is caused by them.