Well, he's being realistic...
And plot is coming into action in the next chapter, because logically it's a dead end for the future King of Pirates.
Even whole SH crew wouldn't have made any significant impact from this point forth..
But the statement, "We have to beat big mom and her crew..." is there... I hope they don't end up defeating BM against all sorts of odds.