The one thing every One Piece fan needs is patience. I mean, a very huge deal of patience.
Do try again, mate. I know its anime version hasn't much given some consistent impacts as its manga does, but there's always special moments where only in anime can be done. If you compare these two (if you read the manga, that is.) you'll find that Toei also shows several worthy scenes even surpass the manga. A few. Try again.
But if you still can't then, drop it. Seriously. Or else you can't even reach Punk Hazard since you mind too much about the slow pace and ridiculousness.
All the great flashbacks, slow pace (whatever), ridiculous moments, weird behaviours and various things that not available in other 'wiser'/'perfect' series are One Piece traits ever since the beginning. You should've been able to accept them all if you have reached that far; Fishman Island.