Yes. Part 3's establishing of Stands is what truly changes the way combat works in the series, not to mention the series does have some great cases of character writing on occasion and the handling of character deaths becomes far better later on.
If wanting to see it at its peak, you could read Steel Ball Run, though it's advised to at least finish Part 3 first as the tributes to the franchise as a whole within it aren't as apparent unless you've at least read through the first 3 parts.