I didn't mind Jaden during the first season. He got a bit annoying in the second. I only watched an episode or so from the third season and didn't bother with the fourth since it was never dubbed and I'm not so inclined to watch the subbed version.
But the problem with Jaden pre-S4 (or it might be sometime in S3, but definitely S4 from what I've heard from fans) is that he's a complete Bobby Sue. There's nothing wrong with him. He hogs the spotlight and robs the audience of awesome hypothetical duels (such as seeing Pegasus throw down for the first time since Duelist Kingdom not counting POL), wins 98% of the duels he's in (ties 1.5% and loses 0.5%), is always chipper and positive about every situation regardless of how dire it is unlike every normal person, never shows much weakness physically or mentally, and is just overall boring. But most of all, I just hated his spotlight hogging. I really got pumped when Pegasus whipped out a Duel Disk and prepared to face Franz for the return of Ra, but no, Jaden had to jump in and deny me of seeing that. I wanted to see other characters face the villains, but no, Jaden had to – or at least he had to be the one to beat them. It just got frustrating because as plot-protected as Yugi was, they still made it seem like he was going to lose at times. I never got that feeling with Jaden because of his derpy "I'll never give up, I'll find a way to beat your unbeatable monster that nobody else could ever hope to beat" personality, and the fact that he really did win pretty much any duel regardless of what he was up against. All three Sacred Beasts? Not a problem. The Winged Dragon of Ra with protection backing it? Hah. Yugi's deck? "It's just his cards, not really Yugi." Kaibaman? Holy shit, he lost that one. Etc.