Firstly, both are physical classes so if you want to have any chance in pvp I suggest you don't bother with any energy attacks
Here are better builds for pvp, everyone changes a few skills but these will point you in the right direction.
Swordsman PVP
Swordsman = Spam knockdown (generate 2 rp balls with Energy Recovery skill 4/6, multiple sword slashes with knockdown effect), this basic combo along with swordsman's high hitrate and crit rate.
Fighter PVP
The needles deal the crit damage and thunder with speed gear for opponents with anti crit gear.
Kill quickly and hope your high dodge rate saves you if you don't.
Again these aren't for everyone, everyone has personal preferences but if your doing pvp, you should use something similar.