Note: thanks to my guildie Pharous for posting a similar post on the guild forums and inspiring me to write my own.
Now, this is not a chronological list, it just lists some options you can use to gear up, and how they rank compared to eachother. I'm assuming you have no arena rating or points.
Crafted Gear The most basic gear here is the Eviscerator's Battlegear set. This is an eight-piece set with no sockets and a total of 350 resilience. However it's got a fair amount of stamina and it's not that expensive to get either. So buy the mats, find a leatherworker, give mats and tip, collect gear.
Emblems You can trade Emblems of Heroism, Valor etc. for PvP gear. Emblems of Heroism give Savage Gladiator gear, which is a step up from the crafted set. I would recommend buying a Rolfsen's Ripper first, though. Emblems of Valor get you Hateful Gladiator's Gear, which you can also buy for Honor. They are all the same iLvL as most of the Titan-forged gear from the Wintergrasp vendors.
Honor Other than the Hateful set, you can also buy the Deadly non-set pieces for honor (that is, bracers, belt, boots, necklace and ring). The bracers and boots are better than the ones you can get through Wintergrasp, the belt is roughly the same.
You can also buy the Battlemaster's trinkets here (I chose Battlemaster's Conviction myself, but in retrospect I might've gone for the +crit one), and the Medallion of the Alliance/Horde, which you will definitly want unless you're Human.
Wintergrasp Lots of PvP loot to be had here. The titan-forged helm and boots are on par with Hateful Gladiator gear, the belt and chest are on par with Deadly Gladiator gear. All of them are bought with Wintergrasp marks.
There is also an alternative to the medallion available, keeping the traditional trinket effect and replacing the resilience of the Medallion with another useful stat (crit/AP/haste/hit), a PvP version of the Mirror of Truth, and another trinket with passive resilience and an on-use AP or haste increase.
You can also buy some gems and enchants with Stone Keeper Shards. And a mammoth.
And last but not least, you can raid the Vault of Archavon for a chance at both PvE and PvP loot.
How to gear up My guildie suggested this:
[STEP ONE] (a) If you don't raid or you don't have any excess Emblems, get the crafted gear and go farm battlegrounds. (b) If you do have Emblems to spend, do so. Just don't buy the chest.
[STEP TWO] Grind honor and buy Hateful Glad pieces with them (but not the chest) until you have the 4 set bonus. Get the Belt and Boots from Wintergrasp Marks.
[STEP THREE] Get the chest from Wintergrasp.
[STEP FOUR] Get the bracers, two rings (Hateful and Deadly), necklace, cloak, and the Medallion for honor. Buy the cheapest things first.