Note: thanks to my guildie Pharous for posting a similar post on the guild forums and inspiring me to write my own.
Now, this is not a chronological list, it just lists some options you can use to gear up, and how they rank compared to eachother. I'm assuming you have no arena rating or points.
The most basic gear here is the Eviscerator's Battlegear set. This is an eight-piece set with no sockets and a total of 350 resilience. However it's got a fair amount of stamina and it's not that expensive to get either. So buy the mats, find a leatherworker, give mats and tip, collect gear.
You can also supplement this set with some crafted jewelcrafting stuff (Emerald Choker, Scarlet Signet and Savage Titanium Ring or Titanium Impact Choker and Titanium Impact Band if you have more money to spend) and a crafted cape, the Frostguard Drape.
Regarding weapons, you can get a Titansteel Shanker crafted by a friendly blacksmith.
You can trade Emblems of Heroism, Valor etc. for PvP gear. Emblems of Heroism give Savage Gladiator gear, which is a step up from the crafted set. I would recommend buying a Rolfsen's Ripper first, though.
Emblems of Valor get you Hateful Gladiator's Gear, which you can also buy for Honor. They are all the same iLvL as most of the Titan-forged gear from the Wintergrasp vendors.
Other than the Hateful set, you can also buy the Deadly non-set pieces for honor (that is, bracers, belt, boots, necklace and ring). The bracers and boots are better than the ones you can get through Wintergrasp, the belt is roughly the same.
You can also buy the Battlemaster's trinkets here (I chose Battlemaster's Conviction myself, but in retrospect I might've gone for the +crit one), and the Medallion of the Alliance/Horde, which you will definitly want unless you're Human.
Lots of PvP loot to be had here. The titan-forged helm and boots are on par with Hateful Gladiator gear, the belt and chest are on par with Deadly Gladiator gear. All of them are bought with Wintergrasp marks.
There is also an alternative to the medallion available, keeping the traditional trinket effect and replacing the resilience of the Medallion with another useful stat (crit/AP/haste/hit), a PvP version of the Mirror of Truth, and another trinket with passive resilience and an on-use AP or haste increase.
You can also buy some gems and enchants with Stone Keeper Shards. And a mammoth.
And last but not least, you can raid the Vault of Archavon for a chance at both PvE and PvP loot.
How to gear up
My guildie suggested this:
(a) If you don't raid or you don't have any excess Emblems, get the crafted gear and go farm battlegrounds.
(b) If you do have Emblems to spend, do so. Just don't buy the chest.
Grind honor and buy Hateful Glad pieces with them (but not the chest) until you have the 4 set bonus. Get the Belt and Boots from Wintergrasp Marks.
Get the chest from Wintergrasp.
Get the bracers, two rings (Hateful and Deadly), necklace, cloak, and the Medallion for honor. Buy the cheapest things first.