James Audley, 2nd Baron Audley (8 January 1312/13 – 1 April 1386) of Heighley Castle, Staffordshire, was an English peer.
He was the son and heir of Nicholas Audley, 1st Baron Audley (1289–1316) by his wife Joan FitzMartin (died Feb.
1320 / 1 Aug.
1322), who was the daughter of William FitzMartin (died 1324), feudal baron of Barnstaple (in Devon), and Marcher Lord of Kemes (in what later became Pembrokeshire).
She was posthumously the eventual sole heiress of her brother William FitzMartin (died 1326) to Barnstaple and Kemes.