Joe

Joe is a drunken fighter who, during the time of Ultima IV, lived in Britain.

Upon providing him with some rum he informs you that Joe (i.e. himself) can help you with the stones and upon further inquiry will tell you that the yellow stone resides in Despise.