Abdur Rahman bin Sa’d (may Allah have mercy on him) says that once I was with Sayyiduna Ibn Umar (may Allah be pleased with them both), and he used to offer voluntary prayers on his mount, regardless of which direction it was facing. I once asked him about this, so he said that I have seen the Prophet (peace and blessings of Allah be upon him) doing it in this manner.