Traveling on horseback:
— A file of men ahorseback passed by.

synonym: ahorse.

On the back of a horse:
— Policeman patrolled the streets ahorseback.

synonyms: ahorse, horseback.