Without prior preparation:
— He spoke extemporaneously.

synonyms: extemporarily, extempore.

Roget 612: extempore, extemporaneously; offhand, impromptu, a limproviste [Fr.]; improviso^†; on the spur of the moment, on the spur of the occasion.