Leave furtively and stealthily.

synonyms: slip away, sneak away, sneak off, steal away.