The Collaborative International Dictionary of English v.0.48:

Rejoicingly \Re*joi"cing*ly\, adv.
   With joy or exultation.
   [1913 Webster]