The Collaborative International Dictionary of English v.0.48:

Paganly \Pa"gan*ly\, adv.
   In a pagan manner. --Dr. H. More.
   [1913 Webster]