The Collaborative International Dictionary of English v.0.48:

Vexingly \Vex"ing*ly\, adv.
   In a vexing manner; so as to vex, tease, or irritate.
   --Tatler.
   [1913 Webster]