The Collaborative International Dictionary of English v.0.48:

Pastorium \Pas*to"ri*um\, n. [See Pastor; cf. Auditorium.]
   A parsonage; -- so called in some Baptist churches. [Southern
   U. S.]
   [Webster 1913 Suppl.]