Tozenji Temple was used as a diplomatic residence by the first British diplomatic envoy to Japan, Sir John Rutherford Alcock, and his successor, Sir Harry Smith Parkes. Although it was attacked by the Joi sect several times, the inner study and the entrance remain as they were at that time.