When Island House was completed in 1906, it stood on a small islet called Yuen Chau Tsai, near the head of Tolo Harbour, which was connected to the mainland by a causeway. The two-storey building with open verandahs is a classic example of colonial architecture in the early 20th century. The building was erected as quarters for District Officer and then used as the official residence of Secretary for District Administration until 1985. It was long associated with the former New Territories administration. The building is now used by the World Wide Fund for Nature Hong Kong as a Conservation Studies Centre.
Island House was declared a monument in 1983.