Robin Longbottom looks at an extraordinary 19th-century house and gardens, whose site now forms part of a park ...