In 1536, after the dissolution of the priory, the lands in Lambourne formerly belonging to it were granted to Robert, Earl of Sussex (d. 1542). In 1554 Henry, Earl of Sussex (d. 1557), sold Pryors to Robert Taverner. The manor subsequently descended with Arneways until 1681. In that year Arneways was sold by John Broomfield to John Todd, but Pryors remained in the possession of Broomfield, who left it by his will (1687) to his sister Elizabeth, wife of Nicholas Staphurst, M.D. Nicholas Staphurst, son of Elizabeth, sold the estate in 1713 to Dr. Thomas Tooke, Rector of Lambourne. A sketch map of Pryors and the glebe land made in 1714 is a little difficult to follow but appears to show that Pryors proper consisted of 35 acres and that an additional 11 acres belonging to the glebe were farmed as part of Pryors. Tooke died in 1721, leaving Pryors to his wife for life with remainder to his brother John Tooke (d. 1764) who also succeeded him as rector. John Tooke was succeeded as rector and owner of Pryors by his son Robert Tooke (d. 1776). Robert left Pryors to his sister Mrs. Calvert, who held it until her death about 1794. (fn. 174) She was succeeded by her daughter Mary, wife of John Martin, who sold the farm about 1798 to Charles Smith of Suttons in Stapleford Tawney (q.v.). Pryors was thus merged in the Suttons estate. In 1841 Pryors and Patch Park together contained 136 acres.
A small timber-framed and weather-boarded house, now known as Patch Park Cottage, is thought to represent the former manor house of Priors. Until recently it was divided into two tenements. Externally it appears to be of the 18th or early 19th century, but two ground floor rooms have stop-chamfered beams, probably of the 17th century and it is possible that at one time the building was of greater extent.