Tailgut duplication cysts are rare congenital lesions that are thought to arise from vestiges of the embryonic hindgut.