Hello,
normally there should be no duplicate links in sitemap, if you can post your website URL, please do (so that I can check it).
Yes, you can manually remove one of the links from sitemap, make sure that you don't add other text/remove other lines.