Sitemap Help - Remove /tag/ from URLS

I have a website that uses both categories and tags to organise posts.

I have removed the /tag/ in the URL so that it reads: example.com/tag-1-details/

However in my sitemap (Yoast) it says:

example.com/tag/tag-1-details/

Can anyone help and advise how I can remove the ‘tag’ from the urls in Yoast Sitemap.

Thanks

-- Another option would be to use another plugin, advice appreciated.