Stop custom Gutenberg styles taking over other admin bits?

Is there any classes or way of targeting CSS so custom Gutenberg styles doesn't take over the whole admin?

For example i want p tag to reflect the front of site font-family and a links etc, but then it adds that font to all text in the admin and makes for example the add image text button bold and other changes.

There seems to be endless classes within the editor, i only want custom styles to appear within the content, not the button text for adding a link or image etc.

Is this possible?