Google map API Key restrictions does not recognize website IP

I created a wordpress website and I use google map API. I would like to add restrictions to prevent troubles. So I get the IP of the website from my hosting services and I also ping it to double check. I added it on the list of authorized IP but I still have an error message (Google Maps JavaScript API error: RefererNotAllowedMapError) and it is impossible to display a card.

I can't understand what am I missing there. To be precise, it was working fine when I was on local, i was just adding my IP address in the white list.

Also, the website works great if I use no restriction.

Any Ideas? Thank you for your help