Why we need a statistical hypothesis testing for correlations between variables when we can check using scatter plots?

Need Guidance on correlation test.

When we need to perform correlation between 2 variables, we generally start with scatter plot. Sometime it is suggested to perform hypothesis testing as well.

I'm Looking for some documentation guide which can help in deciding whether to check for scatter plot OR hypothesis testing.