I found this setting in the settings menu of WordPress. " Discourage search engines from indexing this site" under search engine visibility. Is there any scenarios when I would want to have this option enabled?
If you want to make sure your website never shows up on Google, check this option. otherwise leave it unchecked. This setting won't prevent search engines from ever being able to find your website but it will instruct them not to crawl or index any of the content on your site. There are times when you may want it but it's not likely that you would want to put a large amount of effort into your site only to block the biggest source of traffic you can get