data integration: 10 Things I Wish I'd Known Earlier
https://raindrop.io/vormastmtz/bookmarks-43553781
This enables Goggle (user-agent identify GoogleBot) to go to each individual site and directory, when simultaneously banning Question Jeeves from the website fully