1b.app
Link copied -

Give Googlebot access to robots.txt

You need to change the robots.txt file to fix the problem!
Update your robots.txt file to allow Googlebot and Googlebot-Image user agents to crawl your site.
tell me how to do it?
Original question is available on version: ua

Answers:

Сусяк Ігор
Integrator.com.ua
Personal license
Atools good evening,
if the box is on your site, then you can create or change files using a similar logic: https://1b.app/ua/forum/integrations-with-online-stores/8975-zakrit-ot-indeksats... ostavit-dlya-indeksatsii-internet-magazin/
if it's a rental - only box admins have access to the site - describe in more detail what exactly should go into robots.txt, preferably with examples and maybe they'll set it up for you.
05.01.2023, 23:33
Original comment available on version: ua

We have a lease, you need to give access to Google bots to scan the media folder with product photos for Google Merchant Center
06.01.2023, 09:31
Original comment available on version: ua


Atools wrote:
We have a lease, you need to give access to Google bots to scan the media folder with product photos for Google Merchant Center

since you are on rent
then we will arrange it for you.
Tell me what exactly Google is asking you for? allow photo from folder media/shop/ ?
06.01.2023, 09:50
Original comment available on version: ua


Ustimenko Igor
OneBox production wrote:

Atools wrote:
We have a lease, you need to give access to Google bots to scan the media folder with product photos for Google Merchant Center

since you are on rent
then we will arrange it for you.
Tell me what exactly Google is asking you for? allow photo from folder media/shop/ ?

as written in the help https://support.google.com/merchants/answer/6098154?hl=uk
Make changes to the robots.txt file on your web server to allow Google's web crawler access to the images you submit. The robots.txt file is usually located in the root directory of the web server (for example, http://www.example.com/robots.txt). To give us access to the entire site, in the file allow the Googlebot-image user agent to crawl images and the Googlebot user agent to crawl web pages. To do this, modify your robots.txt file as follows:
User-agent: Googlebot
Disallow:
User-agent: Googlebot-image
Disallow:
to the photo folder
06.01.2023, 10:08
Original comment available on version: ua

run check
changed robots
09.01.2023, 10:18
Original comment available on version: ru

Please join the conversation. If you have something to say - please write a comment. You will need a mobile phone and an SMS code for identification to enter. Log in and comment