Jump to content

Configurare Robots.txt

Recommended Posts

Motoarele de cautare inspecteaza radacina domeniului cautand fisierul robots.txt (www.site.ro/robots.txt).

  • User-agent este numele robotului.
    User-agent: googlebot

  • Pentru specificarea tuturor robotiilor folositi caracterul *.
    User-agent: *

  • Disallow exclude de la cautare anumite fisiere sau directoare. Daca vrem sa excludem la cautare fisierul text.html introducem in robots.txt urmatoarea linie:

    Disallow: test.html

    Pentru excluderea unui director la cautare, de exemplu directorul probe aflat in radacina domeniului, introducem in robots.txt urmatoarea linie:

    Disallow: /probe/

Cateva exemple aveti mai jos:

Exemplul 1: permitem accesul oricarui robot si nici un fisier nu va fi exclus la cautare:

User-agent: *
Disallow: [/code] [u][b]Exemplul 2: acces interzis tuturor robotilor:[/b][/u]
[code]User-agent: *
Disallow: /
Exemplul 3: acces interzis unui anume robot:
User-agent: googlebot
Disallow: / [/code] [u][b]Exemplul 4: pentru un anume robot este exclus de la cautare fisierul test.html :[/b][/u]
[code]User-agent: googlebot
Disallow: test.html

Te-ai inregistrat? Ne-ar placea sa te prezinti.

Cum pot sustine forumul?
Cumpara de la eMag folosind acest link.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Recently Browsing   0 members

    No registered users viewing this page.

  • Create New...

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.