bloggero
06-21-2008, 11:10 PM
Am cautat pe net un robots.txt cit mai complet pentru un pic de seo si eliminare de duplicate coontent pentru wordpress, am gasit mami multe dar m-am decis doar la acesta
User-agent: *
Disallow: /cgi-bin/
Disallow: /trackback/
Disallow: /wp-admin/
Disallow: /wp-content/
Disallow: /wp-content/themes/
Disallow: /wp-includes/
Disallow: /wp-login.php
Disallow: /wp-
Disallow: /comments/
Disallow: /comments/feed/
Disallow: /feed/
Disallow: /rss/
Disallow: /*/feed/
Disallow: /*/trackback/
Disallow: /author
Disallow: /*?*
Disallow: /2006/
Disallow: /2007/
Disallow: /2008/
Disallow: /2009/
Disallow: /date/
Disallow: /attachment/
# disallow all files ending with these extensions
Disallow: /*.php$
Disallow: /*.js$
Disallow: /*.inc$
Disallow: /*.css$
Sitemap: httx:// w w w. my sit e .c om/sitemap.xml
nu am scos tags si categoriile din indexare pentru ca nu cred ca imi dauneaza sau cel putin nu imi dauneaza pentru blogul in cauza.
Voi folositi un astfel de robots.txt ? si daca da care ?
Obs. daca o sa il folositi pe acesta nu uitati si schimbati linkul de la sitemap
User-agent: *
Disallow: /cgi-bin/
Disallow: /trackback/
Disallow: /wp-admin/
Disallow: /wp-content/
Disallow: /wp-content/themes/
Disallow: /wp-includes/
Disallow: /wp-login.php
Disallow: /wp-
Disallow: /comments/
Disallow: /comments/feed/
Disallow: /feed/
Disallow: /rss/
Disallow: /*/feed/
Disallow: /*/trackback/
Disallow: /author
Disallow: /*?*
Disallow: /2006/
Disallow: /2007/
Disallow: /2008/
Disallow: /2009/
Disallow: /date/
Disallow: /attachment/
# disallow all files ending with these extensions
Disallow: /*.php$
Disallow: /*.js$
Disallow: /*.inc$
Disallow: /*.css$
Sitemap: httx:// w w w. my sit e .c om/sitemap.xml
nu am scos tags si categoriile din indexare pentru ca nu cred ca imi dauneaza sau cel putin nu imi dauneaza pentru blogul in cauza.
Voi folositi un astfel de robots.txt ? si daca da care ?
Obs. daca o sa il folositi pe acesta nu uitati si schimbati linkul de la sitemap