[ Sasa Stevic @ 21.02.2005. 22:52 ] @
Na koji nacin se sajt moze skinuti sa GOOGLE pretrazivaca? Naime, neke su stranice zbog ogranicenog bandwith-a blokirane, tako da nisu u funkciji, a google ih jos prikazuje prilikom pretrage. Molim vas za direktan link i da mi neko malo pojasni postupak, ako zna naravno! Hvala!
[ Nikola Denić @ 22.02.2005. 00:12 ] @
User-agent: *
Disallow: /admin/

User-agent: Mediapartners-Google*
Disallow:
User-agent: DittoSpyder
Disallow: /

User-agent: psbot
Disallow: /

User-agent: MSIECrawler
Disallow: /

User-agent: Teleport
Disallow: /

User-agent: TeleportPro
Disallow: /

User-agent: WebZip/4.0
Disallow: /

User-agent: WebStripper
Disallow: /

User-agent: WebSauger
Disallow: /

User-agent: WebCopier
Disallow: /

User-agent: NetAnts
Disallow: /

User-agent: Mister PiX
Disallow: /

User-agent: WebAuto
Disallow: /

User-agent: TheNomad
Disallow: /

User-agent: WebZip
Disallow: /

User-agent: NetMechanic
Disallow: /

User-agent: URL_Spider_Pro
Disallow: /

User-agent: CherryPicker
Disallow: /

User-agent: EmailCollector
Disallow: /

User-agent: EmailSiphon
Disallow: /

User-agent: WebBandit
Disallow: /

User-agent: EmailWolf
Disallow: /

User-agent: ExtractorPro

Disallow: /

User-agent: SiteSnagger
Disallow: /

User-agent: ProWebWalker
Disallow: /


i tako dalje ..zavisi sta hoces da zabranis .. nadam se da ti jasan primer