[ASK] Robot txt tidak dapat diakses

Discussion in 'General Internet' started by Agustian, Sep 30, 2016.

  1. Agustian

    Agustian Member

    Joined:
    Aug 20, 2015
    Messages:
    167
    Likes Received:
    14
    Trophy Points:
    18
    Den / Jeng / Para mastah di bersosial, mau tanya nih ? baru baru ini ane buat blog pakai wordpress. cuman pas pengaturan robot txt di webmaster robot txt nya kok merah yah ? Mungkin disini ada yang bisa bantu !? Makasih ...

    [​IMG]
     
  2. KangAndre

    KangAndre Member

    Joined:
    Jan 25, 2014
    Messages:
    10,244
    Likes Received:
    2,714
    Trophy Points:
    413
    Coba pakai yang standar dulu (tanpa perubahan) isinya akan seperti ini:

    Code:
    User-agent: Mediapartners-Google
    Disallow:
    
    User-agent: *
    Disallow: /search
    Allow: /
    
    Sitemap: http://www.alhijaztourumroh.com/sitemap.xml
    
    kemudian test dan resubmit
     
  3. ncang

    ncang Super Level

    Joined:
    Feb 7, 2013
    Messages:
    4,655
    Likes Received:
    761
    Trophy Points:
    113
    Google+:
    minggu kemarin, jadi seperti ini :
    dan sementara tanpa sitemap.xml juga :D don't try this at home
     
  4. KangAndre

    KangAndre Member

    Joined:
    Jan 25, 2014
    Messages:
    10,244
    Likes Received:
    2,714
    Trophy Points:
    413
    namablog/sitemap.xml muncul sendiri di standar blogger.com
    coba test namablogspot/robots.txt
     
  5. ncang

    ncang Super Level

    Joined:
    Feb 7, 2013
    Messages:
    4,655
    Likes Received:
    761
    Trophy Points:
    113
    Google+:
    iya klo blogspot, wp, htmly & cms lain,, tergantung kebutuhan
     
  6. Garett

    Garett Super Level

    Joined:
    Apr 13, 2015
    Messages:
    1,104
    Likes Received:
    1,049
    Trophy Points:
    163
    Google+:
    Layanan blog selain self-host (blogger, wordpress.com, tumblr) nggak perlu robot.txt. Hanya submit sitemap.xml atau rss agar crawl-bot bisa akses. Nggak perlu pikir pusing.

    Sebenarnya ada di pengaturan blog tersendiri.
     
    Last edited: Oct 2, 2016
  7. Agustian

    Agustian Member

    Joined:
    Aug 20, 2015
    Messages:
    167
    Likes Received:
    14
    Trophy Points:
    18
    Ok makasih @KangAndre ane coba lagi.
     
  8. Ipan Nursila

    Ipan Nursila Member

    Joined:
    Apr 21, 2015
    Messages:
    300
    Likes Received:
    41
    Trophy Points:
    28
    Saya pernah ngalamin, setalah tanya sana sini admin SEOBlogaf bilang Default in aja Robot Txt nya dan besok nya kembali normal
     
Loading...

Share This Page