|
   |
| Forum moderator: bigblog |
| uCoz Community » For Webmasters » Custom Solutions » My site, Archive.org, uCoz... and a major head ache (robots.txt is the devil) |
| My site, Archive.org, uCoz... and a major head ache |
-I retrieved my domain fairtomidlandfans.com after a few months of not owning it.
-Created a uCoz website for the domain in plans of reviving the website. -Was using Archive.org to take old pages from fairtomidlandfans.com and revive them through uCoz on the new website from the same domain. -Within 24 hours, Archive.org restricted access to archives of the website: Page cannot be displayed due to robots.txt. -I have contacted Archive.org on how to fix this, but am wondering if the uCoz community has encountered an issue like this and have any tips for a solution? What do I need to modify in robots.txt for Archive.org to crawl it and access archives of the domain? |
z0mbief3tus, apologies for the late reply, however uCoz does not permit indexing to brand new websites. You'll find your website will open for indexing *as soon as it has met the indexing criteria. If you feel your website already meets these criteria you may submit it for approval. Please feel free to post any further updates you feel we should know about.
 Moved to Custom Solutions. Jack of all trades in development, design, strategy.
Working as a Support Engineer. Been here for 13 years and counting. |
| |||
| |||