   |
| uCoz Community » For Webmasters » Site Promotion » Indexing Policy & Robots.txt |
| Indexing Policy & Robots.txt |
Website's Indexing Status All uCoz websites have Indexing status that is displayed at the top of the Control Panel's main page (/panel/?a=cp). The parameter shows whether indexing by search engines is allowed for the website or not (whether the website is in quarantine). The indexing status can show one of the two options: "indexing is allowed (quarantine is removed)":  Or "indexing is prohibited (the website is in quarantine)":  The status "indexing is prohibited (the website is in quarantine)" is assigned by default to all newly created websites. Quarantine Removal Policy A website can become available for indexing either automatically (if a premium plan is purchased) or upon the website owner's request. If the website does not have a premium plan and the user wants the quarantine to be removed, a request should be submitted from the website's Control Panel:  There will be a pop-up window with the info on the quarantine policy:  After the request has been submitted, the website will be checked automatically according to a number criteria: the website's age, presence of a custom domain name, content, verified phone number etc. On the basis of these criteria the system decides whether the quarantine should be removed. We cannot provide a more detailed description of the algorithm. Note! If the quarantine removal was denied, the next request can be submitted no sooner than in 7 days. Robots.txt A website's robots.txt file is located at http://your_website_address/robots.txt. A website with the default robots.txt is indexed in the best possible way – we set up the file in such a way that only pages with content are indexed, and not all existing pages (e.g. login or registration page). Therefore uCoz websites are indexed better and get higher priority in comparison with other sites where all unnecessary pages are indexed. That's why we strongly recommend not to replace the default robots.txt by your own. If you still want to replace the file by your own, create a text file using Notepad or any other text editor and name it "robots.txt". Then upload it to the root folder of your website via File Manager or FTP. Note: while website indexing is prohibited, no modification of the robots.txt file is possible. The default robots.txt looks as follows: Quote User-agent: * Allow: /*?page Allow: /*?ref= Allow: /stat/dspixel Disallow: /*? Disallow: /stat/ Disallow: /index/1 Disallow: /index/3 Disallow: /register Disallow: /index/5 Disallow: /index/7 Disallow: /index/8 Disallow: /index/9 Disallow: /index/sub/ Disallow: /panel/ Disallow: /admin/ Disallow: /informer/ Disallow: /secure/ Disallow: /poll/ Disallow: /search/ Disallow: /abnl/ Disallow: /*_escaped_fragment_= Disallow: /*-*-*-*-987$ Disallow: /shop/order/ Disallow: /shop/printorder/ Disallow: /shop/checkout/ Disallow: /shop/user/ Disallow: /*0-*-0-17$ Disallow: /*-0-0- Sitemap: http://forum.ucoz.com/sitemap.xml Sitemap: http://forum.ucoz.com/sitemap-forum.xml Robots.txt during the quarantine looks as follows: Quote User-agent: * Disallow: / Robots.txt FAQ Informers are not indexed because they display information that ALREADY exists. As a rule this information is already indexed on the corresponding pages. Question: I have accidentally messed up robots.txt. What should I do? Answer: Delete it. The default robots.txt file will be added back automatically (the system checks whether a website has it, and if not – adds back the default file). Question: Is there any use in submitting a website to search engines if the quarantine hasn't been removed yet? Answer: No, your website won't be indexed while in quarantine. Question: Will the robots.txt file be replaced automatically after the quarantine has been removed? Or should I update it manually? Answer: It will be updated automatically. Question: Is it possible to delete the default robots.txt? Answer: You can't delete it, it's a system file, but you can add your own file. However, we don't recommend to do this, as was stated above. During the quarantine it is impossible to upload a custom robots.txt. Question: What should I do to forbid indexing of the following pages? _http://site.ucoz.com/index/0-4 _http://site.ucoz.com/index/0-5 Answer: Add the following lines to the robots.txt file: /index/0-4 /index/0-5 Question: I have forbidden indexing of some links by means of robots.txt but they are still displayed. Why is it so? Answer: By means of robots.txt you can forbid indexing of pages, not links. Question: I want to make some changes in my robots.txt file. How can I do this?
Answer: Download it to your PC, edit it and then upload it back via File Manager or FTP. I'm not active on the forum anymore. Please contact other forum staff.
|
adinbatsin, you can ask questions in your own language here http://forum.ucoz.com/forum/28-149-1 In this thread you need to speak English. Please, provide a website name and describe what the problem is exactly.
|
Hello!
I have a site and I want more times to modify the robots.txt file... I can't do this!! Someone can say me how I can do this? I have tried to upload a robots.txt file, but don't works this. *The website was created 2 days ago. |
@Natashko: Thank you very much for the fast respond.
Another question: I can remove this quarantine time in a mode? Like I can pay some money or I can get a domain for remove the quarantine? |
smyth_makoto21, There is a 30-day quarantine for new websites in the system. The more detailed information is here:
http://faq.ucoz.com/#29 http://forum.ucoz.com/forum/23-4687-1 As a rule it is not reasonable to submit a website to search engines till 30 days after its creation have passed. If you still want to unblock the robots.txt file for your website to be indexed sooner, you can pay for any of premium packages in the website Control Panel -> Top Bar -> $ -> Paid services. Please see the screenshot: http://faq.ucoz.com/screenshots/paid_service_packages.png |
How do I disable my account UcoZ? Hello would like this off the community, anywhere in the site because it was developing a website and expect to have a very large number of hits, then from what I understand this text, my sites will not appear on search engines!
 Here where I live, about 80% of people use search engines to enter a site. So with my site not indexed, I have to do much work, to have many visitors!  Since my site will not be indexed'll pay another server!  
|
neilson, your site will be indexed after 1 month of having your site open with limited traffic. It is possible to decrease this time to two weeks with frequent visitors or to have your site open for indexing immediately you can pay for a package.
If you are already paying for one of the paid packages no quarantine is in place and all search providers are able to index your site. Hope this adresses your concerns,
Jack of all trades in development, design, strategy.
Working as a Support Engineer. Been here for 13 years and counting. |
Quote (Paradox) Neilson , o site será indexado após um mês de ter o seu site aberto com tráfego limitado. É possível diminuir este tempo para duas semanas, com visitas freqüentes ou ter o seu site aberto para indexação imediatamente você pode pagar por um pacote. Se você já está pagando por um dos pacotes pagos de quarentena não está no local e todos os provedores de pesquisa são capazes de indexar o seu site. Espero que este adresses suas preocupações, Just to clarify! So if I continue for a month, my website ready, will be available to put my site in search engine, with free account?  If so, I have experience in SEO, I can improve my site on my own? Using the techniques of SEO?
|
That's correct. After 30 days your websites bot quarantine ends and you can index the website however you would like.
Jack of all trades in development, design, strategy.
Working as a Support Engineer. Been here for 13 years and counting. |
X-TRAK, if you read the above information carefully you will notice that there is a 30 day quarantine of bots on new sites. During this time no bot (eg GoogleBot) will be able to crawl your site. If you want your site opened for indexing immediately you can pay for a package with the service in it.
Hope this helps,
Jack of all trades in development, design, strategy.
Working as a Support Engineer. Been here for 13 years and counting. |
Thank you Paradox for help.
 Added (2011-06-27, 3:55 Am) |
X-TRAK, which website are you referring to? http://info-warez.ucoz.net is opened for indexation. furry-porn.ucoz.co.uk is not
|
| |||