Page 10 of 15«12891011121415»
uCoz Community » For Webmasters » Site Promotion » Indexing Policy & Robots.txt
Indexing Policy & Robots.txt
Sunny
Posts: 9296
Reputation: 456

Message # 1 | 10:41 AM
Website's Indexing Status


All uCoz websites have Indexing status that is displayed at the top of the Control Panel's main page (/panel/?a=cp). The parameter shows whether indexing by search engines is allowed for the website or not (whether the website is in quarantine).
The indexing status can show one of the two options: "indexing is allowed (quarantine is removed)":



Or "indexing is prohibited (the website is in quarantine)":



The status "indexing is prohibited (the website is in quarantine)" is assigned by default to all newly created websites.

Quarantine Removal Policy


A website can become available for indexing either automatically (if a premium plan is purchased) or upon the website owner's request. If the website does not have a premium plan and the user wants the quarantine to be removed, a request should be submitted from the website's Control Panel:



There will be a pop-up window with the info on the quarantine policy:



After the request has been submitted, the website will be checked automatically according to a number criteria: the website's age, presence of a custom domain name, content, verified phone number etc. On the basis of these criteria the system decides whether the quarantine should be removed. We cannot provide a more detailed description of the algorithm.

Note! If the quarantine removal was denied, the next request can be submitted no sooner than in 7 days.


Robots.txt


A website's robots.txt file is located at http://your_website_address/robots.txt. A website with the default robots.txt is indexed in the best possible way – we set up the file in such a way that only pages with content are indexed, and not all existing pages (e.g. login or registration page). Therefore uCoz websites are indexed better and get higher priority in comparison with other sites where all unnecessary pages are indexed.

That's why we strongly recommend not to replace the default robots.txt by your own.


If you still want to replace the file by your own, create a text file using Notepad or any other text editor and name it "robots.txt". Then upload it to the root folder of your website via File Manager or FTP. Note: while website indexing is prohibited, no modification of the robots.txt file is possible.

The default robots.txt looks as follows:
Quote

User-agent: *
Allow: /*?page
Allow: /*?ref=
Allow: /stat/dspixel
Disallow: /*?
Disallow: /stat/
Disallow: /index/1
Disallow: /index/3
Disallow: /register
Disallow: /index/5
Disallow: /index/7
Disallow: /index/8
Disallow: /index/9
Disallow: /index/sub/
Disallow: /panel/
Disallow: /admin/
Disallow: /informer/
Disallow: /secure/
Disallow: /poll/
Disallow: /search/
Disallow: /abnl/
Disallow: /*_escaped_fragment_=
Disallow: /*-*-*-*-987$
Disallow: /shop/order/
Disallow: /shop/printorder/
Disallow: /shop/checkout/
Disallow: /shop/user/
Disallow: /*0-*-0-17$
Disallow: /*-0-0-

Sitemap: http://forum.ucoz.com/sitemap.xml
Sitemap: http://forum.ucoz.com/sitemap-forum.xml



Robots.txt during the quarantine looks as follows:

Quote

User-agent: *
Disallow: /




Robots.txt FAQ


Informers are not indexed because they display information that ALREADY exists. As a rule this information is already indexed on the corresponding pages.


Question: I have accidentally messed up robots.txt. What should I do?

Answer: Delete it. The default robots.txt file will be added back automatically (the system checks whether a website has it, and if not – adds back the default file).


Question: Is there any use in submitting a website to search engines if the quarantine hasn't been removed yet?

Answer: No, your website won't be indexed while in quarantine.


Question: Will the robots.txt file be replaced automatically after the quarantine has been removed? Or should I update it manually?

Answer: It will be updated automatically.


Question: Is it possible to delete the default robots.txt?

Answer: You can't delete it, it's a system file, but you can add your own file. However, we don't recommend to do this, as was stated above. During the quarantine it is impossible to upload a custom robots.txt.


Question: What should I do to forbid indexing of the following pages?
_http://site.ucoz.com/index/0-4
_http://site.ucoz.com/index/0-5

Answer: Add the following lines to the robots.txt file:
/index/0-4
/index/0-5


Question: I have forbidden indexing of some links by means of robots.txt but they are still displayed. Why is it so?

Answer: By means of robots.txt you can forbid indexing of pages, not links.


Question: I want to make some changes in my robots.txt file. How can I do this?

Answer: Download it to your PC, edit it and then upload it back via File Manager or FTP.

I'm not active on the forum anymore. Please contact other forum staff.
Muşatinu
Posts: 46
Reputation: 0

Message # 136 | 9:48 PM
donce,
Quote (Sunny)
There is a "quarantine" for each new website when no modification of the robots.txt file is possible. In case of good traffic the quarantine will last up to 2 weeks, for the sites with low traffic – 30 days. If you pay for any of the additional services quarantine will end immediately after the payment.
donce
Posts: 41
Reputation: 0

Message # 137 | 6:11 AM
30 days is past but still is same.And why my search doesnt work?
When I tipe some name of entries they show me 0 results.
Maybe this isnt place for that kind of question but ...sorry

http://filmofil.ucoz.com/
Sunny
Posts: 9296
Reputation: 456

Message # 138 | 11:47 AM
donce, what is your website address?
I'm not active on the forum anymore. Please contact other forum staff.
donce
Posts: 41
Reputation: 0

Message # 139 | 7:59 PM
Sunny,

http://filmofil.ucoz.com/

http://filmofil.ucoz.com/
Sunny
Posts: 9296
Reputation: 456

Message # 140 | 9:55 AM
donce, at the moment your robots.txt looks ok.
I'm not active on the forum anymore. Please contact other forum staff.
Nazish
Posts: 13
Reputation: 0

Message # 141 | 1:03 PM
Dear Admin, it seems like robots.txt is very complicated issue here angry I got the same error from few days back and trying to solve that matter now I became tired. I have edited my robots.txt file and now google not shows any error but everyday I have3 to resubmit to google to get visitors. If I submitted today I will get 20+ visitors while next day 0 visitors and it will continue till I resubmit dry I am soooooo much worried please help me. my site is
http://paulonation.ucoz.com/
Thanks
Paradox
Posts: 3276
Reputation: 145

Message # 142 | 8:20 AM
Nazish, Google catalogs site's robots.txt files on it's own accord. As to getting visitors there is no law of the internet written in stone saying that you will receive visitors every day your site is up. Somedays you will have good days where you get a flood of users visiting your site while on others it will be empty. The art of owning a website is having patience and giving your site time to grow and develop an audience. wink
Developer, Designer, Communicator.
Been here for 6 years and counting.
Visit me at alexmoloney.me.
Sunny
Posts: 9296
Reputation: 456

Message # 143 | 10:31 AM
Nazish, Paradox is right. Submitting a website to Google does not mean you will have lots of visitors. Website promotion consists of many aspects. I suggest that you read articles on website promotion to learn more.
I'm not active on the forum anymore. Please contact other forum staff.
Nazish
Posts: 13
Reputation: 0

Message # 144 | 7:16 AM
Thanks Admin and Head Mod for your response and valuable advices smile
furki
Posts: 1
Reputation: 0

Message # 145 | 1:32 PM
See my website robots.txt

www.easyearnonlinefree.tk/robots.txt

but my site is not showing in google



what should i do?
Attachments: 2114602.png(16Kb)
Sunny
Posts: 9296
Reputation: 456

Message # 146 | 2:12 PM
furki, you just need to wait till Google re-indexes your website.
I'm not active on the forum anymore. Please contact other forum staff.
Sunny
Posts: 9296
Reputation: 456

Message # 147 | 12:33 PM
The following line has bee added to the default robots.txt: Disallow: /?ssid=
It prevents from indexing the duplicates of the home page.

I'm not active on the forum anymore. Please contact other forum staff.
CiRRuS
Posts: 24
Reputation: 0

Message # 148 | 9:20 PM
and it is that bad if i removed /informer/ from robots.txt?
Post edited by CiRRuS - Thursday, 2013-02-21, 9:23 PM
Paradox
Posts: 3276
Reputation: 145

Message # 149 | 7:00 AM
CiRRuS, I would strongly advise you leave it in. It won't reduce the security of your site however it can affect your sites SEO. wink
Developer, Designer, Communicator.
Been here for 6 years and counting.
Visit me at alexmoloney.me.
CiRRuS
Posts: 24
Reputation: 0

Message # 150 | 11:10 AM
hmm maybe but i added my website 2 days ago on google and i already had more then 20 users from google .. for me this is pretty much because i still haven't advertised it, and i don't want to advertise it until it is not complete
uCoz Community » For Webmasters » Site Promotion » Indexing Policy & Robots.txt
Page 10 of 15«12891011121415»
Search: