URGENT problem with spiders

GK User
Wed Aug 31, 2011 9:53 pm
my site is invisible in internet please help me.
i show whats in robots.txt
User-agent: *
Disallow: /administrator/
Disallow: /cache/
Disallow: /components/
Disallow: /images/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /logs/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/

My site url www.virecodesign.ro
User avatar
Platinum Boarder

GK User
Thu Sep 01, 2011 5:00 am
Invisible.... what do you mean by that? How old is the site?
User avatar
Expert Boarder

GK User
Thu Sep 01, 2011 8:05 am
Invisible= my site is not present in google. I've launched my site 2 months ago. Please help me!
User avatar
Platinum Boarder

teitbite
Thu Sep 01, 2011 8:18 am
Hi

Try to add it manualy :)
User avatar
Moderator

GK User
Thu Sep 01, 2011 10:10 am
Can you show me how to add manually?
Thanks
User avatar
Platinum Boarder

GK User
Thu Sep 01, 2011 12:34 pm
Do have a google webmasters account?

If not you can learn more about webmaster tools here.

Once you have a webmaster tools account you will need to submit your site url and a site map using the tools provided.

The time taken by google to index your sites content can take rather a long time, especially if you don't have many links back to your site.

The reason I mention that is because there is a temptation to try and fix something which isn't broken, in an attempt to speed up indexing etc.

EDIT: The other search engines also have similar tools for managing the way they index your site.

You will also need to add the verification codes or files to your site. There a number of extensions on the JED which allow you to manage several search engine auth. codes easily, gavick templates cater for the google key.

Here is another method of including information in the page header EasyHeader it's very useful for adding verification codes or css style sheet and scripts etc.

Hope that helps,
User avatar
Expert Boarder

GK User
Thu Sep 01, 2011 1:32 pm
thanks for that. But i still don't understand why my robots.txt file block the spiders?
User avatar
Platinum Boarder

GK User
Thu Sep 01, 2011 3:49 pm
Have you used the webmaster tools robots test?

You can also use this url to test robots files http://www.sxw.org.uk/computing/robots/check.html

.
User avatar
Expert Boarder


cron