AdSense ads, but not in Google index

[zmcnulty]

My site is http://www.techjapan.com.

Search for it on google all you want -- it won't show up.
But as you can see, my site shows AdSense ads.

I've emailed Google about it plenty of times, but they have some sort of policy against responding to individual requests. My theory is my site was blacklisted for some reason. As far as I know, nobody owned "techjapan.com" before I did. My site has never shown up on Google, and it's been open for over 2 years.

Any advice? Thanks!

[Erik Geurts]

I searched and found:
http://www.google.com/search?hl=en&q=techjapan.com&btnG=Google+Search

However, your site has a pagerank of zero (so it is in Google, just not ranked very high).

Then I looked at your robots.txt file. It looks like this:
User-agent: *
Disallow: admin.php
Disallow: config
Disallow: header
Disallow: footer
Disallow: pntables
Disallow: referer
Disallow: /images
Disallow: /includes
Disallow: /modules/NS-
Disallow: /pnadodb
Disallow: /themes
Disallow: /pnTemp
Disallow: /docs
Disallow: /javascript

User-agent: WISENutbot
Disallow: /

User-agent: WebClipping.com
Disallow: /

You're disallowing a lot, but not allowing very much. Would that be a cause?

My personal experience with e-mails to the AdSense support staff is pretty good. For instance, last Sunday I mailed a question, I got the answer back within 12 hours. I'm in Holland, the support staff in this case is in London.

[Big Bill]

The OP also has a whole load of meta tags which are really not necessary and in saying index,follow are contradicting what the robots.txt says. Also the expire=0 meta instruction is probably doing no good at all as it seems to be suggesting that the site exires from Google's cache the minute it's indexed.

BB

[zmcnulty]

Whoa, sorry for the late response.

Thanks for the suggestions. I didn't even know my page was on Google, I guess it had been too long since I last checked.

The robots.txt file validates properly, and I'm disallowing so much because all of that stuff is administrative stuff, and is denied for security purposes.

I don't see how my index,follow command is contracting my robots.txt -- index would be whether or not I want the robot to index my page, and follow is whether or not I want it to follow any links. As I said, all I've denied in my robots.txt is administrative stuff. "Follow" would tell the robot to follow links on my page, which point to things like /Article512.html and so on. Furthermore, Google is the only search engine that seems to have problems with my site. here's (http://search.yahoo.com/search?p=Mercedes+helmet+mouse&prssweb=Search&ei=UTF-8&fr=FP-tab-web-t&fl=0&x=wrt) a link to a Yahoo query with one of my latest posts. As you can see, Yahoo has no problems spidering my site.

Nor do I see how http-equiv expires being set to 0 is a problem. I use a similar configuration on my other site, psp-vault.com (http://www.psp-vault.com), and it's expires tag is also set to 0. Yet here it is (http://www.google.com/search?hl=en&lr=&c2coff=1&rls=GGGL%2CGGGL%3A2005-09%2CGGGL%3Aen&q=site%3Awww.psp-vault.com&btnG=Search), being spidered by Google.

What would I set my http-equiv expires tag to, anyway? I went ahead and set it to like 2057 for the time being, just to see what happens.

[MickC]

The robots.txt file validates properly, and I'm disallowing so much because all of that stuff is administrative stuff, and is denied for security purposes.

Just a note here, but some unscrupulous people have started grabbing the robots.txt file to see where administrative areas are, thus making it a security issue of another sort.

That's not to say that you shouldn't use it, but just that you should be aware of the potential downside to it.