Forum of the spiders and crawlers tracking script CrawlTrack / javascript / any other way to include

anand · 08-10-2007 21:43:51

Hi,

I want to use crawltrack for a number of sites, however in the present method, anyone can get access to my mysql credentials since all php code is open. Is there a way we can include the crawltrack code and safeguard the mysql info ? Example like google analytics, it has a small javascript code which can be inserted. I know javascript is not perfect since many search engines ignore it, perhaps we could use a html image tag and call the url of the script. This inturn records information required and sends to crawltrack.

This way i can use crawltrack on aspx websites as well.

Any help would be appreciated.

Jidébé · 08-10-2007 22:10:53

Hello,

What did you mean by?:

anyone can get access to my mysql credentials since all php code is open

Until now, I haven't find any other way than a php tag to detect crawlers, with Javascript or html image tag you will not detect them.

Jean-Denis

anand · 08-10-2007 22:22:36

Jidébé wrote:
Hello,

What did you mean by?:
a
nyone can get access to my mysql credentials since all php code is open

As its just a include link, the user can place another file which just after the include echo's all variables for mysql. Wouldn't that work ?

Until now, I haven't find any other way than a php tag to detect crawlers, with Javascript or html image tag you will not detect them.

Jean-Denis

I have seen a lot of products out in market which are able to do so using html image / javascript, surely not an expert on this, but i wonder how they make it possible.

Can i know what all variables / information is passed to crawltrack.php / is required by crawltrack.php to detect crawlers ?

Thanks.

Jidébé · 08-10-2007 22:40:26

anand wrote:
the user can place another file which just after the include echo's all variables for mysql. Wouldn't that work ?

This is only possible if the user can place a file on your site!!!

If you want to offer the usage of your CrawlTrack to other webmasters you have to use the second tag which is not using an include but an http request (the include is not possible from an other server than yours). And in this case no way to see your mysql info.

You can try that script and you will see that you will not find my mysql info:

<?php
include 'http://www.crawltrack.fr/robot/crawltrack.php';
echo $crawltuser;
echo $crawltpassword;
echo $crawltdb;
echo $crawlthost;

?>
You will have a blank page.

anand wrote:
I have seen a lot of products out in market which are able to do so using html image / javascript

For human visit yes, for crawlers no (crawler are not loading javascript and image).

Jean-Denis

anand · 08-10-2007 22:53:30

Jidébé wrote:
anand wrote:
the user can place another file which just after the include echo's all variables for mysql. Wouldn't that work ?
This is only possible if the user can place a file on your site!!!

If you want to offer the usage of your CrawlTrack to other webmasters you have to use the second tag which is not using an include but an http request (the include is not possible from an other server than yours). And in this case no way to see your mysql info.

You can try that script and you will see that you will not find my mysql info:

<?php
include 'http://www.crawltrack.fr/robot/crawltrack.php';
echo $crawltuser;
echo $crawltpassword;
echo $crawltdb;
echo $crawlthost;

?>
You will have a blank page.

Can i use the above include in sites which i want to track ? OR do i have to use the http request thing ? Just trying to find ways to have something smaller do the job and i have some asp.net sites to track, need to find a way to do so.

anand wrote:
I have seen a lot of products out in market which are able to do so using html image / javascript
For human visit yes, for crawlers no (crawler are not loading javascript and image).

Jean-Denis

Hmm... thats correct. How does then google analytics work ? Doesn't it give information on various search engines ? (I could be wrong on this, since i haven't seen any other crawler on my site apart from googlebot on Google Analytics).

Could we do a simpler/ smaller code for that http request ? And make it adaptable for asp site as well ?

Thanks.

Jidébé · 08-10-2007 23:06:22

The include tag (not the test script in my previous post, but the one given by your CrawlTrack) is to be use when the site to track and Crawltrack are install on the same server.

The http one is to be use when the site and CrawlTrack are not on the same server.

For asp site, there is actually no tag available, the solution will be to convert the http one from php to asp. I will add this on my todo list (if somebody who know asp can help on this, he is welcome ).

Jean-Denis

Support forum

#1 08-10-2007 21:43:51

javascript / any other way to include

#2 08-10-2007 22:10:53

Re: javascript / any other way to include

#3 08-10-2007 22:22:36

Re: javascript / any other way to include

Jidébé wrote:

#4 08-10-2007 22:40:26

Re: javascript / any other way to include

anand wrote:

anand wrote:

#5 08-10-2007 22:53:30

Re: javascript / any other way to include

Jidébé wrote:

anand wrote:

anand wrote:

#6 08-10-2007 23:06:22

Re: javascript / any other way to include

Board footer