Tracking Forums, Newsgroups, Maling Lists
Home Scripts Tutorials Tracker Forums
  Advanced Search
  HOME    TRACKER    PHP


SuperbHosting.net have generously sponsored dedicated servers to ensure a reliable and scalable dedicated hosting solution for BigResource.com.





Identifying Search Engines


my website is pretty much database driven and i've typically parsed the data in PHP and just output flat HTML. however, i'm trying to save some badwidth by spitting out just the critical information, and have javascript parse out the data.

however, i'm kinda worried how search engines would react to this. (especially google) would search engines ignore the keywords if they are inside javascript tags? how do i detect search engines? maybe i can just setup a special script that output's "search-engine-friendly" output.




View Complete Forum Thread with Replies

Related Forum Messages:
Search Multiple Search Engines
Does anyone know how it may be possible to write some code to search multiple search engines?

View Replies !
Php And Search Engines
I've got a site built around a few php programs, when the page is requested it uses htaccess to call a php program with the page name. This page name is used to extract title/description/keywords/h1/h2/alttext/copy etc from a database and then populate the page. The site works well and I only have 2 or 3 programs to run a large site based on a database. The problem is when I run it through the spider test on this site it doesn't pick up the title/description or keywords. Is this something to do with the page being built on the fly, and if so does anyone have a solution to this?

View Replies !
Search Engines.
i have a car showroom and i was wondering how i can do it so that seach engines can crawl my showroom. it looks like this detailed.php?model=Cadillac&make=Escalade can anyone point me into the right direction?

View Replies !
[FAQ] Search Engines And PHP
Q: Is PHP search engine friendly?
Q: Will search engine spiders crawl my PHP pages?

A:
Spiders should crawl anything provided they're accessible. Since,
nowadays most of the websites are been developed with PHP, you are not
supposed to doubt that.

As a proof that PHP pages could be crawled and indexed, refer this
Google search
<http://www.google.com/search?q=inurl%3Aphp+filetype%3Aphp>

Q: How can I submit my website to search engines? Should I use PHP to
submit?
A: Consult their documents. It is always better to categorize your site
and submit to DMoz. Usually, PHP has no role here; but however some
search engines (specifically Google and it's sitemap protocol) provides
option to inform them the changes using a ping mechanism and here PHP
could be used.

Refer:
http://dmoz.org/add.html
http://www.google.com/webmasters/
https://www.google.com/webmasters/s...s/en/about.html

Q: How to indentify the spider?
A: You may identify it by user agent and or IP.

Refer:
http://www.iplists.com/
http://joseluis.pellicer.org/ua/
http://www.pgts.com.au/pgtsj/pgtsj0208d.html

Q: Will search engines follow redirection? If so, what URL will be get
indexed?
A: Yes, the final URL

Q: Will search engines handle cookies?
A: No.

Q: Will search engines handle sessions?
A: No, if your session is cookies based. If there is a provision for
URL rewriting (ie, trans sid feature), it will handle or maintain
sessions.

Q: All the pages in my website use session. But, I don't want the URL
rewriting as it results in uglier URLs (appended with PHPSESSID).
A: Then, you may selectively enable trans sid feature only for the
search engine spiders by sniffing their user agent and or IP.

Q: Will search engines save the links with the session id (PHPSESSID)
in the URL?
A: Majority of the search engines automatically remove the session id
in their index. But, there are also report that few search engines
(more specifically MSN) don't remove them; in that case there are
chances that the session of more than one user (when they visit the
site via search engine) may be shared/hijacked provided there is not
enough measures taken into account.

Q: How to optimize my site?
A:
Make the contents accessible. Be sure to validate your HTML and stick
to W3C standards; this will help the search engines to see your access
your contents easily.

But, also remember that most of the SEO (Search Engine Optimization)
theories are big hoax and it's a crazy business. If you provide good
quality of service in your site, hardly it won't get visibility.

Refer:
http://www.w3.org/QA/

Q: I prefer more visitors via search engines. What should I do?
A: As said, believe in the good quality and you'll definitely be known.
You may also opt to advertize in the search engines, if you strongly
believe in advertizements.

Q: Please give me some quick hacks for my website to get more visitors
through search engines.
A: Since, many search engines are now contents based (previously and
still few search engines used META keywords), enough keywords on the
page might help.

So, some people use the cloaking technique, in which different content
is been provide to spiders by sniffing their user agent string and or
IP. Some people use also keyword stuffing techniques, in which the
keywords are largley stuffed to a page and probably hidden using CSS or
so. And, all such "fooling" techniques are highly against to the search
engines' TOS and as a penalty the site might even be get blacklisted.
Some search engines like Google even employ people to evaluate the
quality of their search results and provide option to lodge complaints
against any "fooling" sites.

Q: What is PR?
A: In search engines context, PR would mean Google's PageRank (tm)
algorithm that determines the rank of the page determined through the
number of pages linking to it and the rank of the linking pages. Hence,
PageRank can be used to find the popularity of that page. However, this
would hardly affect the position of a webpage on a search page and can
safely be ignored (Some SEO business people may not agree with this)

Refer:
http://en.wikipedia.org/wiki/PageRank

View Replies !
Search Engines
I have a site and would like to place a search engine on my site that allows someone to do a search using a search box on my page and searches a number of other sites which then reports it back on one results page. I have a site that has newspaper links on it.

I want to have a search box on my site that allows users to do a search of all local newspapers. Say they type in murder, the search box would then go out and search any defined sites for the term murder and then generate a results page (on my server) showing all the match stories from the sites searched.

View Replies !
Search Engines Do It
about there trolling. do search engines use cURL to periodically scan pages? or do they do it some other way?

View Replies !
Search Engines
i am designing a site and i want users to be able to search through our databases. is this possible with php? is it possible to design a search function that allows users this ability? or, is it more possible to index the pages on the site, and then search through indexed pages?

View Replies !
Header() And Search Engines.
I would like to have a log of visitors which are referred to other sites by mine. I can do this by giving them a reference to a page on my site which would contain the following:
PHP Code:

View Replies !
Search Engines And Patents
I am thinking of a web application that requires an internal search engine, Im not a php expert, I would hire someone else for this, but it maked me think about some issues.
Ive read that companies like yahoo, ask jeeves, google etc. Own the patent for their search algorithms.

With this in mind, how would a small company develop a search engine without crossing the legal barrier that these patents impose? Is there such a thing like an open source search algorithm that is good enough to use in commercial websites?

View Replies !
PHP Pages And Search Engines
I am in development of my site and alot of the site has php3 pages. What i need to know is, does search engines index PHP3 pages?

View Replies !
How Good Are These Search Engines?
I am looking at replacing htdig.org tool with something fast. I came
across

http://www.site-search-pro.com/
http://www.phpdig.net/

My requirements are,

- Users should be able to search across the domains mentioned in the
configuration file (all sub-domains of indiainfo.com)
- users should be able to search withing a particular domain (just
travel.indiainfo.com)

View Replies !
Php Session Ids And Search Engines.
My website pages (urls) seem to have session ids included in the urls, and i know that will some how effect the search engine prefreces, or anything to the search result, I have no access to the php.ini files, so does anyone know how this problem may be solved through the use of .htaccess files?

View Replies !
Problem In The Search Engines
I have a site I've ignored for a while, letting it mature.

I just did some checking and it's got 1700 pages registered in google....all bad pages using something like:

http://www.mydomain.com/index.php?blah-keyword-blah

I want to make it so that any queries that include that keyword in the url goes to a proper 404 page.

View Replies !
Redirecting And Search Engines
I have a script that takes some parameters and redirect using header(). So it has no actual output. So, now I discover that I forgot search engines, and today this script got crawled an insane amount of times. Has this already affected my search engine ranking? How can I restrict the crawlers from indexing this script (which has lots and lots of urls thanks to url rewriting)? I can't use robots meta tags since the script has no actual output, and a robots.txt might prove difficult.

View Replies !
SESSID And Search Engines
I'm having a problem and was hoping someone could offer some advice.. or at least a theory? I have a site that I've installed a PHP search engine script on.

It works great... except that it finds result sets for many different PHP session IDs. I don't want these sessions to be indexed and can't seem to stop it from happening. Code:

View Replies !
Search Engines With Querys?
I have a site which uses querys like:

products.php?prodid=45

Will search engines like google spider these pages or not? If not is there a way where i can get spiders to crawl these pages?

Thanks to anyone who can help me with this?

View Replies !
Detect Search Engines
I have a page that i want google to index but i don't want users to be able to see it without logging in first now i know how to make sure the user is logged in unfortunatly if i leave it at that google msn yahoo and all the other bots will just index the "you havnt logged in message" whats a way i can detect the vistor and if they are a search engine bot display the page as normal otherwise if they are human die("you are not logged in");

View Replies !
PHP Generated Pages & Search Engines
I'm trying to get a basic idea of how well PHP generated pages can be spidered by search engines? I'm working for a company that keeps two versions of it's site at the moment. One copy run off of a database using CGI, and one copy entirely in HTML so search engines will find them. I've told them that this is just a bad idea, and far too time consuming. I'm under the impression that PHP pages can be found by search engines, am I wrong? I'm going to be running almost their entire database of products off of one file, will the search engines be able to find these if there aren't direct links to them?

Any other suggestions as to how to keep their positions in the search engines (very good right now) would be appreciated as well.

View Replies !
Dynamic Pages Vs Search Engines
I have a how-to-do-it manual like site,
related to fishing. I want to add a new
interactive question/comment feature to each
instructional page on the site.

I want (registered) users to be able to add
comments at the bottom of each page, similar
to the way the php, mysql, apache manuals work.

PUNCHLINE_A:
I don't want to revert to a system of dynamic links
that look like "pagePainter.php?page_id=123"

I did that for a while. But every time I edited
the site (reloaded the database) all the page_ids
changed, and then voila I had stale links spattered
all over my Google search results--because the
same page now had a slightly different page_id.

To avoid that I could associate each page with
a unique lookup string that is its server-side file path:

pagePainter.php?page_key=/pages/manual/chapter1/engine_repair/carburetors

Then the keys wouldn't change everytime I added a few new pages
to the system, and reloaded the database. Then my Google search
links would remain constant.

PUNCHLINE_B:
Will the search engines spider and index links that look like that?
Or will I have to make a system that spits out the entire page as static
html, each time a registered user adds a new page question or comment?

Or should I put the comments box in an iframe, which is also a spidering
can of worms?

View Replies !
Php Template System And Search Engines
I've been working on a new design for our website, and we came up with a php template system, which reads a content page from a folder "conent"(html files). as such: index.php?content=pagex

Now I was wondering if a searchengine would pick up a page from the pages folder, the viewer would only see the text because the design, menus etc are all being created by the index.php.

The above we do not want to happen! is there ny way to avoid such an incident?

View Replies !
Php Files Can't Be Indexed By Search Engines
is it true that php files can't be search/find by a search engine? only html files can be searched? if yes, how come php files can't be search.

View Replies !
Dynamic Pages With Search Engines
We know search engines cannot index many database-driven pages basically any page with a '?' or '&' in the URL, and i want to ask if is there en way to transform that simbols in / for example.

View Replies !
$_SERVER['REFERER'] & Search Engines
When using the $_SERVER['REFERER'] varible when someone is sent to you site from another via clicking a link etc, how do you dectect search engines spiders/bots. I am doing a voting script and obviously i want to filter the above kind of trafic to keep the stats real.

View Replies !
Site Searchable On Search Engines
i have made some sites but i still have no idea that how can i configure my sites so that they wud be searchable on google, yahoo etc.

View Replies !
Session Codes And Search Engines
I am using session codes in php to dynamically load content onto my web pages...would this affect my search engine positions. the session id gets attached to every internal link url only for the first web page of a session, then disappears. is this likely to cause problems for me or not?

View Replies !
Hide Variables From Search Engines
I want to prevent search engines from indexing pages on my site with specific passed variables. I am using variables to track visitors from Google Ads and email newsletters, so having these variables picked up by Search Engines is "messing up" my user statistics.

Right now, the highest ranked page on my site when using the domain name as a keyword includes variables from an email newsletter sent to select customers as a means of tracking ROI. Now the stats are no good.

View Replies !
Does Search Engines Can Spider PHP Pages?
Does anyone know if the search engines can spider PHP pages?

View Replies !
Provide Links For Search Engines
How do I provide links that search engines can follow if my site is created in PHP and MySql and I always put the session ID in the link (header)? Are there any special tricks?
Basically, I want the search engines to be able to find my pages. Do you need to know more.

View Replies !
Best Way To Switch To The .php Extensions For The Search Engines?
I would like to switch one of my sites to PHP because I like it a lot better than HTML and find it a lot easier and more versatile to use. The only problem is my website has already been indexed for all the HTML pages. What would be the easiest and best way to switch to the .php extensions for the search engines? Should I leave the original .html files there and just put the .php pages on the site map to get indexed (although I am afraid this will be considered duplicate content).

View Replies !
Database Driven Pages On Search Engines
I know this has been discussed at length in these forums from the searches that I've done, but I have a new question of sorts. Basically, I found several solutions to the problem of using PHP/MySQL database driven pages and getting them listed on search engines. One method that I've chosen entails listing the variables in between backslashes after the name of the document, like this http://www.something.com/index.php/test/1234

After a few problems, I've been able to get all of the pages in the first group (I just added the 2nd and 3rd group today) to list perfectly on Google. I'm psyched about this working on my entire database of 10,000+ products, but I'm worried that I may be overlooking something.

If possible, please check out that link and if anyone knows of any shortcomings or pitfalls with using this method, please let me know. Thanks a ton.

View Replies !
PHP Includes, With Meta Tags & Search Engines
I am dealing with a site that has been organized of the php include function devised into four sections 1. header.php 2. nav.php 3. content.php 4. footer.php Basically, content.php includes the other 3 files in their respected spots.

The question that I have, though this organization seem very efficient in order to make quick changes to the site, but how does this effect meta tags that may be indexed by search engines... Since the meta tags exist in one file header.php, then whow does a search engine index a specific page within the site.

View Replies !
Results From Multiple Search Engines In One Page.
I am trying to build a script wherein the user can search multiple search engine like google, yahoo, msn from one page and the results get displayed in one page. Some thing like this link. Code:

View Replies !
Creating Counter That Doesn't Included Search Engines
I want to create a counter to see how many people are viewing a certain page but i don't want to count Search Engines. Is this possible? Code:

View Replies !
Does Content Within An Iframe Get Looked At By Search Engines?
Does content within an iframe get look at by search engines or do they just pass over it?

View Replies !
HT://dig And Other Search Engines Wont Look At Query String In Links
I realize that this is no the HT://dig support forum but I haven't been able to get htdig to index my site properly:

It will only show one file: index.php when every other files is linked off the main page (i.e. index.php?content=page2.html ) I believe that this search engine is not looking at the QUERY_STRING properly or following the links off the main page.

Does anyone know how to get htdig to work on a dynamically generated site - or can you recommend another search engine that would help index and search such a site.

View Replies !
Hide Javascript Code From Browsers And Search Engines
I want to hide the javascript code in a php file because it uses a resource from another website, and if the code is visible, search engines are spidering that php page, and also the scripts in it.

View Replies !
Multi Language Site With PHP, Mysql And Cookies - How About Search Engines?
I need to make at multilanguage language site, and for that I need to
identify the users, and register there choice off language. For that i
imagine using cookies, since this is the only way to identify the
users. But from what I read search engines ignore cookies, and at the
same time I would like the users to be able to send links in there
choice of language to there friends, so I would like this sort of url
scheme.

www.site.com/en/
www.site.com/de/
www.site.com/fr/
.....

But I don´t like the idea of having a lot of duplicate files, with the
only difference being a reference to a specific column in my sql
database. What to do? How do others solve these problems

View Replies !
How Do Search Engines React To The "open/save" Dialog?
I have a page that lists a bunch of PDFs. I want to give people the choice whether they want to open it or save it to the disk. To do that I make the link through a php file using the header function (http://www.php.net/manual/en/function.header.php).

I do want these PDFs to be read by search engines like google.

What does google do when prompted with that dialog box? Does it even "see" it?

If it ignores it I want to make a if: if agent is a search engine, then don't put "content-disposition:attachement". (for the file name issue it's no problem since all my urls are made up by mod_rewrite)

View Replies !
Identifying Browser
Is there a way to identify the brwser a visitor to my site is using?  I would like to include site style based on the visitor's browser.   If their us IE show layout one way, if their using Firefox show it another  way...etc...etc.

View Replies !
Identifying People
on my website i'm finding people are coming back and signing up again and again... how can i log them so i know who has logged in before. was thinking IP but does this not change per session online with dial up?

View Replies !
Identifying A Value Range
i have a form that submits to a php file, the form basically has a hidden field called number:

<input type="hidden" name="number" value="12">

i know how to read the value of that, its simply putting <?php echo $_POST['number']?> but what i want to do is check if the number is between 1 and 25 and if it is then echo A else if it is between 25-75 then echo B else if it is anything above 75 then echo C .

View Replies !
Identifying SSL Clients
I have a site that uses PHP sessions through SSL, my employer does not wish the site to require cookies so I have switched on the use_trans_sid option for users who have cookies disabled. The problem I have is stopping session hijacking.

If I am on a page "https://secure.mysite.com/page.php?PHPSESSID=XXXXX"

And I email the url to someone else they can get onto the site without being challenged for a logon. I am trying to find a way to check that the connection is still coming from the same SSL connection, e.g. by checking the clients public key, but I can't find a way to get any information about the SSL connection from PHP.

View Replies !
Identifying An Image
Ive got a tracking system which tracks how many times a user clicks on an advert on my site. At the moment all the listings are set as one so when a user clicks on that advert it gets one click. However, one of the adverts is now going to contain two images advertising two separate companies.

Ive set it up so the images and urls are different and they go to their own websites and in my tracking table i have just added an extra column called image and the number 1 goes in if image 1 is clicked on or 2 if image 2 is clicked on. However, to display this is the bit im not sure about. At the moment its displayed in a table like this:

Advert Name                Category                      Number of clicks

Advert 1                     Shopping                       257

However, if advert 1 has two images, meaning two separate companies, how can I show this in the above table?

View Replies !
Identifying The Clicked Record
i already know how to load the my list of suppliers using
mysql/php/apache, but what i would like to do now is put a link for
each and every supplier and when someone clicks it, they will
automatically go to that supplier's list of products.

i want something like this:

SUPPLIERS TABLE
supplierID, Name, Address,

AA Alfin21 1506 w. 66th street <>EDIT<>

View Replies !
Identifying The Logged On User
is there a way (in php) to identify the user name used when logging onto a mySQL database? I want to know this so that I can program a basic audit trail on edited records.

View Replies !
Identifying Black Images
I would like to be able to identify completely black images in order that I can exclude them. I am thinking I could use gdlib but I cannot find a suitable function. If I can find the rgb of the image then I can exclude it.

View Replies !
Identifying Individual Users
I know that you can identify users using an ip address. But what if you have several users with different computers in one room sharing the same ip address. Is there anyway to differentiate each individual. Is there a unique signature from the computers that can be used?

View Replies !
Identifying Parts Of A String
$url = /blah/elephant/spaghetti/page.php

This gives you the whole path.

But how can you identify each directory in the url individually?

ie. I want $one to equal 'blah', $two to equal 'elephant' etc.

View Replies !
Identifying Off-site Links
Is there an easy way to identify off-site links using php? For example, on a forum site like phpbuilder.com, I'm looking for code to flag posts that contain: Code:

View Replies !
Identifying A Page Via Hyperlink
I have a page (product_wide.php) that displays sale items. In that page, I "include" a 2nd page that contains hyperlinks to general item categories. The hyperlinks in filternavbar point to product_wide, and display items from the category selected. I need a way, using the same hyperlinks I am using now in filternavbar, to tell, from product_wide, that it was from filternavbar that the link was clicked (as opposed to some other page in the site that takes you to product_wide. I can't change the configuration of the filternavbar url because of duplicate content issues with google.

View Replies !
Identifying Dynamic Form Fields
User goes to page which is a form that asks for some basic info regarding returning products for credit/exchange, and also asks for how many products are going to be returned. Upon submitting, a return authorization form is presented to them with the specified number of product fields. I now want to take the input from this form and email it to myself, as well as, display a confirmation page to the user. The problem I have is a can't say, for instance, echo "$field_name"; because field_name will get created dynamically after the user specifies how many products to return. For example, say the user says 5 products, this will generate a form with field names like:

return_code0 inv_num0 qty0 product0 cre_exch0 stockout0
return_code1 inv_num1 qty1 product1 cre_exch1 stockout1
return_code2 inv_num2 qty2 product2 cre_exch2 stockout2 and so on....

These get created with a for() loop. Once this form is submitted, how can I address the field names? Code:

View Replies !
Identifying If The User Has Placed Invalid Characters
what would the code look like if you wanted to tell the user their info they submitted into a form had invalid characters? would you use ereg?

View Replies !

Copyright © 2005-08 www.BigResource.com, All rights reserved