Identifying Search Engines
my website is pretty much database driven and i've typically parsed the data in PHP and just output flat HTML. however, i'm trying to save some badwidth by spitting out just the critical information, and have javascript parse out the data.
however, i'm kinda worried how search engines would react to this. (especially google) would search engines ignore the keywords if they are inside javascript tags? how do i detect search engines? maybe i can just setup a special script that output's "search-engine-friendly" output.
View Complete Forum Thread with Replies
Related Forum Messages:
Php And Search Engines
I've got a site built around a few php programs, when the page is requested it uses htaccess to call a php program with the page name. This page name is used to extract title/description/keywords/h1/h2/alttext/copy etc from a database and then populate the page. The site works well and I only have 2 or 3 programs to run a large site based on a database. The problem is when I run it through the spider test on this site it doesn't pick up the title/description or keywords. Is this something to do with the page being built on the fly, and if so does anyone have a solution to this?
View Replies !
Search Engines.
i have a car showroom and i was wondering how i can do it so that seach engines can crawl my showroom. it looks like this detailed.php?model=Cadillac&make=Escalade can anyone point me into the right direction?
View Replies !
[FAQ] Search Engines And PHP
Q: Is PHP search engine friendly? Q: Will search engine spiders crawl my PHP pages? A: Spiders should crawl anything provided they're accessible. Since, nowadays most of the websites are been developed with PHP, you are not supposed to doubt that. As a proof that PHP pages could be crawled and indexed, refer this Google search <http://www.google.com/search?q=inurl%3Aphp+filetype%3Aphp> Q: How can I submit my website to search engines? Should I use PHP to submit? A: Consult their documents. It is always better to categorize your site and submit to DMoz. Usually, PHP has no role here; but however some search engines (specifically Google and it's sitemap protocol) provides option to inform them the changes using a ping mechanism and here PHP could be used. Refer: http://dmoz.org/add.html http://www.google.com/webmasters/ https://www.google.com/webmasters/s...s/en/about.html Q: How to indentify the spider? A: You may identify it by user agent and or IP. Refer: http://www.iplists.com/ http://joseluis.pellicer.org/ua/ http://www.pgts.com.au/pgtsj/pgtsj0208d.html Q: Will search engines follow redirection? If so, what URL will be get indexed? A: Yes, the final URL Q: Will search engines handle cookies? A: No. Q: Will search engines handle sessions? A: No, if your session is cookies based. If there is a provision for URL rewriting (ie, trans sid feature), it will handle or maintain sessions. Q: All the pages in my website use session. But, I don't want the URL rewriting as it results in uglier URLs (appended with PHPSESSID). A: Then, you may selectively enable trans sid feature only for the search engine spiders by sniffing their user agent and or IP. Q: Will search engines save the links with the session id (PHPSESSID) in the URL? A: Majority of the search engines automatically remove the session id in their index. But, there are also report that few search engines (more specifically MSN) don't remove them; in that case there are chances that the session of more than one user (when they visit the site via search engine) may be shared/hijacked provided there is not enough measures taken into account. Q: How to optimize my site? A: Make the contents accessible. Be sure to validate your HTML and stick to W3C standards; this will help the search engines to see your access your contents easily. But, also remember that most of the SEO (Search Engine Optimization) theories are big hoax and it's a crazy business. If you provide good quality of service in your site, hardly it won't get visibility. Refer: http://www.w3.org/QA/ Q: I prefer more visitors via search engines. What should I do? A: As said, believe in the good quality and you'll definitely be known. You may also opt to advertize in the search engines, if you strongly believe in advertizements. Q: Please give me some quick hacks for my website to get more visitors through search engines. A: Since, many search engines are now contents based (previously and still few search engines used META keywords), enough keywords on the page might help. So, some people use the cloaking technique, in which different content is been provide to spiders by sniffing their user agent string and or IP. Some people use also keyword stuffing techniques, in which the keywords are largley stuffed to a page and probably hidden using CSS or so. And, all such "fooling" techniques are highly against to the search engines' TOS and as a penalty the site might even be get blacklisted. Some search engines like Google even employ people to evaluate the quality of their search results and provide option to lodge complaints against any "fooling" sites. Q: What is PR? A: In search engines context, PR would mean Google's PageRank (tm) algorithm that determines the rank of the page determined through the number of pages linking to it and the rank of the linking pages. Hence, PageRank can be used to find the popularity of that page. However, this would hardly affect the position of a webpage on a search page and can safely be ignored (Some SEO business people may not agree with this) Refer: http://en.wikipedia.org/wiki/PageRank
View Replies !
Search Engines
I have a site and would like to place a search engine on my site that allows someone to do a search using a search box on my page and searches a number of other sites which then reports it back on one results page. I have a site that has newspaper links on it. I want to have a search box on my site that allows users to do a search of all local newspapers. Say they type in murder, the search box would then go out and search any defined sites for the term murder and then generate a results page (on my server) showing all the match stories from the sites searched.
View Replies !
Search Engines
i am designing a site and i want users to be able to search through our databases. is this possible with php? is it possible to design a search function that allows users this ability? or, is it more possible to index the pages on the site, and then search through indexed pages?
View Replies !
Header() And Search Engines.
I would like to have a log of visitors which are referred to other sites by mine. I can do this by giving them a reference to a page on my site which would contain the following: PHP Code:
View Replies !
Search Engines And Patents
I am thinking of a web application that requires an internal search engine, Im not a php expert, I would hire someone else for this, but it maked me think about some issues. Ive read that companies like yahoo, ask jeeves, google etc. Own the patent for their search algorithms. With this in mind, how would a small company develop a search engine without crossing the legal barrier that these patents impose? Is there such a thing like an open source search algorithm that is good enough to use in commercial websites?
View Replies !
How Good Are These Search Engines?
I am looking at replacing htdig.org tool with something fast. I came across http://www.site-search-pro.com/ http://www.phpdig.net/ My requirements are, - Users should be able to search across the domains mentioned in the configuration file (all sub-domains of indiainfo.com) - users should be able to search withing a particular domain (just travel.indiainfo.com)
View Replies !
Php Session Ids And Search Engines.
My website pages (urls) seem to have session ids included in the urls, and i know that will some how effect the search engine prefreces, or anything to the search result, I have no access to the php.ini files, so does anyone know how this problem may be solved through the use of .htaccess files?
View Replies !
Problem In The Search Engines
I have a site I've ignored for a while, letting it mature. I just did some checking and it's got 1700 pages registered in google....all bad pages using something like: http://www.mydomain.com/index.php?blah-keyword-blah I want to make it so that any queries that include that keyword in the url goes to a proper 404 page.
View Replies !
Redirecting And Search Engines
I have a script that takes some parameters and redirect using header(). So it has no actual output. So, now I discover that I forgot search engines, and today this script got crawled an insane amount of times. Has this already affected my search engine ranking? How can I restrict the crawlers from indexing this script (which has lots and lots of urls thanks to url rewriting)? I can't use robots meta tags since the script has no actual output, and a robots.txt might prove difficult.
View Replies !
SESSID And Search Engines
I'm having a problem and was hoping someone could offer some advice.. or at least a theory? I have a site that I've installed a PHP search engine script on. It works great... except that it finds result sets for many different PHP session IDs. I don't want these sessions to be indexed and can't seem to stop it from happening. Code:
View Replies !
Search Engines With Querys?
I have a site which uses querys like: products.php?prodid=45 Will search engines like google spider these pages or not? If not is there a way where i can get spiders to crawl these pages? Thanks to anyone who can help me with this?
View Replies !
Detect Search Engines
I have a page that i want google to index but i don't want users to be able to see it without logging in first now i know how to make sure the user is logged in unfortunatly if i leave it at that google msn yahoo and all the other bots will just index the "you havnt logged in message" whats a way i can detect the vistor and if they are a search engine bot display the page as normal otherwise if they are human die("you are not logged in");
View Replies !
PHP Generated Pages & Search Engines
I'm trying to get a basic idea of how well PHP generated pages can be spidered by search engines? I'm working for a company that keeps two versions of it's site at the moment. One copy run off of a database using CGI, and one copy entirely in HTML so search engines will find them. I've told them that this is just a bad idea, and far too time consuming. I'm under the impression that PHP pages can be found by search engines, am I wrong? I'm going to be running almost their entire database of products off of one file, will the search engines be able to find these if there aren't direct links to them? Any other suggestions as to how to keep their positions in the search engines (very good right now) would be appreciated as well.
View Replies !
Dynamic Pages Vs Search Engines
I have a how-to-do-it manual like site, related to fishing. I want to add a new interactive question/comment feature to each instructional page on the site. I want (registered) users to be able to add comments at the bottom of each page, similar to the way the php, mysql, apache manuals work. PUNCHLINE_A: I don't want to revert to a system of dynamic links that look like "pagePainter.php?page_id=123" I did that for a while. But every time I edited the site (reloaded the database) all the page_ids changed, and then voila I had stale links spattered all over my Google search results--because the same page now had a slightly different page_id. To avoid that I could associate each page with a unique lookup string that is its server-side file path: pagePainter.php?page_key=/pages/manual/chapter1/engine_repair/carburetors Then the keys wouldn't change everytime I added a few new pages to the system, and reloaded the database. Then my Google search links would remain constant. PUNCHLINE_B: Will the search engines spider and index links that look like that? Or will I have to make a system that spits out the entire page as static html, each time a registered user adds a new page question or comment? Or should I put the comments box in an iframe, which is also a spidering can of worms?
View Replies !
Php Template System And Search Engines
I've been working on a new design for our website, and we came up with a php template system, which reads a content page from a folder "conent"(html files). as such: index.php?content=pagex Now I was wondering if a searchengine would pick up a page from the pages folder, the viewer would only see the text because the design, menus etc are all being created by the index.php. The above we do not want to happen! is there ny way to avoid such an incident?
View Replies !
Dynamic Pages With Search Engines
We know search engines cannot index many database-driven pages basically any page with a '?' or '&' in the URL, and i want to ask if is there en way to transform that simbols in / for example.
View Replies !
$_SERVER['REFERER'] & Search Engines
When using the $_SERVER['REFERER'] varible when someone is sent to you site from another via clicking a link etc, how do you dectect search engines spiders/bots. I am doing a voting script and obviously i want to filter the above kind of trafic to keep the stats real.
View Replies !
Session Codes And Search Engines
I am using session codes in php to dynamically load content onto my web pages...would this affect my search engine positions. the session id gets attached to every internal link url only for the first web page of a session, then disappears. is this likely to cause problems for me or not?
View Replies !
Hide Variables From Search Engines
I want to prevent search engines from indexing pages on my site with specific passed variables. I am using variables to track visitors from Google Ads and email newsletters, so having these variables picked up by Search Engines is "messing up" my user statistics. Right now, the highest ranked page on my site when using the domain name as a keyword includes variables from an email newsletter sent to select customers as a means of tracking ROI. Now the stats are no good.
View Replies !
Provide Links For Search Engines
How do I provide links that search engines can follow if my site is created in PHP and MySql and I always put the session ID in the link (header)? Are there any special tricks? Basically, I want the search engines to be able to find my pages. Do you need to know more.
View Replies !
Best Way To Switch To The .php Extensions For The Search Engines?
I would like to switch one of my sites to PHP because I like it a lot better than HTML and find it a lot easier and more versatile to use. The only problem is my website has already been indexed for all the HTML pages. What would be the easiest and best way to switch to the .php extensions for the search engines? Should I leave the original .html files there and just put the .php pages on the site map to get indexed (although I am afraid this will be considered duplicate content).
View Replies !
Database Driven Pages On Search Engines
I know this has been discussed at length in these forums from the searches that I've done, but I have a new question of sorts. Basically, I found several solutions to the problem of using PHP/MySQL database driven pages and getting them listed on search engines. One method that I've chosen entails listing the variables in between backslashes after the name of the document, like this http://www.something.com/index.php/test/1234 After a few problems, I've been able to get all of the pages in the first group (I just added the 2nd and 3rd group today) to list perfectly on Google. I'm psyched about this working on my entire database of 10,000+ products, but I'm worried that I may be overlooking something. If possible, please check out that link and if anyone knows of any shortcomings or pitfalls with using this method, please let me know. Thanks a ton.
View Replies !
PHP Includes, With Meta Tags & Search Engines
I am dealing with a site that has been organized of the php include function devised into four sections 1. header.php 2. nav.php 3. content.php 4. footer.php Basically, content.php includes the other 3 files in their respected spots. The question that I have, though this organization seem very efficient in order to make quick changes to the site, but how does this effect meta tags that may be indexed by search engines... Since the meta tags exist in one file header.php, then whow does a search engine index a specific page within the site.
View Replies !
HT://dig And Other Search Engines Wont Look At Query String In Links
I realize that this is no the HT://dig support forum but I haven't been able to get htdig to index my site properly: It will only show one file: index.php when every other files is linked off the main page (i.e. index.php?content=page2.html ) I believe that this search engine is not looking at the QUERY_STRING properly or following the links off the main page. Does anyone know how to get htdig to work on a dynamically generated site - or can you recommend another search engine that would help index and search such a site.
View Replies !
Multi Language Site With PHP, Mysql And Cookies - How About Search Engines?
I need to make at multilanguage language site, and for that I need to identify the users, and register there choice off language. For that i imagine using cookies, since this is the only way to identify the users. But from what I read search engines ignore cookies, and at the same time I would like the users to be able to send links in there choice of language to there friends, so I would like this sort of url scheme. www.site.com/en/ www.site.com/de/ www.site.com/fr/ ..... But I don´t like the idea of having a lot of duplicate files, with the only difference being a reference to a specific column in my sql database. What to do? How do others solve these problems
View Replies !
How Do Search Engines React To The "open/save" Dialog?
I have a page that lists a bunch of PDFs. I want to give people the choice whether they want to open it or save it to the disk. To do that I make the link through a php file using the header function (http://www.php.net/manual/en/function.header.php). I do want these PDFs to be read by search engines like google. What does google do when prompted with that dialog box? Does it even "see" it? If it ignores it I want to make a if: if agent is a search engine, then don't put "content-disposition:attachement". (for the file name issue it's no problem since all my urls are made up by mod_rewrite)
View Replies !
Identifying Browser
Is there a way to identify the brwser a visitor to my site is using? I would like to include site style based on the visitor's browser. If their us IE show layout one way, if their using Firefox show it another way...etc...etc.
View Replies !
Identifying People
on my website i'm finding people are coming back and signing up again and again... how can i log them so i know who has logged in before. was thinking IP but does this not change per session online with dial up?
View Replies !
Identifying A Value Range
i have a form that submits to a php file, the form basically has a hidden field called number: <input type="hidden" name="number" value="12"> i know how to read the value of that, its simply putting <?php echo $_POST['number']?> but what i want to do is check if the number is between 1 and 25 and if it is then echo A else if it is between 25-75 then echo B else if it is anything above 75 then echo C .
View Replies !
Identifying SSL Clients
I have a site that uses PHP sessions through SSL, my employer does not wish the site to require cookies so I have switched on the use_trans_sid option for users who have cookies disabled. The problem I have is stopping session hijacking. If I am on a page "https://secure.mysite.com/page.php?PHPSESSID=XXXXX" And I email the url to someone else they can get onto the site without being challenged for a logon. I am trying to find a way to check that the connection is still coming from the same SSL connection, e.g. by checking the clients public key, but I can't find a way to get any information about the SSL connection from PHP.
View Replies !
Identifying An Image
Ive got a tracking system which tracks how many times a user clicks on an advert on my site. At the moment all the listings are set as one so when a user clicks on that advert it gets one click. However, one of the adverts is now going to contain two images advertising two separate companies. Ive set it up so the images and urls are different and they go to their own websites and in my tracking table i have just added an extra column called image and the number 1 goes in if image 1 is clicked on or 2 if image 2 is clicked on. However, to display this is the bit im not sure about. At the moment its displayed in a table like this: Advert Name Category Number of clicks Advert 1 Shopping 257 However, if advert 1 has two images, meaning two separate companies, how can I show this in the above table?
View Replies !
Identifying The Clicked Record
i already know how to load the my list of suppliers using mysql/php/apache, but what i would like to do now is put a link for each and every supplier and when someone clicks it, they will automatically go to that supplier's list of products. i want something like this: SUPPLIERS TABLE supplierID, Name, Address, AA Alfin21 1506 w. 66th street <>EDIT<>
View Replies !
Identifying Black Images
I would like to be able to identify completely black images in order that I can exclude them. I am thinking I could use gdlib but I cannot find a suitable function. If I can find the rgb of the image then I can exclude it.
View Replies !
Identifying Individual Users
I know that you can identify users using an ip address. But what if you have several users with different computers in one room sharing the same ip address. Is there anyway to differentiate each individual. Is there a unique signature from the computers that can be used?
View Replies !
Identifying Parts Of A String
$url = /blah/elephant/spaghetti/page.php This gives you the whole path. But how can you identify each directory in the url individually? ie. I want $one to equal 'blah', $two to equal 'elephant' etc.
View Replies !
Identifying Off-site Links
Is there an easy way to identify off-site links using php? For example, on a forum site like phpbuilder.com, I'm looking for code to flag posts that contain: Code:
View Replies !
Identifying A Page Via Hyperlink
I have a page (product_wide.php) that displays sale items. In that page, I "include" a 2nd page that contains hyperlinks to general item categories. The hyperlinks in filternavbar point to product_wide, and display items from the category selected. I need a way, using the same hyperlinks I am using now in filternavbar, to tell, from product_wide, that it was from filternavbar that the link was clicked (as opposed to some other page in the site that takes you to product_wide. I can't change the configuration of the filternavbar url because of duplicate content issues with google.
View Replies !
Identifying Dynamic Form Fields
User goes to page which is a form that asks for some basic info regarding returning products for credit/exchange, and also asks for how many products are going to be returned. Upon submitting, a return authorization form is presented to them with the specified number of product fields. I now want to take the input from this form and email it to myself, as well as, display a confirmation page to the user. The problem I have is a can't say, for instance, echo "$field_name"; because field_name will get created dynamically after the user specifies how many products to return. For example, say the user says 5 products, this will generate a form with field names like: return_code0 inv_num0 qty0 product0 cre_exch0 stockout0 return_code1 inv_num1 qty1 product1 cre_exch1 stockout1 return_code2 inv_num2 qty2 product2 cre_exch2 stockout2 and so on.... These get created with a for() loop. Once this form is submitted, how can I address the field names? Code:
View Replies !
|