$_SERVER['REFERER'] & Search Engines
When using the $_SERVER['REFERER'] varible when someone is sent to you site from another via clicking a link etc, how do you dectect search engines spiders/bots. I am doing a voting script and obviously i want to filter the above kind of trafic to keep the stats real.
View Complete Forum Thread with Replies
Sponsored Links:
Related Messages:
Php And Search Engines
I've got a site built around a few php programs, when the page is requested it uses htaccess to call a php program with the page name. This page name is used to extract title/description/keywords/h1/h2/alttext/copy etc from a database and then populate the page. The site works well and I only have 2 or 3 programs to run a large site based on a database. The problem is when I run it through the spider test on this site it doesn't pick up the title/description or keywords. Is this something to do with the page being built on the fly, and if so does anyone have a solution to this?
View Replies !
View Related
Search Engines.
i have a car showroom and i was wondering how i can do it so that seach engines can crawl my showroom. it looks like this detailed.php?model=Cadillac&make=Escalade can anyone point me into the right direction?
View Replies !
View Related
[FAQ] Search Engines And PHP
Q: Is PHP search engine friendly? Q: Will search engine spiders crawl my PHP pages? A: Spiders should crawl anything provided they're accessible. Since, nowadays most of the websites are been developed with PHP, you are not supposed to doubt that. As a proof that PHP pages could be crawled and indexed, refer this Google search <http://www.google.com/search?q=inurl%3Aphp+filetype%3Aphp> Q: How can I submit my website to search engines? Should I use PHP to submit? A: Consult their documents. It is always better to categorize your site and submit to DMoz. Usually, PHP has no role here; but however some search engines (specifically Google and it's sitemap protocol) provides option to inform them the changes using a ping mechanism and here PHP could be used. Refer: http://dmoz.org/add.html http://www.google.com/webmasters/ https://www.google.com/webmasters/s...s/en/about.html Q: How to indentify the spider? A: You may identify it by user agent and or IP. Refer: http://www.iplists.com/ http://joseluis.pellicer.org/ua/ http://www.pgts.com.au/pgtsj/pgtsj0208d.html Q: Will search engines follow redirection? If so, what URL will be get indexed? A: Yes, the final URL Q: Will search engines handle cookies? A: No. Q: Will search engines handle sessions? A: No, if your session is cookies based. If there is a provision for URL rewriting (ie, trans sid feature), it will handle or maintain sessions. Q: All the pages in my website use session. But, I don't want the URL rewriting as it results in uglier URLs (appended with PHPSESSID). A: Then, you may selectively enable trans sid feature only for the search engine spiders by sniffing their user agent and or IP. Q: Will search engines save the links with the session id (PHPSESSID) in the URL? A: Majority of the search engines automatically remove the session id in their index. But, there are also report that few search engines (more specifically MSN) don't remove them; in that case there are chances that the session of more than one user (when they visit the site via search engine) may be shared/hijacked provided there is not enough measures taken into account. Q: How to optimize my site? A: Make the contents accessible. Be sure to validate your HTML and stick to W3C standards; this will help the search engines to see your access your contents easily. But, also remember that most of the SEO (Search Engine Optimization) theories are big hoax and it's a crazy business. If you provide good quality of service in your site, hardly it won't get visibility. Refer: http://www.w3.org/QA/ Q: I prefer more visitors via search engines. What should I do? A: As said, believe in the good quality and you'll definitely be known. You may also opt to advertize in the search engines, if you strongly believe in advertizements. Q: Please give me some quick hacks for my website to get more visitors through search engines. A: Since, many search engines are now contents based (previously and still few search engines used META keywords), enough keywords on the page might help. So, some people use the cloaking technique, in which different content is been provide to spiders by sniffing their user agent string and or IP. Some people use also keyword stuffing techniques, in which the keywords are largley stuffed to a page and probably hidden using CSS or so. And, all such "fooling" techniques are highly against to the search engines' TOS and as a penalty the site might even be get blacklisted. Some search engines like Google even employ people to evaluate the quality of their search results and provide option to lodge complaints against any "fooling" sites. Q: What is PR? A: In search engines context, PR would mean Google's PageRank (tm) algorithm that determines the rank of the page determined through the number of pages linking to it and the rank of the linking pages. Hence, PageRank can be used to find the popularity of that page. However, this would hardly affect the position of a webpage on a search page and can safely be ignored (Some SEO business people may not agree with this) Refer: http://en.wikipedia.org/wiki/PageRank
View Replies !
View Related
Search Engines
I have a site and would like to place a search engine on my site that allows someone to do a search using a search box on my page and searches a number of other sites which then reports it back on one results page. I have a site that has newspaper links on it. I want to have a search box on my site that allows users to do a search of all local newspapers. Say they type in murder, the search box would then go out and search any defined sites for the term murder and then generate a results page (on my server) showing all the match stories from the sites searched.
View Replies !
View Related
Search Engines
i am designing a site and i want users to be able to search through our databases. is this possible with php? is it possible to design a search function that allows users this ability? or, is it more possible to index the pages on the site, and then search through indexed pages?
View Replies !
View Related
Search Engines And Patents
I am thinking of a web application that requires an internal search engine, Im not a php expert, I would hire someone else for this, but it maked me think about some issues. Ive read that companies like yahoo, ask jeeves, google etc. Own the patent for their search algorithms. With this in mind, how would a small company develop a search engine without crossing the legal barrier that these patents impose? Is there such a thing like an open source search algorithm that is good enough to use in commercial websites?
View Replies !
View Related
How Good Are These Search Engines?
I am looking at replacing htdig.org tool with something fast. I came across http://www.site-search-pro.com/ http://www.phpdig.net/ My requirements are, - Users should be able to search across the domains mentioned in the configuration file (all sub-domains of indiainfo.com) - users should be able to search withing a particular domain (just travel.indiainfo.com)
View Replies !
View Related
Php Session Ids And Search Engines.
My website pages (urls) seem to have session ids included in the urls, and i know that will some how effect the search engine prefreces, or anything to the search result, I have no access to the php.ini files, so does anyone know how this problem may be solved through the use of .htaccess files?
View Replies !
View Related
Problem In The Search Engines
I have a site I've ignored for a while, letting it mature. I just did some checking and it's got 1700 pages registered in google....all bad pages using something like: http://www.mydomain.com/index.php?blah-keyword-blah I want to make it so that any queries that include that keyword in the url goes to a proper 404 page.
View Replies !
View Related
Identifying Search Engines
my website is pretty much database driven and i've typically parsed the data in PHP and just output flat HTML. however, i'm trying to save some badwidth by spitting out just the critical information, and have javascript parse out the data. however, i'm kinda worried how search engines would react to this. (especially google) would search engines ignore the keywords if they are inside javascript tags? how do i detect search engines? maybe i can just setup a special script that output's "search-engine-friendly" output.
View Replies !
View Related
Redirecting And Search Engines
I have a script that takes some parameters and redirect using header(). So it has no actual output. So, now I discover that I forgot search engines, and today this script got crawled an insane amount of times. Has this already affected my search engine ranking? How can I restrict the crawlers from indexing this script (which has lots and lots of urls thanks to url rewriting)? I can't use robots meta tags since the script has no actual output, and a robots.txt might prove difficult.
View Replies !
View Related
SESSID And Search Engines
I'm having a problem and was hoping someone could offer some advice.. or at least a theory? I have a site that I've installed a PHP search engine script on. It works great... except that it finds result sets for many different PHP session IDs. I don't want these sessions to be indexed and can't seem to stop it from happening. Code:
View Replies !
View Related
Search Engines With Querys?
I have a site which uses querys like: products.php?prodid=45 Will search engines like google spider these pages or not? If not is there a way where i can get spiders to crawl these pages? Thanks to anyone who can help me with this?
View Replies !
View Related
Detect Search Engines
I have a page that i want google to index but i don't want users to be able to see it without logging in first now i know how to make sure the user is logged in unfortunatly if i leave it at that google msn yahoo and all the other bots will just index the "you havnt logged in message" whats a way i can detect the vistor and if they are a search engine bot display the page as normal otherwise if they are human die("you are not logged in");
View Replies !
View Related
PHP Generated Pages & Search Engines
I'm trying to get a basic idea of how well PHP generated pages can be spidered by search engines? I'm working for a company that keeps two versions of it's site at the moment. One copy run off of a database using CGI, and one copy entirely in HTML so search engines will find them. I've told them that this is just a bad idea, and far too time consuming. I'm under the impression that PHP pages can be found by search engines, am I wrong? I'm going to be running almost their entire database of products off of one file, will the search engines be able to find these if there aren't direct links to them? Any other suggestions as to how to keep their positions in the search engines (very good right now) would be appreciated as well.
View Replies !
View Related
Dynamic Pages Vs Search Engines
I have a how-to-do-it manual like site, related to fishing. I want to add a new interactive question/comment feature to each instructional page on the site. I want (registered) users to be able to add comments at the bottom of each page, similar to the way the php, mysql, apache manuals work. PUNCHLINE_A: I don't want to revert to a system of dynamic links that look like "pagePainter.php?page_id=123" I did that for a while. But every time I edited the site (reloaded the database) all the page_ids changed, and then voila I had stale links spattered all over my Google search results--because the same page now had a slightly different page_id. To avoid that I could associate each page with a unique lookup string that is its server-side file path: pagePainter.php?page_key=/pages/manual/chapter1/engine_repair/carburetors Then the keys wouldn't change everytime I added a few new pages to the system, and reloaded the database. Then my Google search links would remain constant. PUNCHLINE_B: Will the search engines spider and index links that look like that? Or will I have to make a system that spits out the entire page as static html, each time a registered user adds a new page question or comment? Or should I put the comments box in an iframe, which is also a spidering can of worms?
View Replies !
View Related
Php Template System And Search Engines
I've been working on a new design for our website, and we came up with a php template system, which reads a content page from a folder "conent"(html files). as such: index.php?content=pagex Now I was wondering if a searchengine would pick up a page from the pages folder, the viewer would only see the text because the design, menus etc are all being created by the index.php. The above we do not want to happen! is there ny way to avoid such an incident?
View Replies !
View Related
Session Codes And Search Engines
I am using session codes in php to dynamically load content onto my web pages...would this affect my search engine positions. the session id gets attached to every internal link url only for the first web page of a session, then disappears. is this likely to cause problems for me or not?
View Replies !
View Related
Hide Variables From Search Engines
I want to prevent search engines from indexing pages on my site with specific passed variables. I am using variables to track visitors from Google Ads and email newsletters, so having these variables picked up by Search Engines is "messing up" my user statistics. Right now, the highest ranked page on my site when using the domain name as a keyword includes variables from an email newsletter sent to select customers as a means of tracking ROI. Now the stats are no good.
View Replies !
View Related
Provide Links For Search Engines
How do I provide links that search engines can follow if my site is created in PHP and MySql and I always put the session ID in the link (header)? Are there any special tricks? Basically, I want the search engines to be able to find my pages. Do you need to know more.
View Replies !
View Related
Best Way To Switch To The .php Extensions For The Search Engines?
I would like to switch one of my sites to PHP because I like it a lot better than HTML and find it a lot easier and more versatile to use. The only problem is my website has already been indexed for all the HTML pages. What would be the easiest and best way to switch to the .php extensions for the search engines? Should I leave the original .html files there and just put the .php pages on the site map to get indexed (although I am afraid this will be considered duplicate content).
View Replies !
View Related
Database Driven Pages On Search Engines
I know this has been discussed at length in these forums from the searches that I've done, but I have a new question of sorts. Basically, I found several solutions to the problem of using PHP/MySQL database driven pages and getting them listed on search engines. One method that I've chosen entails listing the variables in between backslashes after the name of the document, like this http://www.something.com/index.php/test/1234 After a few problems, I've been able to get all of the pages in the first group (I just added the 2nd and 3rd group today) to list perfectly on Google. I'm psyched about this working on my entire database of 10,000+ products, but I'm worried that I may be overlooking something. If possible, please check out that link and if anyone knows of any shortcomings or pitfalls with using this method, please let me know. Thanks a ton.
View Replies !
View Related
PHP Includes, With Meta Tags & Search Engines
I am dealing with a site that has been organized of the php include function devised into four sections 1. header.php 2. nav.php 3. content.php 4. footer.php Basically, content.php includes the other 3 files in their respected spots. The question that I have, though this organization seem very efficient in order to make quick changes to the site, but how does this effect meta tags that may be indexed by search engines... Since the meta tags exist in one file header.php, then whow does a search engine index a specific page within the site.
View Replies !
View Related
HT://dig And Other Search Engines Wont Look At Query String In Links
I realize that this is no the HT://dig support forum but I haven't been able to get htdig to index my site properly: It will only show one file: index.php when every other files is linked off the main page (i.e. index.php?content=page2.html ) I believe that this search engine is not looking at the QUERY_STRING properly or following the links off the main page. Does anyone know how to get htdig to work on a dynamically generated site - or can you recommend another search engine that would help index and search such a site.
View Replies !
View Related
Multi Language Site With PHP, Mysql And Cookies - How About Search Engines?
I need to make at multilanguage language site, and for that I need to identify the users, and register there choice off language. For that i imagine using cookies, since this is the only way to identify the users. But from what I read search engines ignore cookies, and at the same time I would like the users to be able to send links in there choice of language to there friends, so I would like this sort of url scheme. www.site.com/en/ www.site.com/de/ www.site.com/fr/ ..... But I donīt like the idea of having a lot of duplicate files, with the only difference being a reference to a specific column in my sql database. What to do? How do others solve these problems
View Replies !
View Related
How Do Search Engines React To The "open/save" Dialog?
I have a page that lists a bunch of PDFs. I want to give people the choice whether they want to open it or save it to the disk. To do that I make the link through a php file using the header function (http://www.php.net/manual/en/function.header.php). I do want these PDFs to be read by search engines like google. What does google do when prompted with that dialog box? Does it even "see" it? If it ignores it I want to make a if: if agent is a search engine, then don't put "content-disposition:attachement". (for the file name issue it's no problem since all my urls are made up by mod_rewrite)
View Replies !
View Related
Opendir With $_SERVER['HTTP_HOST'] Or $_SERVER['DOCUMENT_ROOT']
Is there a way to use opendir() using some sort of absolute path? I want a file to open the same directory on my site, no matter from what directory it is called. For example, I have the following variables, but no combination seems to work for me. Q: Does opendir() ONLY deal with relative paths? Q: If opendir() works with absolute path, am I missing something?PHP Code:
View Replies !
View Related
404 Get Referer ?
Is it possible to catch the referer when using a 404 document ? for example, someone surfs to www.test.com/mkqjdfkjdfk mkdjfmqkd doesn't excist, so I want to catch this string to analyze it further on ..
View Replies !
View Related
How To Log Referer
how do i get the last link that someone was at? or better yet, when someone clicks a link from abc.com that takes them to def.com, how do i find out that abc.com's link was clicked if my site is def.com. I know there is something about a referrer, but don't know how to implement/even what it is.
View Replies !
View Related
Referer
Is it possible to get the page anchor name when using $_SERVER['HTTP_REFERER'];? So instead of mysite.com/one.html it'll show mysite.com/one.html#two
View Replies !
View Related
Referer?
I want to make something so that you can only see a page if you have been referred there by a certain page. For example www.bla.com/test.php can only be accessed if the page it was linked from was www.bla.com/test123.php. How would i go about doing this? You don't have to litrally write the code out if you don't want to, just an idea of what i have to learn/read in order to do this (i know basic php, been doing it for a while but ive had a big break so i don't remember much).
View Replies !
View Related
Get Referer
Whenever i use anything to get the referer it turns up blank. I want to get the refering URL and then get a Query from that. IS there anyway? I keep trying and can't even get a snippet on doing it.
View Replies !
View Related
About Referer
I'm doing a traffic module for a site and I encounter a problem. I want to know how to determine witch hits are direct hits on the site and witch hits come from other sites and witch hits have their referrer blocked! Code:
View Replies !
View Related
Referer URL
Surfer is coming from A to B. At B, there's a PHP redirect to C. Site B redirects to C, without giving C referrer information. Site C sees Refferrer field as blank. I'd like site C to see site B as a Refferrer.
View Replies !
View Related
Finding Referer In PHP
I'm trying to determine the location a user has come from when they access a script of mine (a custom web logging script). I've searched the manual for 'referer' but can't find any relevant references and looking at output from phpinfo doesn't shed any light on which, if any, variables might hold info about where the user has come from.
View Replies !
View Related
Getting Referer Of Script In PHP
I need to obtain the URL of the site that called one of my scripts. My code on client side looks like this: <SCRIPT type="text/javascript" src="http://example.com/scripts/apiscript.php?key=[hash of site]"> on server side, what do I have to do to get the referer (calling url), so that I can use it to calcuate the required hash?
View Replies !
View Related
Cache And Referer
if we click on back on this browser, this forum somehow refreshes itself. So I assume it uses something like cache. But what about sometimes, like we're filling up a form and click on submit than later realize we miss out something and this time when we click back, we get a "Warning, page had expired". So is this also using cache? If this two is the same case, how come this forum won't get affected by the expired page? For the HTTP_Referer, I'm sorry but can anyone show some example like how do we stick this function to remember every part of the click on our site link like this forum? I'm really desperate to know this answer and hope someone could just briefly go through these two functions to me (rather than send me to php.net or any site) I don't mean to repeat this and hope no one will get offended by this post. I just need a little explaination.
View Replies !
View Related
How To Find Referer?
Can anyone tell me how to find Referer? This internet security certification company prodive a game and you have to have Referer to pass to next level. I tried telnet to go into their site and "GET" , " Referer" command but I just cant get it. Is there any way I can get it?
View Replies !
View Related
Http Referer?
I'm bulding this web site and I do not want other to link to my pages. I can use on every sinle page the http_referer to detect who's the referer and decide if I have to give access or not... but isn't there a better way of doing this instead of putting a piece of code on very single page ?
View Replies !
View Related
|
TRACKER
