Tracking Forums, Newsgroups, Maling Lists
Home Scripts Tutorials Tracker Forums
 
  HOME    TRACKER    PHP




Database Driven Pages On Search Engines


I know this has been discussed at length in these forums from the searches that I've done, but I have a new question of sorts. Basically, I found several solutions to the problem of using PHP/MySQL database driven pages and getting them listed on search engines. One method that I've chosen entails listing the variables in between backslashes after the name of the document, like this http://www.something.com/index.php/test/1234

After a few problems, I've been able to get all of the pages in the first group (I just added the 2nd and 3rd group today) to list perfectly on Google. I'm psyched about this working on my entire database of 10,000+ products, but I'm worried that I may be overlooking something.

If possible, please check out that link and if anyone knows of any shortcomings or pitfalls with using this method, please let me know. Thanks a ton.




View Complete Forum Thread with Replies

See Related Forum Messages: Follow the Links Below to View Complete Thread
PHP Pages And Search Engines
I am in development of my site and alot of the site has php3 pages. What i need to know is, does search engines index PHP3 pages?

PHP Generated Pages & Search Engines
I'm trying to get a basic idea of how well PHP generated pages can be spidered by search engines? I'm working for a company that keeps two versions of it's site at the moment. One copy run off of a database using CGI, and one copy entirely in HTML so search engines will find them. I've told them that this is just a bad idea, and far too time consuming. I'm under the impression that PHP pages can be found by search engines, am I wrong? I'm going to be running almost their entire database of products off of one file, will the search engines be able to find these if there aren't direct links to them?

Any other suggestions as to how to keep their positions in the search engines (very good right now) would be appreciated as well.

Dynamic Pages Vs Search Engines
I have a how-to-do-it manual like site,
related to fishing. I want to add a new
interactive question/comment feature to each
instructional page on the site.

I want (registered) users to be able to add
comments at the bottom of each page, similar
to the way the php, mysql, apache manuals work.

PUNCHLINE_A:
I don't want to revert to a system of dynamic links
that look like "pagePainter.php?page_id=123"

I did that for a while. But every time I edited
the site (reloaded the database) all the page_ids
changed, and then voila I had stale links spattered
all over my Google search results--because the
same page now had a slightly different page_id.

To avoid that I could associate each page with
a unique lookup string that is its server-side file path:

pagePainter.php?page_key=/pages/manual/chapter1/engine_repair/carburetors

Then the keys wouldn't change everytime I added a few new pages
to the system, and reloaded the database. Then my Google search
links would remain constant.

PUNCHLINE_B:
Will the search engines spider and index links that look like that?
Or will I have to make a system that spits out the entire page as static
html, each time a registered user adds a new page question or comment?

Or should I put the comments box in an iframe, which is also a spidering
can of worms?

Dynamic Pages With Search Engines
We know search engines cannot index many database-driven pages basically any page with a '?' or '&' in the URL, and i want to ask if is there en way to transform that simbols in / for example.

Relative Vs. Absolute Links In Php Driven Pages?
If you are dynamically loading pages, through php, from inside a folder that
have relative links to images inside the same folder, into another document
(a template) in a different folder level, the links will be broken.

Is there some magic trick to dealing with this, or is it just better to
never use relative links in a site that will be dynamically driven with php?

Search Multiple Search Engines
Does anyone know how it may be possible to write some code to search multiple search engines?

Php And Search Engines
Ok I really love php and wish to use it for a lot of my web projects. However there is one main downside especially for e-commerce and that is that the php and database generation is not indexed by search engine spiders.
Which is unfortunate since in my testing dynamically generated sites seem to be much quicker than static ones.
So what is the answer, I have developed a few scripts which index the database to produce static html, however is there a better way?

Php And Search Engines
I've got a site built around a few php programs, when the page is requested it uses htaccess to call a php program with the page name. This page name is used to extract title/description/keywords/h1/h2/alttext/copy etc from a database and then populate the page. The site works well and I only have 2 or 3 programs to run a large site based on a database. The problem is when I run it through the spider test on this site it doesn't pick up the title/description or keywords. Is this something to do with the page being built on the fly, and if so does anyone have a solution to this?

Search Engines.
i have a car showroom and i was wondering how i can do it so that seach engines can crawl my showroom. it looks like this detailed.php?model=Cadillac&make=Escalade can anyone point me into the right direction?

[FAQ] Search Engines And PHP
Q: Is PHP search engine friendly?
Q: Will search engine spiders crawl my PHP pages?

A:
Spiders should crawl anything provided they're accessible. Since,
nowadays most of the websites are been developed with PHP, you are not
supposed to doubt that.

As a proof that PHP pages could be crawled and indexed, refer this
Google search
<http://www.google.com/search?q=inurl%3Aphp+filetype%3Aphp>

Q: How can I submit my website to search engines? Should I use PHP to
submit?
A: Consult their documents. It is always better to categorize your site
and submit to DMoz. Usually, PHP has no role here; but however some
search engines (specifically Google and it's sitemap protocol) provides
option to inform them the changes using a ping mechanism and here PHP
could be used.

Refer:
http://dmoz.org/add.html
http://www.google.com/webmasters/
https://www.google.com/webmasters/s...s/en/about.html

Q: How to indentify the spider?
A: You may identify it by user agent and or IP.

Refer:
http://www.iplists.com/
http://joseluis.pellicer.org/ua/
http://www.pgts.com.au/pgtsj/pgtsj0208d.html

Q: Will search engines follow redirection? If so, what URL will be get
indexed?
A: Yes, the final URL

Q: Will search engines handle cookies?
A: No.

Q: Will search engines handle sessions?
A: No, if your session is cookies based. If there is a provision for
URL rewriting (ie, trans sid feature), it will handle or maintain
sessions.

Q: All the pages in my website use session. But, I don't want the URL
rewriting as it results in uglier URLs (appended with PHPSESSID).
A: Then, you may selectively enable trans sid feature only for the
search engine spiders by sniffing their user agent and or IP.

Q: Will search engines save the links with the session id (PHPSESSID)
in the URL?
A: Majority of the search engines automatically remove the session id
in their index. But, there are also report that few search engines
(more specifically MSN) don't remove them; in that case there are
chances that the session of more than one user (when they visit the
site via search engine) may be shared/hijacked provided there is not
enough measures taken into account.

Q: How to optimize my site?
A:
Make the contents accessible. Be sure to validate your HTML and stick
to W3C standards; this will help the search engines to see your access
your contents easily.

But, also remember that most of the SEO (Search Engine Optimization)
theories are big hoax and it's a crazy business. If you provide good
quality of service in your site, hardly it won't get visibility.

Refer:
http://www.w3.org/QA/

Q: I prefer more visitors via search engines. What should I do?
A: As said, believe in the good quality and you'll definitely be known.
You may also opt to advertize in the search engines, if you strongly
believe in advertizements.

Q: Please give me some quick hacks for my website to get more visitors
through search engines.
A: Since, many search engines are now contents based (previously and
still few search engines used META keywords), enough keywords on the
page might help.

So, some people use the cloaking technique, in which different content
is been provide to spiders by sniffing their user agent string and or
IP. Some people use also keyword stuffing techniques, in which the
keywords are largley stuffed to a page and probably hidden using CSS or
so. And, all such "fooling" techniques are highly against to the search
engines' TOS and as a penalty the site might even be get blacklisted.
Some search engines like Google even employ people to evaluate the
quality of their search results and provide option to lodge complaints
against any "fooling" sites.

Q: What is PR?
A: In search engines context, PR would mean Google's PageRank (tm)
algorithm that determines the rank of the page determined through the
number of pages linking to it and the rank of the linking pages. Hence,
PageRank can be used to find the popularity of that page. However, this
would hardly affect the position of a webpage on a search page and can
safely be ignored (Some SEO business people may not agree with this)

Refer:
http://en.wikipedia.org/wiki/PageRank

Header() And Search Engines.
I would like to have a log of visitors which are referred to other sites by mine. I can do this by giving them a reference to a page on my site which would contain the following:
PHP Code:

Search Engines And Patents
I am thinking of a web application that requires an internal search engine, Im not a php expert, I would hire someone else for this, but it maked me think about some issues.
Ive read that companies like yahoo, ask jeeves, google etc. Own the patent for their search algorithms.

With this in mind, how would a small company develop a search engine without crossing the legal barrier that these patents impose? Is there such a thing like an open source search algorithm that is good enough to use in commercial websites?

How Good Are These Search Engines?
I am looking at replacing htdig.org tool with something fast. I came
across

http://www.site-search-pro.com/
http://www.phpdig.net/

My requirements are,

- Users should be able to search across the domains mentioned in the
configuration file (all sub-domains of indiainfo.com)
- users should be able to search withing a particular domain (just
travel.indiainfo.com)

Php Session Ids And Search Engines.
My website pages (urls) seem to have session ids included in the urls, and i know that will some how effect the search engine prefreces, or anything to the search result, I have no access to the php.ini files, so does anyone know how this problem may be solved through the use of .htaccess files?

Php Template System And Search Engines
I've been working on a new design for our website, and we came up with a php template system, which reads a content page from a folder "conent"(html files). as such: index.php?content=pagex

Now I was wondering if a searchengine would pick up a page from the pages folder, the viewer would only see the text because the design, menus etc are all being created by the index.php.

The above we do not want to happen! is there ny way to avoid such an incident?

Php Files Can't Be Indexed By Search Engines
is it true that php files can't be search/find by a search engine? only html files can be searched? if yes, how come php files can't be search.

PHP Includes, With Meta Tags & Search Engines
I am dealing with a site that has been organized of the php include function devised into four sections 1. header.php 2. nav.php 3. content.php 4. footer.php Basically, content.php includes the other 3 files in their respected spots.

The question that I have, though this organization seem very efficient in order to make quick changes to the site, but how does this effect meta tags that may be indexed by search engines... Since the meta tags exist in one file header.php, then whow does a search engine index a specific page within the site.

HT://dig And Other Search Engines Wont Look At Query String In Links
I realize that this is no the HT://dig support forum but I haven't been able to get htdig to index my site properly:

It will only show one file: index.php when every other files is linked off the main page (i.e. index.php?content=page2.html ) I believe that this search engine is not looking at the QUERY_STRING properly or following the links off the main page.

Does anyone know how to get htdig to work on a dynamically generated site - or can you recommend another search engine that would help index and search such a site.

Hide Javascript Code From Browsers And Search Engines
I want to hide the javascript code in a php file because it uses a resource from another website, and if the code is visible, search engines are spidering that php page, and also the scripts in it.

Database Driven Drop Down Menu
I'm trying to create a database driven drop down menu. I feel I'm on to the right path but my code doesn't seem to work. I've looked around and haven't seen where I'm making the mistake. Any one care to take a look? Code:

Multi Language Site With PHP, Mysql And Cookies - How About Search Engines?
I need to make at multilanguage language site, and for that I need to
identify the users, and register there choice off language. For that i
imagine using cookies, since this is the only way to identify the
users. But from what I read search engines ignore cookies, and at the
same time I would like the users to be able to send links in there
choice of language to there friends, so I would like this sort of url
scheme.

www.site.com/en/
www.site.com/de/
www.site.com/fr/
.....

But I donīt like the idea of having a lot of duplicate files, with the
only difference being a reference to a specific column in my sql
database. What to do? How do others solve these problems

Peer Review For Database Driven Web Site
I'm working on a database driven web site using object-oriented programming. I am a novice and am looking for peers to review what I have done.

I Want Search Script Which Can Search All Pages Under Given URL
I want search script which can search all pages under given URL...
because i want to search my text in given website (like Google's
Domain search)

Looking For A Database-driven Email "contact Manager" Application
I'm going to be collecting lots (a few thousand) email addys. Each of
these people will be interested in recieving mail on one or more
topics, with an open ended and growing number of topics. Mailman with
a BD application behing it might be ideal as it would let users add
and delete themselves and each topic would have it's own email list
name identity.

Search Pages
I am making an application that lets you upload pics to a server and also adds the directory to a DB. Now I just need to display the pics and I want to do it a page a picture. Kinda like a search page. AV or Google style. But instead of a link its a pic and then you can choose to go to the next one by clicking on a link. But the whole time it's one dynamic page pulling info off of a mySQL database.

Splitting A Search Into Pages
After trial, error, 2 days reading about PHP and some fine Single Malt,
have finally created a search from a database with multiple criteria as
below.

NOTE comments on tidying the code up are welcomed.

BUT.... if I want to split the search into groups of 10 and then (like
Google) prompt for page 2 of 10, 3 of 10 etc.

Anyone know of any tutorials on this?

<?php
$result = @mysql_query ("SELECT name, townname, town, townid, photo
FROM site01_towns, site01_details WHERE townname='$townsearch' AND
town=townid AND code='sleep'");
while ($row = mysql_fetch_array($result))
{
$photoname = $row['photo'];
$company = $row['name'];
?>

<div align="center">
<center>
<table border="0" cellpadding="0" cellspacing="0" width="400"
height="95">
<tr>
<td valign="top"><?php echo '<p>' . $row['name'] . '</p>' ?></td>
<td valign="middle" width="140"><img src="images/<?php print
$photoname; ?>" border="0"/></td>
</tr>
</table>
</center>
</div>

<?php
}
?>

Display Search Results In Pages
im doing a query on a table that searches articles from the database, and i was wondering how i could display the results as groups of ten, so the next ten search matches are displayed when the user presses a page number.

Displaying Search Results In Pages
I am implementing search functionality in a website. ( internal search).
In that I am taking a keyword as input and searching all the pages and storing
results in an array. I want to display 10 results per page. I wrote below logic for that. Code:

Want PHP Code To Search All The Pages In A Website
i just want to know some code that would retrieve all the pages fron a given website with... that when i give a wesite to code it fetches all the pages in that and make a list for all with address.

Distribute Search Result In Pages - Pagination
How can I distribute a search result in different
pages? For example I have 10 search results (searching
for database) and I would like to get 7 results per
page. So there will be 2 pages, first 7 results in
first page and rest 3 results in second pages. I am
just simply querying from the database.

What will be the best and easy sollution?

Highlight Search Terms In Results Pages
I am trying to find a script or code that will highlight search terms output from my MySql db. I have posted a portion of my pagination page below. The pagination script provides ten records at a time.

For example, I need code, a script, or a funtion to grab the search term coming from the user and generate highlighted keywords when the keywords are entered by the user in the html forms search box.

In the code below, I have inserted sample code so you can see how the display appears. In actual practice, the $Source, $Topic, $Subtopic, and $References values come from the while(list($Source, $Topic,$Subtopic,$References)= mysql_fetch_row($result2)) { code line. Code:

Crawling Google Search Result Pages
I want to make a crawler in php that will crawl google search results for given keywords. Procedure will be something like this:

1. There will be a list of thousands keywords in file with csv or other format.

2. Crawler will crawl google.co.in for each keywords in the file.

3. Top 10 results title, description and the url will be collected and stored in MySQL database.

4. Now crawler will crawl for next keyword after some delay and loop will go on unless reach to daily limit of keywords to crawl. Then next day it will start again.

I need some suggestion on:

1. How to crawl pages without using any addons.
(Because I am going to run this from an free server not my machine so I will only have php, mysql and general features. )

2. What kind of parsing I should use to extract title, description and urls from HTML code.

3. What should be the delay and daily crawl limit. ( I don't want to get banned by google for automatic query. )

Database Search -text Database...
Can anybody tell me how to search a flat file database delimited by |. I have exploded the data and managed to get it into a table but want to restrict the final table contents by a search.

The table code at the moment is below - I'd be using a htm file to submit the data. and hopefully be able to search by partial searches eg big would return big and bigfoot. Code:

Sort Pages Of Records From Database
When I sort dates from my sql database, the records sort all in one time.I would like to sort only 20/25 records and after to clik a button and sort other 20/25 records and so on.

How To Make A Database Connection Available To All Pages?
How can I make a database connection available to all the pages in my
application? I tried doing it with session but it doesn't seem to work.

here's what a did:

How To Display Data From Database In Different Web Pages?
When we get data from database by use mssql_query(),suppose the data is very large ,it has many rows, and we want display the data in different web pages like many search engines do, my question is how to do that using the same result without call mssql_query() again?

How To Obscure Database Info In PHP Pages
I'm moving from Cold Fusion to PHP and I have a question that none of
the books I have answers adequately:
In Cold Fusion, database connection parameters like the table, username
and password are configured on the server. Since they are at the
backend, nothing is exposed on the page except the queries themselves.
In PHP, from what I see, the database info is on the page. Is this not a
security risk? How can one be sure that this info is not on the page
sent to the user?

Call My Html/php Pages From A MySql Database
I wanted to call my html/php pages from a MySql database. But when I view the data in the table on my site it just shows the php statements as text. Is there a way to fix this?

Display Results From A Database On Multiple Pages
I am new to PHP and Mysql but am really determined to learn these techniques. I have some script that reads and displays results from the databse onto a page. However, I really wish to limit the number of results that are displayed to 10 per page and then have the next/privious links under the results. With these results, the results under the email field should be hyperlinked so that the person viewing the results should double click on the email link and send the person an email. How can i do that? I have to learn this technique.

The code is:-

PHP Script To Generate Static Pages From MySql Database.
I need to create static pages from a database and I cannot find such a script. 
The script must be able to create a static page from every record in the table and give it a URL and also create a static index page with links to the pages created from the table.

How To Display Mysql Database Information In Multiple Pages?
how to display mysql database information in multiple pages? i would like to display all my member with consist of 400 people and i wan it list in mulitiple pages, and contain a "delete tick" for me,and when i click the member, can redirect me to member detail imformation. it just similiar to email pages of yahoo inbox.

Which Tool To Use To Create Form For A Database? How To Build A Interfaces (or Web Pages) In Easy Way?
how to build a interfaces (or web pages) in easy way? how to build a form in easy way? how to automate and create web pages with a tool? which tool to use to create form for a database? I mean there is a way or a tool which help me to build an interfaces (web pages) to deal with the data in a database?

Search From Database
IM looking for a better way to get results from search? IM currently using mysql_fetch_array and don't want my search to be in order. So if someone search for a word mysql_fetch_array will search in order of witch one was added to the database or from last. What I would like to have happen is more random or wildcard search. Is there a better way?

How To Search In A Database
I have a table called "lista" into my mysql database.This table has 5 text columns : "TRANSLATEDTITLE" "ORIGINALTITLE" "ACTORS" "DIRECTOR" "YEAR" , and 1 image column called "COVER".

I want to create a page with a form to search entries into this table, and anotger php page with the search results shown inside, everyone with a link that opens a pop window (ex. 400X320).

How To Search In A Database
I have a table called "lista" into my mysql database.This table has 5 text columns : "TRANSLATEDTITLE" "ORIGINALTITLE" "ACTORS" "DIRECTOR" "YEAR" , and 1 image column called "COVER".

I want to create a page with a form to search entries into this table (ex. with Title, Actors, Director, Year), and anotger php page with the search results shown inside, everyone with a link that opens a pop window (ex. 400X320). Who does give me an hand ???

I've seen the Codewalkers solution, but it searchs with another metod of searching (a selectable string with different category of searching). I need a simple search script with these two pages...

Search A Database
how do i seach through a specific column of data within a database for the highest value?

How To Search Without Database
i am developing a site and everything on the site is static meaning no database. now, they wanted to add a search tool bar thats is only meant to search by keywords
my problem is i dont know how to do it because i have done it before.

Search Without SQL Database
Anyone able to point me in the direction of a no database php search tutorial or throw up an example. Basically, I need to search for non HTML elements pages within a directory.

Search Database - MATCH() AGAINST() Or LIKE
I have a fairly basic database that holds articles that visitors of my web site can search based on content of the articles and the author. Simplified the tables look like this...

articles
+-----------------+--------------+------+-----+---------+-------+
| Field | Type | Null | Key | Default | Extra |
+-----------------+--------------+------+-----+---------+-------+
| doc_id | varchar(8) | | PRI | | |
| title | varchar(255) | YES | MUL | NULL | |
| date | date | YES | | NULL | |
| source | text | YES | | NULL | |
| abstract | text | YES | MUL | NULL | |
| body | mediumtext | YES | | NULL | |
+-----------------+--------------+------+-----+---------+-------+

authors
+---------------+--------------+------+-----+---------+----------------+
| Field | Type | Null | Key | Default | Extra |
+---------------+--------------+------+-----+---------+----------------+
| author_id | int(11) | | PRI | NULL | auto_increment |
| doc_id | varchar(8) | YES | | NULL | |
| author | varchar(100) | YES | MUL | NULL | |
+---------------+--------------+------+-----+---------+----------------+

The Authors name is kept in the form of first initial, middle initial (if known) and last name (ie J. Bloggs).

Basically users have two fields they can complete for searching. One is the keywords (ie words in the body of the article) and the other is for the author of the article. Currently I perform a full text search to find authors that match the author they enter but I'm not sure this is the best method as authors with short last names (ie. Li or Cho) can't be found.

This is the code I am using to generate a query to search the database. PHP Code:


Copyright Đ 2005-08 www.BigResource.com, All rights reserved