Efficient Storage Of IP Address
I am establishing a database for the purpose of logging access to my secure
webserver and am wanting to make the database as efficient as I can because
it will be doing a lot of work when the site goes live.
What is the most efficient way in a MySQL table to store remote IP
addresses? What data type should I use? Should I just go with a basic
VARCHAR(15) to allow for 4 sets of 3 digits with 3 decimal separators, or is
there a better way?
View Complete Forum Thread with Replies
Related Forum Messages:
What's The Most Efficient Way?
I've done a database scheme and wonder what the most efficient way of storing certain entries would be. The site will have news, reviews and tutorials and these will be under the same categories. So I'm wondering what the best way to do design the database scheme would be. Have one table like I've done now in the "content" table with the posibilty to differentiate the entries with the "post_type" field or have three different tables? Below is the table "content". Field Type Null Default post_id int(10) No post_date datetime No 0000-00-00 00:00:00 post_text text No post_title text No post_cat_id int(4) No 0 post_description text No post_name varchar(200) No post_type int(4) No 0
View Replies !
How Efficient Is In() , And How Much Is The Most That You Should Put In An In()?
I am just wondering as to the efficiency of the in() function in MySQL. select field1,field2,...,fieldn from table where id in(1,2,3,4,5,6, ... , n); assuming: id is an indexed field. table is a VERY big table (100 000+ - 1 million+ records) what do you think is the largest number of values you could pass to the in() function without completly flattening your server?
View Replies !
Most Efficient YES/NO...
I) Table_A has fields Data_1, Data_2, Data_3, and Data_4; I need to determine whether value 'X' is present (at least once) in any of the Data_N fields. All I need is a YES/NO answer: YES, 'X' is present (at least once) in one of the Data_N fields of Table_A [Record number(s) not required!], or NO, 'X' is not present in any of the Data_N fields in any of the records in Table_A. II) Similar scenario, but this time Table_A has fields RecID, Data_1, Data_2, Data_3, and Data_4. I need to determine the RecID (none, one, or more) of every record that has value 'X' in any of the Data_N fields. I'm looking for the query that will be fastest and most elegant to implement.
View Replies !
Quickest And Most Efficient
i run an online game. I want to give each user a ranking, based on how high thier score is.If for example, i had 20,000 players, i dont want to have to update them all one by one, it may strain the server and take a long time. Is there another way i can assign a rank number (rank 1 has the top score and so on)
View Replies !
Efficient UPDATE
I have a table with the following structure; CREATE TABLE my_table ( id_1 int(11) NOT NULL , id_2 int(10) NOT NULL , stauts tinyint(1) NOT NULL DEFAULT 0 , PRIMARY KEY (id_1) ) Engine =InnoDB'; The table currently has arround 100,000 entries. When I try to run variations of the following statement it is taking around 4 seconds per query; UPDATE IGNORE my_table SET id_1 = 74240, id_2 = 5 I need it to be running a lot faster than 4 seconds per query as I need to update upwards of 100,000 records a day! My server is fairly beefy, a 3 gig dual core opeteron and is generaly running below 1.0 load.
View Replies !
Efficient Tables.
I am starting out on a project where I need to store GPS information. The data consists largely of a series of "Points" each consisting of a longitude,latitude and elevation. On a typical "route" there could be hundreds of points. My question is how can I efficiently store this information. It does not sound sensible to normalise this and add hundreds of rows to a table for each "route". Sample data is along the lines of : - <trkpt lat="54.016942977905273" lon="-1.4903640747070313"> <ele>82.330078125</ele> <time>2006-09-03T07:35:41Z</time> </trkpt> - <trkpt lat="54.016938870772719" lon="-1.490332055836916"> <ele>0</ele> <time>2006-09-03T07:35:42Z</time> </trkpt>
View Replies !
Efficient Placement Of Fields
is there any noticable efficiency is ordering the position of the field types?. Like say i place the join keys in a table at the end, and varchars and text at the top of the table does it really matter? Also when i do a query like select * from table where id IN (1), where 1 is usually a primary key int is that quicker than doing where id=1 or is there no difference and is it handling the int as a string or as an int?
View Replies !
Efficient Database Structure
I have been developing a new website and i need help in deciding the best database structure for it. The site is basically a dating website with various modules like blogs, videos, comments, friends, photos etc. I have created a member table that stores all the basic profile info and created seperate tables for friends, photos, messages, blogs etc and MemberID as foreign key. Now on profile page, i want to display all info related to member like his profile info, his photos, friend list, messages etc and i have to execute 7-10 short queries on profile page for this. Also, i think Joins will not be much helpful as there is one to many relationship e.g there can be more than 1 photo for a member and i am saving each photo in a seperate record. Similar is the case for other tables?
View Replies !
Creating An Efficient Database
i'm currently writing a web based catalogue system in php using a mysql database. the catalogue has a number of products in it from different brands. i would like to know if it is more efficient to have each brand in a separate table then a "master" table just listing the brand name and corresponding table or all the products in one large table and a "master" table listing each brand in the large table. the large product table would of course have a field to state which brand the product was from. the efficiency would be based on users being able to access the database via html browsers using php and also search the database.
View Replies !
How To Make Index Most Efficient
I have a large table (> 3,000,000 records). Each records contain a primary key like 'id' and a lots of attributes like 'age', 'department'. I want to build some indices to accelerate my query. I read the document which says that too many indices may slow down the INSERT and UPDATE operations. So is there any rule on how to set indices in such table? If I create an index for every field, would that be a very bad idea? If I create an index on each of two fields but not on their combination, will the indices contribute to queries on the combination?
View Replies !
Efficient Way To Count Rows
I'm trying to get the number of rows in a table with a very large number of records in it (~9 million). When I run a select count(*) for some criteria (where name='something', etc) it takes around 6-8 secs for the query to return the value. I tried by using SQL_CALC_FOUND_ROWS with a very small LIMIT but then the query was taking even longer. I'm using InnoDB, with query caching enabled. I could look at the information_schema and get the approximate row count but whenever I use a where clause it'll be way off mark.
View Replies !
Efficient Way Of Mass Indexing?
I have been working on a program that will populate and index a database. The populating doesn't take too long, but the indexing does. My question is: Is there a better approach to indexing this table than the one I'm using right now? I'm doing this through QtSql. headers is a QString array of 48 column names I want to index. for (int i = 0; i < headers.size(); ++i) { q.exec("ALTER TABLE mysqltable ADD INDEX(" + headers[i] + ");"); } example run for 20000 rows: viper,david $ time ./main -r 20000 Database Connection Established 0.520u 0.060s 0:21.27 2.7% 0+0k 0+0io 0pf+0w
View Replies !
Is This INSERT With SELECT As Efficient As Possible?
I'm writing a pretty complex web app and will be repeating many times over a query very similar to below and need to know if there is a more efficient way to do it. If anyone has input, I'd be happy to hear: INSERT INTO table (somecolumn) VALUES ((SELECT id FROM other_table WHERE foo = 'bar'))
View Replies !
Is This An Efficient MySQL Setup?
I would like to offload the MySQL server from my dedicated box in order to speed up page loads. I don't have an additional dedicated server so my only option is to get a VPS. But is offloading the MySQL server to a VPS, albeit a modest one, even worthwhile? I understand this is a very broad question because I am not providing any details but that being the case I am expecting a broad answer
View Replies !
Efficient Way To Left Join?
What is the most efficient way to do a table join, but even if there is no matching foreign key, still return the table on the left. SELECT col, col2, COUNT(col3) FROM tbl1 t1 LEFT JOIN tbl2 t2 ON t1.id = t2.id GROUP BY t1.id But this only works if there is a matching foreign key on t2, I would like all t1 rows to return regardless of whether they exist on t2 or not.
View Replies !
Address Table
I have a table that contains addresses. I would like to end up with a record set where each record contains the two letter state code (which is how it is saved), and the sum of the rows in the table for each state. In other words, for each state, how many addresses?I could query each state individually and count the rows for each, but that seems a long way around
View Replies !
Host Address
is there a variable in mysql that stores the host address or ip of the remote machine issuing the command?I want records to contain the ip or hostname of the remote machines.i know how to do this in php, but i want this in pure mysql if possible.
View Replies !
Connection Address
I built my database in yahoo web hosting.But I couldn't fint the true address to create a connection between mysql database and my application?How can I find it ?
View Replies !
Does Bind Address Bug Fix?
In version 4.x has bug for bind-address. (http://bugs.mysql.com/bug.php?id=1200) Does this bug fix in 5.0 under windows 2000 envrionment? I try to remote access mysql server but failed. If I set bind-address=56.22.134.% under [mysqld] in my.ini file and start the server, it show the server stop. (I test under command line really fail to login.) If I remove the line of bin-address, and start mysql service. It show the server started. I double check the version of mysql is: c:> mysql -V mysql Ver 14.12 Distrib 5.0.15, for Win32 (ia32) c:>
View Replies !
Address Table Set
I'm taking my Access Financial database and porting it over to MySQL, and I am building a web interface. The main purpose of this database is for me to store information on my purchases so I can run reports and stuff on it later. I decided to add a store information table to the database. I originally had the following information in one table for store information. storename suite number street city state zip country phonenumber rating comments I decided to break up the address into another table as I normally do, then I started reading about the 3NF and kind of talked myself into a logic problem. My plans now are to have seperate tables for Country City State Zip Address For Country, City, State, and Zip I will just do a FK between that and the store information table and use both the storepk and the other field as the PK of the table. A multi-multi linking design. For example storepk city Would be my table. My problem is I don't know how to handle the address part of the structure. I have the following fields I don't know how to put into a table suite number street I think I have 2 options with this piece of information, I can put it back into the store information table. Or I can put it into it's own separate table. If I put the address info into the store information then I will have multiple duplicate records as I have 8 Albertsons in the city I live in. If I put it into a separate table I don't know how to setup the PK. By setting up an Auto-Increment field I defeat the purpose of being dependent on a PK. My only other real option for data integrity is to make every field in the table part of the PK, and I'm not so sure that is a good idea. I can't really set it up by the storepk for example I have a dozen Chevrons in the city I live in, and if I got gas at a Chevron A all the time, then I would be okay. But if I ever got gas at Chevron B then I would have a duplicate record in the address table. Also I am unsure in the Address table if I should have a link back to the County, State, City, and Zip tables or not.
View Replies !
Most Efficient Way To Extract Limited Data
I am currently using the following code, is it the most efficient way to extract and sort the 6 items from the database. The database currently holds over 2,500,000 rows and I want to extract the data as efficiently and quickly as possible. Code:
View Replies !
Most Efficient, Stable Version Of MYSQL?
We're still using mysql 3.23.56, so it's time to upgrade! It has never once crashed on us, so we've been content with it so far. However, some of the inefficient query optimizations make us want to upgrade. Does anyone know what the current most efficient and stable version of MYSQL is? We don't require views or cursors or stored procedures or any of that... Just whatever's the most reliable and best optimized for fast query execution of fairly simple SQL. I know that 3.23 has some issues with using indices correctly during optimization (most notably in ORDER BY ... DESC). Is that problem fixed in 4?
View Replies !
GROUP BY IP Address Range
I store IP addresses using the INET_ATON function, e.g. INSERT INTO myTable(IP_Address) Values (INET_ATON(123.123.33.12)); I would like to create a daily report that groups IP addresses by a "dotted triad", e.g. (pseudo SQL) SELECT myTable.IP_Address FROM myTable GROUP BY 123.123.33.*;
View Replies !
Calculate Total Ip Address
I have a database which is full of: ip address - uploaded - downloaded. What i am trying to do is find the totals for each ip address (repeats of the same ip gives the sum on the uploaded/downloaded) and then order the query by the ratio (total upload/total download). But im having difficulties constructing the query which will get the sums of uploads and downloads from the same ip and also order by the query without getting errors (divide by zero when total download is 0).
View Replies !
Replication :: Host Should Not Be An IP Address
the host should not be an IP address. I even checked the hostname of the machine and it is correct. I tried adding the correct host name to the username when connecting. Still get the same error. I even tried granting replication to 'repl'@'%' for all hosts and it still givess access denied to 'repl' @'10.68.0.1' tried granting replication to 'root'@'10.68.0.1' and it still gives me access denied. Tried grant all to 'repl'@'%' and 'repl'@'10.68.0.1' and it still gives me ACCESS DENIED. I did flush privileges after each grant statement.
View Replies !
Setting Bind-address
I know by default that the bind-address is set to 127.0.0.1 which is basically local host. What I'm wondering is if it is possible to set mysql to listen for connections from multiple specified IP's? The basic idea is that the main mysql database runs on a dedicated db server and other servers connect to the db via the specified port provided the proper permissions and so on. I've read that you can remove the bind-address line completely to make mysql listen for outside connections but that also opens up huge security holes. I'm sure there has to be a way to do what I'm looking for, I just haven't found it yet.
View Replies !
User Address System
I'm working on a user based data system. I need to store a user's addresses which could be 0 or more. However the addresses could be domestic or foreign. I can tackle creating a multiple domestic address storage solution very easily. However, modifying this to encapsulate both a domestic and foriegn addressing system is boggling my mind. Mainly because foreign addresses don't all share the same format and ordering. Some use county, some don't. Some list a village, some don't, etc.... I'm looking for anything or anyone to provide me with some guidance and/or support to help development the foreign addressing system. I can modify it myself to integrate the domestic addresses.
View Replies !
Compare IP Address And Subnet?
I am trying to use mysql to do the following thing. I have tableA, in which all are single ips. sip ------- 1.2.3.4 8.8.8.8 123.3.32.1 .... and tableB, a list of our group subnets. subnet --------- 1.0.0.0/8 20.0.1.0/24 ..... What I want is only picking up those ips belong to our group from tableA according to the subnet tableB I can't figure out a way to compare ip and subnet, any ideas?
View Replies !
OS X MySQL Connect Address?
I have MySQL installed on OS X Leopard client and I can connect to the databases through my local php site, using "localhost" as the host address. The question is, if I want to connect to the database from another computer, how is this done - what is the host address of the MySQL database? I tired forwarding port 80 in my router to the computer with the database on it. - I go to another computer and type in my assigned ISP IP address and the website comes up fine. But when I enter the IP as the host in the php code, it can't connect to the database. Do I need to open another port or configure something differently to allow connection to the MySQL database via the IP address. Basically if I were to connect the compute directly to the modem, without going through a router, I would have an assigned ISP IP address. So basically I am hosting a website and database. But how to I specifically connect to the MySQL database?
View Replies !
Concatenate Address Fields
I've tried to use concat() to concat address fields into one string, but I'm struggling with the commas etc. My fields are: address_line1 address_line2 city state postal_code country For example, address_line1: 21 Ocean Parade address_line2: [Null] city: Seaview state: CA postal_code: 90069 country: [Null] I'd like it to end up as: '21 Ocean Parade, Seaview, CA 90069'
View Replies !
Address And Contact Tables
I'm building my first web app using Ruby on Rails with MySQL. My app will manage a database of properties, and contacts relating to those propeties, i.e. Buyers and Sellers. Before I start, I would like to know if there are recognised standards or best practice guidelines for creating contact tables and address tables?
View Replies !
Different IP Address For 'localhost' And MySQL
I run MySQL on remote server. So far we have tons of users they have a difficulties to understand that they need to use another IP address instead of 'localhost' in MySQL configuration for their scripts. So I decided to find a solution so they can continue using localhost as MySQL hostname but PHP would understand that localhost is actually different IP address. SO I edited /etc/hosts and set something like: 10.0.0.3 localhost #127.0.0.1 localhost Where 10.0.0.3 MySQL server IP. Now When I do ping localhost I see that my localhost has 10.0.0.3 address. Very nice! Unfortunately when I try to connect to this fake 'localhost' from PHP script, it gets ignored and it still tries to access local MySQL server (which is not installed at all). I have restarted Apache after made changes to /etc/hosts. Moreover as I said 'ping localhost' gives 10.0.0.3 Ip , so Its OK. But not for Apache/PHP. It is somehow possible to let Apache/PHP think that 'localhost' has value which is set on /etc/hosts ?
View Replies !
IP Address Change In MySQL
I have a server here running MySQL and I need to change the IP address of the server. When I do this I notice that mysql is still looking for the old IP and will not allow connections, which makes sense. The question is how do I get mysql to allow connections on the new IP address?
View Replies !
Efficient Ways To Retrieve Specific Rows.
My site used forum software that I wrote myself (in Perl) which, up until now, has used flat files. This worked fine, however lately I've been wanting to do more stuff with user accounts, and had been eying MySQL for over a year. Finally I've decided to start off small by converting the forum's account system to a MySQL database (and convert the rest later after I'm comfortable). So far everything is working fine, and I've figured out how to create the table, insert records, modify records, and so on. However I had a question on what was the most efficient way to retrieve information about a user as I read through the flat file containing messages. As each message is read I want to find that user's relevant information, build it into my output, then continue on to the next message. Now here's my problem. Since I'm reading a flat file in a way that was once trying to be somewhat memory efficient (on really slow server way back when, trying to avoid arrays and hashes) I'm finding that I'm having to send separate questions to MySQL as each message comes up. Say from 1 to 20 very simple questions to complete printing the page. Also, sometimes the questions might be repetitive - since I'm not storing any of the results in memory, if a user appears twice I ask about it twice. Would I really be better off trying to find a way to consolidate all distinct users into a single question? Or is MySQL efficient enough that this isn't really much of a concern?
View Replies !
Efficient String Compare To A Group Of Values
(Post edited to change "WHERE field = options" to "WHERE field IN options"). I have a website using PHP and MySQL 5.0; the database holds personal names, addresses and various information. Right now I'm building a query which checks whether a person lives in a certain group of UK counties. I've got arrays set up in PHP which hold the groups of counties, and I've dynamically created a "group" from each array. So, in PHP, $county_array = array('Kent','Surrey','London','Essex','...'); $county_group gets set to "('kent','surrey','london','essex',...)" Each group may hold perhaps 20 individual counties. Now, for my database query, I use: $query = "SELECT ... WHERE lower(county) IN $county_group"; Is the "WHERE field IN (a|b|c|d|e|...)" a slow comparison in MySQL? Is there a more efficient way to do it? Is this something that stored procedures can help me with?
View Replies !
The Most Efficient Manner To Update Multiple Rows
I have a table that holds information about people The table is quite large (300,000 rows) I need to write code that update many of the rows in the table Here is what I need to do Two of the fields that I store about each person are: location and country The location is some free text which the user can type in, while the country is the ISO country code, like "US", "ES" and so on I need go over all the records in the database, and for those that have a non-empty location field, to extract the value and to try to guess what country the user is from and to update the Country field accordingly My problem is that I might find that most of the records need updating, and this might lead to 100,00+ update statements I cannot use LOAD DATA as this is product database Is there a way to update multiple rows (each with a different value and condition in a single query?
View Replies !
Efficient SELECT From Multiple Tables With Same Formatting?
Let's say I have 2 tables with the exact same formatting (field/column names, etc) -- the only difference is the name of the tables.. one is called "table1" the other is called "table2" If I wanted to query both of the together is this legal and good coding practice? "SELECT id, headline, permalink, body FROM table2007_11, table2007_12 WHERE id=23" understandly I get this error: Column 'id' in field list is ambiguous" is there a better way to do this than printing out each table name for each field individually? (ie. id. table2007_11, id. table2007_12, etc)?
View Replies !
Efficient Country/Province City Setup
I currently have a program that does a global query of all of the data. I want to break it down so as to drill the user down to thier local area. for example: Country Province Region City As you can see, a country can have many provinces, a province many regions and a region many cities or a province many cities. What is the most effecinet way to do this in MySql? I'm OK with doing single tables. ie: INSERT INTO Province VALUES (NULL, 'Ontario', 'ON'); but I'm unclear if that's the way it should be done. I'm using PHP on the client side.
View Replies !
Most Efficient Way Of Storing Data From Multiple Accounts
As part of a system I am putting together I need to allow users to create thier own accounts on my servers. Each user can create their own account, and then have their users register for it. Each account needs it data seperate from the others, a member registered for one account should not be able to view another account and a username registered with one account should still be available to the other accounts. The ways I have been looking at are: 1. Create a new database for every account created so that all users are kept in seperate databases. 2. Have one table for users, one for topics, one for posts etc and then associate each row within this table with the relevent account. So for example a user could register with the forum with the ID 4, so their user entry would be Userid: 234 Username: xxxx Password: xxxx Forumid: 4 Then when a new member registers with any account I simply check that there is not another user with the same account ID and username. Indexes on relevent fields in this system could help speed up huge tables. I expect to quickly have 20,000 plus accounts (and in theory it could go up to hundreds of thousands). I guess my question is which of these methods is better from a speed point of view once we get a large number of accounts and users. Also, are there restrictions on the number of fields in a table that could cause problems? Using MySQL by the way, on an Apache server.
View Replies !
Most Efficient Date Field Type For Selects?
I have searched this forum seeking the answer to this question, to no avail. I am making an events diary that will have a lot of entries. Entries will be entered in all kinds of order, including multiple events spanning a year or so. Even multiple events of the same type will be individual entries. (e.g. weekly chess club meeting every weds at 7pm will be 52 entries) My question is : Which is the best format to store dates? Native mysql date type Integer timestamp A.n.other? I suppose a worst case scenario is imagine I want to generate a calendar for July (31 days) and I want to show how many events there are for each day. 1st July (13 events) 2nd July (22 events) and so on ... it is possible that any given day could have up to 100 entries. What in your opinion is the best column type to use and ss there any kind of Indexing I can use to speed up select by dates? Or any other tip or trick you'd be prepared to share with me?
View Replies !
|
TRACKER
