Mysql Is Not Using ENOUGH Memory On Linux
Running mysql 3.23.56-1.9 (yes , upgrading soon!) on red hat.
Our database:
- data is 5GB or so
- has approx 2GB of indices
We have 4GB of memory on the machine. At least 2.5GB of that is free+cached
[mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
set-variable = key_buffer=500M
set-variable = myisam_sort_buffer_size = 64M
set-variable = table_cache=600
set-variable = join_buffer=1M
set-variable = thread_cache = 8
set-variable = sort_buffer =4M
set-variable = record_buffer=4M
set-variable = thread_cache_size = 64
set-variable = thread_concurrency=8
set-variable = max_allowed_packet = 16M
set-variable = tmp_table_size = 64M
But, no matter how much memory I set for key_buffer in /etc/my.cnf, mysql seems to use very little of it after running millions of queries:
14951 mysql 15 0 226M 221M 1308 S 3.3 5.5 89:55 0 mysqld
View Complete Forum Thread with Replies
Related Forum Messages:
Linux 32bit X86 3gb Memory Limit
I am running MySQL-4.1.9 on a dual xeon FC3 box. Is it safe to set mysqld to use more than 2 GB of memory? If not, what upper limit of memory usage would you suggest for memory usage on a 32-bit box? How would you calculate how much memory mysql will use?
View Replies !
Out Of Memory; Check If Mysqld Or Some Other Process Uses All Available Memory;” Error
We have found that the MYSQL on all Email DB servers starts throwing “Out of memory; check if mysqld or some other process uses all available memory;” error. The error goes once we restart MySQL. But after a week again the same problem occurs. We have 4 GB of physical memory on the server but Mysql utilizes only up to 2.5 GB & starts throwing Out of memory error. Can someone from Database team look into it?
View Replies !
Memory Usage :: Swap Memory Not Released?
We have Mysql 5.0 running on RH linux. We have noticed that the swap memory increases but never gets released unless we reboot the server every 2-3 weeks. How would I know whats using this swap memory? Second question which I think maybe related to the first is that mysql is using a lot of memory when I do a top. Is there a way to limit the memory usage of mysql? I have a large table in mysql about 7 GB and I have 8 GB physical memory and swam is set to use 2GB.
View Replies !
Mysql On Flash-memory
I have a question about flash-memory lifespan. My database consists of 1 table, the table has 50 fields of 10 bytes each, thus each record will have 500bytes. There are 1000 records in the table, so roughly the table will have a size of 0.5MByte. The system will update the record sequentially, one record is updated per second. That is 3600 update per hour or 86400 per day. If I store this database on a 64MB flash-memory card then how long does the card last before wearing out.
View Replies !
MySQL 4.0.13 Memory Problem
I want to get your opinions on how to increase available/free memory and performance on a heavy volume database server. I have MySQL 4.0.13 running on RH 7.2 replicated to another RH 7.2 using same MySQL version. Recently our master database server (2 AMD Cpu + 2Gb memory + 2Gb swap space) started to suffer from memory outages because of heavy load. During day available free memory is changing from 200Mb to 5Mb and when available memory reaches to 5Mb MySQL starts to give 'Too many connections' messages. Db server is working with 45-70 query/second and more than 25,712 connection per hour. There are active 13-18 threads serving databases. To increase available free memory I've did following : 1- Optimized all tables 2- Removed unneccessary/old indexes 3- Moved unused databases to replication server 4- Increased key_buffer_size from 8Mb to 16Mb This changes helped a bit but still memory is a problem for MySQL. Average MySQL thread used to consume 100-120 Mb memory before changes, now it is consuming 60-70Mb per thread. What should I do to prevent 'too many connections' messages and have more memory available on database servers? Should I remove more indexes from tables? Should I increase key_buffer_size to 32Mb or more? Key_buffer_size doesn't look like a problem since key efficiency looks 100% most of the time.
View Replies !
Memory Alignment In MySQL
CREATE TABLE my table (coll_a INT NOT NULL, coll_b SMALLINT, coll_c SMALLINT, INDEX b_index (coll_b) ); Above is the table I will created. I declare coll_b and coll_c, which together will cose me 4 bytes in one row. Is it? What if I declare both of them as INT, will it cost me more memory? How about the memory needed for the index b_index? Not sure how memory alignment will affect MySQL.
View Replies !
MySQL And Memory Consumption
I've done a new install on a Freebsd server (5.1), using the latest ports of MySql 4.1. Everything seems to work great. However when I do a "top", I notice that Mysql is consuming around 321M of memory. This is is a virtually empty database with nothing loaded into it yet. Everything seems to be performing fine. Its just that I don't ever remember MySql using this much memory just after a new installation.
View Replies !
MySQL Client Ran Out Of Memory
I'm using a mysql server with my own TCP/IP server on the same FreeBSD machine. MySQL stores a users database, like logins and passwords. It works fine for a couple of days, but after that my simple queries with one row of result stops working. It says "MySQL Client ran out of memory". If I connect to mysql using other tools or simply restart my server - it works fine again under the same queries. So please don't support I use a huge amount of data, whole database can be selected in one query under normal conditions, its pretty small. My Server Info: sr10# mysql --version mysql Ver 14.7 Distrib 4.1.16, for portbld-freebsd5.4 (i386) using 4.3
View Replies !
MySQL With C++ Causes Memory Leak?
The garbage collector tells me it's using the same amount of memory, but the Task Manager shows it using 4-10KB more each second. Any ideas? If i remove all references to the actual datareader then the mem usage is stable, but as soon as it starts to return records then the leak appears. Code:
View Replies !
MySQL Memory Leak
I appear to have a memory leak problem caused by mysql I currently have 10 instances of /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --user=mysql --pid-file ... running but not actually doing anything. These have been running since the 9th (last time I restarted mysql) There are 2 that if you trace process on them are doing something... Process 565 has a subprocess of 567 and then 567 has the rest as subprocesses. But none of those subprocesses are running mysql commands - or doing anything other than eating memory. When I restart the server, applications are using 0.5Gb Memory then that creeps up to currently using 1.1Gb. So what are those dead process and why are they hanging around?
View Replies !
Compiled Mysql++ Memory Leak
I compiled mysql++ with Visual Studio 2003, the problem is I got i memory leak when i debug the application, the leak occurs even when i only use the mysqlpp::Connection class. Note I linked mysqlpp with mysql 5.0
View Replies !
Mysql Eating Big Chunks Of Memory
I'm running version 4.0.16 on solaris 8 as the backend for a web site serving around 12 million pages impressions a month. The performance of the server is monitored using orcollator. I'm finding that the memory usage on the server remains pretty constant for weeks at a time at around 300 Meg but then every once in a while the size of the mysqld process jumps anywhere between another 50 and 250 Meg. It then stays at this new size until mysql is restared (or jumps again). The memory increase appears to remain as resident according to the output of top. The site has a content management system which connects directly to the production data base as well which while it is used daily has some functionality which is only used as frequently as this problem occurs making me suspect it is the culprit. What I could really do with some advice on is - What are the most likely causes of the memory loss. - whether there are tools that allow you to see a breakdown of how the current memory is being used by mysql, or even better monitor it over time, in order to establish the source of the problem. - And if there aren't any such tools how best to approach this.
View Replies !
MySQL 4.0.13 Memory Problem Under Heavy Load
How to increase available/free memory and performance on a heavy volume database server. I have MySQL 4.0.13 running on RH 7.2 replicated to another RH 7.2 using same MySQL version. Recently our master database server (2 AMD Cpu + 2Gb memory + 2Gb swap space) started to suffer from memory outages because of heavy load. During day available free memory is changing from 200Mb to 5Mb and when available memory reaches to 5Mb MySQL starts to give 'Too many connections' messages. Db server is working with 45-70 query/second and more than 25,712 connection per hour. There are active 10-13 threads serving databases. To increase available free memory I've did the following : 1- Optimized all tables 2- Removed unneccessary/old indexes 3- Moved unused databases to replication server 4- Increased key_buffer_size from 8Mb to 128Mb 5- Have increased max_connection from 100 to 150 6- Have increased thread_cache to 5 This changes helped a bit but still memory is a problem for MySQL. What should I do to prevent 'too many connections' messages and have more memory available on database servers? Should I remove more indexes from tables? Should I increase key_buffer_size to 256Mb or more? Key_buffer_size doesn't look like a problem since key efficiency looks 100% most of the time.
View Replies !
MySQL 4.0.13 Memory Problem On Heavy Load
I want to get your opinions on how to increase available/free memory and performance on a heavy volume database server. I have MySQL 4.0.13 running on RH 7.2 replicated to another RH 7.2 using same MySQL version. Recently our master database server (2 AMD Cpu + 2Gb memory + 2Gb swap space) started to suffer from memory outages because of heavy load. During day available free memory is changing from 200Mb to 5Mb and when available memory reaches to 5Mb MySQL starts to give 'Too many connections' messages. Db server is working with 45-70 query/second and more than 25,712 connection per hour. There are active 13-18 threads serving databases. To increase available free memory I've did following : 1- Optimized all tables 2- Removed unneccessary/old indexes 3- Moved unused databases to replication server 4- Increased key_buffer_size from 8Mb to 16Mb This changes helped a bit but still memory is a problem for MySQL. Average MySQL thread used to consume 100-120 Mb memory before changes, now it is consuming 60-70Mb per thread. What should I do to prevent 'too many connections' messages and have more memory available on database servers? Should I remove more indexes from tables? Should I increase key_buffer_size to 32Mb or more? Key_buffer_size doesn't look like a problem since key efficiency looks 100% most of the time.
View Replies !
Memory Allocation Limit On Mysql 4.0.16 Binary For AIX 5.1
I downloaded the mysql 4.0.16 binary for AIX 5.1 from Mysql.com website. How much memory can this binary's mysqld handle? Is it a 32-bit or 64-bit process? It seems that it can only allocate a maximum of 2GB of memeory (by setting the maxdata as suggested on the AIX note in the documentation). I am using mainly innodb tables. Occasionaly, I have encountered "out of memory error". We have 4GB of memeory on our RS6000 (AIX 5.1). It is used as a dedicated mysql server. Is there a way I could allocate more memory for mysqld?
View Replies !
MySQL Consuming Lots Of Memory During Transactions W/ Many Statements
I am having a problem with MySQL consuming a lot of memory and eventually throwing an Out of Memory error and restarting itself. The symptoms are that swap usage continues to rise until some breaking point. The application is a typical web application w/ 2 web servers running Apache/Tomcat connecting to a dedicated DB server running only MySQL. This seems to occur as a result of running many statements in a single transaction, both against InnoDB tables and MyISAM tables. In one case, I'm writing all user actions to an audit table (MyISAM), all from a single application thread doing approximately 5K inserts (as single INSERTs on a single connection) every few seconds. In the other, I'm doing a variety of select/update/insert/delete statements against InnoDB tables, but again totaling several thousand in one transaction. Both of these problems occur even when there is relatively low activity elsewhere on the system. Code:
View Replies !
Command That Lowers The Amount Of Memory That The Process MySQL?
Someone knows a command that lowers the amount of memory that the process MySQL (mysqld, mysqld-nt...) uses??? My work is to execute many INSERT instructions based on SELECT instructions. When the execution starts, all be fine, but the time passes and this process "mysqld-nt" start grow and grow and then the performance be really bad. I tried to use "FLASH" and "RESET" between the INSERTS but no sucess. Someone knows?
View Replies !
MySQL V4.0 -> Red Hat Linux 9
I'm having great problems trying to install the latest MySQl RPM package onto my Red Hat Linux OS. There is already MySQL v 3.0 pre-installed with the RH Linux distribution disk but I can not seem to get any of the functions working on it. So I have now dopwnloaded the latest version hoping that this will fix the error. I have managed to install the MySQL-shared-compat-4.0.1-0.i386.rpm but i'm getting the following error message when I install MySQL-server-4.0.1-0.i386.rpm : Code:
View Replies !
Mysql On Linux
I am interested in connecting to my MySql database that is running (default install) on FC4. I want to connect to the db with my Windoze machine using MySql Query Browser. Both machines are behind a router; the gateway is 192.168.0.1. The Linux ip address is 192.168.0.50 and the windows is 192.168.0.11 (both static). I guess I need to learn how to determine the mysql host and port when connecting. I thought it would just be 192.168.0.50 and 3306 respectively, it's not working.
View Replies !
MySQL And Linux
I am pretty new to the MySQL/Linux worlds. Each time I want to use MySQL, I have to start the program under the root account. Are users other than "root" allowed to access the program? If so, how is it done? It would be nice if I didn't have to continuously log into root every time I would like to use MySQL.
View Replies !
Mysql In Linux
I have installed MySQl in linux and its working properly. I wrote an c++ program to connect to mysql database, which is capable of retrieving, deleting the values from database table. The problem i am facing is i am unable to insert values into the table at runtime. Can anyone please help me as to how to write the query?
View Replies !
How To Connect Remotely To Linux/MySQL Using MySQL Query Browser
http://dev.mysql.com/doc/query-brows...onnection.html I'm trying to connect from my Windows based PC to a dedicated server which is running on Linux system. I type server host and port 3306 user name admin + password and default schema and I get access denied message. I use putty to connect to the server using IP and port 22 and it connects to the server. What settings do I need to use to connect to MySQL using query browser?
View Replies !
How To Use A Copy Of A MYSQL 4.1 Database In MYSQL 5 Running On Ubuntu Linux
We had a "permanent world" game server running on an older PC, under Ubuntu 5.10, using a MYSQL 4.1 database to store persistent data for the players, then the hard disk quit. We did back up our data on a regular basis, but didn't use MYSQL to do the backups, we simply copied the MYSQL/data/ folder to disk. So now we have a new hard disk, with Ubuntu 7.10 and MYSQL 5 installed. We have everything working, in that we have created the appropriate database and, using a simple test module of our game which will create some of the tables if they don't exist in the database, we can store and retrieve data from the database tables. The problem we have is how in the world do we get the data from the backup copy of the MYSQL 4.1 created database into the new MYSQL 5 database correctly? With 4.1 we could copy the contents of the database folder right into the database folder in the /var/lib/MYSQL/ folder, but this procedure didn't work with MYSQL 5. The files seemed to copy, as in the copy operation gave no errors, but we get an error that says the database is unavailable and to make sure the MYSQL server is running - it is, so we're stumped, and our game server is offline.
View Replies !
MySQL On Redhat Linux
To make a long story short, let me say I had MySQL working on Windows 98 and everything was fine. Well, I took the big leap and removed all traces of Windows and Microsoft from the computer. (hooray!) Once I had Linux running OK, I downloaded and installed MySQL using an RPM package. I guess the server is running (it says it is every time the computer starts and it stops successfully every time the computer shuts down) however, I cannot figure out how to get the MySQL prompt. I've searched the entire hard drive for MySQL, mysql, MySQL*, mysql* and probably some others, too. The only thing I found was a shell script called mysql that starts or stops the server if I am logged in to Linux as root. I cannot figure out how to start the interactive program that allows me to make select statements, inserts, updates, etc. I'm wondering about some things: Did I download and install the wrong thing? Am I just not looking for the correct thing? Did I install it incorrectly?
View Replies !
Mysql On Linux-gui Interface
Is there a GUI interface that is easy to install to manage MySQL on linux? I'm trying add a user account and password to the db server but I'm not having any luck from the command prompt.I'm trying to setup the nexus discussion software.
View Replies !
MYSQL Server In Linux
I have a SQL server on a Linux Fedora machine and I try to use a GUI to connect to database I used different GUI like "Toad for MySQL" in connection page I put Linux IP address as "Server host" and username/password I keep getting error: Error No. 2003 Can't connect to MySQL server on '192.168.0.121' (10061) My question is: Do I need a client installation or configuration on Windows machine?
View Replies !
Installing MySQL RPM On Linux
I am trying to install MySQL with this command: rpm -ivh MySQL-server-4.0.13-0.i386.rpm I get bunch of errors regarding conflicts with the existing installation (files in /usr/share/mysql/.....) 1. Originaly mySQL was isntalled with Linux 7 install 2. I can't un-install mySQL via Linux Add/Remove program, I get an error stating sthat shared library option must be selected (it's is selected) 3. I have deleted /usr/share/mysql directly, but still have a problem.
View Replies !
MySQL, Linux, Ia32, >4GB RAM
I wonder if anybody here is using MySQL (3.23.56?) on a linux/intel ia32 (e.g., Xeon) with more than 4 GB RAM? Did you find a performance enhancement? With PAE mode on? How does this affect MySQL - being a multithreaded process, is there any benefit in having all that extra memory as anything other than a big disk cache?
View Replies !
Connection To MySQL On Linux
I am New to Linux PHP apache and MySQL (following the Book, Begining.PHP, Apache, MySQL Web Development). Got as far as chapter 3 without too many problems. Well no I'm stuck. I get the following error Warning: mysql_connect(): Can't connect to local MySQL server through socket '/tmp/mysql.sock' (2) in /usr/local/apache2/test/createmovie.php on line 4 Database connection error, check your server connection when then following piece of code is executed $connect = mysql_connect("localhost", "mysql", "mysql" ) or die ("Database connection error, check your server connection" ); I'm, A bit lost about which file the path is stored.Has anyone came across this similar problem and found a fix for it?
View Replies !
User Mysql On Linux
Im using Red hat Enterprice WS 3, when I install mysql (version 4.1.7) on linux, everything ok, but when I type # mysql error ocur: ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/tmp/mysql.sock' (2)
View Replies !
Mysql And Linux Script
I need your help with this. I am trying to write a linux script where I can connect to mysql database, use the select statment (count(*)) to get the number of rows, and store the results in a variable. Can you tell me how to put the result in the variable?
View Replies !
Mysql And Linux Users
I installed mysql using rpm. But I did not create a user for mysql. Mysql manual says something like that I should create a group and a user called mysql and that user should own the data directory. I do not understand that exactly. At the moment my mysql data directory is owned by root. Is it ok and do I have to create a user and group called mysql. Can you please tell me exactly what I should do? Other thing is as what user should I run mysql. WHat should I use for the --user option and --pid option.
View Replies !
Mysql Error On Linux
You have an error in your SQL syntax near '(course INNER JOIN round ON course.CourseID = round.CourseID) ON league.LeagueID' at line 1 I get this error when I run on linux.. Code: $SQL="SELECT RoundNum, RoundDate, CourseName, LeagueName, Format FROM league INNER JOIN (course INNER JOIN round ON course.CourseID = round.CourseID) ON league.LeagueID = round.LeagueID Where RoundID=".$RID.";"; Can Anybody help please? I also have another optional question. I cam across a sql function "FIRST()" Does anybody know the MYSQL equivalent?
View Replies !
MySQL Server On Linux
I have MySQL server running fine on Linux Server(Ubuntu 6.06LTS). I need to connect Windows workstations to the MySQL server. I installed MySQL ODBC 3.51.14 driver on it. When i try to connect the ODBC allways returns the following error: [MySQL][ODBC 3.51 Driver]Unknown MySQL server host 'mysql' (11001) I tried server names like 'mysqld', 'MySQL', ip address, combinations of linux server name and mysql name, and other characters like *.*, *:*, *:mysql, etc... The MySql server is running fine on linux server, port=3306(default). The 'bind-address = 127.0.0.1' parameter on 'my.cnf' file is marked as comment.
View Replies !
Hou Use MySql On Linux Web Server
Now the problum is that when i Host complete web site to linux server then my all web page is running but i dont no how use MySql database on Net. Through cPanel i creat MySql database but i cant find database root i m not able to Host or copy my existing MySql database with table which is running on my Computer very fine So please tell me process 1 have to simply upload my mySql database in Public Html folder or else where i m using cPanel file manager to upload files
View Replies !
Perl/mysql On Linux
i am not getting the output for the following code (given below) in apache server on linux. but i do get ouput in perl interpreter please replay me . vinaykumarms@rediffmail.com #!/usr/bin/perl print "ContentType: text/plain "; use DBI; # Connecting to the database # Replace DATABASENAME with the name of the database, # HOSTNAME with the hostname/ip address of the MySQL server. $drh = DBI->install_driver("mysql"); $dsn = "DBI:mysql:database=vinay;host=localhost"; $dbh = DBI->connect($dsn,"",""); # Select the data and display to the browser my $sth = $dbh->prepare("SELECT * FROM login"); $sth->execute(); while (my $ref = $sth->fetchrow_hashref()) { print "Found a row: id = $ref->{'id'}, name = $ref->{'name'} "; } $sth->finish(); # Disconnect from the database. $dbh->disconnect();
View Replies !
Linux Mdk Rpm MySql Installation
I just installed from rpms MySQL on a Mandrake10.1. I can't get trhough the can't connect to Local MySQL server through socket "/var/lib/mysql.sock" (113) There were already mentions to this problem but no solution on the forum. Could it be possible to tell us how to go through?? I've got a mysql.sock in the good path but it's 0bytes. If you don't know the solution, would it be possible to send a copy of your mysql.sock?
View Replies !
Linux And MySQL Access
I know MySQL account has nothing to do with Linux system account. I just wondering is there a way when I creates a new Linux account it will automatically creates a MySQL database account? Or do I have to write my own shell script to do that?
View Replies !
Uninstalling MySQL On Linux
I recently manually installed MySQL on linux/fedora 5 which caused problems as MySQL is built into the the RPM. Therefore I would like to uninstall my version of MySQL and revert back to original. As I am new to Fedora can anyone point me in the right direction to help me uninstall MySQL as there does not appear to be an unistall package/function.
View Replies !
Intalling Mysql On Linux
Before I begin, can I just state I have never installed anything on Linux server, so I am very new to this... Okay at the mo I have and using MYSQL version 3.23.58 on my Linux Sever, incase this is important, heres the details of my server: WEB SERVEUR Platform : Small - Fedora Core 3 Control panel : Plesk 100 Config : AMEN 2400 - AMD Athlon XP 2400+ Disk: 80 Gb - Memory: 512 Mb OK, I need to upgrade to the latest MYSQL version. So far, I have downloaded "mysql-standard-5.0.24a-linux-i686.tar" and unpacked the file uner /usr/local This is where I am stuck, I have no idea what to do next.. I need help for someone never done this before, preferbally a guide like... STEP by STEP, type this, then that etc.
View Replies !
Installing MySQL 5 On Linux
I have just been asked to install MySQL on a server which only has command line access. Despite having used MySQL on Linux for quite some time I have never carried out command-line installation before. The server is Redhat 9 and does not currently have any version of MySQL installed. Can anyone point me in the direction of a comprehensive installation guide which begins with post login via ssh which is where I can currently get to. ie..I need to know, how to download it AND how to then install it.
View Replies !
Installation Problem Mysql 4.0.13 On Red Hat Linux 6.2
I am facing problem in installing the mysql 4.0.13 on my linux 6.2 machine . I have pentium III server. When i give the command rpm -ivt MySQL-server-4.0.13-0.i386.rpm it give the message " Only one major mode may be specified " I tried lot to install the mysql ver 4 on my machine but could not succeed .
View Replies !
Compiling Mysql For Arm On I386-linux
I am hopping to get mysql compiled for arm in an i386 redhat pc. I have the cross compiler and some arm distribution, the version of the gcc is 2.95.3, and mysql distribution is 3.23.57. (I also tried 4.0.14 withthe same results/error) I do a: ../configure --prefix=/usr/local/arm/arm-linux --host=arm-linux --build=i386-linux and after a while I get an error: =============================================== : checking "return type of sprintf"... configure: error: cannot run test program while cross compiling =====================================
View Replies !
Mysql Access Yellow Dog Linux
i have a problem similar to others in this group but this is a little bit different. i am running mysql on my yellow dog linux server, but for some reason whenever i try to connect, it gives this error: [root@powerpig root]# telnet localhost 3306 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. NHost 'localhost.localdomain' is not allowed to connect to this MySQL serverConnection closed by foreign host. [root@powerpig root]# .
View Replies !
|
TRACKER
