Memory Allocation Limit On Mysql 4.0.16 Binary For AIX 5.1
I downloaded the mysql 4.0.16 binary for AIX 5.1 from Mysql.com
website. How much memory can this binary's mysqld handle? Is it a
32-bit or 64-bit process?
It seems that it can only allocate a maximum of 2GB of memeory (by
setting the maxdata as suggested on the AIX note in the
documentation). I am using mainly innodb tables. Occasionaly, I have
encountered "out of memory error".
We have 4GB of memeory on our RS6000 (AIX 5.1). It is used as a
dedicated mysql server. Is there a way I could allocate more memory
for mysqld?
View Complete Forum Thread with Replies
Related Forum Messages:
Memory Allocation Limit
I downloaded the mysql 4.0.16 binary for AIX 5.1 from Mysql.com website. How much memory can this binary's mysqld handle? Is it a 32-bit or 64-bit process? It seems that it can only allocate a maximum of 2GB of memeory (by setting the maxdata as suggested on the AIX note in the documentation). I am using mainly innodb tables. Occasionaly, I have encountered "out of memory error". We have 4GB of memeory on our RS6000 (AIX 5.1). It is used as a dedicated mysql server. Is there a way I could allocate more memory for mysqld?
View Replies !
Linux 32bit X86 3gb Memory Limit
I am running MySQL-4.1.9 on a dual xeon FC3 box. Is it safe to set mysqld to use more than 2 GB of memory? If not, what upper limit of memory usage would you suggest for memory usage on a 32-bit box? How would you calculate how much memory mysql will use?
View Replies !
Simple Discussion On ID Allocation
I have a dilemma regarding the correct way I should allocate IDs for a new table I am designing. The table holds information on folders that users can open in the system. The following information is saved on each folder: *) Folder ID *) User ID (The ID of the user who created the folder *) Name of the folder ... Possibly more data can be added later on I am wondering what should be the best way to allocate IDs to the folders. The primary key in the table is (Folder ID, User ID). Each user can create as many folders as she wants. When a user creates a folder, I need to add a new record to the table, and I am not sure how to allocate the ID for the folder. I can use auto_increment for the folder ID, but would mean that if User X creates his first folder, then the folder ID will be some number that MySQL will allocate and not the number 1. What I WOULD like to do is to have MySQL treat the folder ID with auto_increment attributes within the user ID value. So The first folder that each user will create will get the ID 1, the second 2 and so on. Is this possible? If not, what would be the best way to achieve what I want without running into duplication problems (that I know auto_increment solves)
View Replies !
Out Of Memory; Check If Mysqld Or Some Other Process Uses All Available Memory;” Error
We have found that the MYSQL on all Email DB servers starts throwing “Out of memory; check if mysqld or some other process uses all available memory;” error. The error goes once we restart MySQL. But after a week again the same problem occurs. We have 4 GB of physical memory on the server but Mysql utilizes only up to 2.5 GB & starts throwing Out of memory error. Can someone from Database team look into it?
View Replies !
Memory Usage :: Swap Memory Not Released?
We have Mysql 5.0 running on RH linux. We have noticed that the swap memory increases but never gets released unless we reboot the server every 2-3 weeks. How would I know whats using this swap memory? Second question which I think maybe related to the first is that mysql is using a lot of memory when I do a top. Is there a way to limit the memory usage of mysql? I have a large table in mysql about 7 GB and I have 8 GB physical memory and swam is set to use 2GB.
View Replies !
How To Save Binary Data Into A Binary Field
I want to save some binary data into MYSQL. dim s as string s=chr(0)&chr(1) chr(3) & chr(6) & chr(7) conn.execute "INSERT INTO test values ('" & s & "')" The field in the table test is binary. The odbc returns an error but using the query browser the query ends good. Any idea?
View Replies !
Key1 Without Binary And Key2 With Binary
I have two search keyes, key1 and key2. The following is where clause. where say like '%#key1#%' and say like binary '%#key2#%' I have to use binary for key2 like the above. Now I like to make the following where clause. say like '%#key1#%#key2#%' The where clause above will retrieve all records which has #key1# and #key2# in that order. My problem is in the use of binary, i.e I have to use binary for key2. I can make it like the following for using binary. say like binary '%#key1#%#key2#%' But the code above makes not only key2 but also key1 bianry. Key1 doesn't need bianry but key2 needs bianry. How can I make the where clause key1 without binary and key2 with binary? The following would-be code doesn't work correctly, but it'll show what I want. woudl-be code say like '%#key1(non-binary)#%#key2(binary)#%'
View Replies !
Mysql On Flash-memory
I have a question about flash-memory lifespan. My database consists of 1 table, the table has 50 fields of 10 bytes each, thus each record will have 500bytes. There are 1000 records in the table, so roughly the table will have a size of 0.5MByte. The system will update the record sequentially, one record is updated per second. That is 3600 update per hour or 86400 per day. If I store this database on a 64MB flash-memory card then how long does the card last before wearing out.
View Replies !
MySQL 4.0.13 Memory Problem
I want to get your opinions on how to increase available/free memory and performance on a heavy volume database server. I have MySQL 4.0.13 running on RH 7.2 replicated to another RH 7.2 using same MySQL version. Recently our master database server (2 AMD Cpu + 2Gb memory + 2Gb swap space) started to suffer from memory outages because of heavy load. During day available free memory is changing from 200Mb to 5Mb and when available memory reaches to 5Mb MySQL starts to give 'Too many connections' messages. Db server is working with 45-70 query/second and more than 25,712 connection per hour. There are active 13-18 threads serving databases. To increase available free memory I've did following : 1- Optimized all tables 2- Removed unneccessary/old indexes 3- Moved unused databases to replication server 4- Increased key_buffer_size from 8Mb to 16Mb This changes helped a bit but still memory is a problem for MySQL. Average MySQL thread used to consume 100-120 Mb memory before changes, now it is consuming 60-70Mb per thread. What should I do to prevent 'too many connections' messages and have more memory available on database servers? Should I remove more indexes from tables? Should I increase key_buffer_size to 32Mb or more? Key_buffer_size doesn't look like a problem since key efficiency looks 100% most of the time.
View Replies !
Memory Alignment In MySQL
CREATE TABLE my table (coll_a INT NOT NULL, coll_b SMALLINT, coll_c SMALLINT, INDEX b_index (coll_b) ); Above is the table I will created. I declare coll_b and coll_c, which together will cose me 4 bytes in one row. Is it? What if I declare both of them as INT, will it cost me more memory? How about the memory needed for the index b_index? Not sure how memory alignment will affect MySQL.
View Replies !
MySQL And Memory Consumption
I've done a new install on a Freebsd server (5.1), using the latest ports of MySql 4.1. Everything seems to work great. However when I do a "top", I notice that Mysql is consuming around 321M of memory. This is is a virtually empty database with nothing loaded into it yet. Everything seems to be performing fine. Its just that I don't ever remember MySql using this much memory just after a new installation.
View Replies !
Mysql Is Not Using ENOUGH Memory On Linux
Running mysql 3.23.56-1.9 (yes , upgrading soon!) on red hat. Our database: - data is 5GB or so - has approx 2GB of indices We have 4GB of memory on the machine. At least 2.5GB of that is free+cached [mysqld] datadir=/var/lib/mysql socket=/var/lib/mysql/mysql.sock set-variable = key_buffer=500M set-variable = myisam_sort_buffer_size = 64M set-variable = table_cache=600 set-variable = join_buffer=1M set-variable = thread_cache = 8 set-variable = sort_buffer =4M set-variable = record_buffer=4M set-variable = thread_cache_size = 64 set-variable = thread_concurrency=8 set-variable = max_allowed_packet = 16M set-variable = tmp_table_size = 64M But, no matter how much memory I set for key_buffer in /etc/my.cnf, mysql seems to use very little of it after running millions of queries: 14951 mysql 15 0 226M 221M 1308 S 3.3 5.5 89:55 0 mysqld
View Replies !
MySQL Client Ran Out Of Memory
I'm using a mysql server with my own TCP/IP server on the same FreeBSD machine. MySQL stores a users database, like logins and passwords. It works fine for a couple of days, but after that my simple queries with one row of result stops working. It says "MySQL Client ran out of memory". If I connect to mysql using other tools or simply restart my server - it works fine again under the same queries. So please don't support I use a huge amount of data, whole database can be selected in one query under normal conditions, its pretty small. My Server Info: sr10# mysql --version mysql Ver 14.7 Distrib 4.1.16, for portbld-freebsd5.4 (i386) using 4.3
View Replies !
MySQL With C++ Causes Memory Leak?
The garbage collector tells me it's using the same amount of memory, but the Task Manager shows it using 4-10KB more each second. Any ideas? If i remove all references to the actual datareader then the mem usage is stable, but as soon as it starts to return records then the leak appears. Code:
View Replies !
MySQL Memory Leak
I appear to have a memory leak problem caused by mysql I currently have 10 instances of /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --user=mysql --pid-file ... running but not actually doing anything. These have been running since the 9th (last time I restarted mysql) There are 2 that if you trace process on them are doing something... Process 565 has a subprocess of 567 and then 567 has the rest as subprocesses. But none of those subprocesses are running mysql commands - or doing anything other than eating memory. When I restart the server, applications are using 0.5Gb Memory then that creeps up to currently using 1.1Gb. So what are those dead process and why are they hanging around?
View Replies !
MySQL RPM / Binary
Thanks for the previous rec regarding 4.xx, Now I want to run a second MySQL server and leave the existing (and working) 3.23...Configuring isn't going to be the issue, but according to the RPM output, the package isn't relocatable from /var/mysql blah blah - which is where my existing installation is.I guess I need to download and make the installation manually to force it to a totally separate directory then right?
View Replies !
Compiled Mysql++ Memory Leak
I compiled mysql++ with Visual Studio 2003, the problem is I got i memory leak when i debug the application, the leak occurs even when i only use the mysqlpp::Connection class. Note I linked mysqlpp with mysql 5.0
View Replies !
Mysql Eating Big Chunks Of Memory
I'm running version 4.0.16 on solaris 8 as the backend for a web site serving around 12 million pages impressions a month. The performance of the server is monitored using orcollator. I'm finding that the memory usage on the server remains pretty constant for weeks at a time at around 300 Meg but then every once in a while the size of the mysqld process jumps anywhere between another 50 and 250 Meg. It then stays at this new size until mysql is restared (or jumps again). The memory increase appears to remain as resident according to the output of top. The site has a content management system which connects directly to the production data base as well which while it is used daily has some functionality which is only used as frequently as this problem occurs making me suspect it is the culprit. What I could really do with some advice on is - What are the most likely causes of the memory loss. - whether there are tools that allow you to see a breakdown of how the current memory is being used by mysql, or even better monitor it over time, in order to establish the source of the problem. - And if there aren't any such tools how best to approach this.
View Replies !
MySQL 4.1 Windows Binary
I can't seem to find a binary distribution of mysql 4.1. Can some one tell me if there is one and where to get it? Or is it not as simple as finding a setup.exe?
View Replies !
MySql Binary Log ERROR
I'm getting an "ERROR: File is not a binary log file." error when I execute: >mysqlbinlog ib_logfile0 I'm running 5.0.22 for Win32. I've tried it with the server shutdown, and I've tried it with the -f or --force-read option, too. When I open the ib_logfile0 (or ib_logfile1) in a text editor, it looks like a binary log file --"control characters" interspersed with regular text data from the database. I'm thinking that it may be some problem with the log file headers, but I'm not sure.
View Replies !
Enabling Binary Log In Mysql 5.0.45
I wrote log_bin=[filename] in my.inf and restarted ,eventhough if checked at commandprompt through show variables statement, its showing log_bin =off.I tried through mysql adminstrator stratup variables also. But no change at all.can anyone tell me how to enable binary logs and further process for replication.Awaiting for your valuble replies.
View Replies !
MySQL 4.0.13 Memory Problem Under Heavy Load
How to increase available/free memory and performance on a heavy volume database server. I have MySQL 4.0.13 running on RH 7.2 replicated to another RH 7.2 using same MySQL version. Recently our master database server (2 AMD Cpu + 2Gb memory + 2Gb swap space) started to suffer from memory outages because of heavy load. During day available free memory is changing from 200Mb to 5Mb and when available memory reaches to 5Mb MySQL starts to give 'Too many connections' messages. Db server is working with 45-70 query/second and more than 25,712 connection per hour. There are active 10-13 threads serving databases. To increase available free memory I've did the following : 1- Optimized all tables 2- Removed unneccessary/old indexes 3- Moved unused databases to replication server 4- Increased key_buffer_size from 8Mb to 128Mb 5- Have increased max_connection from 100 to 150 6- Have increased thread_cache to 5 This changes helped a bit but still memory is a problem for MySQL. What should I do to prevent 'too many connections' messages and have more memory available on database servers? Should I remove more indexes from tables? Should I increase key_buffer_size to 256Mb or more? Key_buffer_size doesn't look like a problem since key efficiency looks 100% most of the time.
View Replies !
MySQL 4.0.13 Memory Problem On Heavy Load
I want to get your opinions on how to increase available/free memory and performance on a heavy volume database server. I have MySQL 4.0.13 running on RH 7.2 replicated to another RH 7.2 using same MySQL version. Recently our master database server (2 AMD Cpu + 2Gb memory + 2Gb swap space) started to suffer from memory outages because of heavy load. During day available free memory is changing from 200Mb to 5Mb and when available memory reaches to 5Mb MySQL starts to give 'Too many connections' messages. Db server is working with 45-70 query/second and more than 25,712 connection per hour. There are active 13-18 threads serving databases. To increase available free memory I've did following : 1- Optimized all tables 2- Removed unneccessary/old indexes 3- Moved unused databases to replication server 4- Increased key_buffer_size from 8Mb to 16Mb This changes helped a bit but still memory is a problem for MySQL. Average MySQL thread used to consume 100-120 Mb memory before changes, now it is consuming 60-70Mb per thread. What should I do to prevent 'too many connections' messages and have more memory available on database servers? Should I remove more indexes from tables? Should I increase key_buffer_size to 32Mb or more? Key_buffer_size doesn't look like a problem since key efficiency looks 100% most of the time.
View Replies !
Does MySQL Support Binary Strings?
I want to have a sort of switchboard system on my database which tells which features are set and which ones are not... 01010110 That would tell you that some features are enabled and some are not. However when it comes down to storing the value I have two options... 1) Store it as a CHAR(8) value, and then fetch it without decoding it. Simply have a server side code use number.charAt(i) to determine the bit value. 2) Store it as a Decimal (Base10: 0-255) number and then have server side scripts covert it to base2 (binary). Then from there it will take the process that step one takes... Both these solutions work well, But I would really like to have something in the middle. Say storing a base10 number (already decoded into base 2) but stores as a binary string. Is that possible?
View Replies !
MySQL Consuming Lots Of Memory During Transactions W/ Many Statements
I am having a problem with MySQL consuming a lot of memory and eventually throwing an Out of Memory error and restarting itself. The symptoms are that swap usage continues to rise until some breaking point. The application is a typical web application w/ 2 web servers running Apache/Tomcat connecting to a dedicated DB server running only MySQL. This seems to occur as a result of running many statements in a single transaction, both against InnoDB tables and MyISAM tables. In one case, I'm writing all user actions to an audit table (MyISAM), all from a single application thread doing approximately 5K inserts (as single INSERTs on a single connection) every few seconds. In the other, I'm doing a variety of select/update/insert/delete statements against InnoDB tables, but again totaling several thousand in one transaction. Both of these problems occur even when there is relatively low activity elsewhere on the system. Code:
View Replies !
Command That Lowers The Amount Of Memory That The Process MySQL?
Someone knows a command that lowers the amount of memory that the process MySQL (mysqld, mysqld-nt...) uses??? My work is to execute many INSERT instructions based on SELECT instructions. When the execution starts, all be fine, but the time passes and this process "mysqld-nt" start grow and grow and then the performance be really bad. I tried to use "FLASH" and "RESET" between the INSERTS but no sucess. Someone knows?
View Replies !
Binary Data Handling With Mysql Client
I am wondering what I miss to be able to handle binary data from the mysql client. I have ensured that the user has file_priv set to 'Y' and that max_allowed_packet is larger that the binary lumps handled. Here is my version: Ver 4.1.5-gamma-log for pc-linux on i686 (Source distribution) Right now I'm trying this to insert binary data: mysql> update table set col=load_file("/path/file") where id=1; ....and this to fetch the data again: mysql> select col from table into outfile "/path/file"; As for insertion I am actually not quite sure whether or not it goes well, since I get garbled data out from the fetching. Any way to check the data when inside the table (data length, for instance)? I have two problems with the fetching of data: 1) I cannot specify a path. I am only allowed to specify a filename, and the that file is written to the table's directory in the server's data directory. 2) The resulting file is garbled data. I am not sure if this garbling happened at the time of insertion of data or when I fetched the data out again.
View Replies !
Clearing Mysql Binary Logs From A Script
I'd like to know how to clear down mysql binary logs from a script. I have a script which runs this: "C:Program Filesmysqlinmysql" -uroot -prootpasswd < C:ClearBinaryLogs.sql ClearBinaryLogs.sql: use db PURGE MASTER LOGS BEFORE 'NOW()'; doesn't clear anything but seems to complete without any errors and all the paths are correct, anyone have any ideas?
View Replies !
Writing Large Chunks Of Binary Data To MySQL With ODBC
I'm having a lot of trouble writing large chunks of binary data (tests are in the range of 16-512K, but we need support for large longblobs) to MySQL using ODBC. Database is local on a W2K system, but I have to support all modern Windows systems, and a variety of ODBC configurations. (I'll be testing against multiple ODBC databases soon - but development is against MySQL) I've been able to adapt some example code that executes a statement (SQLExecute) and uses SQLBindParameter to mark the longblob field as SQL_DATA_AT_EXEC. That works. However I really need to use a result set (opened for update), and to add new rows using SQLBulkOperation( hStmt, SQL_ADD) This works for the normally bound fields, but fails if I bind a variable using something like: Code:
View Replies !
Exporting Binary Data From Access 2000 Into MySQL 4.1.5 Gamma
I'm trying to export a pictures table, my mySQL database table already exists so I have linked both tables in Access and I tried to run a simple append query in Access to export the data but I either : - lose the connection to mySQL - have packets that exceed max_allow_packet I have tried different things to set max_allow_packet to a higher value which seems to be 1M by default. I want it to be 1G like setting the value at run-time from the prompt but it seems that no matter what I tried, I either get the syntax wrong or the command is simply ignored. I have also added in my.cnf, the following lines :
View Replies !
Error: MySQL Client Ran Out Of Memory (was "Urgently Need Help")
I'm having a big trouble with this query select *, UNIX_TIMESTAMP(date_submitted) as postedon, UNIX_TIMESTAMP(DATE_ADD(date_submitted, INTERVAL auction_period DAY)) as expiry from bidsnbuys_products where approved='yes' It works before but lately we've got a huge records and if our customers search a product it will give them an error, I even tested by myself and the error is MySQL client ran out of memory Is there a better mysql query with my query above?
View Replies !
Limit Of Mysql
I am just wondering if there are any limits on the number of tables I can create in MySQL and how large I can hold in the database.
View Replies !
Can't Limit /var/log/mysql Logging
Mysql is filling my /var partition because the log limit doesn't seem to be respected. I've tried many different settings in /etc/mysql/my.cnf but nothing works. Logrotate is not enabled/configured. I just want mysql to use a maximum of, let's say, 1GB of my /var partition The log is /var/log/mysql/ Debian GNU/Linux 4.0 kernel 2.4.27-2-386 mysql version 5.0.30-Debian_1-log Following the /etc/mysql/my.cnf file Code:
View Replies !
Limit Cpu Proces MySQL
I have my own server running with MySQL, PHP..... and asterisk(VOIP) Sometime I have that so much visitors(search engines) that MySQL is taking all the processing time. Ive running also asterisk(VOIP) this must be goingon allways. I like to limit MySQL not to take more than 80% CPU speed. How to do this.
View Replies !
Wht Is Mysql Limit/capacity?
Total size/capacity of mysql, (If have then how to increase) Total size/capacity of Database(every), (If have then how to increase) Total size/capacity of Table(every)..... (If have then how to increase)
View Replies !
MySQL Submission Limit
Basically, my PHP submission form submits tutorials that are about < 2kb in size into the database...if I try to submit anything more than that, then it doesn't add them to the database. It might be some setting that needs to be changed in PHPmyAdmin or something, but if they don't submit, then it's going to be a much longer process by submitting them through PHPmyAdmin. It's kinda hard to explain, but hopefully you get the point. If you have any idea why this might be happening, please let me know.
View Replies !
Recordset Paging With MySQL & ASP Using LIMIT
I have an asp page which I want to display 10 records with a 'Previous' and 'Next' link underneath for navigating through the rest of the recordset. I have the page displaying the first 10 records and the links. The links work, but the data does not change. How can I adjust the SQL so that the code re-runs the SQL ? Is there a way to override the LIMIT or change the way it is written ?? Code:
View Replies !
|
TRACKER
