Tracking Forums, Newsgroups, Maling Lists
Home Scripts Tutorials Tracker Forums
 
  HOME    TRACKER    MYSQL




Upload Times


I need to upload 2 star catalogues to the mysql database. the first time i tried this i filled up the HD in 2 Days, my instructor mentioned that journalling was taking up most of the space and decided to remove-it.

now, with journalling turned off, i have started re-uploading the catalogues, but have noticed a significant decrease in "write" speed.

my question is, does journalling speed up writing data into mysql tables? i have roughly 180GB of data to upload, and it took me 4 days to upload 3GB's when last time it took me this time to upload 100GB.




View Complete Forum Thread with Replies

See Related Forum Messages: Follow the Links Below to View Complete Thread
Upload MySQL Database To A Unix Server - What Path To Upload To?
I am going to upload a MySQL database to a Unix server. However, what path do I upload to?
Something makes me thing /var?

Appear 2 Times
i'm having this problem finding out the right sql query.
i have two tables A & B
the userid in table A appears as FK in table B
i need to list userid that appear 2 times or less in table B which has a where clause column3='Yes'

how do i go about it>?

Dates And Times
I have a field in a DB called "customerJobDate" which is configured to store full dates (ODBC dates) e.g. "2006-03-06 08:30:00". Now this does work i can update insert and delete the records perfectly, But if i query the DB asking for all dates that match 2006-03-06 regardless of the time (Date only) then the result returns 0 rows unless any of the dates in the column have 00:00:00 as the time.

This works: 2006-03-06 00:00:00
This does not work 2006-03-06 08:30:00

I hope someone can help me as I am finishing this app and this is the only thing holding me back.

One To Many Multiple Times
I have a 'links directory' database that currently contains 4 tables: category, subcategory, region and links. My links table contains company names and, among others, three fields catID, subcatID and regID. Each of these are related to primary keys in the other three tables, category (catID), subcategory (subcatID) and region (regID).

My issue is that the records in the links table can be in multiple regions, multiple subcategories and multiple categories, but the way I have it designed, each record in links can only be associated with a single catID, subcatID and regID.

Currently the only workaround I can think of it to have duplicate entries in the links table for a single company, but with every variation of catID, subcatID and regID. This will result in a very large table, but I cannot currently think of any better idea.

Dates And Times.
You can't have two timestamp columns in a database both with the default now().
- why I would want to is not the issue.

You can't use the data and time functions, such as CURRDATE()/CURRTIME() provided by MySQL as defaults for date/time type columns.

Is there a way to use something like 'select currtime();' as the default for a column?

so my question is, how do I use ANYTHING other than one timestamp with the default value of now() for date/time defaults in MySQL.

About Dates And Times
I have form with drop down boxes, where folks enter dates and times, I have used implode and explode to format the dates, now I want to write those dates to mysql, I know mysql has its own date and time functions, is there a way to convert my php formatted dates and times into something that mysql will recognize and store as a time and date or does php have a function that will convert it and then allow it to be stored in date/time format in the database?

Number Of Times
I have a query that grabs 500 rows from 1 field within 1 table.

In this table. Each user will have 500 rows associated to them from within that table. So if there are 2 users then there will be 1000 rows. Each time 1 user executes the query, it grabs their 500 rows. If 2 users execute the query simultaneously, then this means that there are 1000 rows, all of which will be selected; 500 by one user and 500 by the other. If 3 users access the table simultaneously, then there are 1500 rows and so on. My question is how many users can execute this query simultaneously before we see performance loss?

Records Between Two Times
I have a table for a restaurant database with two fields open_time and close_time in TIME format. I want to be able to select all records that fall between open_time (when the restaurant opens) and close_time (when the restaurant closes).

I have this query:
Quote: Select hours_id from hours where curtime() between 'open_time' AND 'close_time';

It partially works, but its not working if the close_time is after midnight (i.e 1am = 01:00:00 in database). I can't figure out the issue with the difference between AM and PM.

Ordering Times
i have some vlaues in a database, they are 12 hour times, how would i go about sorting it so 12 comes before 1, as it is its going 1 2 3 4.... 12 etc etc, do i have to use a 24 hour time? then from there function it to show 12 hour when displayed

Comparing Times
I'm creating a voting system, and want to prevent people from cheating. Therefore I'm logging their IP, and the time they voted, and what I'm planning to do is have a script which will delete any records which have been in the database for say 24 hours.

To get the length of time I was gonne use:

HOUR(TIMEDIFF(NOW(),time))

Measuring Query Times
I have read a few posts here and see that some people have questions regarding the length of time it can take to perfrom their queries.

I would be quite happy reaching that stage because at least I would know how long mine take. :|

How can the time delay be forced to output? Using MySQL 5.0.

Subtract Two Event Times
I am trying to formulate a complex query to get some good info straight from SQL, rather than post-processing in XL.

I have a table as follows:
EventID Integer (key)
ActionID Integer, 1 = event on, 2 = event off
dtStamp Date

I want to get the duration of each Event.

I.e. I need, for each Event:
dtStamp(actionID = 2) - dtStamp(actionID = 1)

I was going to try:

>create view EventOnTime as select EventID, dtStamp as EventOnDtStamp from EventLog where ActionID = 1;

>create view EventOffTime as select EventID, dtStamp as EventOffDtStamp from EventLog where ActionID = 2;

>select eventOnTime.EventID, eventOnTime.EventOnDtStamp - eventOffTime.EventOffDtStamp as EventDuration where eventOnTime.EventID = eventOffTime.EventID;

... but I can't create views with this version of SQL (server version: 4.0.20-standard-log)

Dump File Times Out?
I have a huge Access database (about 50,000) records. I use Access dumb to create a sql file which I can them go into phpmyadmin and import the records. Well, after a while the process times out. Is there a way I can import large amount of data into MYSQL without timing out?

Also the access database that I convert over gets updated every week. I don't know which records get updated or added. Also the app I am using only works with Access so I can not completely convert over. Is there a way I can update the MYSQL without having to import that huge file again. Maybe something that will not override the records that are same just change the modifed ones and add the new records.

Struggling With Dates And Times!
I'm using MySQL 3.23 - I know it's old but it comes as default on Linux distribs and I just want something consistent between home, my ISP and work.

I want to work out the time difference between two entries on my database (I'm using PostNuke and have two posts which are stored as integers, ie unix times). I can see that there is now a datediff() and timediff() function but they don't work hence why I mentioned the version I'm using.

Can anyone tell me how to get the difference between two dates - I am assuming I subtract one from the other but don't know how to convert the result into something useful (like days and hours etc) because I'm not sure what the unix time is made up of.

I guess an easier version of that lot is : is a unix time just a second count?

Disabling An Entry More Then 3 Times A Day.
Like if you enter 3 times a day the same text. It echo's something instead of writing in the database. Do i need to add a date on where the line was added to it?

Call To Database Times Out
using ZenCart 1.3.7, and when it calls to the database after clicking on "go to checkout" it hangs and then returns the following error message:

I get this message after clicking on "go to checkout"
2013 Lost connection to MySQL server during query in:

[select sum(tax_rate) as tax_rate from (tax_rates tr left join zones_to_geo_zones za on (tr.tax_zone_id = za.geo_zone_id) left join geo_zones tz on (tz.geo_zone_id = tr.tax_zone_id) ) where (za.zone_country_id is null or za.zone_country_id = 0 or za.zone_country_id = '223') and (za.zone_id is null or za.zone_id = 0 or za.zone_id = '12') and tr.tax_class_id = '1' group by tr.tax_priority]
2006 MySQL server has gone away in:

[select count(*) as total from sessions where sesskey = 'd60f1f220b761a5a176738c1a65de4b2']

Warning: Unknown(): A session is active. You cannot change the session module's ini settings at this time. in Unknown on line 0

I've checked with my host, and they are able to do a php call to the database just fine.

Adding 1 Year To All Times
suppose that

dbX -> tableX

id columnX
1 1190815874
2 1192975748
3 1196695027
4 1196796789

how can i add 1 year all value where year is 2007 ?

my sql do not run

UPDATE `tablex` SET `columnx` = DATE_ADD(`columnx`, INTERVAL 1 YEAR)
WHERE DATE_FORMAT(FROM_UNIXTIME(`columnx`),'%X')) = 2007;

Slow Loading Times
It takes more than 30 seconds to load the phpmyadmin page. On a localhost server.
It says
Fatal error: Maximum execution time of 30 seconds exceeded in c:appservwwwphpmyadminlibrariesmysql_wrappers.lib.php on line 101

This sometimes also happens when loading my local website that uses MySQL.
I've tried reinstalling, but it doesnt help.

Export Records Times Out
I try to export all records from my db about once a week. I use phpmyadmin and select all tables structure and data and export as file. Well the problem now is it always times out when I do this. The db only contains about 18 tables and maybe 20,000 lines of data. The tables average about 12 fields each. So now I'm exporting a few tables at a time. Is there something I can do to change this?

Left Join 2 Times
SELECT f.id as id, f.forum_name as forum, f.forum_desc as description,
count(forum_id) as threads, u.name as mod
FROM forum_forum AS f
LEFT JOIN forum_posts AS p
ON f.id = p.forum_id
AND p.topic_id=0
LEFT JOIN forum_users AS u
ON f.forum_moderator = u.id
GROUP BY f.id

Output: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'mod FROM forum_forum AS f LEFT JOIN forum_posts AS

Does this query contain any syntax errors? Can mysql perform left join 2 times?

Ordering Results By Number Of Times They Appear
I'm not really sure the best way to explain what I want to do, so I'm going to make a really simple example to illustrate what I mean.

Let's say I have a table with column "temperature". There are 5 entries that contain the word "hot", 3 entries that contain the word "medium", and 2 entries that contain the word "cold". However, these entries are not in any particular order.

Is there a "SELECT * FROM" statement which will return the results by order of popularity in the following manner?:

hot (5)
medium (3)
cold (2)

I have a script I'm working on and I'm trying to figure out the best way to do something like this.

Select Same Row Multiple Times Using Column
I've seen this asked before and although someone answered that it is possible, they did not post the solution, so if anyone can enlighten me that would be helpful.

Basiclly with table info


name | quantity
john | 3
anne | 1
will | 2
Return results

john
john
john
anne
will
will

Who Do I Write Select With Dates And Times
i have to cols, date and time. who can i do, SELECT between (date 1,time 1) to (date 2, time 2)?

for example i want to get the recordes between 2007-01-01 23:00:00 to 2007-01-03 03:00:00 ?

How To Find Out How Many Times A Query Has Been Executed
How can you count the number of times your query has been executed? So I'm trying to set it up, so that I get a variable on every time someone views a review.

I have two querys right now, but honestly don't really know what I'm doing. And I'm assuming I have to increment viewcount everytime that query gets executed.

This query looks up the review:

Report Of Query Execution Times
Does mysql have a tool to record and report a list of all queries executed and how long it took to execute each query? If not can anyone suggest a tool I can use to do this?

I've heard of mysql query profiler but does it capture queries from all sessions?

Trace SQL Queries Date/times
I have a web application connected to mySQL 4.1 database. I would like to know the date/time for the queries executed on mySQL DB when any operations performed from the UI.

Is there any mechanism to trace the information related to any query updates happening on the DB when operations are performed from the UI.

Datetime And Timestamp Recording Different Times
I have a datetime field that records date and time. This field records
when rec is created. I also have a timestamp field that records
whenever the record is updated. I noticed that when i first create the
record, the update time is about 3-5 minutes before the create time.
The update time and create time has to be identical. How can one lag
the other? Im executing sql from a php page.

Joining A Table Multiple Times
I was wondering if it was possible to join 2 tables on 3 different feilds, but I don't want the 3 feilds to limit my results... I'll try and explain:

Table 1 = "offices"
Table 2 = "employees"

The offices table has the addresses of all the offices and 3 extra feilds "manager", "supervisor", and "employee". (these 3 feilds have a numeric value equal to the primary key in the employees table)

The employees table has the employee information like address and phone number and such.

I would like to write a query that would pull the office name as one feild, followed by "manager", "supervisor" and "employee".

Currently I have this, but it only pulls the employee and I'm not sure how to get the manager and supervisor to be a part of the query:

SELECT CONCAT(office.id_store, ' - ', office.storename) as offices, CONCAT(user.lastname, ', ', user.firstname) as fullname
FROM office LEFT JOIN user ON office.empoyee = user.id_user

Mysql Result Times Over 15 Seconds
I am having problems with result times. I run a search from my website and it takes around 15 seconds to generate the mysql query and then 40 seconds to load the page.

MySQL Query Times Out From Page But Not Console...
The query works ok when executed from the console, but never executes from the any page. - When I use MySQL Administrator to view the threads this particular thread gets stuck on "copying to tmp table on disk"...

Calculating Time Difference In Minutes Between 2 Times
I have two columns in a table start_time and end_time (stored as datetime). I wish to work out the time difference in minutes between these two values. If the difference is 1hr 30 minutes I wish to get 90 (mins)

I have tried:

SELECT TIME_FORMAT(TIMEDIFF(start_time, end_time), '%i') FROM table ...  This returns justs the minutes (e.g. 30)

and

SELECT TIME_FORMAT(start_time - end_time, '%i') FROM table .... no such luck.

Linking Table Entries Multiple Times
I have no idea how to handle certain kinds of relations between tables:

I have a table called 'labels' and a table called 'artists'. Every artist belongs to at least one label, but could also belong to any higher number of them. How would I solve this in my database architecture?

I discarded the idea of simply adding 10 columns called 'label1', 'label2', etc; Also I have found the ENUM and SET datatypes, but the possible values entered there should be set at table creation time which is also not quite what I'm looking for.

Which Is Faster In MySQL? Comparing Unix Times, Or DATETIMES?
I'm leaning towards using unix times inserted into my MySQL for ease of use in manipulating the data with PHP. I think this will be the final decision, which one would be faster?

--

Mysql:
* INT (4 bytes)
* DATETIME (8 bytes)
* TIMESTAMP (4 bytes)

--

My PHP application does alot of querying from the database to compare specific data within TIMERANGES, so always, I'm querying with "time >" or "time <".

My question is would doing the WHERE time query with the native MySQL DATETIME be faster, than doing a WHERE query with the unix timestamp?

Upload
what is the best way to upload big database
to internet server?

Cannot Upload
I am uploading Excel.csv to mySQL using phpMyAdmin. I've done it many times before with no problems.

Got a single table with 18 columns and 137 rows. One of those columns has quite a bit of HTML in it to create a particular table for each of the 137 item.

The table data uploads EXCEPT for one column ... it's a price column. Simple 2 decimal prices.

I cannot get that column to upload?

The only other time I had a similar problem was with a date column. That was a date format issue that I fixed without a problem.

Upload Form
I am trying to use this code to insert the file into my dba but am not sure if it works i get errors. I want to create a table, then put the file into the table using a web baised form. If anyone knows how i can create a form to do this or if anyone knows of documentation on how to do this i would be greatful. Below is my code

<?
if(isset($_POST['upload']))
{
$fileName = $_FILES['userfile']['name'];
$tmpName = $_FILES['userfile']['tmp_name'];
$fileSize = $_FILES['userfile']['size'];
$fileType = $_FILES['userfile']['type'];

$fp = fopen($tmpName, 'r+');
$content = fwrite($fp, $fileSize);
$content = fread($fp, $fileSize);
$content = addslashes($content);
fclose($fp);

if(!get_magic_quotes_gpc())
{
$fileName = addslashes($fileName);
}


include 'library/config.php';
include 'library/opendb.php';

// add a table to the selected database
$result="CREATE TABLE userfile (fileName VARCHAR(25), fileSize VARCHAR(25), fileType VARCHAR(15), fileSize VARCHAR(2000))";
if (mysql_query($result)){
echo "success in table creation.";
} else {
echo "no table created.";
}

$query = "INSERT INTO upload (name, size, type, content ) ".
"VALUES ('$fileName', '$fileSize', '$fileType', '$content')";

mysql_query($query) or die('Error, query failed');
include 'library/closedb.php';

echo "<br>File $fileName uploaded<br>";
}
?>
<form action="" method="post" enctype="multipart/form-data" name="uploadform">
<table width="350" border="0" cellpadding="1" cellspacing="1" class="box">
<tr>
<td width="246"><input type="hidden" name="MAX_FILE_SIZE" value="2000000"><input name="userfile" type="file" class="box" id="userfile">
</td>
<td width="80"><input name="upload" type="submit" class="box" id="upload" value=" Upload "></td>
</tr>
</table>
</form>

Upload Files
how I can upload files to mysql with a form??

Image Upload
The basic question: What field do I use in MySQL to store images? Is it varchar?

My second question: I'm using Dreamweaver MX to talk to my MySQL database using PHP. I can update records, add new records etc.. The only thing I can't figure out is how to create a browse option to look for a image to upload.

&gt; 8 Hrs To Upload Data
a brief description of my situation :
1. Have a table with 23 odd fields. During table creation, I declared a 6 key combination primary key.
2. To upload 1.2 million records, I used "LOAD DATA INFILE...etc." & specified the target for the "LOAD INFILE..." statement as my text file which has the 1.2 mil. records.
3. I have waited for more than 8 hrs & the thread is still 'inserting' records into the table! I used SHOW PROCESSLIST to check what the thread is doing..
4. The data is plain & simple VARCHARS & a bunch of DECIMAL types

My queries -
1. Is 8-10 hrs reqd to upload a million records? If not, what am I doing wrong?
2. Should I drop the primary key constraint--> upload the records--> create the constraint again? Will this make the upload faster?why?

Upload Database
I create a database in my pc. now i need to upload it to remote server(I use third party hosting companies), but I don't know how to do that!!?
I have mysql admin software and also I know the command:mysql dump may help,

Upload 50 MB Db Script
I have exported DB script from MySQL database. Its size is 50 MB. Now I want to upload this script data into another MySQL databse. But It gives me time execution error when I try to upload through PHPMyAdmin web interface.

Fastest Way To Upload
i have to upload 12M records to a MySQL database. What is the fastest way -- like 20000 per second? I mean if source is a flat file? or if source is a remote db? or if source is a single table only from a different schema??

Upload Images
I am completely new to MySQL and have no idea how it works.
I want to be able to have an upload form so people can upload images to a MySQL database I have some script running on. How would I code that and also regulate so it resizes to a specific size when I call it up to show on a "results page"?

Also, I have noticed that the fields that I have in the database seem to be all "required". If I don't input ALL of the fields then nothing is inputted into the database. However, if I do fill out all of the fields in the database then everything is uploaded correctly.What do I have to do in Myphp... to change it so no all of the fields are mandated to allow data entry? Also, I noticed that all of the fields are "NULL" if that means anything.

Upload SQL File
I bought a database from a friend, he given me a SQL extenstion file and he said just go to your database and Import it. But in my Mysql PHP Myadmin there is not import function what i will do now?

Upload My Database
Im an absolute beginner with mysql and have successfully setup and have working a licensed copy of VBulletin of which I have uploaded the php files for, but not the database.I am completely lost here. How do I upload the mysql database to the web server?

Upload Datafiles
is there somewhere an option i can increase the limit of 8,192KB per file upload on the SQL import datafile form ?
I saw on many places they have up to 48k

Binary Upload
i like to upload blob-data to MySQl database with this command:

insert into files (f_name, f_binary, f_date, t_id) values ('musik2', LOAD_FILE('C:/Dokumente und Einstellungen/wolfgang.RE-MSQDW1NI9MBG/data/Neuer Ordner/a.mp3'), 2004-12-12, 1)

MySQl states Error: 1048 Column 'f_binary' can not be null

As I wasn't able to figure out my mistake in the commmand I created a txt-file a a.txt and doing the same command with this file - and this works.


Upload Backup
I am trying to back up my database via phpMyAdmin. I exported the data with no problem to a SQL file. However I am having problems uploading it to the new database. Since the file is large I first uploaded it to my server in a directory that the $cfg['uploadDIr'] parameter in the config.inc.php file is looking in.
In phpMyAdmin I then click on the SQL tab and under the 'web server upload directory' I select the file and hit the 'Go' button. However after a short while I receive the error message "error 500: Internal Server Error - The server encountered an unexpected condition which prevented it from fulfilling the request."
It does work if I upload a small file, but I get the error message when I upload a large file. Any idea why I can't upload a larger file (which is only 930KB)?

Upload Large Sql Files

Any suggestions for how to upload large data files (.sql).

Our data is updated every few days, and we need to upload the data on our webserver. How we can do that.

We are using PHP/Mysql on linux server.



Copyright © 2005-08 www.BigResource.com, All rights reserved