Re: Is there a solution to this?
Not to bash MySQL -- because it really is a nice database for being FREE -- but this is the kind of thing that puts MySQL in a bad light relative to "real" databases like Oracle or even SQL Server.
If I issue a query against a database, it should either (a) do the work and give me the answer, or (b) throw an error. It should NOT hang indefinitely under ANY circumstances. Nor should it take DAYS to finish a relatively simple query. The fact that this thread was created THREE YEARS AGO is pretty damning. This should be fixed by now.
Just to forestall any comments to the affect, "Well, if you just turn this dial so, and then set this switch however, then it won't hang," the database shouldn't hang regardless of how badly I maul my setup parameters. Do you think I ever have to worry about this kind of thing with SQL Server? Never.
For those of you looking for some hint as to what's going on, here's a little bit of help:
(1) SHOW PROCESSLIST will tell you at a very high level what the process is actually doing. But if you've found this thread, you know that already.
(2) On Windows Server, the temporary table is being written to the C:\Windows\Temp folder, with a name like "#sql_*.MYD". If you're patient, you can watch just how S-L-O-W-L-Y MySQL writes this table. I have no idea what kind of algorithm could possibly take this long.
For instance, I have a query that's been running for 3 hours and has only managed to write 45MB to the temporary table (and no indexes yet). I can copy the entire temporary table in 15 seconds, so the process definitely isn't I/O bound. The process is using almost ZERO CPU, so it's definitely not CPU bound. I guess the process must be memory bound, but MySQL is using a GIG of RAM, so it could have built that entire result table in memory without any problem. The performance really is pretty sad.
In the realm of workarounds, we've had decent success breaking the job into smaller pieces and then running them all sequentially. Of course, you have no way of knowing when you'll need to do this until you've tried the full query first and seen it hang. Sad, sad, sad.
Edited 1 time(s). Last edit at 11/14/2008 12:35AM by Robert Freeland.
Subject
Views
Written By
Posted
26915
August 11, 2005 11:25AM
23424
August 12, 2005 09:07AM
18791
August 12, 2005 01:06PM
18266
August 22, 2005 09:46AM
16325
August 24, 2005 03:27PM
12799
August 24, 2005 04:05PM
13494
August 26, 2005 11:02AM
7257
August 26, 2005 11:05AM
6629
August 26, 2005 11:45AM
6420
August 26, 2005 05:46PM
6695
August 26, 2005 10:34PM
6261
August 25, 2005 01:08PM
5687
August 26, 2005 11:07AM
5526
August 27, 2005 09:09AM
5826
August 29, 2005 11:50AM
5751
August 29, 2005 12:04PM
5094
August 29, 2005 12:55PM
4987
August 29, 2005 05:26PM
4943
August 29, 2005 06:34PM
4580
August 29, 2005 08:40PM
4463
August 29, 2005 08:47PM
4342
August 29, 2005 09:00PM
4553
August 30, 2005 10:05AM
4380
August 30, 2005 10:18AM
4949
August 30, 2005 10:20AM
5975
August 29, 2005 08:53PM
4845
August 29, 2005 09:50PM
4629
August 29, 2005 10:01PM
5055
August 30, 2005 08:53AM
4521
August 30, 2005 11:22AM
5056
August 30, 2005 11:33AM
4719
August 30, 2005 11:59AM
24195
August 31, 2005 02:32PM
6346
August 31, 2005 02:49PM
5068
August 31, 2005 02:56PM
4872
August 31, 2005 03:06PM
8108
December 07, 2006 10:30AM
4834
August 31, 2005 03:10PM
4718
August 31, 2005 03:32PM
17540
August 31, 2005 07:15PM
4937
September 01, 2005 03:05AM
7680
September 15, 2005 04:31PM
5393
September 01, 2005 04:39AM
4280
September 08, 2005 09:53AM
4629
September 08, 2005 11:25AM
4457
September 26, 2005 11:52AM
4343
September 26, 2005 12:13PM
4295
September 27, 2005 09:55AM
4038
September 27, 2005 10:18AM
3940
September 28, 2005 10:29AM
4103
September 28, 2005 10:34AM
4252
September 28, 2005 10:52AM
4748
September 28, 2005 10:58AM
9515
September 23, 2005 01:56AM
4761
September 23, 2005 07:11AM
4774
October 05, 2005 04:58AM
4613
October 05, 2005 04:52PM
5949
October 05, 2005 11:49PM
5253
October 06, 2005 01:34AM
6509
October 06, 2005 04:57PM
4479
December 13, 2005 10:28AM
4480
December 13, 2005 10:34AM
4379
November 17, 2005 09:39AM
4746
January 08, 2007 12:12PM
4643
December 12, 2005 02:13PM
4474
December 14, 2005 11:43PM
4054
December 15, 2005 08:37AM
4145
December 15, 2005 11:18AM
4042
December 15, 2005 11:27AM
4168
December 15, 2005 11:32AM
3917
December 15, 2005 11:43AM
3860
December 15, 2005 11:43AM
4022
December 15, 2005 11:48AM
3908
December 15, 2005 11:51AM
4318
December 15, 2005 02:14PM
3979
December 15, 2005 02:18PM
3837
December 15, 2005 02:27PM
4337
December 15, 2005 02:43PM
3915
December 15, 2005 08:46AM
4878
January 26, 2006 12:38PM
4020
January 26, 2006 01:48PM
4107
January 26, 2006 01:48PM
3867
January 26, 2006 01:52PM
4021
January 27, 2006 04:46PM
3851
January 29, 2006 11:21AM
4227
January 30, 2006 09:42AM
4252
February 27, 2006 02:17PM
3954
February 27, 2006 02:23PM
4177
March 05, 2006 04:56AM
4005
March 06, 2006 08:09AM
3968
April 05, 2006 01:03PM
4156
September 27, 2006 08:43AM
4113
November 19, 2006 04:42AM
4266
December 14, 2006 05:45PM
4071
February 01, 2007 04:40AM
4719
November 11, 2007 01:24PM
4952
December 20, 2007 10:40AM
6307
January 21, 2008 10:14AM
5711
January 21, 2008 10:53AM
5155
May 19, 2008 09:41AM
5393
February 05, 2008 10:27AM
5889
March 12, 2008 08:37AM
5225
May 19, 2008 03:02AM
Re: Is there a solution to this?
5981
November 14, 2008 12:31AM
7014
March 06, 2009 03:36PM