Re: Is there a solution to this?
Not to bash MySQL -- because it really is a nice database for being FREE -- but this is the kind of thing that puts MySQL in a bad light relative to "real" databases like Oracle or even SQL Server.
If I issue a query against a database, it should either (a) do the work and give me the answer, or (b) throw an error. It should NOT hang indefinitely under ANY circumstances. Nor should it take DAYS to finish a relatively simple query. The fact that this thread was created THREE YEARS AGO is pretty damning. This should be fixed by now.
Just to forestall any comments to the affect, "Well, if you just turn this dial so, and then set this switch however, then it won't hang," the database shouldn't hang regardless of how badly I maul my setup parameters. Do you think I ever have to worry about this kind of thing with SQL Server? Never.
For those of you looking for some hint as to what's going on, here's a little bit of help:
(1) SHOW PROCESSLIST will tell you at a very high level what the process is actually doing. But if you've found this thread, you know that already.
(2) On Windows Server, the temporary table is being written to the C:\Windows\Temp folder, with a name like "#sql_*.MYD". If you're patient, you can watch just how S-L-O-W-L-Y MySQL writes this table. I have no idea what kind of algorithm could possibly take this long.
For instance, I have a query that's been running for 3 hours and has only managed to write 45MB to the temporary table (and no indexes yet). I can copy the entire temporary table in 15 seconds, so the process definitely isn't I/O bound. The process is using almost ZERO CPU, so it's definitely not CPU bound. I guess the process must be memory bound, but MySQL is using a GIG of RAM, so it could have built that entire result table in memory without any problem. The performance really is pretty sad.
In the realm of workarounds, we've had decent success breaking the job into smaller pieces and then running them all sequentially. Of course, you have no way of knowing when you'll need to do this until you've tried the full query first and seen it hang. Sad, sad, sad.
Edited 1 time(s). Last edit at 11/14/2008 12:35AM by Robert Freeland.
Subject
Views
Written By
Posted
27074
August 11, 2005 11:25AM
23492
August 12, 2005 09:07AM
18842
August 12, 2005 01:06PM
18320
August 22, 2005 09:46AM
16385
August 24, 2005 03:27PM
12857
August 24, 2005 04:05PM
13543
August 26, 2005 11:02AM
7316
August 26, 2005 11:05AM
6692
August 26, 2005 11:45AM
6479
August 26, 2005 05:46PM
6746
August 26, 2005 10:34PM
6333
August 25, 2005 01:08PM
5755
August 26, 2005 11:07AM
5573
August 27, 2005 09:09AM
5881
August 29, 2005 11:50AM
5809
August 29, 2005 12:04PM
5145
August 29, 2005 12:55PM
5048
August 29, 2005 05:26PM
4998
August 29, 2005 06:34PM
4640
August 29, 2005 08:40PM
4510
August 29, 2005 08:47PM
4393
August 29, 2005 09:00PM
4595
August 30, 2005 10:05AM
4426
August 30, 2005 10:18AM
4998
August 30, 2005 10:20AM
6023
August 29, 2005 08:53PM
4883
August 29, 2005 09:50PM
4693
August 29, 2005 10:01PM
5097
August 30, 2005 08:53AM
4560
August 30, 2005 11:22AM
5106
August 30, 2005 11:33AM
4766
August 30, 2005 11:59AM
24238
August 31, 2005 02:32PM
6401
August 31, 2005 02:49PM
5100
August 31, 2005 02:56PM
4934
August 31, 2005 03:06PM
8161
December 07, 2006 10:30AM
4888
August 31, 2005 03:10PM
4764
August 31, 2005 03:32PM
17591
August 31, 2005 07:15PM
4985
September 01, 2005 03:05AM
7725
September 15, 2005 04:31PM
5439
September 01, 2005 04:39AM
4328
September 08, 2005 09:53AM
4687
September 08, 2005 11:25AM
4494
September 26, 2005 11:52AM
4386
September 26, 2005 12:13PM
4335
September 27, 2005 09:55AM
4094
September 27, 2005 10:18AM
3997
September 28, 2005 10:29AM
4155
September 28, 2005 10:34AM
4307
September 28, 2005 10:52AM
4788
September 28, 2005 10:58AM
9560
September 23, 2005 01:56AM
4822
September 23, 2005 07:11AM
4820
October 05, 2005 04:58AM
4824
October 05, 2005 04:52PM
6004
October 05, 2005 11:49PM
5295
October 06, 2005 01:34AM
6583
October 06, 2005 04:57PM
4530
December 13, 2005 10:28AM
4521
December 13, 2005 10:34AM
4427
November 17, 2005 09:39AM
4789
January 08, 2007 12:12PM
4680
December 12, 2005 02:13PM
4508
December 14, 2005 11:43PM
4100
December 15, 2005 08:37AM
4179
December 15, 2005 11:18AM
4084
December 15, 2005 11:27AM
4209
December 15, 2005 11:32AM
3964
December 15, 2005 11:43AM
3913
December 15, 2005 11:43AM
4075
December 15, 2005 11:48AM
3950
December 15, 2005 11:51AM
4365
December 15, 2005 02:14PM
4023
December 15, 2005 02:18PM
3883
December 15, 2005 02:27PM
4375
December 15, 2005 02:43PM
3951
December 15, 2005 08:46AM
4938
January 26, 2006 12:38PM
4065
January 26, 2006 01:48PM
4150
January 26, 2006 01:48PM
3911
January 26, 2006 01:52PM
4064
January 27, 2006 04:46PM
3917
January 29, 2006 11:21AM
4272
January 30, 2006 09:42AM
4307
February 27, 2006 02:17PM
3999
February 27, 2006 02:23PM
4221
March 05, 2006 04:56AM
4043
March 06, 2006 08:09AM
4005
April 05, 2006 01:03PM
4194
September 27, 2006 08:43AM
4144
November 19, 2006 04:42AM
4298
December 14, 2006 05:45PM
4110
February 01, 2007 04:40AM
4776
November 11, 2007 01:24PM
4992
December 20, 2007 10:40AM
6362
January 21, 2008 10:14AM
5757
January 21, 2008 10:53AM
5212
May 19, 2008 09:41AM
5426
February 05, 2008 10:27AM
5965
March 12, 2008 08:37AM
5280
May 19, 2008 03:02AM
Re: Is there a solution to this?
6030
November 14, 2008 12:31AM
7055
March 06, 2009 03:36PM