Forum for SAN, NAS, iSCSI, RAID, etc. http://forums.mysql.com/list.php?123 Tue, 21 May 2013 23:00:12 +0000 Phorum 5.2.19 http://forums.mysql.com/read.php?123,583684,583684#msg-583684 http://forums.mysql.com/read.php?123,583684,583684#msg-583684 Can someone please give me a rough estimate of howmany tables we can created in a MySQL DB?

Can we create millions of tables in a DB by increasing the hardware alone? Will there be any performance degradation if we have millions of tables in a DB?

Thanks,
Velmuurgan.P]]> Velmurugan Panneerselvam MySQL & Storage Thu, 11 Apr 2013 11:59:16 +0000 http://forums.mysql.com/read.php?123,568157,568157#msg-568157 http://forums.mysql.com/read.php?123,568157,568157#msg-568157 itwizard solution MySQL & Storage Tue, 11 Sep 2012 06:22:51 +0000 http://forums.mysql.com/read.php?123,564542,564542#msg-564542 http://forums.mysql.com/read.php?123,564542,564542#msg-564542 Michael Andrews MySQL & Storage Thu, 09 Aug 2012 18:47:33 +0000 http://forums.mysql.com/read.php?123,563585,563585#msg-563585 http://forums.mysql.com/read.php?123,563585,563585#msg-563585
I have records into .CSV file and I want to import them into MySQL database. Whenever I import the .CSV I get the message “Import has been successfully finished…” but only 79 out of 114 records will be inserted into the database. When I try to import the CSV file with 411 records, just 282 will be inserted. The CSV file which got 411 records includes two categories of records “Active and Sold” whereby 114 records are Active. Has someone gotten this type of problem? If so what should be done?

Thanks]]> Support 2011 MySQL & Storage Wed, 01 Aug 2012 20:43:01 +0000 http://forums.mysql.com/read.php?123,557913,557913#msg-557913 http://forums.mysql.com/read.php?123,557913,557913#msg-557913
In Windows Server 2008

We closed external storage physically. MySQL service stoped and we could not reach the server. Then we opened the storage unit and we could start service

Logs

120618 14:49:30 InnoDB: Operating system error number 21 in a file operation.
InnoDB: Some operating system error numbers are described at
InnoDB: http://dev.mysql.com/doc/refman/5.0/en/operating-system-error-codes.html
InnoDB: File name E:\Data\ibdata1
InnoDB: File operation call: 'aio write'.
InnoDB: Cannot continue operation.
We made storage unit offline from operating system. After 3-4 minutes and some insert trials(some insert trials succeded) MySQL service stoped and we could not reach the server.

Logs

120618 14:27:21 InnoDB: Operating system error number 21 in a file operation.
InnoDB: Some operating system error numbers are described at
InnoDB: http://dev.mysql.com/doc/refman/5.0/en/operating-system-error-codes.html
InnoDB: File name E:\Data\ibdata1
InnoDB: File operation call: 'aio read'.
InnoDB: Cannot continue operation.
Then we made storage unit online and tried to start the service

Logs

InnoDB: The first specified data file E:\ibdata1 did not exist:
InnoDB: a new database to be created!
120618 14:29:00 InnoDB: Setting file E:\ibdata1 size to 10 MB
InnoDB: Database physically writes the file full: wait...
InnoDB: Error: all log files must be created at the same time.
InnoDB: All log files must be created also in database creation.
InnoDB: If you want bigger or smaller log files, shut down the
InnoDB: database and make sure there were no errors in shutdown.
InnoDB: Then delete the existing log files. Edit the .cnf file
InnoDB: and start the database again.
120618 14:29:00 [ERROR] Default storage engine (InnoDB) is not available
120618 14:29:00 [ERROR] Aborting
Then we tried to reconfigure MySQL

Logs

InnoDB: End of page dump
120618 14:34:02 InnoDB: Page checksum 1575996416, prior-to-4.0.14-form checksum 1371122432
InnoDB: stored checksum 0, prior-to-4.0.14-form stored checksum 0
InnoDB: Page lsn 0 0, low 4 bytes of lsn at page end 0
InnoDB: Page number (if stored to page already) 0,
InnoDB: space id (if created with >= MySQL-4.1.1 and stored already) 0
120618 14:34:02 - mysqld got exception 0xc0000005 ;
This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail.

key_buffer_size=0

read_buffer_size=65536
max_used_connections=0
max_connections=100
threads_connected=0
It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_connections = 32000 K bytes of memory Hope that's ok; if not, decrease some variables in the equation.

thd=00000000

Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong...
006D2DB6 mysqld-nt.exe!page_cur_search_with_match()[page0cur.c:347]
0067A777 mysqld-nt.exe!btr_cur_search_to_nth_level()[btr0cur.c:500]
006B2E0E mysqld-nt.exe!btr_pcur_open_on_user_rec()[btr0pcur.c:549]
006A5615 mysqld-nt.exe!dict_load_indexes()[dict0load.c:604]
006A6424 mysqld-nt.exe!dict_load_sys_table()[dict0load.c:1023]
006BBB20 mysqld-nt.exe!dict_boot()[dict0boot.c:378]
00668A79 mysqld-nt.exe!innobase_start_or_create_for_mysql()[srv0start.c:1462]
00444462 mysqld-nt.exe!innobase_init()[ha_innodb.cc:1427]
0044B30D mysqld-nt.exe!ha_init()[handler.cc:483]
004B923E mysqld-nt.exe!init_server_components()[mysqld.cc:3431]
004BD070 mysqld-nt.exe!win_main()[mysqld.cc:3806]
c004BD43B mysqld-nt.exe!mysql_service()[mysqld.cc:3967]
006E28EF mysqld-nt.exe!_threadstart()[thread.c:196]
75583677 kernel32.dll!BaseThreadInitThunk()
77359D72 ntdll.dll!RtlInitializeExceptionChain()
77359D45 ntdll.dll!RtlInitializeExceptionChain()
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. 120618 14:29:00 [Note] C:\Program Files (x86)\MySQL\MySQL Server 5.0\bin\mysqld-nt: Shutdown complete
In Windows Server 2003

We made storage unit offline. After 3-4 minutes and some insert trials(some insert trials succeded) MySQL service stoped and we could not reach the server.

Logs

InnoDB: Log scan progressed past the checkpoint lsn 0 9834427 120618 14:09:59 InnoDB: Database was not shut down normally!
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files...
InnoDB: Restoring possible half-written data pages from the doublewrite
InnoDB: buffer...
InnoDB: Doing recovery: scanned up to log sequence number 0 9834574
120618 14:09:59 InnoDB: Starting an apply batch of log records to the database...
InnoDB: Progress in percents: 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 . 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99
InnoDB: Apply batch completed
120618 14:10:00 InnoDB: Started; log sequence number 0 9834574
120618 14:10:00 [Note] C:\Program Files (x86)\MySQL\MySQL Server 5.0\bin\mysqld-nt: ready for connections.
Version: '5.0.90-community-nt' socket: '' port: 3306 MySQL Community Edition (GPL)
120618 14:12:36 InnoDB: Operating system error number 21 in a file operation.
InnoDB: Some operating system error numbers are described at
InnoDB: http://dev.mysql.com/doc/refman/5.0/en/operating-system-error-codes.html
InnoDB: File name E:\Data\ibdata1
InnoDB: File operation call: 'aio read'.
InnoDB: Cannot continue operation.
Then we made storage unit online we could not start the service until we reinstalled MySQL. Before reinstall we tried to reconfigure but it did not work.

Logs

120618 14:16:53 InnoDB: Operating system error number 3 in a file operation.
InnoDB: The error means the system cannot find the path specified.
InnoDB: If you are installing InnoDB, remember that you must create
InnoDB: directories yourself, InnoDB does not create them.
InnoDB: File name E:\Data\ibdata1
InnoDB: File operation call: 'create'.
InnoDB: Cannot continue operation.
Could not start the MySQL service on Local Computer. Error 1067: The process terminated unexpectedly.(ERROR MESSAGE)

We closed external storage physically. MySQL service stoped and we could not reach the server. After that we opened the storage unit and we could start service(not automatically)

Logs

120618 14:01:26 InnoDB: Operating system error number 21 in a file operation.
InnoDB: Some operating system error numbers are described at
InnoDB: http://dev.mysql.com/doc/refman/5.0/en/operating-system-error-codes.html
InnoDB: File name E:\Data\ibdata1
InnoDB: File operation call: 'aio write'.
InnoDB: Cannot continue operation.

We presented external storage to the operating system via iSCSI interface

We expect service to autostart after storage unit is online/open. But these tests show unstable behaviors. Is there any solutions to this.]]> Onur Özçelik MySQL & Storage Mon, 18 Jun 2012 08:54:13 +0000 http://forums.mysql.com/read.php?123,520232,520232#msg-520232 http://forums.mysql.com/read.php?123,520232,520232#msg-520232
We have a mysql database on LUNS. I wish to do the following;

Clone LUNS in a consistant state for backups
SNAP from cloned LUNS for test/dev]]> bob flynn MySQL & Storage Thu, 15 Mar 2012 14:16:19 +0000 http://forums.mysql.com/read.php?123,515125,515125#msg-515125 http://forums.mysql.com/read.php?123,515125,515125#msg-515125 I would like to know is RAID 5 suitable for Mysql? Thank you.]]> newbie Shai MySQL & Storage Mon, 13 Feb 2012 12:16:52 +0000 http://forums.mysql.com/read.php?123,433580,433580#msg-433580 http://forums.mysql.com/read.php?123,433580,433580#msg-433580 Mirabell Stoffen MySQL & Storage Sun, 16 Oct 2011 17:30:46 +0000 http://forums.mysql.com/read.php?123,389072,389072#msg-389072 http://forums.mysql.com/read.php?123,389072,389072#msg-389072
I have a reasonably small database (c. 7G) which stores data related to files found on the filesystem. Up to now we have used NetApp/NFS for all datafiles (tablespaces, logfiles, binary logs) and our database runs in a replicated environment. I am now considering moving the files (c. 5.5M) into the database for better transactional safety but will probably retain NFS storage as is (i.e., datafiles stay where they are etc.) - a lot of files are less than 10K, most are less than 100K but there are some that are considerably large (i.e., several MB)

Has anyone got detailed experience with managing file assets in a database ? e.g., access times etc. Does anyone have general tuning tips (e.g., options) or advice on storage engines and row formats etc. ? Any thoughts welcome.

I have heard that backups run slower but imagine this is less of a concern if we are using NFS snapshots (i.e., we won't want to use mysqldump etc.)

Regards,
Alan.]]> Alan Moran MySQL & Storage Thu, 07 Oct 2010 09:20:31 +0000 http://forums.mysql.com/read.php?123,376591,376591#msg-376591 http://forums.mysql.com/read.php?123,376591,376591#msg-376591 http://github.com/facebook/flashcache
http://www.facebook.com/note.php?note_id=388112370932
http://www.percona.com/files/presentations/UC2010-An-Overview-of-Flash-Storage-for-Databases.pdf
http://perspectives.mvdirona.com/2010/04/29/FacebookFlashcache.aspx
http://www.mysqlperformanceblog.com/2010/04/27/level-2-flash-cache-is-there/
http://www.mysqlperformanceblog.com/2010/05/10/flashcache-first-experiments/
http://www.mysqlperformanceblog.com/2010/05/18/flashcache-more-benchmarks/
http://www.mysqlperformanceblog.com/2010/05/25/flashcache-tpcc-workload/]]> Edwin DeSouza MySQL & Storage Fri, 16 Jul 2010 17:03:30 +0000 http://forums.mysql.com/read.php?123,363667,363667#msg-363667 http://forums.mysql.com/read.php?123,363667,363667#msg-363667
Join us on Wednesday, April 21st, 2010 at 10am PST for our webinar, highlighting the key reasons why and when iSCSI is the best choice over NAS when selecting a high performance storage system.

Sign up for this FREE webinar and discover:

* The difference between iSCSI and NAS
* Typical iSCSI/NAS applications
* Advantages/disadvantages of iSCSI and NAS
* When to buy iSCSI vs NAS

Click here to register for the webinar.
https://www2.gotomeeting.com/register/218619595


John Harris
---]]> john Harris MySQL & Storage Fri, 16 Apr 2010 20:15:09 +0000 http://forums.mysql.com/read.php?123,356621,356621#msg-356621 http://forums.mysql.com/read.php?123,356621,356621#msg-356621 http://www.igvita.com/2009/12/07/future-of-rdbms-is-ram-clouds-ssd/]]> Edwin DeSouza MySQL & Storage Wed, 03 Mar 2010 03:37:50 +0000 http://forums.mysql.com/read.php?123,301897,301897#msg-301897 http://forums.mysql.com/read.php?123,301897,301897#msg-301897 http://shinguz.blogspot.com/2010/01/mysql-on-vmware-workstationdrbd-vs.html]]> Edwin DeSouza MySQL & Storage Fri, 22 Jan 2010 18:24:26 +0000 http://forums.mysql.com/read.php?123,287713,287713#msg-287713 http://forums.mysql.com/read.php?123,287713,287713#msg-287713
We have a DB server with 500qps. Its doing about 20 000 reads per second with iostat -x 1 and 5 000 writes per second.

The server is disk i/o bound. It is running at Engine Yard w/ a SAN by CoRaid.

My recommendation is to move this onto separate direct attach storage machines with master/slave replication in the short term.

In the long term we will break up the large tables with sharding.

Any feedback would be appreciated. Is SAN better? Is DAS better? Etc.]]> Khalid Shaikh MySQL & Storage Fri, 23 Oct 2009 23:43:27 +0000 http://forums.mysql.com/read.php?123,274827,274827#msg-274827 http://forums.mysql.com/read.php?123,274827,274827#msg-274827
I have Novell SuSE Linux Enterprise 10 and I would like to know the best and safest approach to installing the MySQL which comes with the package on a separate mount point on our SAN.

What are the detailed steps?

Do I:

1. First, just install it as is (default)

2. stop mysql

3. create a mount point on the SAN

4. copy what is on /var/lib/mysql to the SAN mount point I just created

5. define/configure the permissions

6. makes changes in my.cnf to point to the SAN mount point (including the log and tmp location)

7. make an entry in /etc/fstab to the new mount point

8. and finally, restart MySQL?

is this it in a nutshell?

What happens when i create a new database? it should go to the new mount point, correct?

Thanks

Chris]]> Christopher Liong MySQL & Storage Mon, 10 Aug 2009 17:31:17 +0000 http://forums.mysql.com/read.php?123,272859,272859#msg-272859 http://forums.mysql.com/read.php?123,272859,272859#msg-272859
I would like to setup multiple web-servers each running a MySQL server.
The database itself is stored on a remote storage iSCSI.

Can someone please explain how the multiple MySQL servers can run this in parralel since I know that each MySQL server needs to manage the database by itself?
Maybe I am mistaken here or there is a solution I am not aware of.

Thank you,
Zeev]]> Zeev Cohen MySQL & Storage Wed, 05 Aug 2009 08:29:33 +0000 http://forums.mysql.com/read.php?123,264910,264910#msg-264910 http://forums.mysql.com/read.php?123,264910,264910#msg-264910
Example

server 1: datadir = /mnt/md3000i/mysql/var
server 2: datadir = /mnt/md3000i/mysql/var
server 3: datadir = /mnt/md3000i/mysql/var

Where /mnt/md3000i/mysql/var is the same filesystem on the md3000i and servers access simultaneously to the datadir files.

Would it be possible? Any suggestion?

Thanks in advance,

Andres]]> andres m77 MySQL & Storage Mon, 08 Jun 2009 22:04:16 +0000 http://forums.mysql.com/read.php?123,264138,264138#msg-264138 http://forums.mysql.com/read.php?123,264138,264138#msg-264138
We are planning to mount MySQL 5 DB files with NFS.

Right now folder "/var/lib/mysql" has been mounted.

Initially we faced following problems while starting mysql service.
"Starting MSQL.Manager of pid-file quit without updating file."
"MySQL manager or server PID file could not be found".

After giving full 777 permissions to the mysql folder mysql service started. But again we are facing problems while stopping mysql service.

It seems we are missing some fundamentals.

Are there any guide lines available for configuring MySQL with NFS?

Quick response would be highly appreciated.

Regards,
Prasad.]]> prasad k MySQL & Storage Mon, 25 May 2009 14:05:47 +0000 http://forums.mysql.com/read.php?123,263143,263143#msg-263143 http://forums.mysql.com/read.php?123,263143,263143#msg-263143 http://yoshinorimatsunobu.blogspot.com/2009/05/make-sure-write-cache-is-enabled-on.html]]> Edwin DeSouza MySQL & Storage Mon, 18 May 2009 16:09:56 +0000 http://forums.mysql.com/read.php?123,262703,262703#msg-262703 http://forums.mysql.com/read.php?123,262703,262703#msg-262703 I am happy to announce the release of GlusterFS version 2.0. Hope
you get to give it a try! :)

----
GlusterFS is a clustered file system that runs on commodity
off-the-shelf hardware, delivering multiple times the scalability and
performance of conventional storage. The architecture is modular,
stackable and kernel-independent, which makes it easy to customize,
install, manage and support different operating systems. Multiple
storage systems can be clustered together, supporting petabytes of
capacity in a single global namespace. Building a configuration of a
few hundred terabytes can be accomplished in less than thirty minutes.

GlusterFS 2.0 Release:
GlusterFS v2.0 has gone through a major revamp in design and
development since v1.3. Thanks to thousands of initial users who
provided us great feedback and bug reports. There are a number of
production deployments now. GlusterFS uses existing disk file systems
(such as Ext3, XFS, ZFS..) to store your data as regular files and
folders. You can restore the data, even after you uninstall GlusterFS.
So, give it a try and let us know.

License: GNU GPLv3
What is in 2.0 release
Who is using GlusterFS
Download

Happy Hacking
--
GlusterFS Team]]> Anand Avati MySQL & Storage Fri, 15 May 2009 11:07:20 +0000 http://forums.mysql.com/read.php?123,262261,262261#msg-262261 http://forums.mysql.com/read.php?123,262261,262261#msg-262261
http://www.bigdbahead.com/?p=518 (Part 1)
http://www.bigdbahead.com/?p=532 (Part 1B)

http://www.bigdbahead.com/?p=557]]> Edwin DeSouza MySQL & Storage Tue, 12 May 2009 18:08:28 +0000 http://forums.mysql.com/read.php?123,262114,262114#msg-262114 http://forums.mysql.com/read.php?123,262114,262114#msg-262114 http://yoshinorimatsunobu.blogspot.com/2009/05/tables-on-ssd-redobinlogsystem.htm]]> Edwin DeSouza MySQL & Storage Tue, 12 May 2009 00:09:47 +0000 http://forums.mysql.com/read.php?123,257870,257870#msg-257870 http://forums.mysql.com/read.php?123,257870,257870#msg-257870
Im a newbie here and a system database developer at hospital in Malaysia.

I was wondering is there any storage limit for Mysql? I assume it is depends on the hardware storage (hardisk capacity).

I got a big question here, I've already developed a system for the radiology department and the hardisk capacity is 320GB in the server. The data type are just in words (admin base work) nothing involved with images.

So i was wonder, for the next 10 years and I assume the capacity was full. At that point, What happen to the system??

Thanks and sorry if im at the wrong thread discussion.

Azhan
Malaysia]]> azhan yusoff MySQL & Storage Wed, 15 Apr 2009 08:35:52 +0000 http://forums.mysql.com/read.php?123,257268,257268#msg-257268 http://forums.mysql.com/read.php?123,257268,257268#msg-257268 http://www.bigdbahead.com/?p=422]]> Edwin DeSouza MySQL & Storage Fri, 10 Apr 2009 18:39:09 +0000 http://forums.mysql.com/read.php?123,255778,255778#msg-255778 http://forums.mysql.com/read.php?123,255778,255778#msg-255778 http://blogs.sun.com/realneel/entry/ssds_for_performance_engineers]]> Edwin DeSouza MySQL & Storage Thu, 02 Apr 2009 05:09:36 +0000 http://forums.mysql.com/read.php?123,255353,255353#msg-255353 http://forums.mysql.com/read.php?123,255353,255353#msg-255353 http://it.anandtech.com/IT/showdoc.aspx?i=3532]]> Edwin DeSouza MySQL & Storage Tue, 31 Mar 2009 03:19:22 +0000 http://forums.mysql.com/read.php?123,254522,254522#msg-254522 http://forums.mysql.com/read.php?123,254522,254522#msg-254522 http://www.bigdbahead.com/?p=334]]> Edwin DeSouza MySQL & Storage Wed, 25 Mar 2009 16:36:33 +0000 http://forums.mysql.com/read.php?123,251778,251778#msg-251778 http://forums.mysql.com/read.php?123,251778,251778#msg-251778 http://www.bigdbahead.com/?p=139
http://www.bigdbahead.com/?p=140
http://www.bigdbahead.com/?p=141]]> Edwin DeSouza MySQL & Storage Mon, 09 Mar 2009 23:56:43 +0000 http://forums.mysql.com/read.php?123,251776,251776#msg-251776 http://forums.mysql.com/read.php?123,251776,251776#msg-251776 http://www.mysqlperformanceblog.com/2009/03/09/when-would-you-use-san-with-mysql/]]> Edwin DeSouza MySQL & Storage Mon, 09 Mar 2009 23:54:05 +0000 http://forums.mysql.com/read.php?123,236943,236943#msg-236943 http://forums.mysql.com/read.php?123,236943,236943#msg-236943 http://www.bigdbahead.com/?p=81]]> Edwin DeSouza MySQL & Storage Wed, 03 Dec 2008 18:33:36 +0000