Re: server on development machine
Posted by: Peter Brawley
Date: July 02, 2021 11:51AM

> Any other settings you think I should tweak to make the import go faster?

If you're using the WB Importer, it's reportedly slow, see for example https://gdsotirov.blogspot.com/2018/07/mysql-wb-data-import-slow.htm, I've no idea why it's slow, I rilly don't want to spend a day grokking its source code. For speed, use Load Data Infile.

The claims table is an relational disaster waiting to happen. Tables with hundreds of columns perform poorly. SQL is not designed to parse subgroups of columns named col1,col2,col3,... &c. Tables that are to be queried need to follow rules of normalisation at least up to 3td Normal Form ...

https://www.artfulsoftware.com/mysqlbook/sampler/mysqled1ch01.pdf

https://www.artfulsoftware.com/dbdesignbasics.html

So if it's me, I import the .csvs into MyISAM tables, design normalised ie queryable InnoDB tables for that data, write scripts that populate those tables from the MyISAM input tables ... following a process like that described in the 2nd link above.

Options: ReplyQuote


Subject
Written By
Posted
Re: server on development machine
July 02, 2021 11:51AM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.