ODBC parallel query performance issue using C++
Posted by:
Lin Zida
Date: March 24, 2020 03:07AM
I have a program on C++, connecting mysql8.0 using mysqlodbc 8.0.18 and MSADO.
Here is the program structure: There is one main thread which collects data from a file repeatedly. It dispatches the data to several worker threads. Each worker thread has its own connection to a Mysql8.0 database. And once they get data from the main thread, they will insert the data into the target database. All the threads work concurrently. The program runs on a machine with 40 cores.
I find that as the number of the work threads grows, the performance goes better then worse, even when the number of thread keeps less than 40. It seems that there is a limit on the number of parallel threads in Connector/ODBC. Once the total number exceeds the limit, the performance gets worse.
How can I config this limit?
Subject
Written By
Posted
ODBC parallel query performance issue using C++
March 24, 2020 03:07AM
Sorry, you can't reply to this topic. It has been closed.
Content reproduced on this site is the property of the respective copyright holders.
It is not reviewed in advance by Oracle and does not necessarily represent the opinion
of Oracle or any other party.