MySQL Forums
Forum List  »  Oracle

Re: transfering data
Posted by: Josh Chamas
Date: November 16, 2004 07:30PM

Jafni Hipni wrote:
> about 3000 transactions per second during peak
> hour...
>

3000 transactions a second should not be a problem getting this data into MySQL especially if its on similar hardware that your Oracle server is running on, however the real issue is the process to do this.

> did we have to use software agent for transfering
> data in synchronize time between Oracle9i and

If you want a product out of the box that handles this, you might look at GoldenGate as they deal in heterogenous replicated environments.

If GoldenGate or other tool vendors do not meet your requirements, there are a couple methods that I would consider, but they are home grown approaches which is probably what you need for a higher volume environment like this with real time replication requirements. First, you could consider writting triggers that would build a replication queue for each of your tables, maybe inserting events into one central replication queue table, and have a process pick these records up from the queue and batch them into MySQL in near real time.

If you really need real time, then you could consider having your application layer connect to MySQL and replicate the transactions itself, for example in the Perl world, DBD::Multiplex can be used to run SQL against multiple database connections at once ( http://search.cpan.org/~tkishel/DBD-Multiplex-1.95/Multiplex.pm ) ... in the Java world, you might consider the C-JDBC ( http://c-jdbc.objectweb.org/ ) software which publishes a white paper actually showing MySQL/Oracle ( http://c-jdbc.objectweb.org/current/doc/C-JDBC_Flexible_Database_Clustering_Middleware.pdf ) used as parallel database backends. The C-JDBC project seems to enable using various database backends to create a RAID-1 or RAID-N type cluster, but RAID in this case would be "Redundant Array of Independent Databases" :) I have not used any of these software packages, so YMMV.

If you don't really need realtime, and your data set is small enough, then you might consider doing full or partial dumps of the Oracle database, and rebuild the MySQL database entirely, or select tables via this snapshot process. This latter should be easy enough and there are plenty of tools out there that can help with this latter process.

Regards,

Josh

Josh Chamas
Director, Professional Services
MySQL Inc., www.mysql.com
Get More with MySQL! http://www.mysql.com/consulting

Options: ReplyQuote


Subject
Views
Written By
Posted
4630
July 12, 2004 11:02PM
2786
July 24, 2004 07:57AM
2791
August 01, 2004 08:26AM
2865
August 05, 2004 10:15PM
2723
August 06, 2004 02:00AM
2721
August 09, 2004 04:15AM
2708
November 11, 2004 10:15PM
2791
November 17, 2004 12:42AM
Re: transfering data
2569
November 16, 2004 07:30PM
3221
November 17, 2004 12:27AM
3036
November 17, 2004 12:31AM
3183
November 17, 2004 01:53AM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.