MySQL Forums
Forum List  »  Data Warehouse

DW job control tool
Posted by: Lars Johansson
Date: March 22, 2007 08:11AM

I had forgot all about this, long time passed since I wrote this. Now the system is ported to Windows, and we built a pretty advanced BPCS import appl, that imports data from a number of DB2/BPCS servers around the world.
The strength of this system is the advanced job control facilities and the 'simple' xml user interface. No GUI at all! And it's easy to change/extend.

I created a job control system in PHP,to aid the ETL process in a data warehouse. It's a pretty advanced application generator that can connect to SAP systems and external databases via PHP PDO. The system runs in Linux. Jobs, processes, data sources etc. are defined in XML. I just want to know if there is any interest in systems like this one, if so and my boss say's its ok, I like to release under GNU.
Note! This is not a Data Warehouse generator! but a system that can help you control DW processes, like create&mail Excel reports or the above mentioned ETL process where you can e.g. import data from a SAP rfc call.
Example of an OPS jobstream (with 3 jobs):

<job name='Import_SAP_currency_into_Mysql_DW' type='script' >
<sap><rfc><name>BAPI_CURRENCY_GETLIST</name></rfc></sap>
<sql><autoload>replace</autoload</sql>
</job>
<job name='Convert_PDO_MSsql2Excel' type='script' data='pdo.php'>
<pdo>
<sql>use RSX35TST;select * from RRALLM;</sql>
<sqlconverter>
<name>sqlconverter_PHPExcel01.php</name><target>report0</target>
</sqlconverter>
</pdo>
</job>
<job name='And_send_it_as_mail_attachment' type='sendmail'>
<recipients>kalle.kula@bolaget.se</recipients>
<subject>Excel report</subject>
<body>Excel 2007 wb attached</body>
<attachment>
<name>project.XLS</name><file>@J_Convert_PDO_MSsql2Excel/report0.xlsx</file>
</attachment>
</job>



Edited 1 time(s). Last edit at 05/04/2008 08:03AM by Lars Johansson.

Options: ReplyQuote


Subject
Views
Written By
Posted
DW job control tool
8104
March 22, 2007 08:11AM
4885
November 14, 2007 02:04PM
4655
February 29, 2008 09:53PM
4502
April 08, 2008 01:16AM
4452
May 03, 2008 03:35AM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.