Skip navigation links

MySQL Forums :: Data Warehouse :: DW job control tool


Advanced Search

DW job control tool
Posted by: Lars Johansson ()
Date: March 22, 2007 08:11AM

I had forgot all about this, long time passed since I wrote this. Now the system is ported to Windows, and we built a pretty advanced BPCS import appl, that imports data from a number of DB2/BPCS servers around the world.
The strength of this system is the advanced job control facilities and the 'simple' xml user interface. No GUI at all! And it's easy to change/extend.

I created a job control system in PHP,to aid the ETL process in a data warehouse. It's a pretty advanced application generator that can connect to SAP systems and external databases via PHP PDO. The system runs in Linux. Jobs, processes, data sources etc. are defined in XML. I just want to know if there is any interest in systems like this one, if so and my boss say's its ok, I like to release under GNU.
Note! This is not a Data Warehouse generator! but a system that can help you control DW processes, like create&mail Excel reports or the above mentioned ETL process where you can e.g. import data from a SAP rfc call.
Example of an OPS jobstream (with 3 jobs):

<job name='Import_SAP_currency_into_Mysql_DW' type='script' >
<sap><rfc><name>BAPI_CURRENCY_GETLIST</name></rfc></sap>
<sql><autoload>replace</autoload</sql>
</job>
<job name='Convert_PDO_MSsql2Excel' type='script' data='pdo.php'>
<pdo>
<sql>use RSX35TST;select * from RRALLM;</sql>
<sqlconverter>
<name>sqlconverter_PHPExcel01.php</name><target>report0</target>
</sqlconverter>
</pdo>
</job>
<job name='And_send_it_as_mail_attachment' type='sendmail'>
<recipients>kalle.kula@bolaget.se</recipients>
<subject>Excel report</subject>
<body>Excel 2007 wb attached</body>
<attachment>
<name>project.XLS</name><file>@J_Convert_PDO_MSsql2Excel/report0.xlsx</file>
</attachment>
</job>



Edited 1 time(s). Last edit at 05/04/2008 08:03AM by Lars Johansson.

Options: ReplyQuote


Subject Views Written By Posted
DW job control tool 7064 Lars Johansson 03/22/2007 08:11AM
Re: DW job control tool 4411 Wes Duenow 11/14/2007 02:04PM
Re: DW job control tool 4215 Peter Nolan 02/29/2008 09:53PM
Re: DW job control tool 4097 Roland Bouman 04/08/2008 01:16AM
Re: DW job control tool 3970 Lars Johansson 05/03/2008 03:35AM


Sorry, you can't reply to this topic. It has been closed.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.