Popular @
Forum Controls
Spotlight Features
The Rich Engineering Heritage Behind Dependency Injection
Andrew McVeigh takes us on a tour of the rich heritage behind dependency injection, what it represents, and tells us why its here to stay.
NetBeans 6: Matisse Updates
NetBeans 6 delivers great updates to the Matisse GUI builder. Spend a few minutes with Roman Strobl and get an expert briefing on what's new and what has changed. (sponsored)
Introduction to Groovy Part 3
In this, the third and final installation of Andres' Introduction to Groovy series, you learn about how Groovy handles variable numbers of arguments, named parameters, currying, and more about Groovy operators. Including, some new operators.
Easier Custom Components with Swing Fuse
Swing Fuse (actually just Fuse), is a framework designed to make it easier to create your own custom desktop components. In this article, Daniel Spiewak shows you how to get started and provides sample source code you can download.
Benchmark Analysis: Guice vs Spring
Willam Louth shows how he uses JXInsight Probes to investigate probable performance issues with code bases that he is not familiar with. He also highlights possible pitfalls in creating a benchmark, as well as in the analysis of results.
Kettle ETL Java API
URL: Program your own ETL using the Kettle Java API
At 7:02 AM on Oct 14, 2005, Matt Casters
wrote:
Fresh Jobs for Developers Post a job opportunity
If you ever had to transform data in your software and wanted to automate this process in your java software, then maybe the Kettle Java API is something you can use.
On the Kettle web site I've set up a small example that generates a transformation to read data from one database table & store it in another database, executes the SQL for the new table and the transformation itself. All this in a few hundred lines of java code!
You can find the example in the new Kettle 2.1.3 point version, on the download page.
More details can be found here: http://www.kettle.be/en/api.htm
Please do contact us if you need more information.
Best regards,
Matt
http://www.kettle.be/en/contact.htm
9 replies so far (
Post your own)
Re: Kettle ETL Java API
I found one broken link on your screenshots page:http://www.kettle.be/en/screenshots/linux002.png
should be
http://www.kettle.be/en/screenshots/linux001.png
Re: Kettle ETL Java API
Thanks a lot Andrey!Let me take the opertunity to say that no SWT code is used in the API example shown. (no link with swt.jar or any jni lib is needed)
All the best,
Matt
Re: Kettle ETL Java API
Hi,We have develop our own ETL component(say xETL) to decode CDR files (specific files genareted for each phone call). But processing speed of the xETL is not sufficient enough to process all the requests(since single CDR file is genaratde for each phone call). Sometimes most of the CDR files ignored by the system or it will stuck.
So we are planning to use the Kettle latest version instead of our own xETL.
Actually I want to know the Processing speed of the Kettel. ie. how many requests can process at a time.
Note : Say we use Pentium 4 machine with 2 GB Memory
Thanks in advanced
Thilina
Re: Kettle ETL Java API
I guarantee you that your internal xETL is 1000 times faster than this piece of shit!Re: Kettle ETL Java API
You're an idiot JD... Kettle is pretty fast (faster than most commercial ETL tools out there) and they're rewriting it for speed right now.So if you want to know Kettle is faster than your internal xETL, just try it... it's open source after all.
Re: Kettle ETL Java API
hi Thilina Anjitha,I am in the same situation, I need to load CDR in the data base and also have a tool ETL.
Now I am testing tool KETTL. ie. the obtained results are 2.000.000 of lines in 23 minutes, with a data base Oracle. It is a good performance.
All the best.
Re: Kettle ETL Java API
The code behind this project is the scariest I have ever seen, like a first grader wrote it. It works for little hello world type transformations, one off projects, but it's your job on the line, not mine. I'd take a look at the following projects before settling on Kettle:1) Talend - http://www.talend.com
2) Clover - http://www.cloveretl.org
Both are far superior, both API and GUI wise. We're currently using Talend and have had no problems. It's a project written by real developers, the Hibernate of ETL.
Re: Kettle ETL Java API
CloverETL. Looking at the support forums... CloverETL has 10 messages on them, Kettle has about 10000.Talend, perl based however they also generate java right now. Qua functionality Talend looks at Kettle to build in functionality (you can compare dates when some functionality was in Kettle and when it was in Talend). That's that for your superior API and coding
Let people compare themselves and they will be enlightened. Personally it took me 1 minute to get Kettle running, about 1 hour for Talend.
Re: Kettle ETL Java API
Just came across this old post. Thanks for the defense, but JD is right. Kettle is not a Java or technology project. It's a BI/ETL project. Even now we allow novice Java programmers with great ideas to participate. For that reason alone we try to stay away from writing software that is "too complex". If it requires a set of Spring libraries and a matching set of XML documents to load a class, we have a problem with it. It's this attitude along that might scare off some "Java developers". However, it did create a strong user and developer community over the last 2 years.In the end, you can't make anyone happy against his or her own will. If people want to generate code, I will even advice them to use Talend. If they want something more maintainable, they can go for Kettle.
Cheers,
Matt