January 14th 2010 02:19 pm
Job drill down & sniff testing
Dear Kettle fans,
Besides refactoring and cleaning up code, I fortunately can write some new code once in a while as well.
Today, I’m happy to demo job drill down and step sniff testing for you.
The first feature, Job drill down, allows you to drill down into a running job entry, into sub-jobs, transformations and even mappings (sub-transformations). All the time, you’ll see the logging for that part of the root job as well as the usual metrics:
The second feature is also a lot of fun. It allows you to execute a transformation in Spoon and see the rows that are coming out of a step in real time. I called this feature a sniff test since that’s what it seems to be doing:
Hope you like these small usability features. If you want to try it out yourself, get Hudson build 1598 or later.
Until next time,
Matt
4 Comments »
Diddy on 15 Jan 2010 at 19:15 #
Hi Matt,
Thanks for this very informative post!
These are two great new additions that I will definitely appreciate!
Especially the second one, that allows you to check the data as it gets processed, which will be a very good way to check the steps for errors.
Best regards,
Diddy
Samatar on 15 Jan 2010 at 20:26 #
Hi Matt,
nice.I love it
Regarding the drill down feature is it hard to display step metrics in job metrics?
I mean by expanding running trans job entry, you will see directly steps metrics.
By the way thanks fror the good job.
Take care
Samatar
Matt Casters on 15 Jan 2010 at 22:43 #
Hi Samatar,
I’ts going to be somewhat problematic to display the whole grid inside of the job metrics.
However, perhaps we can give another indicator like display the read/written metrics from the steps that are selected in the logging tab of the transformation. That way you have an idea of what’s going on.
Something like that should be easy enough.
Cheers,
Matt
Debbie Shapiro on 27 Feb 2010 at 1:37 #
These are excellent additions!
Looking forward to 4.0.