Wednesday 23 November 2011

Talend - How to capture rejected rows from output component

Problem - You have a job to transfer data from source table to target table and you are using some talend input and output database components for example tMSSqlInput and tMSSqloutput. You are interested in finding the rejected rows which are not processed by your tMSSqloutput component

Solution - For this you can use ROWS-->REJECT property of tMSSqlOutput component. Right click on tMSSqlOutput and select Rows-->Reject and then connect this reject flow to your other tFileOutputDelimited component or similar.
 (Validated on TIS V 4.0.2)

5 comments:

  1. Not valid on TDQ 4.2.3

    ReplyDelete
  2. Are there any conditions that this relies upon? Are there any penalties in using it?

    I.e., when using Oracle output, the Use Batch option under the Advanced tab HAS to be UNCHECKED, otherwise, REJECTS as an option does not even appear.
    When using REJECTS, there can be signigicant performance decreases. In an informal test, I got a 120x difference between using REJECTS and not.

    ReplyDelete
  3. i want to create user define sequence in talend it's possible ?

    ReplyDelete
  4. Hi , I want to remove empty rows from the mandatory column and log into a file. How i can do that

    ReplyDelete
  5. thanks Anonymous from 7 Jan :) same rules applied to PostgreSQL output, reject row doesn't appear until Batch option and Dien on Error are unchecked.

    ReplyDelete