What is the meaning of the 'Loader: CSV rows limit has been reached' message in the TrueSight Capacity Optimization (TSCO) ETL logs?

Version 4
    Share This:

    This document contains official content from the BMC Software Knowledge Base. It is automatically updated when the knowledge article is modified.


    TrueSight Capacity Optimization


    Capacity Optimization


    All CO versions


    Looking at the ETL log, there is the message CSV rows limit has been reached.
    What does this message mean? Is the data being fully imported into TrueSight Capacity Optimization (TSCO)? Is there anything that needs to be done to address this message?

    11/07/2011 09:17:11 INFO Loader: Dataset size is 47885
    11/07/2011 09:17:11 INFO Loader: default rows limit = 1000
    11/07/2011 09:17:16 INFO Loader: CSV rows limit has been reached




    The message Loader: CSV rows limit has been reached isn't a problem.

    It just means that the human readable text version of the import file reached 1000 lines so TSCO will stop updating that file.

    That CSV file is not used to import data into TSCO: that file is created to assist with ETL debugging.  Even after the CSV file has reached the maximum row limit the binary file which is used by the bulk populate to import the data will continue to be updated. 

    The default is to create a human readable output file containing the first 1000 rows of data, this can be increased for debugging purposes via the ETL Run Configuration (Advanced View) Loader configuration section "Maximum number of rows for CSV output" property.  The field being blank will default to 1000 lines.  A value of -1 will output all data into the human readable output file.

       Legacy ID:KA352370


    Article Number:


    Article Type:


      Looking for additional information?    Search BMC Support  or  Browse Knowledge Articles