Qlik Sense and loading data from CSV: text longer than 1,048,576 characters is broken into multiple rows

[Sonja_Bauernfeind]

Qlik Sense can process a maximum of 1,048,576 (2^20) characters by row when loading data from a CSV file. If a row in the source CSV file is longer than this limit, Qlik Sense automatically breaks it to multiple rows in the loaded table.

This doesn't happen when loading another file format (like XML) or loading the same CSV file in QlikView.

Resolution

To increase the maximum length, please set parameter LongestPossibleLine in Settings.ini file of Qlik Sense Engine to a higher value than 1048576.

See How to modify Qlik Sense Engine's Settings.ini for detailed instructions of changing parameters in Settings.ini.

Cause

Qlik Sense engine supports up to 512 Megabytes (512*1024*1024) as line length. Script reload can handle strings up to this length in a single data cell. However, when using the data selection wizard, such long string may break the web socket. Therefore, maximum string length is limited to 1,048,576 characters to avoid this web socket issue.

Environment

Qlik Sense Enterprise on Windows  

[Antoine04]

Hello,

I have the same issue with Qlik Cloud.

Any idea about how to handle it ?

Best Regards,

Antoine

[human]

would be great if its broken into different lines, but on my end this error-code prevents the script from finishing successfully (Cloud),
no settings.ini to be found in the Cloud. wtf I thought you are giving the resources that everything works smoothly in the Cloud, at least you advertise it this way. 

[AkashPohare_HB]

Hello @Sonja_Bauernfeind ,

Post upgrade to May 2024 SR4, few of jobs are failing with "Data source line limit exceeded. Max line length is 1048576 bytes." Does it mean the size of the value of a row in a field cannot be greater than 1 MB? or does it mean that a value of a row in a field cannot have characters more than 1048576?

Also, will the above solution works in my case?

[Sonja_Bauernfeind]

Hello @AkashPohare_HB 

This would require more investigation than we can realistically provide through an article. Please log a support ticket to have this looked into in more detail.

All the best,
Sonja