Skip to main content
Announcements
Have questions about Qlik Connect? Join us live on April 10th, at 11 AM ET: SIGN UP NOW

Data file size exceeded file streaming buffer size. Adjust the StreamingBufferSizeMB setting.

No ratings
cancel
Showing results for 
Search instead for 
Did you mean: 
Sonja_Bauernfeind
Digital Support
Digital Support

Data file size exceeded file streaming buffer size. Adjust the StreamingBufferSizeMB setting.

Last Update:

Feb 8, 2023 4:55:07 AM

Updated By:

Sonja_Bauernfeind

Created date:

Feb 8, 2023 4:41:34 AM

Loading files larger than 50MB from either Dropbox or SharePoint with their respective connectors leads to: 

Data file size exceeded file streaming buffer size. Adjust the StreamingBufferSizeMB setting.

 

Environment

Qlik Sense Enterprise on Windows 
Qlik Cloud 

 

Resolution

Qlik Sense Enterprise on Windows (client-managed):

The solution requires us to modify the Qlik Sense Engine settings.ini. See How to modify Qlik Sense Engine settings.ini for details on the procedure.

  1. Stop the Engine Server
  2. Go to C:\ProgramData\Qlik\Sense\Engine
  3. Create a backup of the Settings.ini 
  4. Open the Settings.ini file
  5. Add StreamingBufferSizeMB=1024 line  (higher values are not currently supported by connectors)
  6. Add an empty line after the above parameter if the parameter is the last one to be added
  7. Save
  8. Restart the Engine Service

 

Qlik Cloud

The value cannot be configured in Qlik Cloud. A workaround is to split the big data files by e.g. months.

 

Internal Investigation ID(s) 

QLIK-83207
CP-4120
QLIK-82097

Labels (1)
Comments
Ken_T
Specialist
Specialist

thanks for publishing this.  I can confirm this works for SharePoint on May 2022 Enterprise 

elifapa
Contributor III
Contributor III

hi Sonja, could you let me know higher values than 1024mb is still not supported by Qlik? we are on qlik sense may 2022. thank you!
KR, Elif

Sonja_Bauernfeind
Digital Support
Digital Support

Hello @elifapa 

Not at this point, no.

All the best,
Sonja 

abTech
Contributor II
Contributor II

i'm using qlik sense desktop version may 2023,

i'm trying to load a file from google cloud storage and i done the authentication process but when it comes to loading the file and error accrue says: adjust the streaming buffer size 

how can i fix this.

and there is no setting.ini file in installation directory 

Sonja_Bauernfeind
Digital Support
Digital Support

Hello @abTech 

The Desktop Client also has a settings.ini, it is stored in C:\Users\USERNAME\Documents\Qlik\Sense.

Here's an article which documents the change of a specific setting; you can use that as a template: How to enable Qlik Sense Desktop debug level logging 

All the best,
Sonja 

 

klekovkinda
Partner - Contributor III
Partner - Contributor III

By the way is there any technical details about this setting (StreamingBufferSizeMB)?
I mean how does it influence on performance etc. 
For example I have 24 running tasks at the same time, all of them are reading files. If I set StreamingBufferSizeMB to 1024 does it mean that the Qlik will reserve more memory  like 24*(1024-<DefaultStreamingBufferSizeMB>)Mb?
And what is the default StreamingBufferSizeMB?
Or I can set 1024 and the memory consumption will be the same as I have set it to 256?

Contributors
Version history
Last update:
‎2023-02-08 04:55 AM
Updated by: