Collaborate with over 60,000 Qlik technologists and members around the world to get answers to your questions, and maximize success.Join Us
Monitoring apps fail to reload in multi-node environments: QVX_UNEXPECTED_END_OF_DATA: Default app reload fails in multinode environment
Reload of Monitoring Apps fails with Reload of Monitoring Apps fails with Error: Connector connect error: Parameter "xxxxxx" has no value, or a misplaced semicolon
To fix the monitoring app issues in any version of Sense is to make the changes and updates below:
First, it's very important to verify that the Service Account is added to your proper AD Group (check with your Active Directory team) and is an admin, especially if your User Directory Connector in the QMC uses an LDAP filter.
Temporarily disable antivirus or provide an exception for all Qlik folders
Open all ports in the firewall that are needed according to the only documentation for the November release.
Check that all services are running and can be restarted, as well as verifying the user account running them. If any service is not running, reboot the server. The account running the services must be the dedicated Qlik service account created for this Qlik installation--verify it has not been changed to any other user such as a company employee.
There are 3 main directories for Qlik Sense, the one in "C:\Program Files\Qlik", the one in “C:\ProgramData\Qlik\Sense”, as well as the shared folder (if using Shared Persistence). Right-click on these two directories and verify that the Qlik Service account used to run the Qlik services is listed on the Security tab and has "Full Control". In addition, check the "Sharing" tab as well to make sure this same account is listed under file sharing and has "Read/Write" abilities.
Finally, verify that the Qlik Server has internet connectivity. It must be able to reach the outside world. This is a requirement for versions June 2017 – February 2018. If there is no internet access via a browser to the outside world, then all monitoring apps will fail. Please see articles Data Connections not visible in the Data Load Editor in Qlik Sense 3.2 all SRs or later releases or Error 11041/11043 and An error occurred / Failed to load connection error message in Qlik Sense - Server Has No Internet in the support portal if you have no internet access.
Now that the pre-req's have been met, it's time to dive into the admin portal by opening the QMC portal
Delete all connections in the "Data Connections" tab that begin with "QRS_" (before June 2017) AND "Monitor_Apps_" (after June 2017). If the Sense version is June 2017 or later and for some reason the "QRS" and the "Monitor_Apps" data connections exist, then delete all of them.
Next, go to the Apps tab and delete all monitoring apps that are named License Monitor, Operations Monitor, etc. (related to monitoring).
Minimize the QMC. This step is very important and required: Delete all ".QVD" files within the Windows Directory that's related to the monitoring apps (usually C:\ProgramData\Qlik\Sense\Log"). Do not open any directories, merely look at the files in this folder. All files related to "reloads", "governance", "monitor", "etc... any QVD file listed in this Log folder needs to be deleted except ones that have the terms "central logging" in them.
In addition, go to the shared ArchivedLog shared folder in Windows and ZIP all log files especially the Engine logs, as anything older than 6 months can sometimes cause the reloads to fail. Once a ZIP is done, delete all log files. This is usually not required but is helpful in cases where the log files are too big and are causing reload issues.
Now that the monitoring apps have been cleaned up, as well as the underlying files causing issues, open the QMC again.
In the Apps section of the QMC, import the new default monitoring apps using the "Import" button within the "Apps" section of the QMC. C:\ProgramData\Qlik\Sense\Repository\DefaultApps
Next, check the Virtual Proxy to see if they use a prefix. If so, this prefix needs to be included in the connection string for each “monitoring_app” Data Connection. (e.g. https://qlikserver1/prefix123/qps instead of https://qlikserver1/qps ; assuming the Virtual Proxy prefix is named “prefix123”.
Check the Proxy and verify the HTTPS Default port is 443. If not, update the DC connection strings.
Check the Proxy and verify that Kerberos Authentication is not enabled.
It is required that at least one virtual proxy uses the Windows authentication pattern for the monitoring apps to work. Just confirm you are using "Windows" in the Virtual Proxy settings under the "Authentication" section.
After which, click on "Tasks" under "Associated Items" for each Monitoring App that was imported and create an automatic rule to have them automatically refresh. Set the time for the first start to 1 minute from now so that the trigger will automatically kick off once you save. After running through all of these steps, be sure to delete this rule afterwards so that they don't try to load every 1 minute.
Go to the "Data Connections" section of the QMC to verify that new "QRS_" (before June 2017) or "Monitor_Apps_" (June 2017+) data connections were automatically re-created.
Open one of them and view the entire connection string. Verify that this exists in the string ";skipServerCertificateValidation=true;". Now verify all of the other "monitor_apps_" data connections to check that this is listed in the connection string. This is often the cause of issues post-upgrade.
If it’s a multi-node setup and newer than Sense 3.2.5, then the ServerLogFolder and ArchivedLogFolder must also be updated per this link.
Verify if https://localhost (June or newer: the URL's are actually listed twice in each data connection and both must be updated; in v 3.2.5 or older it's listed only once) or the FQDN should be listed in each connection string and change if needed. FQDN is required for multi-nodes or cloud solutions – or when files are not local. It's highly suggested to never use localhost. Review the beginning of the connection string for each "monitor_app" data connection as well as the end, since the URL (e.g. localhost or FQDN) will be listed twice and both need updating.
Open each Data Connection beginning with "QRS_" (before June 2017) or "Monitor_Apps_" (after June 2017), and update the User ID and Password fields (must use the Service Account running the Qlik Services… look in Windows Services). Note: this service account must be an administrator with Full Control and be a part of the required AD Groups listed in the installation guide. Example – if the Qlik Services show the user running these services is “domain123\qvservice” then enter “domain123\qvservice” as the User ID in each “monitor_app” Data Connection, and then enter the password for this service account. Repeat for each “monitor_app” data connection. This is also one of the main causes of monitoring app issues, especially if you get a "4xx" error such as a "401 Unauthorized". A "401 Unauthorized" is generally caused by the wrong User ID, wrong Password, or leaving the User ID as default (.\admin).
On a related note, if the Qlik Services within Windows Services show the user account is local, such as “.\qlikservice”, then the User ID that will need to be entered in the QMC for every Data Connection that begins with “monitor_apps_” will need to be (servername\serviceuser). For example, if the central server’s name is “Server123”, and the Qlik Services show that “.\qlikservice” is the service account running Qlik Services, then enter in “Server123\qlikservice” as the User ID in the QMC for each data connection.
It's time to check if everything is now working properly. Go to the Apps section, click on the monitoring apps that were imported, choose "More Actions" and click "Reload Now".
Go to the "Tasks" tab to see if they reloaded. Hit refresh in the top right of the QMC page.
If the version of Sense is "November 2017" or "11.24.x", there is a code related issue that effects some installations. If it’s an upgraded November 2017 release and the above didn’t fix the issue (be sure to apply the latest November Patch before continuing), try using a copy of the September 2017 monitoring app QVF files. You can get these from Qlik Support. In the QMC go ahead and import them, then replace the November monitoring app files. The Data Connections and QVD files (as mentioned above in detail!) will need to be deleted first, before attempting to load the September release of the monitoring apps.
This issue should now be addressed. Reload the tasks manually and collect the Script Reload Logs for review.
If the reloads are now working, be sure to edit the scheduled reload times for the monitoring apps. As noted above, we set this to occur every minute for testing purposes. It's suggested to change this to once daily or weekly.
In case of the reload tasks still failing, download the script reload logs on this page for the tasks that fail, and add it to the support case for further review.
Search Qlik's Support Knowledge database or request assisted support for highly complex issues.Submit a case
Experiencing a serious issue, please contact us by phone. View phone numbers and hours by region.