Find Answers
Qlik Community
Collaborate with over 60,000 Qlik technologists and members around the world to get answers to your questions, and maximize success.
Join Us
Knowledge
Qlik Data Catalyst - Unable to run any prepare flows in Mapreduce mode
Article Number: 000076436 | Last Modified: 2019/06/11Description
In Qlik Data Catalyst, a prepare flow in MapReduce mode is failing.
All prepare jobs fail with error:
All prepare jobs fail with error:
Caused by: java.lang.IllegalAccessError: tried to access method org.apache.hadoop.mapred.TaskReport.downgrade(Lorg/apache/hadoop/mapreduce/TaskReport;)Lorg/apache/hadoop/mapred/TaskReport; from class org.apache.hadoop.mapred.DowngradeHelper$TaskReportIterator
Cause
If core_env.properties is correctly setup in setenv.sh, please verify the followings
- Test to execute prepare job using LOCAL engine. If it works in LOCAL, but does not work in MR, then most likely QDC is not correctly configured to access Hadoop classes and/or the hive cluster.
- If it is HDP 2.6.x, check for existence of spark-hdp-assembly.jar in any dirPath under <TOMCAT HOME>. It create conflicts with parepare-on-spark classpath. If it exists, remove it.
- Run “hadoop classpath” as the qdc service account. It will return few paths, make sure they are all accessible by the service account.
Resolution
Correctly setup core_env.properties in /config/setenv.sh according documentation.
Ref: Page 29 of QlikDataCatalyst_4.0.4_InstallationGuide.pdf
Ref: Page 29 of QlikDataCatalyst_4.0.4_InstallationGuide.pdf
Get Answers
Find Answers
Get Support
Have a Question?
Search Qlik's Support Knowledge database or request assisted support for highly complex issues.
Submit a case
Talk with a Representative
Critical Issues
Experiencing a serious issue, please contact us by phone. For Data Integration related issues please refer to your onboarding documentation for current phone number.
Call Us