Question
Brendan Gunn on Wed, 10 Jan 2018 14:55:59
Hi
I have tried to install Hue on HDInsight Interactive Query cluster during deployment and after the cluster has been deployed. Both throw an error installing it using the script.
Please can you look into this matter, it is constantly occurring.
Thanks
Brendan
Replies
PRADEEP CHEEKATLA on Wed, 10 Jan 2018 20:04:56
Could you share screenshot of the error message?
Note: To install Hue on HDInsight clusters, the recommended headnode size is at least A4 (8 cores, 14 GB memory).
The script to install Hue on a Linux-based HDInsight cluster is available at https://hdiconfigactions.blob.core.windows.net/linuxhueconfigactionv02/install-hue-uber-v02.sh. You can use this script to install Hue on clusters with either Azure Storage Blobs (WASB) or Azure Data Lake Store as default storage.
For more details, refer “Install and use Hue on HDInsight Hadoop clusters”.
-----------------------------------------------------------------------------------------------
Do click on "Mark as Answer" and “Vote as Helpful” on the post that helps you, this can be beneficial to other community members.
Brendan Gunn on Thu, 11 Jan 2018 10:42:01
Hi
HDInsight is connected to Blob Storage - General Purpose v2
Head nodes x 2 = D13 v2 (8 core, 56 GB RAM)
Ambari Log
stderr: /var/lib/ambari-agent/data/errors-54.txt
Verification successful
Verification successful
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 7323 100 4240 100 3083 54662 39746 --:--:-- --:--:-- --:--:-- 55064
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/custom_actions/scripts/run_customscriptaction.py", line 194, in <module>
ExecuteScriptAction().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 329, in execute
method(env)
File "/var/lib/ambari-agent/cache/custom_actions/scripts/run_customscriptaction.py", line 179, in actionexecute
ExecuteScriptAction.execute_bash_script(bash_script, scriptpath, scriptparams)
File "/var/lib/ambari-agent/cache/custom_actions/scripts/run_customscriptaction.py", line 149, in execute_bash_script
raise Exception("Execution of custom script failed with exit code",exitcode)
Exception: ('Execution of custom script failed with exit code', 135)
stdout: /var/lib/ambari-agent/data/output-54.txt
OS verion is 16.04. Using hue-binaries-16-04.
USERID=hdinsightwatchdog
JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
fullHostName=hn0-dddlla.irmxjjnrjyrevmv5etzh1xv25g.fx.internal.cloudapp.net. Lower case: hn0-dddlla.irmxjjnrjyrevmv5etzh1xv25g.fx.internal.cloudapp.net
primary headnode=hn0-dddlla.irmxjjnrjyrevmv5etzh1xv25g.fx.internal.cloudapp.net. Lower case: hn0-dddlla.irmxjjnrjyrevmv5etzh1xv25g.fx.internal.cloudapp.net
Cluster Name=dddllap
Updated hadoop.proxyuser.hue.groups = *
[ERROR] Failed to update oozie-site. Exiting!
USERID=hdinsightwatchdog PASSWORD=S/R/2Y?n5VyjgB [ERROR] "oozie-site" not found in server response. [ERROR] Output of `curl -k -s -u hdinsightwatchdog:S/R/2Y?n5VyjgB "http://headnodehost:8080/api/v1/clusters/dddllap?fields=Clusters/desired_configs"` is: [ERROR] { "href" : "http://headnodehost:8080/api/v1/clusters/dddllap?fields=Clusters/desired_configs", "Clusters" : { "cluster_name" : "dddllap", "version" : "HDP-2.6", "desired_configs" : { "ams-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-grafana-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-grafana-ini" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-hbase-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-hbase-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-hbase-policy" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-hbase-security-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-hbase-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-logsearch-conf" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-ssl-client" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-ssl-server" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "beeline-log4j2" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "capacity-scheduler" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "cluster-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "core-site" : { "tag" : "version1515666383486386310", "user" : "hdinsightwatchdog", "version" : 3 }, "hadoop-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hadoop-metrics2.properties" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hadoop-policy" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hcat-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hdfs-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hdfs-logsearch-conf" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hdfs-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-atlas-application.properties" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-exec-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-exec-log4j2" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-interactive-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-interactive-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-log4j2" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-logsearch-conf" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hivemetastore-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hiveserver2-interactive-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hiveserver2-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "llap-cli-log4j2" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "llap-daemon-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "mapred-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "mapred-logsearch-conf" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "mapred-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "parquet-logging" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-hdfs-audit" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-hdfs-plugin-properties" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-hdfs-policymgr-ssl" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-hdfs-security" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-hive-audit" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-hive-plugin-properties" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-hive-policymgr-ssl" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-hive-security" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-yarn-audit" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-yarn-plugin-properties" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-yarn-policymgr-ssl" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-yarn-security" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "slider-client" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "slider-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "slider-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ssl-client" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ssl-server" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "tez-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "tez-interactive-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "tez-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "webhcat-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "webhcat-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "webhcat-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "yarn-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "yarn-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "yarn-logsearch-conf" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "yarn-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zeppelin-config" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zeppelin-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zeppelin-log4j-properties" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zeppelin-logsearch-conf" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zeppelin-shiro-ini" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zoo.cfg" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zookeeper-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zookeeper-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zookeeper-logsearch-conf" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 } } } }
('Start downloading script locally: ', u'https://hdiconfigactions.blob.core.windows.net/linuxhueconfigactionv02/install-hue-uber-v02.sh')
Fromdos line ending conversion successful
('Unexpected error:', "('Execution of custom script failed with exit code', 135)")
Removing temp location of the script
Command failed after 1 tries
AshishThapliyal on Thu, 11 Jan 2018 17:39:00
Hue is not a supported component in Azure HDInsight. We recommend using supported tools to query data from HDInsight Interactive Query Cluster
https://docs.microsoft.com/en-us/azure/hdinsight/interactive-query/apache-interactive-query-get-started
Brendan Gunn on Fri, 12 Jan 2018 13:57:15
Hi
Is Hue only supported on the HDInsight Hadoop cluster: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-hue-linux
Are there any plans to support Hue in the near future, it would be great if we could use the workflow planner on Hue to schedule tasks. Is Oozie supported, I dont see it on any lists.
What scripts are supported on different cluster types isnt well documented and there is nothing that stops you from running a script on HDInsight even though it is not supported on the cluster. This may be worth updating, would have saved some frustration.
Thanks
PRADEEP CHEEKATLA on Sun, 14 Jan 2018 11:57:51
You may leave you feedback here:
https://feedback.azure.com/forums/217335-hdinsight
All of the feedback you share in these forums will be monitored and reviewed by the Microsoft engineering teams responsible for building Azure.
-----------------------------------------------------------------------------------------------
Do click on "Mark as Answer" and “Vote as Helpful” on the post that helps you, this can be beneficial to other community members