Question

Brendan Gunn on Wed, 10 Jan 2018 14:55:59


Hi

I have tried to install Hue on HDInsight Interactive Query cluster during deployment and after the cluster has been deployed. Both throw an error installing it using the script.

Please can you look into this matter, it is constantly occurring.

Thanks

Brendan


Sponsored



Replies

PRADEEP CHEEKATLA on Wed, 10 Jan 2018 20:04:56


Could you share screenshot of the error message?

Note: To install Hue on HDInsight clusters, the recommended headnode size is at least A4 (8 cores, 14 GB memory).

The script to install Hue on a Linux-based HDInsight cluster is available at https://hdiconfigactions.blob.core.windows.net/linuxhueconfigactionv02/install-hue-uber-v02.sh. You can use this script to install Hue on clusters with either Azure Storage Blobs (WASB) or Azure Data Lake Store as default storage.

For more details, refer “Install and use Hue on HDInsight Hadoop clusters”.

-----------------------------------------------------------------------------------------------

Do click on "Mark as Answer" and “Vote as Helpful” on the post that helps you, this can be beneficial to other community members.

Brendan Gunn on Thu, 11 Jan 2018 10:42:01


Hi

HDInsight is connected to Blob Storage - General Purpose v2

Head nodes x 2 = D13 v2 (8 core, 56 GB RAM)

Ambari Log

stderr:   /var/lib/ambari-agent/data/errors-54.txt

Verification successful
Verification successful
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  7323  100  4240  100  3083  54662  39746 --:--:-- --:--:-- --:--:-- 55064
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/custom_actions/scripts/run_customscriptaction.py", line 194, in <module>
    ExecuteScriptAction().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 329, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/custom_actions/scripts/run_customscriptaction.py", line 179, in actionexecute
    ExecuteScriptAction.execute_bash_script(bash_script, scriptpath, scriptparams)
  File "/var/lib/ambari-agent/cache/custom_actions/scripts/run_customscriptaction.py", line 149, in execute_bash_script
    raise Exception("Execution of custom script failed with exit code",exitcode)
Exception: ('Execution of custom script failed with exit code', 135)


stdout:   /var/lib/ambari-agent/data/output-54.txt

OS verion is 16.04. Using hue-binaries-16-04.
USERID=hdinsightwatchdog
JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
fullHostName=hn0-dddlla.irmxjjnrjyrevmv5etzh1xv25g.fx.internal.cloudapp.net. Lower case: hn0-dddlla.irmxjjnrjyrevmv5etzh1xv25g.fx.internal.cloudapp.net
primary headnode=hn0-dddlla.irmxjjnrjyrevmv5etzh1xv25g.fx.internal.cloudapp.net. Lower case: hn0-dddlla.irmxjjnrjyrevmv5etzh1xv25g.fx.internal.cloudapp.net
Cluster Name=dddllap
Updated hadoop.proxyuser.hue.groups = *
[ERROR] Failed to update oozie-site. Exiting!
USERID=hdinsightwatchdog PASSWORD=S/R/2Y?n5VyjgB [ERROR] "oozie-site" not found in server response. [ERROR] Output of `curl -k -s -u hdinsightwatchdog:S/R/2Y?n5VyjgB "http://headnodehost:8080/api/v1/clusters/dddllap?fields=Clusters/desired_configs"` is: [ERROR] { "href" : "http://headnodehost:8080/api/v1/clusters/dddllap?fields=Clusters/desired_configs", "Clusters" : { "cluster_name" : "dddllap", "version" : "HDP-2.6", "desired_configs" : { "ams-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-grafana-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-grafana-ini" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-hbase-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-hbase-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-hbase-policy" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-hbase-security-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-hbase-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-logsearch-conf" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-ssl-client" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ams-ssl-server" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "beeline-log4j2" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "capacity-scheduler" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "cluster-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "core-site" : { "tag" : "version1515666383486386310", "user" : "hdinsightwatchdog", "version" : 3 }, "hadoop-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hadoop-metrics2.properties" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hadoop-policy" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hcat-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hdfs-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hdfs-logsearch-conf" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hdfs-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-atlas-application.properties" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-exec-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-exec-log4j2" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-interactive-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-interactive-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-log4j2" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-logsearch-conf" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hive-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hivemetastore-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hiveserver2-interactive-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "hiveserver2-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "llap-cli-log4j2" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "llap-daemon-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "mapred-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "mapred-logsearch-conf" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "mapred-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "parquet-logging" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-hdfs-audit" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-hdfs-plugin-properties" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-hdfs-policymgr-ssl" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-hdfs-security" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-hive-audit" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-hive-plugin-properties" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-hive-policymgr-ssl" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-hive-security" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-yarn-audit" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-yarn-plugin-properties" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-yarn-policymgr-ssl" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ranger-yarn-security" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "slider-client" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "slider-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "slider-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ssl-client" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "ssl-server" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "tez-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "tez-interactive-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "tez-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "webhcat-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "webhcat-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "webhcat-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "yarn-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "yarn-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "yarn-logsearch-conf" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "yarn-site" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zeppelin-config" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zeppelin-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zeppelin-log4j-properties" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zeppelin-logsearch-conf" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zeppelin-shiro-ini" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zoo.cfg" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zookeeper-env" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zookeeper-log4j" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 }, "zookeeper-logsearch-conf" : { "tag" : "TOPOLOGY_RESOLVED", "user" : "internal", "version" : 2 } } } }
('Start downloading script locally: ', u'https://hdiconfigactions.blob.core.windows.net/linuxhueconfigactionv02/install-hue-uber-v02.sh')
Fromdos line ending conversion successful
('Unexpected error:', "('Execution of custom script failed with exit code', 135)")
Removing temp location of the script

Command failed after 1 tries


AshishThapliyal on Thu, 11 Jan 2018 17:39:00


Hue is not a supported component in Azure HDInsight. We recommend using supported tools to query data from HDInsight Interactive Query Cluster

https://docs.microsoft.com/en-us/azure/hdinsight/interactive-query/apache-interactive-query-get-started

Brendan Gunn on Fri, 12 Jan 2018 13:57:15


Hi

Is Hue only supported on the HDInsight Hadoop cluster: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-hue-linux

Are there any plans to support Hue in the near future, it would be great if we could use the workflow planner on Hue to schedule tasks. Is Oozie supported, I dont see it on any lists.

What scripts are supported on different cluster types isnt well documented and there is nothing that stops you from running a script on HDInsight even though it is not supported on the cluster. This may be worth updating, would have saved some frustration.

Thanks

PRADEEP CHEEKATLA on Sun, 14 Jan 2018 11:57:51


You may leave you feedback here:

https://feedback.azure.com/forums/217335-hdinsight

All of the feedback you share in these forums will be monitored and reviewed by the Microsoft engineering teams responsible for building Azure.

-----------------------------------------------------------------------------------------------

Do click on "Mark as Answer" and “Vote as Helpful” on the post that helps you, this can be beneficial to other community members