1. hue [jobsub] saving a design shows an empty page after.
when I check the system log whic likes followings:
The main error is :
WebHdfsException: SecurityException: Failed to obtain user group information:
org.apache.hadoop.security.authorize.AuthorizationException: User:
hue is not allowed to impersonate hue (error 401)
A: change hadoop core-site.xml and the following properties to it and upgrade to all nodes, restart cluster
<property> <name>hadoop.proxyuser.hue.hosts</name> <value>*</value> </property> <property> <name>hadoop.proxyuser.hue.groups</name> <value>*</value> </property>
2. When I design a sqoop job in "Job Designer" and save , but the list only displays the example jobs.
My designed job is missing. Check the logs, find some errors
A: change permissions by command
hdfs dfs -chmod -R 777 ./
3. when I submit a sqoop job from Job Designer to run, an error produces
To check the configuration
A: change hue.ini to
[[hdfs_clusters]] # HA support by using HttpFs [[[default]]] # Enter the filesystem uri fs_defaultfs=hdfs://192.168.122.1:2014 # NameNode logical name. #logical_name=zhj-c0 logical_name=hdfs://192.168.122.1:2014 # Use WebHdfs/HttpFs as the communication mechanism. # Domain should be the NameNode or HttpFs host. # Default port is 14000 for HttpFs. webhdfs_url=http://192.168.122.1:50070/webhdfs/v1 # Change this if your HDFS cluster is Kerberos-secured ## security_enabled=false
[[yarn_clusters]] [[[default]]] # Enter the host on which you are running the ResourceManager resourcemanager_host=192.168.122.1 # The port where the ResourceManager IPC listens on resourcemanager_port=2015 # Whether to submit jobs to this cluster submit_to=True # Change this if your YARN cluster is Kerberos-secured ## security_enabled=false # URL of the ResourceManager API resourcemanager_api_url=http://192.168.122.1:2019 # URL of the ProxyServer API ## proxy_api_url=http://localhost:8088 # URL of the HistoryServer API history_server_api_url=http://192.168.122.1:19888
# NameNode logical name.
#logical_name=zhj-c0
logical_name=hdfs://192.168.122.1:2014
This cofiguration is werid due to its name, actually it means nameNode
The values in the above configureation are corrosponding to hadoop related configurations listed in the
following table
https://groups.google.com/a/cloudera.org/forum/#!topic/hue-dev/QNOb5RWwYNQ
References
https://github.com/cloudera/hue/blob/master/docs/user-guide/jobdesigner.md
http://cloudera.github.io/hue/docs-3.5.0/release-notes/release-notes-3.5.0.html
http://grokbase.com/p/cloudera/hue-dev/13c5mehwrq/review-request-jobsub-saving-a-design-shows-an-empty-page-after
https://review.cloudera.org//r/3895/diff/