|
Error: Refresh DFS Children
|
Posts:
1
Registered:
Aug 13, 2008 01:51:41 PM
|
|
|
|
Error: Refresh DFS Children
Posted:
Aug 13, 2008 02:45:41 PM
|
|
|
|
Hi guys.
First of all: Thanks for this plugin.
I have set up an hadoop-0.17.1. Now I want to use your plugin to create a MapReduce Job. The Eclipse I am using is version 3.4.0 und Windows XP. Unfortunatly, I have some other adjustments (besides trying the new Versions): All my hadoop processes listen do not listen on the standard ports. But I guess this doesnt matter as the plugin connects via ssh to the server where hadoop is installed, right? Thats the reason why I have to give to hostname, the installation directory and the username when creation a new Hadoop server location. Is this right so far?
After setting everything up and clicking on the server and opening the DFS, I get the error "Refresh DFS Children has encountered a problem." with the details:
"An internal error occurred during: "Refresh DFS Children".
org.eclipse.team.internal.ccvs.ssh2.CVSSSH2Plugin.getPreferenceStore()Lorg/eclipse/jface/preference/IPreferenceStore;"
Any suggestions on how to get this running?
Thanks so much, Robin
|
|
Posts:
1
Registered:
Sep 02, 2008 11:44:39 PM
|
|
|
|
Re: Error: Refresh DFS Children
Posted:
Sep 03, 2008 12:31:19 AM
in response to: robin_'s post
|
|
|
|
Hi Robin,
I faced the same problem with you. I ran hadoop independently by executing the /hadoop-home-path/bin/start-all.sh and everything went well. But when I used the plugin and tried to get the perspective with a view of hadoop distributed file system by using the eclipse, I got the error "Refresh DFS Children has encountered a problem". Wished that you have resolved this problem, could you give me some experience on this matter?
Thank you so much.
Lai
|
|
Posts:
5
Registered:
Nov 16, 2008 09:34:06 PM
|
|
|
|
Re: Error: Refresh DFS Children
Posted:
Nov 16, 2008 09:37:57 PM
in response to: robin_'s post
|
|
|
|
I also have the same problem.
Error Msg:
An internal error occurred during: "Launching WordCount.java on localhost Hadoop Server".
org.eclipse.team.internal.ccvs.ssh2.CVSSSH2Plugin.getPreferenceStore()Lorg/eclipse/jface/preference/IPreferenceStore;
I am using Ubuntu 7.10 and eclipse Version: 3.4.1.
I am 100% sure my local hadoop server is running because I can use the command line to run hadoop jobs, etc. I think I set up the the "MapReduce Servers" tab correctly. I just put the path where I plut the hadoop directory, hostname, and username.
|
|
Posts:
5
Registered:
Nov 16, 2008 09:34:06 PM
|
|
|
|
Re: Error: Refresh DFS Children
Posted:
Nov 17, 2008 06:40:22 PM
in response to: lawrence.lee's post
|
|
|
|
I forgot to mention that I am running java 1.6 if that helps. I think it could be a problem with the built in ssh client and the java version. I was reading a previous thread on page 2 and people were having issues related to that.
|
|
Posts:
5
Registered:
Nov 16, 2008 09:34:06 PM
|
|
|
|
Re: Error: Refresh DFS Children
Posted:
Nov 18, 2008 07:19:44 PM
in response to: robin_'s post
|
|
|
|
After beating my head on this for a while and reading some previous threads, I finally got the hadoop plugin to work in eclipse. Here's what I did:
My setup:
ubuntu 7.10 (sorry windows users)
eclipse version 3.3
java-6-sun-1.6.0.03
hadoop-0.18.2
Installation:
1) Get correct version of the software listed above and install it. There are numerous sites on how to install hadoop on one machine.
old version of eclipse can http://archive.eclipse.org/eclipse/downloads/
2)Look for the hadoop-eclipse jar plugin file in the contrib dir directly under your hadoop installation directory and copy it to plugin dir of eclipse. Make sure eclipse is closed before doing this. I was lazy so I just copied the plugin into the plugin dir of eclipse.
Setup:
If you installed it correctly, you should be able to start the MapReduce perspective and Map/Reduce view. Both are under Window > Open Perspective and Show View respectively.
3)Click the blue elephant on the upper right corner of the Map/Reduce view. It'll bring up a configuration window.
4)Type in any name for the the Location Name. I just called it localhost cluster.
5)Set the port numbers for Map/Reduce Master and DFS Master. Look in your conf/hadoop-site.xml for "mapred.job.tracker" and "dfs.default.name" respectively. If not in that file, then it is probably in hadoop-default.xml or hadoop-env.xml.
6)Click "Advanced Parameters" tab and set the "mapred.job.tracker" parameter. For some reason it doesn't automatically change when you change it in the "General" tab.
7)User name should be whoever owns hadoop. For me, it is just m y login, others make a separate "hadoop" user for hadoop.
8)If you have done everything correctly, you should be able to click the triangles on the left to span the hierarchy view.
|
|
Posts:
30
Registered:
Oct 30, 2007 07:45:40 AM
|
|
|
|
Re: Error: Refresh DFS Children
Posted:
Jan 08, 2009 02:04:19 AM
in response to: lawrence.lee's post
|
|
|
|
Can u please tell me which plugin from where u used for the eclipse.
Thanks in Advance
-sudan
|
|
|
|
|