The tag has no usage guidance.

learn more… | top users | synonyms

0
votes
0answers
11 views

How do I address the java process warning and MySql conflict while deploying Hortonworks?

I have two nodes in AWS. I got a java process warning while registering and confirming hosts. Could this warning message, issued for the name node, be ignored please? Process Issues (1) The ...
0
votes
1answer
46 views

SSH permission denied from Linux to Windows using keys

I am a beginner in hadoop, and I am trying to set-up hadoop cluster in fully distribution mode. My master is windows and my slave machine is Linux running on VM. I have created SSH keys and in both ...
0
votes
1answer
25 views

Copy files mentioned in List one by one only after completion

I have a list of file names in a text file files.txt which are listed one by one in next line ie. file1.txt file2.txt file3.txt file4.txt ... ... ... I have to execute the following command for ...
0
votes
0answers
14 views

Can't see any website hosted in a node while same issue is not present in other nodes in LAN

Recently we setup a Hadoop cluster with 10 nodes in our Office premises. All of these nodes are installed with CentOS 6. However the issue I'm facing may not be related to Hadoop and accordingly I'm ...
0
votes
0answers
93 views

hadoop fs operations file not found

I installed and configured hadoop recently on my ubuntu 12.04 operated machine. The installation was successful and I am able to start all services successfully. I am facing problem with hadoop fs . I ...
0
votes
0answers
42 views

Hypertable and thrift installation on xampp on windows 10

Please tell me is it possible to install hypertable and thrift and also hadoop on xampp on windows 10 64bit to test a site. If possible so please give step by step guide to install these things. ...
0
votes
0answers
30 views

Should I go for Hadoop?

I hope discussing scenarios and solutions isn't out of context, if it is then please suggest. Details: Windows server 2012 R2 with IIS and MS SQL standard edition, using C# in the front end with Ajax ...
0
votes
0answers
11 views

to pass the acton name,start date and end date and status to another action in oozie workflow

I have a requirement like i need to pass an actions output(like action_name,success/failed) to another action in a oozie workflow. Kindly pass some information how to schedule the actions ? This is ...
0
votes
0answers
28 views

Creating a cluster on Ambari

I have installed ambari and the server is running - as can be seen by the screenshot. What is the procedure to then create a cluster? The documentation literally says "follow the onscreen ...
0
votes
0answers
29 views

How does ResourceManager communicates to NameNode

Does ResourceManager talks to NameNode when running an application in YARN. If Yes, would like to know when and how.
0
votes
0answers
47 views

Is HDFS concurrent reading less efficient than reading a replicated copy?

If I have two identical files A and B on HDFS, and then have two simultaneous read tasks on those files. Is scenario 1 faster? Scenario 1: read A + read B Scenario 2: read A + read A If the ...
0
votes
2answers
37 views

Will Hadoop benefit from just one disk?

If I use a single node setup with Hadoop where it has only one disk, I can easily use it to play around with Hadoop and stuff, but will there actually be any benefit to using Hadoop in this case over ...
1
vote
1answer
522 views

Open eclipse with a linux user that doesn't have graphical environment (created from console)

I created an user from console in my Ubuntu Destkop 14.04 LTS, doing this: sudo addgroup hadoop sudo adduser --ingroup hadoop hduser I used that user for doing all sort of stuff, because i'm using ...
0
votes
0answers
148 views

Why would a dead datanode be working on a Hadoop program?

I have 3 datanodes hadoop01, hadoop02, and hadoop03. When I run hadoop dfsadmin -report, I get that 1 data node is dead and the offending datanode (Last contact: Mon Mar 16 22:49:47 CDT 2015) is ...
0
votes
0answers
88 views

How to Deploy an Hadoop MapR Sandbox in The Cloud?

I'm New to Cloud computing so give me a favor if its a silly question. I have a OVA Template of MapR Sandbox downloaded from this below link. ...
1
vote
0answers
209 views

How do I find which disk (volume) is failing?

I am using stock Apache Hadoop 1.1.1 and I can't get a datanode to start due to: 2015-04-23 09:12:48,138 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from ...
0
votes
1answer
41 views

Hadoop output during run — What is the number right after the timestamp

When Hadoop runs, it puts out the messages we've all seen many times. E.g.: 2015-03-30 10:09:08,750 [main] WARN org.apache.hadoop.conf.Configuration - dfs.data.dir is deprecated. Instead, use ...
0
votes
1answer
2k views

ERROR: Can't get Master address from zookeeper; znode data == null

I have two linux machine one is master machine(192.168.8.174) and another one is slave1 machine(192.168.8.173). I have installed and configured Hadoop 2.6.0 in fully distributed mode successfully. ...
0
votes
1answer
139 views

Copy data from local disk to hdfs in a federation of HDFS

I am trying to configure a Federation of HDFS. Therefore, I configured the $ cat etc/hadoop/hdfs-site.xml in both hosts (hadoop-coc-1, and hadoop-coc-2). The problem is that with this configuration, ...
0
votes
1answer
20 views

What does “streaming-off-disk” mean?

I am taking a course offered by www.statistics.com—Advanced Analytics and Machine Learning with Hadoop—and I reading through course material. I stumbled upon the following statement (emphasis mine): ...
0
votes
1answer
212 views

Is it normal behavior for the Reduce tasks to wait until the Map tasks finish?

I have a 50 GB MapReduce job which is (basically) a WordCount app and it has the following Map/Reduce job percentages (listed at the end of the question). It seems like the reducers want to wait until ...
1
vote
0answers
20 views

View all CURRENT parameters for a hadoop installation?

I have inherited a hadoop installation and I would like to query all usage parameters and configuration options. I am sifting through the conf directory and it is helping, but this is an old ...
1
vote
1answer
143 views

Hadoop Uninstall : Shall I remove linux-image packages?

I removed hadoop from my machine via apt-get remove --purge hadoop In the output I see the following packages were not removed : The following packages were automatically installed and are no longer ...
0
votes
1answer
285 views

Permission denied (publickey) error when using scp

I had created 3 linux instances on the Amazon EC2 cloud without a passphrase for the private key. I had stored the private key in a file id_rsa in one of my instances(the master) to allow it to ssh ...
-2
votes
1answer
66 views

Can't download hadoop

Am I taking crazy pills or is it impossible to download hadoop right now? I am looking at http://www.apache.org/dyn/closer.cgi/hadoop/common/ to find mirrors for it and absolutely none of them work ...
1
vote
0answers
182 views

adding nodes to hadoop cluster virtualbox

I am trying to setup a mini hadoop cluster with virtualbox: hosts file (hosts file properly configured): hadoop@rui-VirtualBox:/home/rui$ cat /etc/hosts | grep 10. 10.0.13.96 hnode1 10.0.13.97 ...
0
votes
2answers
546 views

Unable to SSH, cannot create /dev/null/.ssh

I am trying to deploy hadoop with a master and slave node. But the master fails to start tasttracker and datanode processes in slaves, as it is not able to ssh into slaves. The error message is 'Could ...
1
vote
1answer
2k views

Disable RAID Controller at BOOT and Partition Each Disk

I have some decent HP Proliants server that come with "HP Smart Array P410i Controller" enabled, I am using these boxes to set up a Hadoop cluster and I know, RAID is for sure a no-no for Hadoop since ...
1
vote
1answer
485 views

Sqoop JDBC connection timeout after import but before hive import

We are using Sqoop v1.4.4 14/05/27 13:49:14 INFO sqoop.Sqoop: Running Sqoop version: 1.4.4-cdh5.0.0 Sqoop 1.4.4-cdh5.0.0 git commit id 8e266e052e423af592871e2dfe09d54c03f6a0e8 When I'm importing a ...
1
vote
0answers
978 views

Hadoop - java.io.IOException: Connection reset by peer when creating when creating a new directory

I have installed hadoop 2.4.0 as a single node for learning purposes but after I start hadoop and create a directory using the command: hadoop fs -mkdir /tmp I get the following error: ls: Failed ...
1
vote
5answers
939 views

Mac OS X 10.9 Mavericks breaks passwordless SSH to localhost (for hadoop)

Sorry if this sounds like a repeat, but I'm fairly sure it's specifically Mac OS X 10.9 related, it works fine for me on my 10.8 machine. I've done everything identically, as usual: $:~ ssh-keygen -t ...
1
vote
0answers
166 views

hadoop cluster high availability error couldn't find or load main class

[hduser@mn1 bin]$ ./hdfs zkfc -formatZK Error: Could not find or load main class ”-Djava.library.path=”.home.hduser.2.3.0″.lib” I did every step just like in this tutorial, TWICE. The error still ...
0
votes
1answer
163 views

How to start after installing OpenStack

I have installed OpenStack following the tutorial from here I want to know that how can I deploy simple PHP application using Apache Hadoop on OpenStack? Any reference?
2
votes
2answers
488 views

Unable to send files via SCP

I tried using the scp command with the -i option to transfer the file from local machine to remote EC2 instance: Akhis-Macbook-Pro:~ aswinakhilesh$ sudo scp -i Mykey.pem FileA ...
0
votes
1answer
517 views

Disable Hadoop Symlinks on Windows

I'm running Hadoop 2.2.0 on Windows 7. When I try to execute my job, Hadoop tries to create symlinks in the temp folder on my local file system. This is not working as I do not have the necessary ...
0
votes
0answers
563 views

How to install Mahout on Windows 8.1?

My goal is to build up a recommendation system and after going through many articles, I came across Mahout as a simple, yet effective way to go on. I already have XAMPP installed on my system. How ...
0
votes
1answer
845 views

How to remove large number of files/folders in linux

We are using hadoop to split a table into smaller files to feed to mahout, but in the process, we created a huge amount of _temporary logs. we have an nfs mount for the hadoop volume so we can use ...
0
votes
2answers
12k views

How to move files to hdfs in hadoop using unix command

I have 2 directories "dft" and "hdfs" in the unpacked Hadoop folder. I am trying to copy the file(StartUnit.txt) in dft into hdfs. The corresponding command and exception are as shown below ...
0
votes
0answers
349 views

Failed to set permissions of path: ..\taskTracker\cyg_server to 0700

While running a job in Cygwin in Hadoop cluster, the permission failed. $ bin/hadoop jar hadoop-examples-*.jar wordcount inputwords outputwords2 Patch for HADOOP-7682: Instantiating workaround file ...
2
votes
2answers
6k views

Slave: ssh: connect to host slave port 22: Connection timed out

i have done with single node cluster on two different machine,I have made one as master(192.168.1.1) and other m/c as slave(192.168.1.2), I am successfully able to ping between two machine,I have made ...
1
vote
2answers
2k views

wants to remove cdh4(hadoop) from ubuntu 12.04

i have installed cdh3 pseudo mode in my ubuntu 12.04(precise) system using the following web reference cdh3-install-ubuntu12.04 now i tried to install cdh4 to replace cdh3 but,unfortunately found ...
0
votes
1answer
205 views

Does formatting the HDFS filesystem remove my data?

I'm starting to learn Hadoop. If I want to format the HDFS filesystem I need to execute bin/hadoop namenode -format Does it mean that it will format my filesystem, losing everything I have there? ...
1
vote
0answers
881 views

Why does eclipse report an error when I use it under a hadoop account?

I created two accounts, one is a common user, the other is just for hadoop, which is a superuser as root. I can load eclipse normally under my common user account, but I could not use it under hadoop ...
0
votes
1answer
183 views

Hue not loading in browser

I have a Hue installation on my local machine and the browser loads it very well in the browser when I give the URL 10.20.30.40:8888 in my browser. When i do the same for a remote machine (I ...
1
vote
1answer
2k views

Pig tutorial in local mode returns OutOfMemoryError

I am new with pig and I try to learn from pig tutorial on Apache website. I am working with hadoop 1.0.1 and PigVersion 0.11.1. In the tutorial, it is proposed to try pig on two examples (called ...
1
vote
0answers
649 views

Cygwin ssh-host-config on windows for hadoop

I'm new to cygwin and hadoop, please anyone could explain which mirror link is the proper to install cygwin what version of hadoop is bug free ( .sh works good ) is it must to run below commands ...
0
votes
1answer
425 views

Passwordless ssh on cloudera hadoop

I am using cdh4 on ec2. On the master node I don't see any keys pre-built and in fact passwordless ssh from master to hadoop slave node(s) does not work out-of-the-box. [ec2-user@ip-10-196-blah-blah ...
-1
votes
0answers
102 views

How to speed up mahout learning process? [closed]

I have been using a dataset with million documents as a training set. It takes a day for mahout to learn in my machine with 8GB ram, intel i5 2.50GHZ? Is there any tweak to improve the learning ...
1
vote
1answer
503 views

Check Oozie status in UNIX

Hadoop Admin Utility Created a basic hadoop admin utility which checks dfs health and oozie status. Checking oozie status In my above utility, I am using the below command : bin/oozie admin ...
-1
votes
2answers
721 views

Does Hortonworks Data Platform support Ubuntu or not?

I am new to the Hortonworks Data Platform. Can anyone tell me whether Ubuntu supports Hortonworks Data Platform or not?