Hadoop Installation On Windows 7 Using Cygwin

Posted on

Apache Hadoop Installation on Windows 64-bit platform. Below article gives the step by step procedure to install cygwin on windows 64 bit and run hadoop. Installing Apache Hadoop on Windows 10 using Cygwin64. Posted by Naveen Acharya at 08:27. Email This BlogThis! Share to Twitter Share to Facebook Share to Pinterest.

Active6 years, 6 months ago
  • Download VMware VMPlayer on your Windows. Hadoop-1.0.1 on windows-7,. Improvements for running Hadoop on Windows. I downloaded Hadoop 2.2 yesterday. Hadoop Installation on Windows 7 Using Cygwin. Hadoop Installation on Windows. Let us download and install Hadoop. I was installing Hadoop 2.7.0 recently on a Windows platform.
  • Aug 01, 2016  Author: Aikansh Manchanda I am an IT professional with 10 years of experience with JAVA/J2EE technologies and around 2.5 years experience with BigData/Hadoop. Big Data skills include Spark/Scala, Grafana, Hive, Sentry, Impala.

I've just installed hadoop on windows using cygwin which works fine, and now I am installing Hive. I am running it as:

(both give the same problem) as I have found out there is a bug with the windows naming convension (https://issues.apache.org/jira/browse/HIVE-2388..)

When I run the above command, Hive seems to load fine, but when I enter 'show tables;' I get no response. This is the same for all queries. CREATE TABLE etc, there is no response

Its the same problem as this guy:http://mail-archives.apache.org/mod_mbox..

Any ideas?

p_mcp
p_mcpp_mcp
1,1602 gold badges20 silver badges58 bronze badges

1 Answer

I resolved a similar issue and successfully ran HIVE after starting all Hadoop daemons

  • namenode
  • datanode
  • jobtracker
  • Task Tracker

Running queries from files using hive -f <filename>, instead of writing queries directly at the HIVE command prompt. Additionally, you may also use bin/hive -e 'SHOW TABLES'

Hadoop Installation On Windows 7 Using Cygwin Download

Jesse
7,2457 gold badges38 silver badges55 bronze badges
MadhuMadhu

Not the answer you're looking for? Browse other questions tagged windowshadoopcygwinhive or ask your own question.

Active5 years, 4 months ago

Before I explain the issue I am having, need to let you know that I am totally new to CYGWIN and stuff like this.My objective of installing SSH using CYGWIN is to setup Hadoop on windows 7 x64 machine. I am trying to execute the steps given on https://gist.github.com/tariqmislam/2159173. however I am not able to provide a blank password. Below is the log for same. Any help will be greatly appreciated.

Hadoop Installation On Windows 7 Using Cygwin

$ chmod +r /etc/passwd

Hadoop installation on windows 7 using cygwin free

$ chmod u+w /etc/passwd

$ chmod +r /etc/group

$ chmod u+w /etc/group

$ chmod 755 /var

$ touch /var/log/sshd.log

$ chmod 664 /var/log/sshd.log

$ ssh-host-config

All of America, with sportswriter John Morris and his sassy companion Julia Sullivan. Available at for Kindle, for Nook, and at Apple iBooks and iTunes bookstore (preview ). They’re out to solve his electrocution, to figure out the mystery of the Monday Night Murders. Who witnessed the murder of cocky, verbose primetime TV announcer George Hoagland? Mobi format for kindle.

* Query: Overwrite existing /etc/ssh_config file? (yes/no) yes* Info: Creating default /etc/ssh_config file* Query: Overwrite existing /etc/sshd_config file? (yes/no) yes* Info: Creating default /etc/sshd_config file* Info: Privilege separation is set to yes by default since OpenSSH 3.3. Info: However, this requires a non-privileged account called 'sshd'. Info: For more info on privilege separation read /usr/share/doc/openssh/README.privsep. Query: Should privilege separation be used? (yes/no) no** Info: Updating /etc/sshd_config file

* Query: Do you want to install sshd as a service? Query: (Say 'no' if it is already installed as a service) (yes/no) yes Query: Enter the value of CYGWIN for the daemon: [] Info: On Windows Server 2003, Windows Vista, and above, the Info: SYSTEM account cannot setuid to other users -- a capability Info: sshd requires. You need to have or to create a privileged** Info: account. This script will help you do so.

* Info: You appear to be running Windows XP 64bit, Windows 2003 Server, Info: or later. On these systems, it's not possible to use the LocalSystem Info: account for services that can change the user id without an Info: explicit password (such as passwordless logins [e.g. public key** Info: authentication] via sshd).

* Info: If you want to enable that functionality, it's required to create Info: a new account with special privileges (unless a similar account Info: already exists). This account is then used to run these special* Info: servers.

* Info: Note that creating a new user requires that the current account* Info: have Administrator privileges itself.

* Info: No privileged account could be found.

* Info: This script plans to use 'cyg_server'.* Info: 'cyg_server' will only be used by registered services.* Query: Do you want to use a different name? (yes/no) no* Query: Create new privileged user account 'cyg_server'? (yes/no) yes* Info: Please enter a password for new user cyg_server. Please be sure Info: that this password matches the password rules given on your system. Info: Entering no password will exit the configuration. Query: Please enter the password: Query: Please enter the password: Query: Please enter the password:** Query: Please enter the password:

harpun
3,8121 gold badge29 silver badges38 bronze badges
Pranav KaushikPranav Kaushik

2 Answers

I can only recommend running hadoop in a linux virtual machine or native linux. Although successfully running hadoop 0.20.0 on windows xp+cygwin and windows7+cygwin, I once tried setting up a newer version of hadoop on windows7, but failed miserably due to errors in hadoop. IIRC hadoop with the security patch won't even run on windows7 because of problems with file permissons, etc. So my advice: run hadoop on linux if you can, you'll avoid a serious amount of problems.

harpunharpunHadoop Installation On Windows 7 Using Cygwin
3,8121 gold badge29 silver badges38 bronze badges

I followed steps in the following link and sshd installation and starting as service was working fine for me:

Deepak SinghviDeepak Singhvi

Not the answer you're looking for? Browse other questions tagged windows-7hadoopsshcygwin or ask your own question.