Comments for Kyle Mulka's Blog

Comment on Script to delete all tables in Hive by Rob Cranfill

Rob Cranfill — Wed, 03 Apr 2013 16:21:42 +0000

I might suggest you specify the database being used, if needed:
hive -e ‘use XXX;show tables’ | xargs -I ‘{}’ hive -e ‘use XXX;drop table {}’

/rob

Comment on How to Install Sqoop on Amazon Elastic Map Reduce (EMR) by Sqoop via an ssh tunnel on Amazon EMR « Getting there is 99.5% the fun

Sqoop via an ssh tunnel on Amazon EMR « Getting there is 99.5% the fun — Fri, 29 Mar 2013 02:07:00 +0000

[...] turns out other people have solved this problem, but here’s our solution for posterity. Note that it’s [...]

Comment on Natalie Emcard by john ilanny

john ilanny — Mon, 28 Jan 2013 20:04:01 +0000

Just found good ole Natalie Emcard in Burlington Books’ Student Book for English. Here she’s taking on the role of Melanie Burke – jazz musician on pg. 49.

Comment on How to Install Sqoop on Amazon Elastic Map Reduce (EMR) by Justin

Justin — Thu, 22 Nov 2012 02:30:27 +0000

This worked for me. One obstacles I had was that I wrote my .sh file on Windows so the “End Of Line” format was incorrect.

You can use Notepad++ to fix this, go to Edit > EOL Conversion > UNIX Format

Thanks Kyle.

Comment on How to Install Sqoop on Amazon Elastic Map Reduce (EMR) by Rupinder

Rupinder — Wed, 21 Nov 2012 14:11:16 +0000

I just checked and successfully installed sqoop as a bootstrap action in EMR.

Comment on How to Install Sqoop on Amazon Elastic Map Reduce (EMR) by Rupinder

Rupinder — Wed, 21 Nov 2012 13:26:45 +0000

Thanks. This was helpful.
Is it possible to configure the script to install Sqoop as a bootstrap action in EMR Console ?

Comment on Natalie Emcard by Mack Teoh

Mack Teoh — Sat, 17 Nov 2012 03:29:06 +0000

im looking for bookmarks, anyone heard of this place? http://www.backlinksplus.com/social-bookmarking/

Comment on How to Install Sqoop on Amazon Elastic Map Reduce (EMR) by ranjith

ranjith — Fri, 10 Aug 2012 21:37:20 +0000

The last sqoop import and export statement
./sqoop-1.4.1-incubating__hadoop-0.20/bin/sqoop export –connect jdbc:mysql:/// –table –export-dir –fields-terminated-by , –input-null-non-string ‘\\N’ –username –password

Is this a part of the emr job flow ? Can we add this as a step to the job flow that which runs the export of data from hive to mysql on the emr instance? Or do I need to run this from terminal?

Comment on How to Install Sqoop on Amazon Elastic Map Reduce (EMR) by Siyin

Siyin — Tue, 17 Jul 2012 16:01:08 +0000

Hi,

I followed your steps exactly and got the following error running sqoop:

Exception in thread “main” java.lang.NoClassDefFoundError: com/cloudera/sqoop/Sqoop
Caused by: java.lang.ClassNotFoundException: com.cloudera.sqoop.Sqoop
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Could not find the main class: com.cloudera.sqoop.Sqoop. Program will exit.

Any ideas on why it’s looking for Cloudera’s Sqoop library and how do I get past this? Thanks.

Comment on List of Sites Affected by Fisher Plaza Data Center Fire by Amazon Cloud: Two power outages in two weeks « TechOpsGuys.com

Amazon Cloud: Two power outages in two weeks « TechOpsGuys.com — Sat, 30 Jun 2012 18:54:23 +0000

[...] issues and eventually resulted in more then 24 hours of downtime due to a fire knocking out many well known sites like Bing Travel as well as many others. It took them months to repair the facility, they had [...]