Skip to content Skip to sidebar Skip to footer
Showing posts with the label Hadoop
Spark 2.2 Thrift Server Error On Dataframe Numberformatexception When Query Hive Table

Spark 2.2 Thrift Server Error On Dataframe Numberformatexception When Query Hive Table

Post a Comment
I have Hortonworks HDP 2.6.3 running Spark2 (v2.2). My test case is very simple: Create a Hive tab… Read more Spark 2.2 Thrift Server Error On Dataframe Numberformatexception When Query Hive Table
Transport Exception

Transport Exception

Post a Comment
I'm trying to import happybase but gets the following error message while connecting. I have Ha… Read more Transport Exception
Subprocess Popen To Run Commands (hdfs/hadoop)

Subprocess Popen To Run Commands (hdfs/hadoop)

Post a Comment
I am trying to use subprocess.popen to run commands on my machine. This is what I have so far cmdve… Read more Subprocess Popen To Run Commands (hdfs/hadoop)
Spark On Windows 10. 'files\spark\bin\..\jars""\' Is Not Recognized As An Internal Or External Command

Spark On Windows 10. 'files\spark\bin\..\jars""\' Is Not Recognized As An Internal Or External Command

Post a Comment
I am very frustrated by Spark. An evening wasted thinking that I was doing something wrong but I ha… Read more Spark On Windows 10. 'files\spark\bin\..\jars""\' Is Not Recognized As An Internal Or External Command
Reading And Writing From Hive Tables With Spark After Aggregation

Reading And Writing From Hive Tables With Spark After Aggregation

Post a Comment
We have a hive warehouse, and wanted to use spark for various tasks (mainly classification). At tim… Read more Reading And Writing From Hive Tables With Spark After Aggregation
Hadoop Streaming: Where Are Application Logs?

Hadoop Streaming: Where Are Application Logs?

Post a Comment
My question is similar to : hadoop streaming: how to see application logs? (The link in the answer … Read more Hadoop Streaming: Where Are Application Logs?