Python Channel

I am working with Hive data pulled into a Python Jupyter notebook using a Hive wrapper written in P… Read more Collect Set By Group?

I have Hortonworks HDP 2.6.3 running Spark2 (v2.2). My test case is very simple: Create a Hive tab… Read more Spark 2.2 Thrift Server Error On Dataframe Numberformatexception When Query Hive Table

I have sample input dataframe as below, but the value (clm starting with m) columns can be n number… Read more How To Select Columns Using Dynamic Select Query Using Window Function

We have a hive warehouse, and wanted to use spark for various tasks (mainly classification). At tim… Read more Reading And Writing From Hive Tables With Spark After Aggregation

is it possible to connect to hadoop and run hive queries using Python 3.x? I am using Python 3.4.1.… Read more Hive Client For Python 3.x

I need to compare data changes in two partitions of table in Hive. Specifically, I have two partiti… Read more Compare Two Partitions Of Table In Hive

Below is the example for my use case. Solution 1: You can reference this question where an OP was… Read more How To Find The Pathing Flow And Rank Them Using Pig Or Hive?

I need to compare data changes in two partitions of table in Hive. Specifically, I have two partiti… Read more Compare Two Partitions Of Table In Hive