I've configured Hortonworks HDP with ambari services, later I add HAWQ and PXF. Through some research i've seen that is possible to query data stored in Hive through HCatalog and since i already loaded the dataset to hive it would easy the work, but i am doing some benchmark, can someone tell me if the use of the Hcatalog affects HAWQ in terms of performance?
Acessing Hive Data on HAWQ/PXF with HCatalog
109 views Asked by Mário Rodrigues At
2
There are 2 answers
Related Questions in HIVE
- Type Adapter for Offset in hive flutter
- HIVE Sql Date conversion
- How to set spark.executor.extraClassPath & spark.driver.extraClassPath in hive query without adding those in hive-site.xml
- Hive query on HUE shows different timestamp than programatically/on data
- descending order of data in hive using collect_set
- How to optimize writing to a large table in Hive/HDFS using Spark
- Spark SQL repartition before insert operation
- Alter datatype of complex type(array<struct>>) in hive
- SqlAlchemy connection to Hive using http thrift transport and basic auth
- Aggregate values into a new column while retaining the old column
- Is it possible to query MAPR hdfs/hive tables from Trino?
- Can we make a column having both partitioning and bucketing in hive?
- converting varchar(7) to decimal (7,5) in hive
- Extract all characters before numeric values in hive SQL
- Livy session to submit pyspark from HDFS
Related Questions in HORTONWORKS-DATA-PLATFORM
- I want to ingest the csv data to the HDFS with Hortonworks Data Platform Sandbox
- Creating Data Lineage
- Is it possible to get data both hadoop cluster?
- Apache ranger hive plugin for HDP cluster is not working
- How can upload large files to the Horton work Sandbox HDP 2.6.5
- Hortonworks 2.6.5 yum install python-pip not working
- Partition the data frame using column X and writes the data without column X
- Why does ambari is showing this kerberos authentication error : AmbariAuthToLocalUserDetailsService
- How to get hortonworks data platform and cloudera distribution for hadoop latest version
- NiFi processors cannot connect to Zookeeper
- Postgresql stuck in recovery mode
- wget + download ambari tar ball
- How to copy a file from /user/maria_dev/tutorials/test.csv (HDP) to /sandbox/tutorial-files/640/nifi/input (HDF)?
- Do we need install all HDP's Services Client in all node?
- Hive - Convert epoch time (ms - 13 digit) to timestamp till milliseconds in hive sql
Related Questions in AMBARI
- Apache Ambari installation issue
- How to Add a Service to Ambari managed cluster (bigtop 3.2.1) , example : sqoop / sentry / kudu
- Compile Apache Ambari Error Could not resolve dependencies for project org.apache.ambari:ambari-metrics-assembly
- Integration of keycloak with Apache knox
- Why yarn resource manager not consume the max cores from node manager machines
- Ambari 2.8.0 failed install bigtop 3.2.0 when installing bigtop-select
- "IF NOT EXISTS" Unrecognized when I init hive-metastore
- failed to add host/datanode in ambari 2.7.5
- NiFi using memory more than allocated
- Ambari 2.7.7 Build Failure
- Ubuntu 22.04 docker install HDP 2.6.5 with error "failed to get D-BUS connection: No such file or directory
- Enabling Hadoop Namenode HA in Apache ambari using Bigtop
- HDFS showing heartbeat lost for nodes
- Install Spark 3.* on HDP with Ambari
- Ambari UI not showing versions in cluster installation
Related Questions in HCATALOG
- Store Pig result into Hive table using Hcat - ClassNotFoundException: org.datanucleus.NucleusContext
- Better process or tools to deploy large number of Hive tables
- EMR - Sqoop import using hcatalog failing on EMR
- Sqoop Export from hive table to teradata table
- Merge two bag and get all the field from first bag in pig
- is there a Hive/hcat property to export partitioned tables to a single file instead of a directory?
- How to decide the MySQL capacity for Hive Metastore DB?
- When Spark call Hive from oozie, exception raised "java.lang.ClassNotFoundException: org.apache.hadoop.hive.ql.metadata.HiveException"
- java.lang.NoSuchMethodError: org.apache.hive.common.util.ShutdownHookManager.addShutdownHook
- How to use Hive Metastore standalone?
- Sqoop export from Hcatalog to MySQL with different col names assign
- Is there are way to load partial table from hive to pig relation?
- sqoop action with hcatalog in oozie workflow has problem
- Creating s3 external table in amazon EMR with remote metastore
- Permission issue encountered during sqoop import using Hcatalog
Related Questions in HAWQ
- Compile error when I install HAWQ on Centos7:
- what are the Hadoop requirements for hawq 2.4
- why HAWQ Initialization error sync hawq-site.xml failed
- HAWQ PostgreSQL - Increment row based on previous row
- Greenplum's pg_dump cannot support lock statement
- HAWQ installation error
- verify whether an id passes through all stages
- Is it possible to collocate similar data on the same segment in Greenplum?
- HAWQ - Error while querying external HDFS table (PXF)
- HAWQ - how to choose a node to install segments
- Error when installing "hawq init cluster" on Docker, ,"internal_load_library","dfmgr.c",208
- Not able to Install HAWQ DB successfully in Centos 7.x version
- GPDB : SSH permission denied (public key)
- GPDB:Out of memory at segment
- How to connect spark from HAWQ via JDBC/ODBC driver?
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Popular Tags
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
When HAWQ accesses PXF tables using HCatalog integration, it determines format of underlying table(and even partition) and uses profile, optimized for that particular format, so there should be no performance degradation.