What is difference between YARN and hive2 queues?

Question

What is difference between yarn.scheduler.capacity.root.queues and hive.server2.tez.default.queues?

Answer 1

In short :

hive.server2.tez.default.queues values are subset of yarn.scheduler.capacity.root.queues(If capacity scheduler is configured in YARN, if not other scheduler) values.

---

Detailed answer:

hive.server2.tez.default.queues: (Default: empty)

A list of comma separated values corresponding to YARN queues of the same name. When HiveServer2 is launched in Tez mode, this configuration needs to be set for multiple Tez sessions to run in parallel on the cluster.

This does NOT mean that queries can't be issued to other "existing" queue defined in capacity scheduler. source

---

yarn.scheduler.capacity.root.queues:

The CapacityScheduler has a pre-defined queue called root. All queueus in the system are children of the root queue. Further queues can be setup by configuring yarn.scheduler.capacity.root.queues with a list of comma-separated child queues. source, setting up capacity scheduler

So, the scope of hive.server2.tez.default.queues is upto Hive queries only, but yarn.scheduler.capacity.root.queues scope will be for all the components(like MapReduce and Spark) in the cluster which are using YARN as Resource Manager.