How to specify a filter to exclude hdfs file of a partition when calling distcp -update?

179 views Asked by At

Hadoop distcp -update is used with a filter. I want to exclude the hdfs file of the partition dt=20230621. What should I do? The command I am using now is

$ hadoop distcp -update -append -filters ".*dt=20230621.*" /tmp/source /tmp/target

...but the partition dt=20230621 below is still being backed up while I'd like to avoid copying these files.

0

There are 0 answers