blog darkness...

words, music, food

Entries for tag "hadoop"

tools.DistCp: Exception encountered java.lang.IllegalArgumentException: n must be positive

When using distcp on hadoop, I sometimes get the following error:

tools.DistCp: Exception encountered java.lang.IllegalArgumentException: n must be positive

Which is slightly misleading.  Internet searches (Stack Overflow) make it seem like this can be transient or when you have an empty directory (n = 0).  In my case, the error was because the number of nested directories in my recursive copy was too large for distcp to handle ...

Continue reading »

cloudera manager can't add hosts... hosts fail

Solution is pretty simple... just add your hostname to /etc/hosts. Can't believe I couldn't find an answer to this anywhere /tmp/scm_prepare_node.NGs7zGVx >>/usr/lib64/cmf/agent/src/cmf/parcel.py:15: DeprecationWarning: the sets module is deprecated >> from sets import Set >>/usr/lib64/cmf/agent/src/cmf/agent.py:31: DeprecationWarning: the sha module is deprecated; use the hashlib module instead >> import sha >>[17/Sep/2014...
Continue reading »