I am running an Apache Spark app as a cron job, but I keep getting emails with the following message
Spark assembly has been built with Hive, including Datanucleus jars on classpath message
My cron entry is something like the following
...home/sparkJob.sh > /home/SaprkJobOperation-`date +\%Y\%m\%d\%H`-cron.log
I understand that there are some log4j properties, and I have managed to log those to a file, but I am not able to suppress the message. I want to get emails only for stderr messages. Is there a way to suppress this message?