submit spark job to dataproc

When I submit my shaded JAR to a local standalone cluster, it works fine. However, when I submit it to a Dataproc cluster, I encounter the error “java.lang.NoClassDefFoundError”, even though the class exists in the Maven dependency.

Why is this happening?

Leave a Comment