SuccessChanges

Summary

  1. [SPARK-30382][SQL] Remove Hive LogUtils usage to prevent (details)
  2. [SPARK-30450][INFRA] Exclude .git folder for python linter (details)
Commit 2be528682832cfae1298161c62acd0a5a48a1d48 by dhyun
[SPARK-30382][SQL] Remove Hive LogUtils usage to prevent
ClassNotFoundException
Avoid hive log initialisation as
https://github.com/apache/hive/blob/rel/release-2.3.5/common/src/java/org/apache/hadoop/hive/common/LogUtils.java
introduces dependency over
`org.apache.logging.log4j.core.impl.Log4jContextFactory` which is
missing in our spark installer classpath directly. I believe the
`LogUtils.initHiveLog4j()` code is here as the HiveServer2 class is
copied from Hive.
To make `start-thriftserver.sh --help` command success.
Currently, start-thriftserver.sh --help throws
```
... Thrift server options: Exception in thread "main"
java.lang.NoClassDefFoundError:
org/apache/logging/log4j/spi/LoggerContextFactory
at org.apache.hive.service.server.HiveServer2.main(HiveServer2.java:167)
at
org.apache.spark.sql.hive.thriftserver.HiveThriftServer2$.main(HiveThriftServer2.scala:82)
at
org.apache.spark.sql.hive.thriftserver.HiveThriftServer2.main(HiveThriftServer2.scala)
Caused by: java.lang.ClassNotFoundException:
org.apache.logging.log4j.spi.LoggerContextFactory
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 3 more
```
No
Checked Manually
Closes #27042 from ajithme/thrifthelp.
Authored-by: Ajith <ajith2489@gmail.com> Signed-off-by: Dongjoon Hyun
<dhyun@apple.com>
The file was modifiedsql/hive-thriftserver/v1.2/src/main/java/org/apache/hive/service/server/HiveServer2.java (diff)
The file was modifiedsql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/server/HiveServer2.java (diff)
Commit ed8a260749e3d26d82829986c3b36bc9043d854a by dhyun
[SPARK-30450][INFRA] Exclude .git folder for python linter
### What changes were proposed in this pull request?
This excludes the .git folder when the python linter runs.  We want to
exclude because there may be files in .git from other branches that
could cause the linter to fail.
### Why are the changes needed?
I ran into a case where there was a branch name that ended ".py" suffix
so there were git refs files in .git folder in .git/logs/refs and
.git/refs/remotes.
### Does this PR introduce any user-facing change?
No.
### How was this patch tested?
Manual.
```
$ git branch 3.py
$ git checkout 3.py Switched to branch '3.py'
$ dev/lint-python starting python compilation test... Python compilation
failed with the following errors:
*** Error compiling './.git/logs/refs/heads/3.py'...
File "./.git/logs/refs/heads/3.py", line 1
   0000000000000000000000000000000000000000
895e572b73ca2796cbc3c468bb2c21abed5b22f1 Dongjoon Hyun <dhyunapple.com>
1578438255 -0800 branch: Created from master
                                                  ^ SyntaxError: invalid
syntax
*** Error compiling './.git/refs/heads/3.py'...
File "./.git/refs/heads/3.py", line 1
   895e572b73ca2796cbc3c468bb2c21abed5b22f1
                                          ^ SyntaxError: invalid syntax
```
Closes #27120 from ericfchang/master.
Authored-by: Eric Chang <eric.chang@databricks.com> Signed-off-by:
Dongjoon Hyun <dhyun@apple.com>
The file was modifieddev/tox.ini (diff)
The file was modifieddev/lint-python (diff)