[SPARK-49550][BUILD] Upgrade Hadoop to 3.4.1

### What changes were proposed in this pull request?

This PR aims to upgrade Apache Hadoop to 3.4.1.

### Why are the changes needed?

To bring the latest bug fixes.

- http://hadoop.apache.org/docs/r3.4.1/index.html
- http://hadoop.apache.org/docs/r3.4.1/hadoop-project-dist/hadoop-common/release/3.4.1/RELEASENOTES.3.4.1.html
- http://hadoop.apache.org/docs/r3.4.1/hadoop-project-dist/hadoop-common/release/3.4.1/CHANGELOG.3.4.1.html

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#48295 from dongjoon-hyun/SPARK-49550.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>

dev/deps/spark-deps-hadoop-3-hive-2.3

@@ -71,16 +71,16 @@ gcs-connector/hadoop3-2.2.25/shaded/gcs-connector-hadoop3-2.2.25-shaded.jar
 gmetric4j/1.0.10//gmetric4j-1.0.10.jar
 gson/2.11.0//gson-2.11.0.jar
 guava/33.2.1-jre//guava-33.2.1-jre.jar
-hadoop-aliyun/3.4.0//hadoop-aliyun-3.4.0.jar
-hadoop-annotations/3.4.0//hadoop-annotations-3.4.0.jar
-hadoop-aws/3.4.0//hadoop-aws-3.4.0.jar
-hadoop-azure-datalake/3.4.0//hadoop-azure-datalake-3.4.0.jar
-hadoop-azure/3.4.0//hadoop-azure-3.4.0.jar
-hadoop-client-api/3.4.0//hadoop-client-api-3.4.0.jar
-hadoop-client-runtime/3.4.0//hadoop-client-runtime-3.4.0.jar
-hadoop-cloud-storage/3.4.0//hadoop-cloud-storage-3.4.0.jar
-hadoop-huaweicloud/3.4.0//hadoop-huaweicloud-3.4.0.jar
-hadoop-shaded-guava/1.2.0//hadoop-shaded-guava-1.2.0.jar
+hadoop-aliyun/3.4.1//hadoop-aliyun-3.4.1.jar
+hadoop-annotations/3.4.1//hadoop-annotations-3.4.1.jar
+hadoop-aws/3.4.1//hadoop-aws-3.4.1.jar
+hadoop-azure-datalake/3.4.1//hadoop-azure-datalake-3.4.1.jar
+hadoop-azure/3.4.1//hadoop-azure-3.4.1.jar
+hadoop-client-api/3.4.1//hadoop-client-api-3.4.1.jar
+hadoop-client-runtime/3.4.1//hadoop-client-runtime-3.4.1.jar
+hadoop-cloud-storage/3.4.1//hadoop-cloud-storage-3.4.1.jar
+hadoop-huaweicloud/3.4.1//hadoop-huaweicloud-3.4.1.jar
+hadoop-shaded-guava/1.3.0//hadoop-shaded-guava-1.3.0.jar
 hive-beeline/2.3.10//hive-beeline-2.3.10.jar
 hive-cli/2.3.10//hive-cli-2.3.10.jar
 hive-common/2.3.10//hive-common-2.3.10.jar

pom.xml

@@ -123,7 +123,7 @@
     <slf4j.version>2.0.16</slf4j.version>
     <log4j.version>2.24.1</log4j.version>
     <!-- make sure to update IsolatedClientLoader whenever this version is changed -->
-    <hadoop.version>3.4.0</hadoop.version>
+    <hadoop.version>3.4.1</hadoop.version>
     <!-- SPARK-41247: When updating `protobuf.version`, also need to update `protoVersion` in `SparkBuild.scala` -->
     <protobuf.version>3.25.5</protobuf.version>
     <protoc-jar-maven-plugin.version>3.11.4</protoc-jar-maven-plugin.version>