Skip to content

Commit

Permalink
[SPARK-9010] [DOCUMENTATION] Improve the Spark Configuration document…
Browse files Browse the repository at this point in the history
… about `spark.kryoserializer.buffer`

The meaning of spark.kryoserializer.buffer should be "Initial size of Kryo's serialization buffer. Note that there will be one buffer per core on each worker. This buffer will grow up to spark.kryoserializer.buffer.max if needed.".

The spark.kryoserializer.buffer.max.mb is out-of-date in spark 1.4.

Author: zhaishidan <zhaishidan@haizhi.com>

Closes apache#7393 from stanzhai/master and squashes the following commits:

69729ef [zhaishidan] fix document error about spark.kryoserializer.buffer.max.mb
  • Loading branch information
stanzhai authored and srowen committed Jul 14, 2015
1 parent 20c1434 commit c1feebd
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/configuration.md
Original file line number Diff line number Diff line change
Expand Up @@ -665,7 +665,7 @@ Apart from these, the following properties are also available, and may be useful
<td>
Initial size of Kryo's serialization buffer. Note that there will be one buffer
<i>per core</i> on each worker. This buffer will grow up to
<code>spark.kryoserializer.buffer.max.mb</code> if needed.
<code>spark.kryoserializer.buffer.max</code> if needed.
</td>
</tr>
<tr>
Expand Down

0 comments on commit c1feebd

Please # to comment.