Skip to content

Commit 8750ebb

Browse files
yruslanyruslan
committed
Update spark-cobol version to 2.10.4 and 2.10.5-SNAPSHOT in build files and documentation.
1 parent d307a35 commit 8750ebb

8 files changed

Lines changed: 21 additions & 19 deletions

File tree

‎README.md‎

Lines changed: 14 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -75,13 +75,13 @@ You can link against this library in your program at the following coordinates:
7575
</tr>
7676
<tr>
7777
<td>
78-
<pre>groupId: za.co.absa.cobrix<br>artifactId: spark-cobol_2.11<br>version: 2.10.3</pre>
78+
<pre>groupId: za.co.absa.cobrix<br>artifactId: spark-cobol_2.11<br>version: 2.10.4</pre>
7979
</td>
8080
<td>
81-
<pre>groupId: za.co.absa.cobrix<br>artifactId: spark-cobol_2.12<br>version: 2.10.3</pre>
81+
<pre>groupId: za.co.absa.cobrix<br>artifactId: spark-cobol_2.12<br>version: 2.10.4</pre>
8282
</td>
8383
<td>
84-
<pre>groupId: za.co.absa.cobrix<br>artifactId: spark-cobol_2.13<br>version: 2.10.3</pre>
84+
<pre>groupId: za.co.absa.cobrix<br>artifactId: spark-cobol_2.13<br>version: 2.10.4</pre>
8585
</td>
8686
</tr>
8787
</table>
@@ -92,17 +92,17 @@ This package can be added to Spark using the `--packages` command line option. F
9292

9393
### Spark compiled with Scala 2.11
9494
```
95-
$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.11:2.10.3
95+
$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.11:2.10.4
9696
```
9797

9898
### Spark compiled with Scala 2.12
9999
```
100-
$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.10.3
100+
$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.10.4
101101
```
102102

103103
### Spark compiled with Scala 2.13
104104
```
105-
$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.13:2.10.3
105+
$SPARK_HOME/bin/spark-shell --packages za.co.absa.cobrix:spark-cobol_2.13:2.10.4
106106
```
107107

108108
## Usage
@@ -240,18 +240,18 @@ Cobrix's `spark-cobol` data source depends on the COBOL parser that is a part of
240240

241241
The jars that you need to get are:
242242

243-
* spark-cobol_2.12-2.10.3.jar
244-
* cobol-parser_2.12-2.10.3.jar
243+
* spark-cobol_2.12-2.10.4.jar
244+
* cobol-parser_2.12-2.10.4.jar
245245

246246
> Versions older than 2.8.0 also need `scodec-core_2.12-1.10.3.jar` and `scodec-bits_2.12-1.1.4.jar`.
247247
248248
> Versions older than 2.7.1 also need `antlr4-runtime-4.8.jar`.
249249
250250
After that you can specify these jars in `spark-shell` command line. Here is an example:
251251
```
252-
$ spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.10.3
252+
$ spark-shell --packages za.co.absa.cobrix:spark-cobol_2.12:2.10.4
253253
or
254-
$ spark-shell --master yarn --deploy-mode client --driver-cores 4 --driver-memory 4G --jars spark-cobol_2.12-2.10.3.jar,cobol-parser_2.12-2.10.3.jar
254+
$ spark-shell --master yarn --deploy-mode client --driver-cores 4 --driver-memory 4G --jars spark-cobol_2.12-2.10.4.jar,cobol-parser_2.12-2.10.4.jar
255255
256256
Setting default log level to "WARN".
257257
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
@@ -319,7 +319,7 @@ The fat jar will have '-bundle' suffix. You can also download pre-built bundles
319319

320320
Then, run `spark-shell` or `spark-submit` adding the fat jar as the option.
321321
```sh
322-
$ spark-shell --jars spark-cobol_2.12_3.3-2.10.4-SNAPSHOT-bundle.jar
322+
$ spark-shell --jars spark-cobol_2.12_3.3-2.10.5-SNAPSHOT-bundle.jar
323323
```
324324

325325
> <b>A note for building and running tests on Windows</b>
@@ -2015,14 +2015,16 @@ at org.apache.hadoop.io.nativeio.NativeIO$POSIX.getStat(NativeIO.java:608)
20152015
A: Update hadoop dll to version 3.2.2 or newer.
20162016
20172017
## Changelog
2018-
- #### 2.10.4 will be released soon.
2018+
- #### 2.10.4 released 14 May 2026.
20192019
- [#841](https://github.com/AbsaOSS/cobrix/pull/841) Added support for file start and end offset options for in-place processing of files without converting to dataframes.
20202020
- [#842](https://github.com/AbsaOSS/cobrix/pull/842) Added support for controlling handling of nulls for various data types when writing EBCDIC files.
20212021
```scala
20222022
.option("write_null_strings_as_spaces", "true")
20232023
.option("write_null_display_numbers_as_zeros", "true")
20242024
.option("write_null_comp3_numbers_as_zeros", "true")
20252025
```
2026+
- [#845](https://github.com/AbsaOSS/cobrix/pull/845) Fixed in-place EBCDIC files processing so it retains bytes skipped by decoding process using 'file_start_offset' and 'file_end_offset'.
2027+
- [#847](https://github.com/AbsaOSS/cobrix/pull/847) Fixed array flattening `SparkUtils.flattenSchema()` in Spark 4+.
20262028
20272029
- #### 2.10.3 released 27 April 2026.
20282030
- [#839](https://github.com/AbsaOSS/cobrix/pull/839) Added `variable_size_occurs = "pad_record"` for fixed-size records where `OCCURS DEPENDING ON` arrays use variable physical storage and the remaining record is padded.

‎cobol-converters/pom.xml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222
<parent>
2323
<groupId>za.co.absa.cobrix</groupId>
2424
<artifactId>cobrix_2.12</artifactId>
25-
<version>2.10.4-SNAPSHOT</version>
25+
<version>2.10.5-SNAPSHOT</version>
2626
<relativePath>../pom.xml</relativePath>
2727
</parent>
2828

‎cobol-parser/pom.xml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222
<parent>
2323
<groupId>za.co.absa.cobrix</groupId>
2424
<artifactId>cobrix_2.12</artifactId>
25-
<version>2.10.4-SNAPSHOT</version>
25+
<version>2.10.5-SNAPSHOT</version>
2626
<relativePath>../pom.xml</relativePath>
2727
</parent>
2828

‎examples/examples-collection/pom.xml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@
3131
<scala.compat.version>2.12</scala.compat.version>
3232
<spark.version>3.5.7</spark.version>
3333
<specs.version>2.4.16</specs.version>
34-
<spark.cobol.version>2.10.3</spark.cobol.version>
34+
<spark.cobol.version>2.10.4</spark.cobol.version>
3535
<scodec_core.version>1.11.10</scodec_core.version>
3636
</properties>
3737

‎examples/spark-cobol-app/build.sbt‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ ThisBuild / version := "0.1.0-SNAPSHOT"
2020
ThisBuild / scalaVersion := "2.12.20"
2121

2222
val sparkVersion = "3.5.7"
23-
val sparkCobolVersion = "2.10.3"
23+
val sparkCobolVersion = "2.10.4"
2424
val scalatestVersion = "3.2.19"
2525

2626
ThisBuild / libraryDependencies ++= Seq(

‎examples/spark-cobol-app/pom.xml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@
3131
<scala.compat.version>2.12</scala.compat.version>
3232
<scalatest.version>3.2.19</scalatest.version>
3333
<spark.version>3.5.7</spark.version>
34-
<spark.cobol.version>2.10.3</spark.cobol.version>
34+
<spark.cobol.version>2.10.4</spark.cobol.version>
3535
</properties>
3636

3737
<dependencies>

‎pom.xml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222
<groupId>za.co.absa.cobrix</groupId>
2323
<artifactId>cobrix_2.12</artifactId>
2424

25-
<version>2.10.4-SNAPSHOT</version>
25+
<version>2.10.5-SNAPSHOT</version>
2626

2727
<packaging>pom</packaging>
2828

‎spark-cobol/pom.xml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222
<parent>
2323
<groupId>za.co.absa.cobrix</groupId>
2424
<artifactId>cobrix_2.12</artifactId>
25-
<version>2.10.4-SNAPSHOT</version>
25+
<version>2.10.5-SNAPSHOT</version>
2626
<relativePath>../pom.xml</relativePath>
2727
</parent>
2828

0 commit comments

Comments
 (0)