Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[Feature] how to fix reproducible issues in the latest release 1.0.0? #5002

Closed
2 tasks done
algomaster99 opened this issue Jan 28, 2025 · 1 comment
Closed
2 tasks done
Labels
enhancement New feature or request

Comments

@algomaster99
Copy link

algomaster99 commented Jan 28, 2025

Search before asking

  • I searched in the issues and found nothing similar.

Motivation

I am looking into why builds are not reproducible and I was investigating this project v1.0.0. I was not able to reproduce the artifact paimon-format-1.0.0-sources.jar because it seems it has one file, org/apache/parquet/filter2/compat/, less than the reference version on Maven central. Maybe I am missing something from build command that the scripts are using as Hervė suggests?
The mvn command that the scripts run:

mvn -Papache-release clean package -DskipTests -Dmaven.javadoc.skip -Dgpg.skip -Dexec.skip \
    -V -e org.apache.maven.plugins:maven-artifact-plugin:3.6.0:compare org.apache.maven.plugins:maven-artifact-plugin:3.6.0:describe-build-output -Dbuildinfo.reproducible -Dcompare.fail=false 

First line is specific to this project and the second line is specific to verifying the artifacts generated.

Solution

No response

Anything else?

This PR is related to #3719 and all preceding PRs related to reproducibility. I hope this is the right template to ask for such kind of help :)

Are you willing to submit a PR?

  • I'm willing to submit a PR!
@algomaster99 algomaster99 added the enhancement New feature or request label Jan 28, 2025
@algomaster99
Copy link
Author

This is possible if git checkout deletes all files in a certain directory. git does not track directory but they are on the filesystem and hence they are compressed into the archive. I am assuming that during the release the empty directory org/apache/parquet/filter2/compat/ existed on filesystem.

cc @hboutemy

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant