{devel}[foss/2023b] TensorFlow v2.15.1, Bazel v6.3.1, flatbuffers-python v23.5.26, ml_dtypes v0.4.0 #21169

tanmoy1989 · 2024-08-12T14:54:17Z

(created using eb --new-pr)

Requires: 1. update custom easyblock for Tensorflow for versions 2.14 + 2.15 easybuild-easyblocks#3303
2. Bazel-6.3.1_cc-info.patch file (link)
{lib}[gfbf/2023b] tensorboard v2.15.1 #23080

…ore-13.2.0.eb, dill-0.3.8-GCCcore-13.2.0.eb, flatbuffers-python-23.5.26-GCCcore-13.2.0.eb, grpcio-1.57.0-GCCcore-13.2.0.eb, ml_dtypes-0.4.0-gfbf-2023b.eb, nsync-1.29.2-GCCcore-13.2.0.eb

boegel · 2024-08-14T11:52:36Z

@tanmoy1989 A bunch of patch files for Bazel are missing?

tanmoy1989 · 2024-08-14T12:29:50Z

@boegel: thanks, done!

…Flow2151

easybuild/easyconfigs/m/ml_dtypes/ml_dtypes-0.4.0-gfbf-2023b.eb

Co-authored-by: Alexander Grund <[email protected]>

Flamefire · 2024-09-16T12:43:05Z

easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023b.eb

    }),
    ('Werkzeug', '3.0.2', {
-        'source_tmpl': SOURCELOWER_TAR_GZ,
+        'source_tmpl': '%(namelower)s-%(version)s.tar.gz',


Why this change?

Honestly the change was not intentional and also not manual. It appeared when I did: "eb --inject-checksums=sha256 --force Tensorflow-2.15.1-foss-2023b.eb" to include the two new patches - probably due to formatting by EasyBuild/Python?

I opened an issue for that: easybuilders/easybuild-framework#4695

easybuild/easyconfigs/n/nsync/nsync-1.29.2-GCCcore-13.2.0.eb

Co-authored-by: Alexander Grund <[email protected]>

easybuild/easyconfigs/n/nsync/nsync-1.29.2-GCCcore-13.2.0.eb

Co-authored-by: Alexander Grund <[email protected]>

pavelToman · 2024-11-04T18:22:06Z

Is there any progress on this PR? I would use dill-0.3.8 in my PR.

pavelToman · 2024-11-05T09:10:09Z

@boegelbot please test @ generoso

tanmoy1989 · 2024-11-05T10:05:43Z

@pavelToman Thanks for triggering the bot. I am not aware of any further progress except me just waiting for someone to review it.

easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023b.eb

…b.eb Co-authored-by: Adam Huffman <[email protected]>

easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023b.eb

…b.eb Co-authored-by: Adam Huffman <[email protected]>

easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023b.eb

…b.eb Co-authored-by: Adam Huffman <[email protected]>

akesandgren · 2025-06-18T07:08:32Z

Test report by @akesandgren
SUCCESS
Build succeeded for 7 out of 7 (5 easyconfigs in total)
b-cn1613.hpc2n.umu.se - Linux Ubuntu 22.04, x86_64, AMD EPYC 7313 16-Core Processor, Python 3.10.12
See https://gist.github.com/akesandgren/4a18f42922387d91999f7b2e16bd9af3 for a full test report.

…asyconfigs into 20240812155402_new_pr_TensorFlow2151

akesandgren · 2025-06-18T07:29:04Z

easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023b.eb

+            'TensorFlow-2.15.1_fix-pybind11-build.patch',
+            'TensorFlow-2.15.1_fix-AVX512-eigen-compilation.patch',
+            'TensorFlow-2.15.1_fix-AVX512-eigen-compilation-gcc13.patch',
+            'TensorFlow-2.15.1_upgrade-ml_dtypes-dependency-version.patch',


Please add the disable-avx512-extensions.patch

akesandgren · 2025-06-18T07:32:11Z

@tanmoy1989 And please fix permissions on Bazel-6.3.1_add-symlinks-in-runfiles.patch
it should not be executable.

tanmoy1989 · 2025-06-19T10:24:22Z

@akesandgren thanks, changed the file permission! And also added the patch file on TensorFlow EC as you mentioned.

akesandgren · 2025-06-19T11:03:26Z

Doh, you need to update the checksum for Bazel-6.3.1_add-symlinks-in-runfiles.patch since you changed the content, or just re-add that space you removed

akesandgren · 2025-06-19T13:14:22Z

Test report by @akesandgren
SUCCESS
Build succeeded for 2 out of 2 (2 easyconfigs in total)
b-cn1613.hpc2n.umu.se - Linux Ubuntu 22.04, x86_64, AMD EPYC 7313 16-Core Processor, Python 3.10.12
See https://gist.github.com/akesandgren/e903f1d6629f2b751a432f3ca6581116 for a full test report.

bedroge · 2025-06-23T20:09:24Z

Test report by @bedroge
SUCCESS
Build succeeded for 4 out of 4 (4 easyconfigs in total)
node24 - Linux Rocky Linux 8.10, x86_64, AMD EPYC 7763 64-Core Processor (zen3), Python 3.6.8
See https://gist.github.com/bedroge/82f0479848647d1f0dc8f8ce04c58191 for a full test report.

akesandgren

LGTM

akesandgren · 2025-06-24T08:47:24Z

I withdraw that approve, you still didn't remove tensorboard from the exts_list replacing grpcio with the external tensorboard
@tanmoy1989 Please try that either with 2.18.0 or the 2.15.1 that we have in PR #23080

Still not using external tensorboard

tanmoy1989 · 2025-06-24T09:10:31Z

@akesandgren: Sure, just to confirm the things that I need to do:

Remove tensorboard from exts_list
Remove grpcio/1.67.1 from the dependencies
add tensorboard/2.15.1 from PR {lib}[gfbf/2023b] tensorboard v2.15.1 #23080 to dependencies
Could you please let me know that's all for me or if I have missed anything?

akesandgren · 2025-06-24T10:38:05Z

@tanmoy1989 Quoting from my previous comment on this:
"Then remove all extensions that tensorboard already have. See the existing TensorFlow-2.15.1-foss-2023a.eb for which ones it doesn't need when using tensorboard as a standalone dependency"
Or look at what extensions are used in the respective standalone tensorboard EC's and remove them from TensorFlow.

tanmoy1989 · 2025-06-24T10:49:26Z

@akesandgren sorry, I missed that! Hopefully, I have now updated everything! Thanks for checking!

…asyconfigs into 20240812155402_new_pr_TensorFlow2151

akesandgren · 2025-06-24T14:24:16Z

Test report by @akesandgren
FAILED
Build succeeded for 3 out of 4 (4 easyconfigs in total)
b-cn1611.hpc2n.umu.se - Linux Ubuntu 22.04, x86_64, AMD EPYC 7313 16-Core Processor, 1 x NVIDIA NVIDIA A100 80GB PCIe, 555.58.02, Python 3.10.12
See https://gist.github.com/akesandgren/0f586a1cbedd1749078fac5b555227a8 for a full test report.

easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023b.eb

akesandgren · 2025-06-24T16:44:50Z

Test report by @akesandgren
SUCCESS
Build succeeded for 4 out of 4 (4 easyconfigs in total)
b-cn1611.hpc2n.umu.se - Linux Ubuntu 22.04, x86_64, AMD EPYC 7313 16-Core Processor, 1 x NVIDIA NVIDIA A100 80GB PCIe, 555.58.02, Python 3.10.12
See https://gist.github.com/akesandgren/ba0f0029d13f10b814d256b57685c98a for a full test report.

akesandgren · 2025-06-24T17:38:49Z

Hmmm, since we already have tensorboard 2.18.0 as dependency for other packages in 2023b, can you try changing to that?
It's fairly likely to work, but in case not we'll drop back to 2.15.1 and add an exception for tensorboard

akesandgren · 2025-06-25T07:08:19Z

Test report by @akesandgren
FAILED
Build succeeded for 4 out of 5 (4 easyconfigs in total)
b-cn1611.hpc2n.umu.se - Linux Ubuntu 22.04, x86_64, AMD EPYC 7313 16-Core Processor, 1 x NVIDIA NVIDIA A100 80GB PCIe, 555.58.02, Python 3.10.12
See https://gist.github.com/akesandgren/fe226c4ef4368d394acfc987ca7da1a1 for a full test report.

akesandgren · 2025-06-25T07:15:57Z

Ok, TF 2.15 can't use tensorboard 2.18, so we'll need to go back to 2.15.1 and add an exception for that.
@boegel I don't remember how do do that. Can you assist here?

adding easyconfigs: TensorFlow-2.15.1-foss-2023b.eb, Bazel-6.3.1-GCCc…

5ed737f

…ore-13.2.0.eb, dill-0.3.8-GCCcore-13.2.0.eb, flatbuffers-python-23.5.26-GCCcore-13.2.0.eb, grpcio-1.57.0-GCCcore-13.2.0.eb, ml_dtypes-0.4.0-gfbf-2023b.eb, nsync-1.29.2-GCCcore-13.2.0.eb

boegel changed the title ~~{devel}[GCCcore/13.2.0] TensorFlow v2.15.1, Bazel v6.3.1, dill v0.3.8, ...~~ {devel}[foss/2023b] TensorFlow v2.15.1, Bazel v6.3.1, dill v0.3.8, ... Aug 14, 2024

boegel added the update label Aug 14, 2024

boegel added this to the 4.x milestone Aug 14, 2024

adding BAzel patch files

aa70a05

Merge branch 'easybuilders:develop' into 20240812155402_new_pr_Tensor…

09d38a8

…Flow2151

Flamefire reviewed Sep 4, 2024

View reviewed changes

easybuild/easyconfigs/m/ml_dtypes/ml_dtypes-0.4.0-gfbf-2023b.eb Outdated Show resolved Hide resolved

tanmoy1989 and others added 2 commits September 4, 2024 16:10

Update easybuild/easyconfigs/m/ml_dtypes/ml_dtypes-0.4.0-gfbf-2023b.eb

585ccee

Co-authored-by: Alexander Grund <[email protected]>

adding two more patch files

77df09f

Flamefire reviewed Sep 16, 2024

View reviewed changes

Flamefire suggested changes Sep 17, 2024

View reviewed changes

easybuild/easyconfigs/n/nsync/nsync-1.29.2-GCCcore-13.2.0.eb Outdated Show resolved Hide resolved

Update easybuild/easyconfigs/n/nsync/nsync-1.29.2-GCCcore-13.2.0.eb

e45c0b3

Co-authored-by: Alexander Grund <[email protected]>

Flamefire reviewed Sep 17, 2024

View reviewed changes

easybuild/easyconfigs/n/nsync/nsync-1.29.2-GCCcore-13.2.0.eb Outdated Show resolved Hide resolved

Flamefire reviewed Sep 17, 2024

View reviewed changes

easybuild/easyconfigs/n/nsync/nsync-1.29.2-GCCcore-13.2.0.eb Outdated Show resolved Hide resolved

tanmoy1989 and others added 3 commits September 17, 2024 18:16

Update easybuild/easyconfigs/n/nsync/nsync-1.29.2-GCCcore-13.2.0.eb

12be05f

Co-authored-by: Alexander Grund <[email protected]>

Update easybuild/easyconfigs/n/nsync/nsync-1.29.2-GCCcore-13.2.0.eb

623e46a

Co-authored-by: Alexander Grund <[email protected]>

adding ml_dtypes patch file

c6d6c9a

pavelToman mentioned this pull request Nov 4, 2024

{bio}[foss/2023b] Mustache v1.3.3, hic-straw v1.3.1, cooler v0.10.2, multiprocess v0.70.16 #21783

Merged

verdurin requested changes Nov 5, 2024

View reviewed changes

easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023b.eb Outdated Show resolved Hide resolved

easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023b.eb Outdated Show resolved Hide resolved

tanmoy1989 and others added 2 commits November 5, 2024 10:24

Update easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023…

808435f

…b.eb Co-authored-by: Adam Huffman <[email protected]>

Update easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023…

4f4b08a

…b.eb Co-authored-by: Adam Huffman <[email protected]>

verdurin requested changes Nov 5, 2024

View reviewed changes

easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023b.eb Outdated Show resolved Hide resolved

Update easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023…

d890527

…b.eb Co-authored-by: Adam Huffman <[email protected]>

verdurin requested changes Nov 5, 2024

View reviewed changes

easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023b.eb Outdated Show resolved Hide resolved

Update easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023…

c1fb4f3

…b.eb Co-authored-by: Adam Huffman <[email protected]>

Merge branch 'develop' of https://github.com/easybuilders/easybuild-e…

f42f661

…asyconfigs into 20240812155402_new_pr_TensorFlow2151

akesandgren requested changes Jun 18, 2025

View reviewed changes

tanmoy1989 and others added 2 commits June 19, 2025 11:04

Update TensorFlow-2.15.1-foss-2023b.eb

f9d5bb5

fix permissions

742e153

Update Bazel-6.3.1_add-symlinks-in-runfiles.patch

beb766b

akesandgren previously approved these changes Jun 24, 2025

View reviewed changes

Update TensorFlow-2.15.1-foss-2023b.eb

2229b9f

Update TensorFlow-2.15.1-foss-2023b.eb

cd42b3d

akesandgren changed the title ~~{devel}[foss/2023b] TensorFlow v2.15.1, Bazel v6.3.1, dill v0.3.8, flatbuffers-python v23.5.26, grpcio v1.57.0, ml_dtypes v0.4.0, nsync v1.29.2~~ {devel}[foss/2023b] TensorFlow v2.15.1, Bazel v6.3.1, flatbuffers-python v23.5.26, ml_dtypes v0.4.0 Jun 24, 2025

Merge branch 'develop' of https://github.com/easybuilders/easybuild-e…

ebc2c6c

…asyconfigs into 20240812155402_new_pr_TensorFlow2151

akesandgren requested changes Jun 24, 2025

View reviewed changes

easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023b.eb Outdated Show resolved Hide resolved

Update TensorFlow-2.15.1-foss-2023b.eb

c83a6cb

Update TensorFlow-2.15.1-foss-2023b.eb

405d7e6

Thyre added the 2023b label Aug 18, 2025

{devel}[foss/2023b] TensorFlow v2.15.1, Bazel v6.3.1, flatbuffers-python v23.5.26, ml_dtypes v0.4.0 #21169

Are you sure you want to change the base?

{devel}[foss/2023b] TensorFlow v2.15.1, Bazel v6.3.1, flatbuffers-python v23.5.26, ml_dtypes v0.4.0 #21169

Uh oh!

Conversation

tanmoy1989 commented Aug 12, 2024 • edited by akesandgren Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

boegel commented Aug 14, 2024

Uh oh!

tanmoy1989 commented Aug 14, 2024

Uh oh!

Uh oh!

Flamefire Sep 16, 2024

Choose a reason for hiding this comment

Uh oh!

tanmoy1989 Sep 16, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Flamefire Nov 7, 2024

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

pavelToman commented Nov 4, 2024

Uh oh!

pavelToman commented Nov 5, 2024

Uh oh!

tanmoy1989 commented Nov 5, 2024

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

akesandgren commented Jun 18, 2025

Uh oh!

akesandgren Jun 18, 2025

Choose a reason for hiding this comment

Uh oh!

akesandgren commented Jun 18, 2025

Uh oh!

tanmoy1989 commented Jun 19, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

akesandgren commented Jun 19, 2025

Uh oh!

akesandgren commented Jun 19, 2025

Uh oh!

bedroge commented Jun 23, 2025

Uh oh!

akesandgren left a comment

Choose a reason for hiding this comment

Uh oh!

akesandgren commented Jun 24, 2025

Uh oh!

tanmoy1989 commented Jun 24, 2025

Uh oh!

akesandgren commented Jun 24, 2025

Uh oh!

tanmoy1989 commented Jun 24, 2025

Uh oh!

akesandgren commented Jun 24, 2025

Uh oh!

Uh oh!

akesandgren commented Jun 24, 2025

Uh oh!

akesandgren commented Jun 24, 2025

Uh oh!

akesandgren commented Jun 25, 2025

Uh oh!

akesandgren commented Jun 25, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

tanmoy1989 commented Aug 12, 2024 •

edited by akesandgren

Loading

tanmoy1989 Sep 16, 2024 •

edited

Loading

tanmoy1989 commented Jun 19, 2025 •

edited

Loading