Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fedora 41 repo #16590

Closed
marmarek opened this issue Oct 1, 2024 · 18 comments
Closed

Fedora 41 repo #16590

marmarek opened this issue Oct 1, 2024 · 18 comments
Labels
Type: Feature Feature request or new feature

Comments

@marmarek
Copy link

marmarek commented Oct 1, 2024

Describe the feature would like to see added to OpenZFS

Fedora 41 is going to be released in about a month (https://fedorapeople.org/groups/schedule/f-41/f-41-key-tasks.html), current beta has kernel 6.11. Is there a chance for release with F41 repo before final F41 release?

How will this feature improve OpenZFS?

Helps Fedora users that like to update early.

Additional context

Related comment: #16544 (comment)

@edgan
Copy link

edgan commented Oct 26, 2024

Fedora 41 is expected to be released on October 29th 2024.

@edgan
Copy link

edgan commented Oct 29, 2024

It has been released.

@luerhard
Copy link

Fedora 41 is out. I now cannot access my pool anymore. I tried reinstalling the repo but it did not help:

sudo dnf install -y https://zfsonlinux.org/fedora/zfs-release-2-5$(rpm --eval "%{dist}").noarch.rpm
Updating and loading repositories:
 ZFS on Linux for Fedora 41                                                                                                                                                                                                                           100% |   1.5 KiB/s |   1.4 KiB |  00m01s
>>> Status code: 404 for http://download.zfsonlinux.org/fedora/41/x86_64/repodata/repomd.xml (IP: 52.92.212.195) - http://download.zfsonlinux.org/fedora/41/x86_64/repodata/repomd.xml - repomd.xml
>>> Status code: 404 for http://download.zfsonlinux.org/fedora/41/x86_64/repodata/repomd.xml (IP: 52.92.212.195) - http://download.zfsonlinux.org/fedora/41/x86_64/repodata/repomd.xml - repomd.xml
>>> Status code: 404 for http://download.zfsonlinux.org/fedora/41/x86_64/repodata/repomd.xml (IP: 52.92.212.195) - http://download.zfsonlinux.org/fedora/41/x86_64/repodata/repomd.xml - repomd.xml
>>> Status code: 404 for http://download.zfsonlinux.org/fedora/41/x86_64/repodata/repomd.xml (IP: 52.92.212.195) - http://download.zfsonlinux.org/fedora/41/x86_64/repodata/repomd.xml - repomd.xml
>>> Librepo error: Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried
Repositories loaded.

Am I doing something wrong or is there just not zfs for fedora 41 yet?

@edgan
Copy link

edgan commented Oct 29, 2024

Fedora 41 is out. I now cannot access my pool anymore. I tried reinstalling the repo but it did not help:

sudo dnf install -y https://zfsonlinux.org/fedora/zfs-release-2-5$(rpm --eval "%{dist}").noarch.rpm
Updating and loading repositories:
 ZFS on Linux for Fedora 41                                                                                                                                                                                                                           100% |   1.5 KiB/s |   1.4 KiB |  00m01s
>>> Status code: 404 for http://download.zfsonlinux.org/fedora/41/x86_64/repodata/repomd.xml (IP: 52.92.212.195) - http://download.zfsonlinux.org/fedora/41/x86_64/repodata/repomd.xml - repomd.xml
>>> Status code: 404 for http://download.zfsonlinux.org/fedora/41/x86_64/repodata/repomd.xml (IP: 52.92.212.195) - http://download.zfsonlinux.org/fedora/41/x86_64/repodata/repomd.xml - repomd.xml
>>> Status code: 404 for http://download.zfsonlinux.org/fedora/41/x86_64/repodata/repomd.xml (IP: 52.92.212.195) - http://download.zfsonlinux.org/fedora/41/x86_64/repodata/repomd.xml - repomd.xml
>>> Status code: 404 for http://download.zfsonlinux.org/fedora/41/x86_64/repodata/repomd.xml (IP: 52.92.212.195) - http://download.zfsonlinux.org/fedora/41/x86_64/repodata/repomd.xml - repomd.xml
>>> Librepo error: Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried
Repositories loaded.

Am I doing something wrong or is there just not zfs for fedora 41 yet?

#16645

Fedora 40 with the latest updates, and Fedora 41 on release both use a 6.11 kernel. A released version of zfs that supports 6.11 hasn't happened yet. So there is no point to making a Fedora 41 repository till they make such a release of zfs. It is expected to be 2.2.7, and the official policy is when it is ready.

@luerhard
Copy link

luerhard commented Oct 29, 2024

Interesting. Time to use the macbook then until zfs is ready and I can use my PC again ... (thanks for the response!)

Pretty sure I already was on 6.11 in Fedora 40 though.

@tonyhutter
Copy link
Contributor

Fedora 41 was released today - we're testing it right now: #16700

@edgan
Copy link

edgan commented Oct 31, 2024

Not sure what you are on about. I am running 6.11.5-200.fc40.x86_64 kernel and ZFS is working just fine.

zfs-2.2.6-1 zfs-kmod-2.2.6-1

You are right. I had not rebooted my Fedora 40 server that uses zfs, because I expected it to break for all the reasons listed below.

Linux 6.11 compatibility and new promptly release:
#16645

zfs-2.2.6/META:

Meta:          1
Name:          zfs
Branch:        1.0
Version:       2.2.6
Release:       1
Release-Tags:  relext
License:       CDDL
Author:        OpenZFS
Linux-Maximum: 6.10
Linux-Minimum: 3.10

https://github.com/openzfs/zfs/releases:

[zfs-2.2.6]
Supported Platforms

    Linux: compatible with 4.18 - 6.10 kernels
    FreeBSD: compatible with releases starting from 12.2-RELEASE

Edit: I just upgraded to Fedora 41, and then found this.

Problem 1: conflicting requests
  - nothing provides kernel-devel <= 6.8.999 needed by zfs-dkms-2.2.4-1.fc40.noarch from zfs
  - nothing provides kernel-devel <= 6.9.999 needed by zfs-dkms-2.2.5-1.fc40.noarch from zfs
  - nothing provides kernel-devel <= 6.10.999 needed by zfs-dkms-2.2.6-1.fc40.noarch from zfs

So you have to have a 6.10 kernel installed to keep zfs-dkms happy, and the upgraded uninstalled all the 6.10 kernels. So then zfs-dkms go uninstalled. Then I can't be reinstalled, because there is no 6.10 kernel. Yet, it does seem like zfs works with 6.11 kernels.

I can manually work around this by either rebuilding the fc40 packages, or install a 6.10 kernel to make it happy.

@edgan
Copy link

edgan commented Oct 31, 2024

So I ended up needing to recompile just the zfs-dkms after modifying the spec file to say 6.11.999 instead of 6.10.999 for the kernel-devel dependency.

http://download.zfsonlinux.org/fedora/40/SRPMS/zfs-dkms-2.2.6-1.fc40.src.rpm

This is where I expect some developer to say, but there are X, Y, and Z reasons that 6.11 is unsupported with zfs-2.2.6. On the other hand, as I see above, Fedora 41 got "released".

I don't actually see Fedora 41 here.

http://download.zfsonlinux.org/fedora/

@ftc2
Copy link

ftc2 commented Nov 1, 2024

i say this at the risk of being off topic in case it helps someone.

if you're on fedora 41 (or otherwise on 6.11), afaik you can just use koji to install 6.10 and then stay there until openzfs supports 6.11.

these two posts summarize how and have some tips:
https://forum.level1techs.com/t/picking-a-new-server-os/208353/3
https://forum.level1techs.com/t/picking-a-new-server-os/208353/30

@edgan
Copy link

edgan commented Nov 1, 2024

i say this at the risk of being off topic in case it helps someone.

if you're on fedora 41 (or otherwise on 6.11), afaik you can just use koji to install 6.10 and then stay there until openzfs supports 6.11.

these two posts summarize how and have some tips: https://forum.level1techs.com/t/picking-a-new-server-os/208353/3 https://forum.level1techs.com/t/picking-a-new-server-os/208353/30

Just ran across this bug.

#16621

@ftc2
Copy link

ftc2 commented Nov 1, 2024

i don't get it. you installed 6.10, and openzfs still isn't working?

like those posts you quoted say, here's the 6.10 packages for f41:
https://bodhi.fedoraproject.org/updates/?search=kernel-6.10&release=f41

so from looking at that, in the koji steps linked in that second post above, you'd put in 6.10.0-64.fc41 since that's the newest build

then use the rest of the tips in those posts to clean up as you see fit

i would expect the f40 openzfs package to work at that point

@edgan
Copy link

edgan commented Nov 1, 2024

i don't get it. you installed 6.10, and openzfs still isn't working?

There are different circumstances.

  1. Fedora 40/41 and explicitly booting 6.10. Yes, this works without issue.
  2. Fedora 40/41 with 6.10 installed but booting 6.11. This throws the error I just linked to.
  3. Fedora 40/41 with 6.11 installed with a modified zfs-dkms to allow a 6.11 kernel. This throws the error I just linked to.

I am about to test a modify zfs-dkms with the patch.

#16621 would be a X that I thought about above.

Edit:

I took https://github.com/openzfs/zfs/commit/cad9f2df5d212eebe3bfbff9412ab8de0124f023.patch with the patch to the patch below to get it to actually apply. I added this to the zfs-2.2.6-1 and zfs-dkms-2.2.6-1 spec files as a patch. I rebuilt both, installed both, and ran a dracut --force to force the rebuilding of the initramfs. On reboot I don't have the #16621 issue anymore.

--- cad9f2df5d212eebe3bfbff9412ab8de0124f023.patch	2024-11-01 12:44:11.073493278 -0700
+++ zfs-log.patch	2024-11-01 12:26:38.799718460 -0700
@@ -485,17 +485,17 @@
  	itx->itx_oid = szp->z_id;
  
  	zil_itx_assign(zilog, itx, tx);
-@@ -663,8 +667,8 @@ zfs_log_write(zilog_t *zilog, dmu_tx_t *tx, int txtype,
+@@ -668,8 +668,8 @@
  		if (wr_state == WR_COPIED) {
  			int err;
  			DB_DNODE_ENTER(db);
 -			err = dmu_read_by_dnode(DB_DNODE(db), off, len, lr + 1,
 -			    DMU_READ_NO_PREFETCH);
-+			err = dmu_read_by_dnode(DB_DNODE(db), off, len,
-+			    &lr->lr_data[0], DMU_READ_NO_PREFETCH);
- 			DB_DNODE_EXIT(db);
++                        err = dmu_read_by_dnode(DB_DNODE(db), off, len,
++                            &lr->lr_data[0], DMU_READ_NO_PREFETCH);
  			if (err != 0) {
  				zil_itx_destroy(itx);
+ 				itx = zil_itx_create(txtype, sizeof (*lr));
 @@ -733,7 +737,7 @@ zfs_log_setattr(zilog_t *zilog, dmu_tx_t *tx, int txtype,
  	lr_setattr_t	*lr;
  	xvattr_t	*xvap = (xvattr_t *)vap;

@edgan
Copy link

edgan commented Nov 7, 2024

Fedora 41 was released today - we're testing it right now: #16700

@tonyhutter How is the testing going?

@tonyhutter
Copy link
Contributor

@edgan we'll support Fedora 41 with zfs-2.2.7, which going though iterations here #16720.

@awused
Copy link

awused commented Nov 18, 2024

With kernel 6.12 out, will that patchset also include 6.12 compatibility? It does seem to have a bunch of 6.12 commits but the description is still only 6.11.

I've been putting off updating because of lagging openzfs support, but if openzfs starts supporting 6.11 but 6.12 is already available in Fedora 41, it's going to severely complicate my upgrade and I'll probably end up putting it off until openzfs manages to support the current kernel again.

@wedsonlopes
Copy link

wedsonlopes commented Nov 20, 2024

Interesting. Time to use the macbook then until zfs is ready and I can use my PC again ... (thanks for the response!)

Pretty sure I already was on 6.11 in Fedora 40 though.

I'm not sure if this helps, but I was able to work around the issue by compiling this version directly:
https://github.com/openzfs/zfs/releases/tag/zfs-2.3.0-rc2

I don't recommend doing this because it's a pre-release, but I think the same thing can be done on a stable version, anyway this step-by-step guide helped me access my data again:

# if anything here is missing follow the warning when running ./configure to fix it.

dnf install -y cppcheck shellcheck checkbashisms1 python3-devel libudev-devel libuuid-devel libtirpc-devel

wget https://github.com/openzfs/zfs/releases/download/zfs-2.3.0-rc2/zfs-2.3.0-rc2.tar.gz

tar -xzvf zfs-2.3.0-rc2.tar.gz

cd zfs-2.3.0-rc2/

./configure --prefix=/usr --sbindir=/usr/sbin

make -j$(nproc)

make install

modprobe zfs

zfs version

zpool list

zpool status
root@essie-pc:/home/wedson/Downloads/zfs-2.3.0-rc2# zfs version
zfs-2.3.0-rc2
zfs-kmod-2.2.6-1
root@essie-pc:/home/wedson/Downloads/zfs-2.3.0-rc2# zpool list
NAME     SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
backup   444G   332G   112G        -         -     1%    74%  1.00x    ONLINE  -
root@essie-pc:/home/wedson/Downloads/zfs-2.3.0-rc2# zpool status -v
  pool: backup
 state: ONLINE
  scan: scrub repaired 0B in 00:15:52 with 0 errors on Mon Nov 11 16:09:19 2024
config:

	NAME                                          STATE     READ WRITE CKSUM
	backup                                        ONLINE       0     0     0
	  ata-KINGSTON_SA400S37480G_50026B778238C6AA  ONLINE       0     0     0

errors: No known data errors
root@essie-pc:/home/wedson/Downloads/zfs-2.3.0-rc2# 

@gregwalters
Copy link

I did a Fedora 39 -> 41 system-upgrade without realizing that ZoL wasn't ready yet. Fortunately the DKMS process worked:

[root@storj ~]# rpm -qa | grep -i zfs
libzfs5-2.2.6-1.fc39.x86_64
zfs-dkms-2.2.6-1.fc39.noarch
zfs-2.2.6-1.fc39.x86_64
[root@storj ~]# cat /etc/fedora-release
Fedora release 41 (Forty One)
[root@storj ~]# zpool status
  pool: storj
 state: ONLINE
  scan: scrub repaired 0B in 08:02:58 with 0 errors on Sun Dec  1 10:07:18 2024
config:

	NAME                                  STATE     READ WRITE CKSUM
	storj                                 ONLINE       0     0     0
	  ata-WDC_aaaaaaaaaa  ONLINE       0     0     0
	  ata-WDC_bbbbbbbbb  ONLINE       0     0     0

errors: No known data errors
[root@storj ~]# uname -a
Linux storj 6.11.10-300.fc41.x86_64 #1 SMP PREEMPT_DYNAMIC Sat Nov 23 00:51:20 UTC 2024 x86_64 GNU/Linux

That is, perhaps, another path people can take if they must. Of course, I'm scared to do any updates until this issue is fixed so I don't break my unexpectedly working setup.

@tonyhutter
Copy link
Contributor

zfs-2.2.7 has been released: https://github.com/openzfs/zfs/releases/tag/zfs-2.2.7

It includes packages for Fedora 41:

dnf install -y https://zfsonlinux.org/fedora/zfs-release-2-6$(rpm --eval "%{dist}").noarch.rpm
dnf install zfs

Thanks all for being patient!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Type: Feature Feature request or new feature
Projects
None yet
Development

No branches or pull requests

8 participants