kernel error when reading large number of files (4096) with read delegations on 2.6.32.11

Discussion:

Helms, John

2010-04-22 17:46:59 UTC

Hello, NFSv4 gurus.

I'm testing NFSv4 with read delegations to hopefully fix a customer
environment that is hammered with getattrs under NFSv3. Per our
internal developers, I upgraded the kernel from a stock OEL5u3
2.6.18-128 to 2.6.32.11 (latest stable) in order to get read delegations
and release of unused delegations. The server is a NetApp FAS270
running Ontap 7.3.2P4 with NFSv4 and read delegations enabled. The test
involves a script that iterates through a number sequence and first
echo's the numbers into a file of the same name, then cat's each of
these files into /dev/null. The error occurs when trying to cat the
4096th file as seen here:

[root at netcache1 wrtest]# ./wrdtest.sh

Writing files...

Writing files completed in 8 s.

Sleeping.

Reading files...

cat: 4096.txt: Remote I/O error

Reading files completed in 13 s.

Sleeping.

Listing files...

Message from syslogd@ at Thu Apr 22 12:36:53 2010 ...

netcache1 kernel: ------------[ cut here ]------------

Message from syslogd@ at Thu Apr 22 12:36:53 2010 ...

netcache1 kernel: invalid opcode: 0000 [#1]

Message from syslogd@ at Thu Apr 22 12:36:53 2010 ...

netcache1 kernel: last sysfs file:
/sys/devices/pci0000:01/0000:01:0a.0/0000:02:06.1/resource

NFS operations do seem to continue after a few seconds, but read
delegations are no longer in effect because the filer starts processing
NFS ops. The full error message from /var/log/messages is:

Apr 22 12:36:53 netcache1 kernel: ------------[ cut here ]------------

Apr 22 12:36:53 netcache1 kernel: kernel BUG at fs/inode.c:1343!

Apr 22 12:36:53 netcache1 kernel: invalid opcode: 0000 [#1]

Apr 22 12:36:53 netcache1 kernel: last sysfs file:
/sys/devices/pci0000:01/0000:01:0a.0/0000:02:06.1/resource

Apr 22 12:36:53 netcache1 kernel: Modules linked in: autofs4 hidp ipv6
nfs lockd fscache nfs_acl auth_rpcgss rfcomm l2cap crc16 bluetooth
sunrpc dm_mirror dm_multipath scsi_dh video output sbs sbshc battery ac
parport_pc lp parport sg scb2_flash serio_raw mtd chipreg button e1000
rtc_cmos rtc_core rtc_lib floppy i2c_piix4 pcspkr e100 i2c_core mii
dm_region_hash dm_log dm_mod aic7xxx scsi_transport_spi sd_mod scsi_mod
raid1 ext3 jbd uhci_hcd ohci_hcd ehci_hcd [last unloaded: microcode]

Apr 22 12:36:53 netcache1 kernel:

Apr 22 12:36:53 netcache1 kernel: Pid: 3010, comm: nfsv4.0-svc Tainted:
G W (2.6.32.11 #3) C2100 C2100

Apr 22 12:36:53 netcache1 kernel: EIP: 0060:[<c0493ac2>] EFLAGS:
00010246 CPU: 0

Apr 22 12:36:53 netcache1 kernel: EIP is at iput+0x10/0x4a

Apr 22 12:36:53 netcache1 kernel: EAX: f4d46be4 EBX: f4d46be4 ECX:
f6065e00 EDX: 00000000

Apr 22 12:36:53 netcache1 kernel: ESI: f96f8860 EDI: 00000003 EBP:
f6061000 ESP: f609cf50

Apr 22 12:36:53 netcache1 kernel: DS: 007b ES: 007b FS: 0000 GS: 0000
SS: 0068

Apr 22 12:36:53 netcache1 kernel: Process nfsv4.0-svc (pid: 3010,
ti=f609c000 task=f73b2490 task.ti=f609c000)

Apr 22 12:36:53 netcache1 kernel: Stack:

Apr 22 12:36:53 netcache1 kernel: f5845600 f96e93e7 f5845600 f96f12b5
f5845608 f96f1290 c050a434 f5845600

Apr 22 12:36:53 netcache1 kernel: <0> fffffff5 f96f20b9 7fffffff
f5845600 f6065e00 f675d920 c16a5aa0 0000000d

Apr 22 12:36:53 netcache1 kernel: <0> 00000000 f73b2490 c041bd1c
00000000 00000000 fffffff5 fffffff5 f6061000

Apr 22 12:36:53 netcache1 kernel: Call Trace:

Apr 22 12:36:53 netcache1 kernel: [<f96e93e7>] ?
svc_sock_free+0x34/0x3c [sunrpc]

Apr 22 12:36:53 netcache1 kernel: [<f96f12b5>] ?
svc_xprt_free+0x25/0x2e [sunrpc]

Apr 22 12:36:53 netcache1 kernel: [<f96f1290>] ? svc_xprt_free+0x0/0x2e
[sunrpc]

Apr 22 12:36:53 netcache1 kernel: [<c050a434>] ? kref_put+0x35/0x3f

Apr 22 12:36:53 netcache1 kernel: [<f96f20b9>] ? svc_recv+0x5f8/0x64f
[sunrpc]

Apr 22 12:36:53 netcache1 kernel: [<c041bd1c>] ?
default_wake_function+0x0/0x8

Apr 22 12:36:53 netcache1 kernel: [<fa2e9f32>] ?
nfs4_callback_svc+0x21/0x6e [nfs]

Apr 22 12:36:53 netcache1 kernel: [<fa2e9f11>] ?
nfs4_callback_svc+0x0/0x6e [nfs]

Apr 22 12:36:53 netcache1 kernel: [<c043252a>] ? kthread+0x60/0x66

Apr 22 12:36:53 netcache1 kernel: [<c04324ca>] ? kthread+0x0/0x66

Apr 22 12:36:53 netcache1 kernel: [<c0402e73>] ?
kernel_thread_helper+0x7/0x10

Apr 22 12:36:53 netcache1 kernel: Code: 79 dd f8 ff 81 a3 18 01 00 00 77
ff ff ff 89 d8 5b eb be e8 04 a0 1b 00 31 c0 c3 85 c0 53 89 c3 74 41 83
b8 18 01 00 00 40 75 04 <0f> 0b eb fe 8d 40 24 ba 00 b9 83 c0 e8 89 4e
07 00 85 c0 74 23

Apr 22 12:36:53 netcache1 kernel: EIP: [<c0493ac2>] iput+0x10/0x4a
SS:ESP 0068:f609cf50

Apr 22 12:36:53 netcache1 kernel: ---[ end trace ad2af8766f43e520 ]---

A slightly different error (in kref.c vs inode.c) has also occurred
several times:

Apr 22 09:58:07 netcache1 kernel: ------------[ cut here ]------------

Apr 22 09:58:07 netcache1 kernel: WARNING: at lib/kref.c:43
kref_get+0x18/0x1c()

Apr 22 09:58:07 netcache1 kernel: Hardware name: C2100 C2100

Apr 22 09:58:07 netcache1 kernel: Modules linked in: autofs4 hidp ipv6
nfs lockd fscache nfs_acl auth_rpcgss rfcomm l2cap crc16 bluetooth
sunrpc dm_mirror dm_multipath scsi_dh video output sbs sbshc battery ac
parport_pc lp parport sg scb2_flash button mtd chipreg e1000 serio_raw
rtc_cmos rtc_core rtc_lib floppy i2c_piix4 pcspkr e100 i2c_core mii
dm_region_hash dm_log dm_mod aic7xxx scsi_transport_spi sd_mod scsi_mod
raid1 ext3 jbd uhci_hcd ohci_hcd ehci_hcd [last unloaded: microcode]

Apr 22 09:58:07 netcache1 kernel: Pid: 25329, comm: nfsv4.0-svc Not
tainted 2.6.32.11 #3

Apr 22 09:58:07 netcache1 kernel: Call Trace:

Apr 22 09:58:07 netcache1 kernel: [<c04217e4>] ?
warn_slowpath_common+0x41/0x71

Apr 22 09:58:07 netcache1 kernel: [<c0421801>] ?
warn_slowpath_common+0x5e/0x71

Apr 22 09:58:07 netcache1 kernel: [<c042181e>] ?
warn_slowpath_null+0xa/0xc

Apr 22 09:58:07 netcache1 kernel: [<c050a456>] ? kref_get+0x18/0x1c

Apr 22 09:58:07 netcache1 kernel: [<f992ece8>] ? svc_recv+0x227/0x64f
[sunrpc]

Apr 22 09:58:07 netcache1 kernel: [<c041bd1c>] ?
default_wake_function+0x0/0x8

Apr 22 09:58:07 netcache1 kernel: [<fa526f32>] ?
nfs4_callback_svc+0x21/0x6e [nfs]

Apr 22 09:58:07 netcache1 kernel: [<fa526f11>] ?
nfs4_callback_svc+0x0/0x6e [nfs]

Apr 22 09:58:07 netcache1 kernel: [<c043252a>] ? kthread+0x60/0x66

Apr 22 09:58:07 netcache1 kernel: [<c04324ca>] ? kthread+0x0/0x66

Apr 22 09:58:07 netcache1 kernel: [<c0402e73>] ?
kernel_thread_helper+0x7/0x10

Apr 22 09:58:07 netcache1 kernel: ---[ end trace e11161bf7dec748b ]---

The error doesn't seem to occur when read delegations have been disabled
at the filer. And no error messages have been seen on the filer
console. The network between the filer and linux client is a crossover
cable, and the speed/duplex is 100/full (limited by the hardware on this
re-purposed server).

Thanks,

John Helms

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://linux-nfs.org/pipermail/nfsv4/attachments/20100422/8934d4a4/attachment.html

J. Bruce Fields

2010-04-22 18:31:45 UTC

Permalink

Post by Helms, John
Hello, NFSv4 gurus.
I'm testing NFSv4 with read delegations to hopefully fix a customer
environment that is hammered with getattrs under NFSv3. Per our
internal developers, I upgraded the kernel from a stock OEL5u3
2.6.18-128 to 2.6.32.11 (latest stable) in order to get read delegations

That looks like a bug fixed by 301e99ce4a2f42a317129230fd42e6cd874c64b0
and the immediately preceding patches.

Those are included in the latest 2.6.34, and should be in the next
2.6.32 stable.

--b.

Post by Helms, John
and release of unused delegations. The server is a NetApp FAS270
running Ontap 7.3.2P4 with NFSv4 and read delegations enabled. The test
involves a script that iterates through a number sequence and first
echo's the numbers into a file of the same name, then cat's each of
these files into /dev/null. The error occurs when trying to cat the
[root at netcache1 wrtest]# ./wrdtest.sh
Writing files...
Writing files completed in 8 s.
Sleeping.
Reading files...
cat: 4096.txt: Remote I/O error
Reading files completed in 13 s.
Sleeping.
Listing files...
netcache1 kernel: ------------[ cut here ]------------
netcache1 kernel: invalid opcode: 0000 [#1]
/sys/devices/pci0000:01/0000:01:0a.0/0000:02:06.1/resource
NFS operations do seem to continue after a few seconds, but read
delegations are no longer in effect because the filer starts processing
Apr 22 12:36:53 netcache1 kernel: ------------[ cut here ]------------
Apr 22 12:36:53 netcache1 kernel: kernel BUG at fs/inode.c:1343!
Apr 22 12:36:53 netcache1 kernel: invalid opcode: 0000 [#1]
/sys/devices/pci0000:01/0000:01:0a.0/0000:02:06.1/resource
Apr 22 12:36:53 netcache1 kernel: Modules linked in: autofs4 hidp ipv6
nfs lockd fscache nfs_acl auth_rpcgss rfcomm l2cap crc16 bluetooth
sunrpc dm_mirror dm_multipath scsi_dh video output sbs sbshc battery ac
parport_pc lp parport sg scb2_flash serio_raw mtd chipreg button e1000
rtc_cmos rtc_core rtc_lib floppy i2c_piix4 pcspkr e100 i2c_core mii
dm_region_hash dm_log dm_mod aic7xxx scsi_transport_spi sd_mod scsi_mod
raid1 ext3 jbd uhci_hcd ohci_hcd ehci_hcd [last unloaded: microcode]
G W (2.6.32.11 #3) C2100 C2100
00010246 CPU: 0
Apr 22 12:36:53 netcache1 kernel: EIP is at iput+0x10/0x4a
f6065e00 EDX: 00000000
f6061000 ESP: f609cf50
Apr 22 12:36:53 netcache1 kernel: DS: 007b ES: 007b FS: 0000 GS: 0000
SS: 0068
Apr 22 12:36:53 netcache1 kernel: Process nfsv4.0-svc (pid: 3010,
ti=f609c000 task=f73b2490 task.ti=f609c000)
Apr 22 12:36:53 netcache1 kernel: f5845600 f96e93e7 f5845600 f96f12b5
f5845608 f96f1290 c050a434 f5845600
Apr 22 12:36:53 netcache1 kernel: <0> fffffff5 f96f20b9 7fffffff
f5845600 f6065e00 f675d920 c16a5aa0 0000000d
Apr 22 12:36:53 netcache1 kernel: <0> 00000000 f73b2490 c041bd1c
00000000 00000000 fffffff5 fffffff5 f6061000
Apr 22 12:36:53 netcache1 kernel: [<f96e93e7>] ?
svc_sock_free+0x34/0x3c [sunrpc]
Apr 22 12:36:53 netcache1 kernel: [<f96f12b5>] ?
svc_xprt_free+0x25/0x2e [sunrpc]
Apr 22 12:36:53 netcache1 kernel: [<f96f1290>] ? svc_xprt_free+0x0/0x2e
[sunrpc]
Apr 22 12:36:53 netcache1 kernel: [<c050a434>] ? kref_put+0x35/0x3f
Apr 22 12:36:53 netcache1 kernel: [<f96f20b9>] ? svc_recv+0x5f8/0x64f
[sunrpc]
Apr 22 12:36:53 netcache1 kernel: [<c041bd1c>] ?
default_wake_function+0x0/0x8
Apr 22 12:36:53 netcache1 kernel: [<fa2e9f32>] ?
nfs4_callback_svc+0x21/0x6e [nfs]
Apr 22 12:36:53 netcache1 kernel: [<fa2e9f11>] ?
nfs4_callback_svc+0x0/0x6e [nfs]
Apr 22 12:36:53 netcache1 kernel: [<c043252a>] ? kthread+0x60/0x66
Apr 22 12:36:53 netcache1 kernel: [<c04324ca>] ? kthread+0x0/0x66
Apr 22 12:36:53 netcache1 kernel: [<c0402e73>] ?
kernel_thread_helper+0x7/0x10
Apr 22 12:36:53 netcache1 kernel: Code: 79 dd f8 ff 81 a3 18 01 00 00 77
ff ff ff 89 d8 5b eb be e8 04 a0 1b 00 31 c0 c3 85 c0 53 89 c3 74 41 83
b8 18 01 00 00 40 75 04 <0f> 0b eb fe 8d 40 24 ba 00 b9 83 c0 e8 89 4e
07 00 85 c0 74 23
Apr 22 12:36:53 netcache1 kernel: EIP: [<c0493ac2>] iput+0x10/0x4a
SS:ESP 0068:f609cf50
Apr 22 12:36:53 netcache1 kernel: ---[ end trace ad2af8766f43e520 ]---
A slightly different error (in kref.c vs inode.c) has also occurred
Apr 22 09:58:07 netcache1 kernel: ------------[ cut here ]------------
Apr 22 09:58:07 netcache1 kernel: WARNING: at lib/kref.c:43
kref_get+0x18/0x1c()
Apr 22 09:58:07 netcache1 kernel: Hardware name: C2100 C2100
Apr 22 09:58:07 netcache1 kernel: Modules linked in: autofs4 hidp ipv6
nfs lockd fscache nfs_acl auth_rpcgss rfcomm l2cap crc16 bluetooth
sunrpc dm_mirror dm_multipath scsi_dh video output sbs sbshc battery ac
parport_pc lp parport sg scb2_flash button mtd chipreg e1000 serio_raw
rtc_cmos rtc_core rtc_lib floppy i2c_piix4 pcspkr e100 i2c_core mii
dm_region_hash dm_log dm_mod aic7xxx scsi_transport_spi sd_mod scsi_mod
raid1 ext3 jbd uhci_hcd ohci_hcd ehci_hcd [last unloaded: microcode]
Apr 22 09:58:07 netcache1 kernel: Pid: 25329, comm: nfsv4.0-svc Not
tainted 2.6.32.11 #3
Apr 22 09:58:07 netcache1 kernel: [<c04217e4>] ?
warn_slowpath_common+0x41/0x71
Apr 22 09:58:07 netcache1 kernel: [<c0421801>] ?
warn_slowpath_common+0x5e/0x71
Apr 22 09:58:07 netcache1 kernel: [<c042181e>] ?
warn_slowpath_null+0xa/0xc
Apr 22 09:58:07 netcache1 kernel: [<c050a456>] ? kref_get+0x18/0x1c
Apr 22 09:58:07 netcache1 kernel: [<f992ece8>] ? svc_recv+0x227/0x64f
[sunrpc]
Apr 22 09:58:07 netcache1 kernel: [<c041bd1c>] ?
default_wake_function+0x0/0x8
Apr 22 09:58:07 netcache1 kernel: [<fa526f32>] ?
nfs4_callback_svc+0x21/0x6e [nfs]
Apr 22 09:58:07 netcache1 kernel: [<fa526f11>] ?
nfs4_callback_svc+0x0/0x6e [nfs]
Apr 22 09:58:07 netcache1 kernel: [<c043252a>] ? kthread+0x60/0x66
Apr 22 09:58:07 netcache1 kernel: [<c04324ca>] ? kthread+0x0/0x66
Apr 22 09:58:07 netcache1 kernel: [<c0402e73>] ?
kernel_thread_helper+0x7/0x10
Apr 22 09:58:07 netcache1 kernel: ---[ end trace e11161bf7dec748b ]---
The error doesn't seem to occur when read delegations have been disabled
at the filer. And no error messages have been seen on the filer
console. The network between the filer and linux client is a crossover
cable, and the speed/duplex is 100/full (limited by the hardware on this
re-purposed server).
Thanks,
John Helms
_______________________________________________
NFSv4 mailing list
NFSv4 at linux-nfs.org
http://linux-nfs.org/cgi-bin/mailman/listinfo/nfsv4

Helms, John

2010-04-23 02:46:59 UTC

Permalink

Well, the kernel errors are no longer present on 2.6.34-rc5, but the
read still seems to fail (this time on #4095):

[root at netcache1 ~]# uname -a
Linux netcache1 2.6.34-rc5 #1 Thu Apr 22 19:22:35 CDT 2010 i686 i686
i386 GNU/Linux
[root at netcache1 ~]# mount
/dev/md0 on / type ext3 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
10.10.10.3:/vol/www on /mnt/www type nfs4
(rw,noatime,nodiratime,bg,hard,intr,proto=tcp,rsize=32768,wsize=32768,ad
dr=10.10.10.3)
[root at netcache1 ~]# cd /mnt/www/wrtest/
[root at netcache1 wrtest]# ls
wrdtest.sh
[root at netcache1 wrtest]# ./wrdtest.sh
Writing files...
Writing files completed in 9 s.
Sleeping.
Reading files...
cat: 4095.txt: Remote I/O error
Reading files completed in 13 s.
Sleeping.
Listing files...
Listing files completed in 2 s.
Sleeping.
Deleting files...
Deleting files completed in 11 s.
[root at netcache1 wrtest]#

Anything else I should try or capture to diagnose this?

Thanks,
John Helms

-----Original Message-----
From: J. Bruce Fields [mailto:bfields at fieldses.org]
Sent: Thursday, April 22, 2010 1:32 PM
To: Helms, John
Cc: nfsv4 at linux-nfs.org
Subject: Re: kernel error when reading large number of files (4096)
withread delegations on 2.6.32.11

delegations

That looks like a bug fixed by 301e99ce4a2f42a317129230fd42e6cd874c64b0
and the immediately preceding patches.

Those are included in the latest 2.6.34, and should be in the next
2.6.32 stable.

--b.

processing

Post by Helms, John
Apr 22 12:36:53 netcache1 kernel: ------------[ cut here ]------------
Apr 22 12:36:53 netcache1 kernel: kernel BUG at fs/inode.c:1343!
Apr 22 12:36:53 netcache1 kernel: invalid opcode: 0000 [#1]
/sys/devices/pci0000:01/0000:01:0a.0/0000:02:06.1/resource
Apr 22 12:36:53 netcache1 kernel: Modules linked in: autofs4 hidp ipv6
nfs lockd fscache nfs_acl auth_rpcgss rfcomm l2cap crc16 bluetooth
sunrpc dm_mirror dm_multipath scsi_dh video output sbs sbshc battery ac
parport_pc lp parport sg scb2_flash serio_raw mtd chipreg button e1000
rtc_cmos rtc_core rtc_lib floppy i2c_piix4 pcspkr e100 i2c_core mii
dm_region_hash dm_log dm_mod aic7xxx scsi_transport_spi sd_mod

scsi_mod

Post by Helms, John
raid1 ext3 jbd uhci_hcd ohci_hcd ehci_hcd [last unloaded: microcode]
Apr 22 12:36:53 netcache1 kernel: Pid: 3010, comm: nfsv4.0-svc
G W (2.6.32.11 #3) C2100 C2100
00010246 CPU: 0
Apr 22 12:36:53 netcache1 kernel: EIP is at iput+0x10/0x4a
f6065e00 EDX: 00000000
f6061000 ESP: f609cf50
Apr 22 12:36:53 netcache1 kernel: DS: 007b ES: 007b FS: 0000 GS: 0000
SS: 0068
Apr 22 12:36:53 netcache1 kernel: Process nfsv4.0-svc (pid: 3010,
ti=f609c000 task=f73b2490 task.ti=f609c000)
Apr 22 12:36:53 netcache1 kernel: f5845600 f96e93e7 f5845600 f96f12b5
f5845608 f96f1290 c050a434 f5845600
Apr 22 12:36:53 netcache1 kernel: <0> fffffff5 f96f20b9 7fffffff
f5845600 f6065e00 f675d920 c16a5aa0 0000000d
Apr 22 12:36:53 netcache1 kernel: <0> 00000000 f73b2490 c041bd1c
00000000 00000000 fffffff5 fffffff5 f6061000
Apr 22 12:36:53 netcache1 kernel: [<f96e93e7>] ?
svc_sock_free+0x34/0x3c [sunrpc]
Apr 22 12:36:53 netcache1 kernel: [<f96f12b5>] ?
svc_xprt_free+0x25/0x2e [sunrpc]
Apr 22 12:36:53 netcache1 kernel: [<f96f1290>] ?

svc_xprt_free+0x0/0x2e

Post by Helms, John
[sunrpc]
Apr 22 12:36:53 netcache1 kernel: [<c050a434>] ? kref_put+0x35/0x3f
Apr 22 12:36:53 netcache1 kernel: [<f96f20b9>] ? svc_recv+0x5f8/0x64f
[sunrpc]
Apr 22 12:36:53 netcache1 kernel: [<c041bd1c>] ?
default_wake_function+0x0/0x8
Apr 22 12:36:53 netcache1 kernel: [<fa2e9f32>] ?
nfs4_callback_svc+0x21/0x6e [nfs]
Apr 22 12:36:53 netcache1 kernel: [<fa2e9f11>] ?
nfs4_callback_svc+0x0/0x6e [nfs]
Apr 22 12:36:53 netcache1 kernel: [<c043252a>] ? kthread+0x60/0x66
Apr 22 12:36:53 netcache1 kernel: [<c04324ca>] ? kthread+0x0/0x66
Apr 22 12:36:53 netcache1 kernel: [<c0402e73>] ?
kernel_thread_helper+0x7/0x10
Apr 22 12:36:53 netcache1 kernel: Code: 79 dd f8 ff 81 a3 18 01 00 00 77
ff ff ff 89 d8 5b eb be e8 04 a0 1b 00 31 c0 c3 85 c0 53 89 c3 74 41 83
b8 18 01 00 00 40 75 04 <0f> 0b eb fe 8d 40 24 ba 00 b9 83 c0 e8 89 4e
07 00 85 c0 74 23
Apr 22 12:36:53 netcache1 kernel: EIP: [<c0493ac2>] iput+0x10/0x4a
SS:ESP 0068:f609cf50
Apr 22 12:36:53 netcache1 kernel: ---[ end trace ad2af8766f43e520 ]---
A slightly different error (in kref.c vs inode.c) has also occurred
Apr 22 09:58:07 netcache1 kernel: ------------[ cut here ]------------
Apr 22 09:58:07 netcache1 kernel: WARNING: at lib/kref.c:43
kref_get+0x18/0x1c()
Apr 22 09:58:07 netcache1 kernel: Hardware name: C2100 C2100
Apr 22 09:58:07 netcache1 kernel: Modules linked in: autofs4 hidp ipv6
nfs lockd fscache nfs_acl auth_rpcgss rfcomm l2cap crc16 bluetooth
sunrpc dm_mirror dm_multipath scsi_dh video output sbs sbshc battery ac
parport_pc lp parport sg scb2_flash button mtd chipreg e1000 serio_raw
rtc_cmos rtc_core rtc_lib floppy i2c_piix4 pcspkr e100 i2c_core mii
dm_region_hash dm_log dm_mod aic7xxx scsi_transport_spi sd_mod

scsi_mod

Post by Helms, John
raid1 ext3 jbd uhci_hcd ohci_hcd ehci_hcd [last unloaded: microcode]
Apr 22 09:58:07 netcache1 kernel: Pid: 25329, comm: nfsv4.0-svc Not
tainted 2.6.32.11 #3
Apr 22 09:58:07 netcache1 kernel: [<c04217e4>] ?
warn_slowpath_common+0x41/0x71
Apr 22 09:58:07 netcache1 kernel: [<c0421801>] ?
warn_slowpath_common+0x5e/0x71
Apr 22 09:58:07 netcache1 kernel: [<c042181e>] ?
warn_slowpath_null+0xa/0xc
Apr 22 09:58:07 netcache1 kernel: [<c050a456>] ? kref_get+0x18/0x1c
Apr 22 09:58:07 netcache1 kernel: [<f992ece8>] ? svc_recv+0x227/0x64f
[sunrpc]
Apr 22 09:58:07 netcache1 kernel: [<c041bd1c>] ?
default_wake_function+0x0/0x8
Apr 22 09:58:07 netcache1 kernel: [<fa526f32>] ?
nfs4_callback_svc+0x21/0x6e [nfs]
Apr 22 09:58:07 netcache1 kernel: [<fa526f11>] ?
nfs4_callback_svc+0x0/0x6e [nfs]
Apr 22 09:58:07 netcache1 kernel: [<c043252a>] ? kthread+0x60/0x66
Apr 22 09:58:07 netcache1 kernel: [<c04324ca>] ? kthread+0x0/0x66
Apr 22 09:58:07 netcache1 kernel: [<c0402e73>] ?
kernel_thread_helper+0x7/0x10
Apr 22 09:58:07 netcache1 kernel: ---[ end trace e11161bf7dec748b ]---
The error doesn't seem to occur when read delegations have been disabled
at the filer. And no error messages have been seen on the filer
console. The network between the filer and linux client is a

crossover

Post by Helms, John
cable, and the speed/duplex is 100/full (limited by the hardware on this
re-purposed server).
Thanks,
John Helms
_______________________________________________
NFSv4 mailing list
NFSv4 at linux-nfs.org
http://linux-nfs.org/cgi-bin/mailman/listinfo/nfsv4