2.6.14.3 and weird things with interrupts on smp machines
Arkadiusz Miskiewicz
arekm at pld-linux.org
Sun Jan 8 19:23:25 CET 2006
I've recently noticed that something weird is happening on my SMP machines.
Both machines are 2 x Xeon CPU with HT enabled. /proc/interrupts shows that
only CPU#0 is used which is very weird. I'm running irqbalance.spec. I'm
unable to alter affinity settings for irq - these are always the same as
below.
Has anyone noticed such problems?
First one:
00:00.0 Host bridge: Intel Corporation E7501 Memory Controller Hub (rev 01)
00:00.1 Class ff00: Intel Corporation E7500/E7501 Host RASUM Controller (rev
01)
00:02.0 PCI bridge: Intel Corporation E7500/E7501 Hub Interface B PCI-to-PCI
Bridge (rev 01)
00:02.1 Class ff00: Intel Corporation E7500/E7501 Hub Interface B RASUM
Controller (rev 01)
00:1d.0 USB Controller: Intel Corporation 82801CA/CAM USB (Hub #1) (rev 02)
00:1d.1 USB Controller: Intel Corporation 82801CA/CAM USB (Hub #2) (rev 02)
00:1d.2 USB Controller: Intel Corporation 82801CA/CAM USB (Hub #3) (rev 02)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev 42)
00:1f.0 ISA bridge: Intel Corporation 82801CA LPC Interface Controller (rev
02)
00:1f.1 IDE interface: Intel Corporation 82801CA Ultra ATA Storage Controller
(rev 02)
00:1f.3 SMBus: Intel Corporation 82801CA/CAM SMBus Controller (rev 02)
01:1c.0 PIC: Intel Corporation 82870P2 P64H2 I/OxAPIC (rev 04)
01:1d.0 PCI bridge: Intel Corporation 82870P2 P64H2 Hub PCI Bridge (rev 04)
01:1e.0 PIC: Intel Corporation 82870P2 P64H2 I/OxAPIC (rev 04)
01:1f.0 PCI bridge: Intel Corporation 82870P2 P64H2 Hub PCI Bridge (rev 04)
03:01.0 Fibre Channel: QLogic Corp. QLA2312 Fibre Channel Adapter (rev 02)
04:03.0 VGA compatible controller: ATI Technologies Inc Rage XL (rev 27)
04:04.0 Ethernet controller: Intel Corporation 82557/8/9 [Ethernet Pro 100]
(rev 0d)
04:05.0 Ethernet controller: Intel Corporation 82540EM Gigabit Ethernet
Controller (rev 02)
# cat /proc/interrupts
CPU0 CPU1 CPU2 CPU3
0: 74712 51 0 0 IO-APIC-edge timer
4: 974 0 0 0 IO-APIC-edge serial
8: 1 0 0 0 IO-APIC-edge rtc
9: 0 0 0 0 IO-APIC-level acpi
169: 72699 45 0 0 IO-APIC-level qla2300
177: 549413 229 0 0 IO-APIC-level eth0
185: 280407 80 0 0 IO-APIC-level eth1
NMI: 73803 73785 73781 73782
LOC: 74586 74649 74755 74780
ERR: 0
MIS: 0
# for a in /proc/irq/*; do echo -n "$a :"; cat $a/smp_affinity; done
/proc/irq/0 :0001
/proc/irq/1 :0001
/proc/irq/10 :0001
/proc/irq/11 :0001
/proc/irq/12 :0001
/proc/irq/13 :0001
/proc/irq/14 :0001
/proc/irq/15 :0001
/proc/irq/169 :000f
/proc/irq/177 :000f
/proc/irq/185 :000f
/proc/irq/2 :ffff
/proc/irq/3 :0001
/proc/irq/4 :0001
/proc/irq/5 :0001
/proc/irq/6 :0001
/proc/irq/7 :0001
/proc/irq/8 :0001
/proc/irq/9 :0001
CPU: After generic identify, caps: bfebfbff 00000000 00000000 00000000
00004400 00000000 00000000
CPU: After vendor identify, caps: bfebfbff 00000000 00000000 00000000 00004400
00000000 00000000
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 0
CPU: After all inits, caps: bfebfbff 00000000 00000000 00000080 00004400
00000000 00000000
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#0.
CPU0: Intel P4/Xeon Extended MCE MSRs (12) available
mtrr: v2.0 (20020519)
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Checking 'hlt' instruction... OK.
ACPI: Looking for DSDT in initrd... not found.
CPU0: Intel(R) Xeon(TM) CPU 2.80GHz stepping 05
Booting processor 1/1 eip 2000
Initializing CPU#1
Calibrating delay using timer specific routine.. 5581.36 BogoMIPS
(lpj=27906820)
CPU: After generic identify, caps: bfebfbff 00000000 00000000 00000000
00004400 00000000 00000000
CPU: After vendor identify, caps: bfebfbff 00000000 00000000 00000000 00004400
00000000 00000000
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 0
CPU: After all inits, caps: bfebfbff 00000000 00000000 00000080 00004400
00000000 00000000
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#1.
CPU1: Intel P4/Xeon Extended MCE MSRs (12) available
CPU1: Intel(R) Xeon(TM) CPU 2.80GHz stepping 05
Booting processor 2/6 eip 2000
Initializing CPU#2
Calibrating delay using timer specific routine.. 5581.73 BogoMIPS
(lpj=27908671)
CPU: After generic identify, caps: bfebfbff 00000000 00000000 00000000
00004400 00000000 00000000
CPU: After vendor identify, caps: bfebfbff 00000000 00000000 00000000 00004400
00000000 00000000
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 3
CPU: After all inits, caps: bfebfbff 00000000 00000000 00000080 00004400
00000000 00000000
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#2.
CPU2: Intel P4/Xeon Extended MCE MSRs (12) available
CPU2: Intel(R) Xeon(TM) CPU 2.80GHz stepping 05
Booting processor 3/7 eip 2000
Initializing CPU#3
Calibrating delay using timer specific routine.. 5581.83 BogoMIPS
(lpj=27909174)
CPU: After generic identify, caps: bfebfbff 00000000 00000000 00000000
00004400 00000000 00000000
CPU: After vendor identify, caps: bfebfbff 00000000 00000000 00000000 00004400
00000000 00000000
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 3
CPU: After all inits, caps: bfebfbff 00000000 00000000 00000080 00004400
00000000 00000000
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#3.
CPU3: Intel P4/Xeon Extended MCE MSRs (12) available
CPU3: Intel(R) Xeon(TM) CPU 2.80GHz stepping 05
Total of 4 processors activated (22331.04 BogoMIPS).
ENABLING IO-APIC IRQs
..TIMER: vector=0x31 pin1=2 pin2=-1
checking TSC synchronization across 4 CPUs: passed.
Brought up 4 CPUs
Second one:
00:00.0 Host bridge: Intel Corporation E7500 Memory Controller Hub (rev 03)
00:02.0 PCI bridge: Intel Corporation E7500/E7501 Hub Interface B PCI-to-PCI
Bridge (rev 03)
00:1d.0 USB Controller: Intel Corporation 82801CA/CAM USB (Hub #1) (rev 02)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev 42)
00:1f.0 ISA bridge: Intel Corporation 82801CA LPC Interface Controller (rev
02)
00:1f.1 IDE interface: Intel Corporation 82801CA Ultra ATA Storage Controller
(rev 02)
00:1f.3 SMBus: Intel Corporation 82801CA/CAM SMBus Controller (rev 02)
01:01.0 Ethernet controller: Intel Corporation 82557/8/9 [Ethernet Pro 100]
(rev 10)
01:02.0 VGA compatible controller: ATI Technologies Inc Rage XL (rev 27)
02:1c.0 PIC: Intel Corporation 82870P2 P64H2 I/OxAPIC (rev 03)
02:1d.0 PCI bridge: Intel Corporation 82870P2 P64H2 Hub PCI Bridge (rev 03)
02:1e.0 PIC: Intel Corporation 82870P2 P64H2 I/OxAPIC (rev 03)
02:1f.0 PCI bridge: Intel Corporation 82870P2 P64H2 Hub PCI Bridge (rev 03)
03:03.0 Fibre Channel: QLogic Corp. QLA2312 Fibre Channel Adapter (rev 02)
04:01.0 Ethernet controller: Intel Corporation 82545EM Gigabit Ethernet
Controller (Copper) (rev 01)
# cat /proc/interrupts
CPU0 CPU1 CPU2 CPU3
0: 354490746 0 0 0 IO-APIC-edge timer
2: 0 0 0 0 XT-PIC cascade
4: 447316 0 0 0 IO-APIC-edge serial
8: 2 0 0 0 IO-APIC-edge rtc
145: 0 0 0 0 IO-APIC-level
uhci_hcd:usb1
153: 387875616 0 0 0 IO-APIC-level eth0
169: 49346270 0 0 0 IO-APIC-level qla2300
177: 2764054244 0 0 0 IO-APIC-level eth1
NMI: 354490780 354490764 354490762 354490760
LOC: 354506771 354506924 354506917 354506900
ERR: 0
MIS: 0
# for a in /proc/irq/*; do echo -n "$a :"; cat $a/smp_affinity; done
/proc/irq/0 :0001
/proc/irq/1 :0001
/proc/irq/10 :0001
/proc/irq/11 :ffff
/proc/irq/12 :0001
/proc/irq/13 :0001
/proc/irq/14 :0001
/proc/irq/145 :ffff
/proc/irq/15 :0001
/proc/irq/153 :ffff
/proc/irq/161 :ffff
/proc/irq/169 :ffff
/proc/irq/177 :ffff
/proc/irq/2 :ffff
/proc/irq/3 :0001
/proc/irq/4 :0001
/proc/irq/5 :ffff
/proc/irq/6 :0001
/proc/irq/7 :0001
/proc/irq/8 :0001
/proc/irq/9 :ffff
CPU: After generic identify, caps: 3febfbff 00000000 00000000 00000000
00000000 00000000 00000000
CPU: After vendor identify, caps: 3febfbff 00000000 00000000 00000000 00000000
00000000 00000000
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 0
CPU: After all inits, caps: 3febfbff 00000000 00000000 00000080 00000000
00000000 00000000
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#0.
CPU0: Intel P4/Xeon Extended MCE MSRs (12) available
mtrr: v2.0 (20020519)
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Checking 'hlt' instruction... OK.
CPU0: Intel(R) XEON(TM) CPU 1.80GHz stepping 04
Booting processor 1/1 eip 2000
Initializing CPU#1
Calibrating delay using timer specific routine.. 3599.64 BogoMIPS
(lpj=17998208)
CPU: After generic identify, caps: 3febfbff 00000000 00000000 00000000
00000000 00000000 00000000
CPU: After vendor identify, caps: 3febfbff 00000000 00000000 00000000 00000000
00000000 00000000
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 0
CPU: After all inits, caps: 3febfbff 00000000 00000000 00000080 00000000
00000000 00000000
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#1.
CPU1: Intel P4/Xeon Extended MCE MSRs (12) available
CPU1: Intel(R) XEON(TM) CPU 1.80GHz stepping 04
Booting processor 2/6 eip 2000
Initializing CPU#2
Calibrating delay using timer specific routine.. 3599.77 BogoMIPS
(lpj=17998879)
CPU: After generic identify, caps: 3febfbff 00000000 00000000 00000000
00000000 00000000 00000000
CPU: After vendor identify, caps: 3febfbff 00000000 00000000 00000000 00000000
00000000 00000000
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 3
CPU: After all inits, caps: 3febfbff 00000000 00000000 00000080 00000000
00000000 00000000
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#2.
CPU2: Intel P4/Xeon Extended MCE MSRs (12) available
CPU2: Intel(R) XEON(TM) CPU 1.80GHz stepping 04
Booting processor 3/7 eip 2000
Initializing CPU#3
Calibrating delay using timer specific routine.. 3599.78 BogoMIPS
(lpj=17998926)
CPU: After generic identify, caps: 3febfbff 00000000 00000000 00000000
00000000 00000000 00000000
CPU: After vendor identify, caps: 3febfbff 00000000 00000000 00000000 00000000
00000000 00000000
CPU: Trace cache: 12K uops, L1 D cache: 8K
CPU: L2 cache: 512K
CPU: Physical Processor ID: 3
CPU: After all inits, caps: 3febfbff 00000000 00000000 00000080 00000000
00000000 00000000
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#3.
CPU3: Intel P4/Xeon Extended MCE MSRs (12) available
CPU3: Intel(R) XEON(TM) CPU 1.80GHz stepping 04
Total of 4 processors activated (14404.04 BogoMIPS).
ENABLING IO-APIC IRQs
..TIMER: vector=0x31 pin1=2 pin2=0
checking TSC synchronization across 4 CPUs: passed.
Brought up 4 CPUs
--
Arkadiusz Miśkiewicz PLD/Linux Team
http://www.t17.ds.pwr.wroc.pl/~misiek/ http://ftp.pld-linux.org/
More information about the pld-devel-en
mailing list