Re: PCI-DMA: high address but no IOMMU - nForce4

From: Matti Aarnio (matti.aarnio_at_zmailer.org)
Date: 10/30/05

  • Next message: Jesper Juhl: "Re: New (now current development process)" 
    Date:	Sun, 30 Oct 2005 03:27:37 +0300
To: Andi Kleen <ak@suse.de>

    On Fri, Oct 28, 2005 at 12:16:51AM +0200, Andi Kleen wrote:
    > Michael Madore <michael.madore@gmail.com> writes:
    > > 2.6.14-rc5 on a dual Opteron nforce4 motherboard with 8GB of RAM:
    ...
    > > With 2.6.13, the systems boots OK with these messages in the log:
    > >
    > > Checking aperture...
    > > CPU 0: aperture @ 8000000 size 32 MB
    > > Aperture from northbridge cpu 0 too small (32 MB)
    > > No AGP bridge found
    > > Your BIOS doesn't leave a aperture memory hole
    > > Please enable the IOMMU option in the BIOS setup
    > > This costs you 64 MB of RAM
    > > Mapping aperture over 65536 KB of RAM @ 8000000
    > > ...
    > > PCI-DMA: Disabling AGP.
    > > PCI-DMA: aperture base @ 8000000 size 65536 KB
    > > PCI-DMA: Reserving 64MB of IOMMU area in the AGP aperture
    >
    > Can you post the full boot log?

    I will attach my own; A brand new Amd64 dual-core thing.
    Works fine with mem=2500M, but blows up with mem=3G or
    without any override and full 4G complement in use.

    This board (ASUS A8N-SLI) does use NVIDIA nForce4 chipset with
    bios-option to map (hoist) "excess memory" out from first 4G to
    higher physical addresses so that it can be accessed by the
    processor.

    This board has no AGP at all in it, but it does have lots
    of PCIE, and a bit of PCI-X thrown in for "legacy cards".
    Somehow that detail breaks things when the machine really
    should use bounce-buffering, or something similar -- I don't
    know if Nvidia nForce4 chipset does have IOMMU, though...

    If Nvidia did omit such essential piece of hardware from
    a modern chipset, I do find it amazingly short-sighted...
    (Of course they don't yield documentation of the chips to
    public so that I can't quickly verify this detail...)

    > > Using git bisect, I narrowed the problem down to the following commit:
    > >
    > > 6142891a0c0209c91aa4a98f725de0d6e2ed4918 is first bad commit
    > > diff-tree 6142891a0c0209c91aa4a98f725de0d6e2ed4918 (from
    > > 357e11d4cbbbb959a88a9bdbbf33a10f160b0823)
    > > Author: Andi Kleen <ak@suse.de>
    > > Date: Mon Sep 12 18:49:24 2005 +0200
    > >
    > > [PATCH] x86-64: Avoid unnecessary double bouncing for swiotlb
    > >
    > > PCI_DMA_BUS_IS_PHYS has to be zero even when the GART IOMMU is disabled
    > > and the swiotlb is used. Otherwise the block layer does unnecessary
    > > double bouncing.
    >
    > Your system shouldn't be using swiotlb anyways.

    In my testing, using precompiled Fedora Core development series
    kernels last kernel fully working with 4G memory is:
          kernel-smp-2.6.13-1.1532_FC4.x86_64.rpm

    next kernel package I found after that was:
          kernel-smp-2.6.13-1.1555_FC5.i686.rpm

    and that blows up like this lattest kernel below (as of 2 days ago)
    I have kernel-2.6.14-1.1632_FC5.x86_64.rpm staged for next reboot,
    which I need to do rather quick, as I omitted loading "devel" dataset
    for this running one, and can't compile nvidia display driver...

    .. and sure enough, it blows up, too. It takes a while longer, because
    memory allocation order for IOs was changed just couple days ago from
    "top down" to "bottom up" (or something of that kind), so that it takes
    now longer before a "bad" block gets allocated... so much so that
    boot process chuks log-level down nonexistent before things become
    really interesting...

    Below you will find TWO boots ending up in a failure.
    First with two/three days old kernel, and then with full 2.6.14.

    > -Andi

       /Matti Aarnio

    Bootdata ok (command line is ro root=/dev/md2 console=ttyS0,38400n8 console=tty0)
    Linux version 2.6.13-1.1629_FC5 (bhcompile@hs20-bc1-4.build.redhat.com) (gcc version 4.0.2 20051007 (Red Hat 4.0.2-3)) #1 SMP Wed Oct 26 17:43:10 EDT 2005
    BIOS-provided physical RAM map:
     BIOS-e820: 0000000000000000 - 000000000009e400 (usable)
     BIOS-e820: 000000000009e400 - 00000000000a0000 (reserved)
     BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
     BIOS-e820: 0000000000100000 - 00000000afff0000 (usable)
     BIOS-e820: 00000000afff0000 - 00000000afff3000 (ACPI NVS)
     BIOS-e820: 00000000afff3000 - 00000000b0000000 (ACPI data)
     BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
     BIOS-e820: 00000000fec00000 - 0000000100000000 (reserved)
     BIOS-e820: 0000000100000000 - 0000000140000000 (usable)
    SRAT: PXM 0 -> APIC 0 -> Node 0
    SRAT: PXM 0 -> APIC 1 -> Node 0
    SRAT: Node 0 PXM 0 0-9ffff
    SRAT: Node 0 PXM 0 0-afffffff
    SRAT: Node 0 PXM 0 0-13fffffff
    Bootmem setup node 0 0000000000000000-000000013fffffff
    Nvidia board detected. Ignoring ACPI timer override.
    ACPI: PM-Timer IO Port: 0x4008
    ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
    Processor #0 15:3 APIC version 16
    ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
    Processor #1 15:3 APIC version 16
    ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
    ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
    ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
    IOAPIC[0]: apic_id 2, version 17, address 0xfec00000, GSI 0-23
    ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
    ACPI: BIOS IRQ0 pin2 override ignored.
    ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
    ACPI: INT_SRC_OVR (bus 0 bus_irq 14 global_irq 14 high edge)
    ACPI: INT_SRC_OVR (bus 0 bus_irq 15 global_irq 15 high edge)
    Setting APIC routing to physical flat
    Using ACPI (MADT) for SMP configuration information
    Allocating PCI resources starting at b4000000 (gap: b0000000:30000000)
    Checking aperture...
    CPU 0: aperture @ c10000000 size 32 MB
    Aperture from northbridge cpu 0 too small (32 MB)
    No AGP bridge found
    Your BIOS doesn't leave a aperture memory hole
    Please enable the IOMMU option in the BIOS setup
    This costs you 64 MB of RAM
    Mapping aperture over 65536 KB of RAM @ 8000000
    Built 1 zonelists
    Kernel command line: ro root=/dev/md2 console=ttyS0,38400n8 console=tty0
    Initializing CPU#0
    PID hash table entries: 4096 (order: 12, 131072 bytes)
    time.c: Using 3.579545 MHz PM timer.
    time.c: Detected 2211.381 MHz processor.
    Console: colour VGA+ 80x25
    Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
    Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
    Memory: 3780456k/5242880k available (2439k kernel code, 151248k reserved, 1458k data, 228k init)
    Calibrating delay using timer specific routine.. 4427.25 BogoMIPS (lpj=8854511)
    Security Framework v1.0.0 initialized
    SELinux: Initializing.
    SELinux: Starting in permissive mode
    selinux_register_security: Registering secondary module capability
    Capability LSM initialized as secondary
    Mount-cache hash table entries: 256
    CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
    CPU: L2 Cache: 1024K (64 bytes/line)
    CPU 0(2) -> Node 0 -> Core 0
    mtrr: v2.0 (20020519)
    Using local APIC timer interrupts.
    Detected 12.564 MHz APIC timer.
    softlockup thread 0 started up.
    Booting processor 1/2 APIC 0x1
    Initializing CPU#1
    Calibrating delay using timer specific routine.. 4422.98 BogoMIPS (lpj=8845960)
    CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
    CPU: L2 Cache: 1024K (64 bytes/line)
    CPU 1(2) -> Node 0 -> Core 1
    AMD Athlon(tm) 64 X2 Dual Core Processor 4400+ stepping 02
    CPU 1: Syncing TSC to CPU 0.
    CPU 1: synchronized TSC with CPU 0 (last diff -77 cycles, maxerr 547 cycles)
    Brought up 2 CPUs
    softlockup thread 1 started up.
    Disabling vsyscall due to use of PM timer
    time.c: Using PM based timekeeping.
    testing NMI watchdog ... OK.
    checking if image is initramfs... it is
    NET: Registered protocol family 16
    ACPI: bus type pci registered
    PCI: Using configuration type 1
    PCI: Using MMCONFIG at e0000000
    ACPI: Subsystem revision 20050902
    ACPI: Interpreter enabled
    ACPI: Using IOAPIC for interrupt routing
    ACPI: PCI Root Bridge [PCI0] (0000:00)
    PCI: Probing PCI hardware (bus 00)
    PCI: Transparent bridge - 0000:00:09.0
    ACPI: PCI Interrupt Link [LNK1] (IRQs *3 4 5 7 9 10 11 12 14 15)
    ACPI: PCI Interrupt Link [LNK2] (IRQs 3 4 5 7 9 10 *11 12 14 15)
    ACPI: PCI Interrupt Link [LNK3] (IRQs 3 4 *5 7 9 10 11 12 14 15)
    ACPI: PCI Interrupt Link [LNK4] (IRQs *3 4 5 7 9 10 11 12 14 15)
    ACPI: PCI Interrupt Link [LNK5] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
    ACPI: PCI Interrupt Link [LUBA] (IRQs *3 4 5 7 9 10 11 12 14 15)
    ACPI: PCI Interrupt Link [LUBB] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
    ACPI: PCI Interrupt Link [LMAC] (IRQs 3 4 5 7 9 10 *11 12 14 15)
    ACPI: PCI Interrupt Link [LACI] (IRQs *3 4 5 7 9 10 11 12 14 15)
    ACPI: PCI Interrupt Link [LMCI] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
    ACPI: PCI Interrupt Link [LSMB] (IRQs 3 4 *5 7 9 10 11 12 14 15)
    ACPI: PCI Interrupt Link [LUB2] (IRQs<7>Losing some ticks... checking if CPU frequency changed.
     3 4 5 7 9 10 *11 12 14 15)
    ACPI: PCI Interrupt Link [LIDE] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
    ACPI: PCI Interrupt Link [LSID] (IRQs 3 4 5 7 9 10 *11 12 14 15)
    ACPI: PCI Interrupt Link [LFID] (IRQs 3 4 *5 7 9 10 11 12 14 15)
    ACPI: PCI Interrupt Link [LPCA] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
    ACPI: PCI Interrupt Link [APC1] (IRQs 16) *0, disabled.
    ACPI: PCI Interrupt Link [APC2] (IRQs 17) *0, disabled.
    ACPI: PCI Interrupt Link [APC3] (IRQs 18) *0, disabled.
    ACPI: PCI Interrupt Link [APC4] (IRQs 19) *0, disabled.
    ACPI: PCI Interrupt Link [APC5] (IRQs *16), disabled.
    ACPI: PCI Interrupt Link [APCF] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APCG] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APCH] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APCJ] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APCK] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APCS] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APCL] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APCZ] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APSI] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APSJ] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APCP] (IRQs 20 21 22 23) *0, disabled.
    Linux Plug and Play Support v0.97 (c) Adam Belay
    pnp: PnP ACPI init
    pnp: PnP ACPI: found 15 devices
    usbcore: registered new driver usbfs
    usbcore: registered new driver hub
    PCI: Using ACPI for IRQ routing
    PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report
    PCI-DMA: Disabling AGP.
    PCI-DMA: More than 4GB of RAM and no IOMMU
    PCI-DMA: 32bit PCI IO may malfunction.<6>PCI-DMA: Disabling IOMMU.
    pnp: 00:00: ioport range 0x4000-0x407f could not be reserved
    pnp: 00:00: ioport range 0x4080-0x40ff has been reserved
    pnp: 00:00: ioport range 0x4400-0x447f has been reserved
    pnp: 00:00: ioport range 0x4480-0x44ff could not be reserved
    pnp: 00:00: ioport range 0x4800-0x487f has been reserved
    pnp: 00:00: ioport range 0x4880-0x48ff has been reserved
    PCI: Bridge: 0000:00:09.0
      IO window: 9000-afff
      MEM window: c8000000-c9ffffff
      PREFETCH window: ca000000-ca0fffff
    PCI: Bridge: 0000:00:0b.0
      IO window: disabled.
      MEM window: disabled.
      PREFETCH window: disabled.
    PCI: Bridge: 0000:00:0c.0
      IO window: disabled.
      MEM window: disabled.
      PREFETCH window: disabled.
    PCI: Bridge: 0000:00:0d.0
      IO window: disabled.
      MEM window: disabled.
      PREFETCH window: disabled.
    PCI: Bridge: 0000:00:0e.0
      IO window: disabled.
      MEM window: c0000000-c7ffffff
      PREFETCH window: b0000000-bfffffff
    IA32 emulation $Id: sys_ia32.c,v 1.32 2002/03/24 13:02:28 ak Exp $
    audit: initializing netlink socket (disabled)
    audit(1041385788.128:1): initialized
    Total HugeTLB memory allocated, 0
    VFS: Disk quotas dquot_6.5.1
    Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
    SELinux: Registering netfilter hooks
    Initializing Cryptographic API
    ksign: Installing public key data
    Loading keyring
    - Added public key DBF5CB6293850D8B
      - key was been created 88976999 seconds in future
    - User ID: Red Hat, Inc. (Kernel Module GPG key)
    pci_hotplug: PCI Hot Plug PCI Core version: 0.5
    pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
    assign_interrupt_mode Found MSI capability
    pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
    assign_interrupt_mode Found MSI capability
    pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
    assign_interrupt_mode Found MSI capability
    pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
    assign_interrupt_mode Found MSI capability
    ACPI: Fan [FAN] (on)
    ACPI: CPU0 (power states: C1[C1])
    ACPI: CPU1 (power states: C1[C1])
    ACPI: Thermal Zone [THRM] (40 C)
    Real Time Clock Driver v1.12
    Linux agpgart interface v0.101 (c) Dave Jones
    PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
    serio: i8042 AUX port at 0x60,0x64 irq 12
    serio: i8042 KBD port at 0x60,0x64 irq 1
    Serial: 8250/16550 driver $Revision: 1.90 $ 32 ports, IRQ sharing enabled
    ˙ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
    ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
    io scheduler noop registered
    io scheduler anticipatory registered
    io scheduler deadline registered
    io scheduler cfq registered
    RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize
    Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
    ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
    NFORCE-CK804: IDE controller at PCI slot 0000:00:06.0
    NFORCE-CK804: chipset revision 242
    NFORCE-CK804: not 100% native mode: will probe irqs later
    NFORCE-CK804: 0000:00:06.0 (rev f2) UDMA133 controller
        ide0: BM-DMA at 0xf000-0xf007, BIOS settings: hda:DMA, hdb:DMA
        ide1: BM-DMA at 0xf008-0xf00f, BIOS settings: hdc:DMA, hdd:DMA
    hda: IBM-DTLA-307060, ATA DISK drive
    ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
    hdc: HL-DT-STDVD-ROM GDR8163B, ATAPI CD/DVD-ROM drive
    ide1 at 0x170-0x177,0x376 on irq 15
    hda: max request size: 128KiB
    hda: 120103200 sectors (61492 MB) w/1916KiB Cache, CHS=65535/16/63, UDMA(100)
    hda: cache flushes not supported
     hda:<0>Kernel panic - not syncing: PCI-DMA: high address but no IOMMU.

    Call Trace:<ffffffff80139ed1>{panic+133} <ffffffff80169359>{mempool_alloc+82}
           <ffffffff8016dda0>{poison_obj+49} <ffffffff80169359>{mempool_alloc+82}
           <ffffffff8016dbba>{dbg_redzone1+28} <ffffffff80169359>{mempool_alloc+82}
           <ffffffff8016ec99>{cache_alloc_debugcheck_after+271}
           <ffffffff8016f2cb>{kmem_cache_alloc+149} <ffffffff801227db>{dma_map_sg+881}
           <ffffffff802a77aa>{ide_build_dmatable+44} <ffffffff802a78fc>{ide_dma_setup+52}
           <ffffffff802a8dc5>{ide_do_rw_disk+947} <ffffffff8029f7db>{ide_do_request+1618}
           <ffffffff8035d038>{_spin_lock_irqsave+9} <ffffffff801432fe>{lock_timer_base+27}
           <ffffffff80144097>{del_timer+102} <ffffffff8027d8f9>{__elv_add_request+82}
           <ffffffff80282273>{__make_request+1272} <ffffffff80160000>{proc_cpuset_show+173}
           <ffffffff8016dbba>{dbg_redzone1+28} <ffffffff80169359>{mempool_alloc+82}
           <ffffffff8027f122>{generic_make_request+567} <ffffffff801502b0>{autoremove_wake_function+0}
           <ffffffff8027f1f8>{submit_bio+193} <ffffffff8018e518>{submit_bh+245}
           <ffffffff8019016f>{block_read_full_page+619} <ffffffff80194514>{blkdev_get_block+0}
           <ffffffff8035d0f1>{_write_unlock_irq+9} <ffffffff80193529>{blkdev_readpage+0}
           <ffffffff80166554>{add_to_page_cache+180} <ffffffff80193529>{blkdev_readpage+0}
           <ffffffff8016711d>{read_cache_page+126} <ffffffff801c9f68>{read_dev_sector+43}
           <ffffffff801cb447>{read_lba+73} <ffffffff801cb702>{efi_partition+155}
           <ffffffff801c9dde>{rescan_partitions+134} <ffffffff8016dda0>{poison_obj+49}
           <ffffffff801c9dde>{rescan_partitions+134} <ffffffff801c9e69>{rescan_partitions+273}
           <ffffffff8019407c>{do_open+283} <ffffffff801943d0>{blkdev_get+101}
           <ffffffff8016dda0>{poison_obj+49} <ffffffff801ca0ce>{register_disk+208}
           <ffffffff80282b8a>{add_disk+52} <ffffffff802aa791>{ide_disk_probe+2859}
           <ffffffff8027868d>{driver_probe_device+63} <ffffffff802787a9>{__driver_attach+76}
           <ffffffff8027875d>{__driver_attach+0} <ffffffff80277c17>{bus_for_each_dev+70}
           <ffffffff80278074>{bus_add_driver+112} <ffffffff8010c22b>{init+482}
           <ffffffff8010faa2>{child_rip+8} <ffffffff8010c049>{init+0}
           <ffffffff8010fa9a>{child_rip+0}

    Bootdata ok (command line is ro root=/dev/md2 console=ttyS0,38400n8 console=tty0 )
    Linux version 2.6.14-1.1632_FC5 (bhcompile@hs20-bc1-4.build.redhat.com) (gcc version 4.0.2 20051007 (Red Hat 4.0.2-3)) #1 SMP Thu Oct 27 22:07:01 EDT 2005
    BIOS-provided physical RAM map:
     BIOS-e820: 0000000000000000 - 000000000009e400 (usable)
     BIOS-e820: 000000000009e400 - 00000000000a0000 (reserved)
     BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
     BIOS-e820: 0000000000100000 - 00000000afff0000 (usable)
     BIOS-e820: 00000000afff0000 - 00000000afff3000 (ACPI NVS)
     BIOS-e820: 00000000afff3000 - 00000000b0000000 (ACPI data)
     BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
     BIOS-e820: 00000000fec00000 - 0000000100000000 (reserved)
     BIOS-e820: 0000000100000000 - 0000000140000000 (usable)
    SRAT: PXM 0 -> APIC 0 -> Node 0
    SRAT: PXM 0 -> APIC 1 -> Node 0
    SRAT: Node 0 PXM 0 0-9ffff
    SRAT: Node 0 PXM 0 0-afffffff
    SRAT: Node 0 PXM 0 0-13fffffff
    Bootmem setup node 0 0000000000000000-000000013fffffff
    Nvidia board detected. Ignoring ACPI timer override.
    ACPI: PM-Timer IO Port: 0x4008
    ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
    Processor #0 15:3 APIC version 16
    ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
    Processor #1 15:3 APIC version 16
    ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
    ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
    ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
    IOAPIC[0]: apic_id 2, version 17, address 0xfec00000, GSI 0-23
    ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
    ACPI: BIOS IRQ0 pin2 override ignored.
    ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
    ACPI: INT_SRC_OVR (bus 0 bus_irq 14 global_irq 14 high edge)
    ACPI: INT_SRC_OVR (bus 0 bus_irq 15 global_irq 15 high edge)
    Setting APIC routing to physical flat
    Using ACPI (MADT) for SMP configuration information
    Allocating PCI resources starting at b4000000 (gap: b0000000:30000000)
    Checking aperture...
    CPU 0: aperture @ 8000000 size 32 MB
    Aperture from northbridge cpu 0 too small (32 MB)
    No AGP bridge found
    Your BIOS doesn't leave a aperture memory hole
    Please enable the IOMMU option in the BIOS setup
    This costs you 64 MB of RAM
    Mapping aperture over 65536 KB of RAM @ 8000000
    Built 1 zonelists
    Kernel command line: ro root=/dev/md2 console=ttyS0,38400n8 console=tty0
    Initializing CPU#0
    PID hash table entries: 4096 (order: 12, 131072 bytes)
    time.c: Using 3.579545 MHz PM timer.
    time.c: Detected 2211.382 MHz processor.
    Console: colour VGA+ 80x25
    Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
    Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
    Memory: 3780452k/5242880k available (2439k kernel code, 151252k reserved, 1459k data, 232k init)
    Calibrating delay using timer specific routine.. 4427.26 BogoMIPS (lpj=8854521)
    Security Framework v1.0.0 initialized
    SELinux: Initializing.
    SELinux: Starting in permissive mode
    selinux_register_security: Registering secondary module capability
    Capability LSM initialized as secondary
    Mount-cache hash table entries: 256
    CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
    CPU: L2 Cache: 1024K (64 bytes/line)
    CPU 0(2) -> Node 0 -> Core 0
    mtrr: v2.0 (20020519)
    Using local APIC timer interrupts.
    Detected 12.564 MHz APIC timer.
    softlockup thread 0 started up.
    Booting processor 1/2 APIC 0x1
    Initializing CPU#1
    Calibrating delay using timer specific routine.. 4422.98 BogoMIPS (lpj=8845961)
    CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
    CPU: L2 Cache: 1024K (64 bytes/line)
    CPU 1(2) -> Node 0 -> Core 1
    AMD Athlon(tm) 64 X2 Dual Core Processor 4400+ stepping 02
    CPU 1: Syncing TSC to CPU 0.
    CPU 1: synchronized TSC with CPU 0 (last diff -77 cycles, maxerr 547 cycles)
    Brought up 2 CPUs
    softlockup thread 1 started up.
    Disabling vsyscall due to use of PM timer
    time.c: Using PM based timekeeping.
    testing NMI watchdog ... OK.
    checking if image is initramfs... it is
    NET: Registered protocol family 16
    ACPI: bus type pci registered
    PCI: Using configuration type 1
    PCI: Using MMCONFIG at e0000000
    ACPI: Subsystem revision 20050902
    ACPI: Interpreter enabled
    ACPI: Using IOAPIC for interrupt routing
    ACPI: PCI Root Bridge [PCI0] (0000:00)
    PCI: Probing PCI hardware (bus 00)
    PCI: Transparent bridge - 0000:00:09.0
    ACPI: PCI Interrupt Link [LNK1] (IRQs *3 4 5 7 9 10 11 12 14 15)
    ACPI: PCI Interrupt Link [LNK2] (IRQs 3 4 5 7 9 10 *11 12 14 15)
    ACPI: PCI Interrupt Link [LNK3] (IRQs 3 4 *5 7 9 10 11 12 14 15)
    ACPI: PCI Interrupt Link [LNK4] (IRQs *3 4 5 7 9 10 11 12 14 15)
    ACPI: PCI Interrupt Link [LNK5] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
    ACPI: PCI Interrupt Link [LUBA] (IRQs *3 4 5 7 9 10 11 12 14 15)
    ACPI: PCI Interrupt Link [LUBB] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
    ACPI: PCI Interrupt Link [LMAC] (IRQs 3 4 5 7 9 10 *11 12 14 15)
    ACPI: PCI Interrupt Link [LACI] (IRQs *3 4 5 7 9 10 11 12 14 15)
    ACPI: PCI Interrupt Link [LMCI] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
    ACPI: PCI Interrupt Link [LSMB] (IRQs 3 4 *5 7 9 10 11 12 14 15)
    ACPI: PCI Interrupt Link [LUB2] (IRQs 3 4 5 7 9 10 *11 12 14 15)
    ACPI: PCI Interrupt Link [LIDE] (IRQs<7>Losing some ticks... checking if CPU frequency changed.
     3 4 5 7 9 10 11 12 14 15) *0, disabled.
    ACPI: PCI Interrupt Link [LSID] (IRQs 3 4 5 7 9 10 *11 12 14 15)
    ACPI: PCI Interrupt Link [LFID] (IRQs 3 4 *5 7 9 10 11 12 14 15)
    ACPI: PCI Interrupt Link [LPCA] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
    ACPI: PCI Interrupt Link [APC1] (IRQs 16) *0, disabled.
    ACPI: PCI Interrupt Link [APC2] (IRQs 17) *0, disabled.
    ACPI: PCI Interrupt Link [APC3] (IRQs 18) *0, disabled.
    ACPI: PCI Interrupt Link [APC4] (IRQs 19) *0, disabled.
    ACPI: PCI Interrupt Link [APC5] (IRQs *16), disabled.
    ACPI: PCI Interrupt Link [APCF] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APCG] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APCH] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APCJ] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APCK] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APCS] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APCL] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APCZ] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APSI] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APSJ] (IRQs 20 21 22 23) *0, disabled.
    ACPI: PCI Interrupt Link [APCP] (IRQs 20 21 22 23) *0, disabled.
    Linux Plug and Play Support v0.97 (c) Adam Belay
    pnp: PnP ACPI init
    pnp: PnP ACPI: found 15 devices
    usbcore: registered new driver usbfs
    usbcore: registered new driver hub
    PCI: Using ACPI for IRQ routing
    PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report
    PCI-DMA: Disabling AGP.
    PCI-DMA: More than 4GB of RAM and no IOMMU
    PCI-DMA: 32bit PCI IO may malfunction.<6>PCI-DMA: Disabling IOMMU.
    pnp: 00:00: ioport range 0x4000-0x407f could not be reserved
    pnp: 00:00: ioport range 0x4080-0x40ff has been reserved
    pnp: 00:00: ioport range 0x4400-0x447f has been reserved
    pnp: 00:00: ioport range 0x4480-0x44ff could not be reserved
    pnp: 00:00: ioport range 0x4800-0x487f has been reserved
    pnp: 00:00: ioport range 0x4880-0x48ff has been reserved
    PCI: Bridge: 0000:00:09.0
      IO window: 9000-afff
      MEM window: c8000000-c9ffffff
      PREFETCH window: ca000000-ca0fffff
    PCI: Bridge: 0000:00:0b.0
      IO window: disabled.
      MEM window: disabled.
      PREFETCH window: disabled.
    PCI: Bridge: 0000:00:0c.0
      IO window: disabled.
      MEM window: disabled.
      PREFETCH window: disabled.
    PCI: Bridge: 0000:00:0d.0
      IO window: disabled.
      MEM window: disabled.
      PREFETCH window: disabled.
    PCI: Bridge: 0000:00:0e.0
      IO window: disabled.
      MEM window: c0000000-c7ffffff
      PREFETCH window: b0000000-bfffffff
    IA32 emulation $Id: sys_ia32.c,v 1.32 2002/03/24 13:02:28 ak Exp $
    audit: initializing netlink socket (disabled)
    audit(1130629766.148:1): initialized
    Total HugeTLB memory allocated, 0
    VFS: Disk quotas dquot_6.5.1
    Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
    SELinux: Registering netfilter hooks
    Initializing Cryptographic API
    ksign: Installing public key data
    Loading keyring
    - Added public key BFB24792A9623ECB
    - User ID: Red Hat, Inc. (Kernel Module GPG key)
    pci_hotplug: PCI Hot Plug PCI Core version: 0.5
    pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
    assign_interrupt_mode Found MSI capability
    pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
    assign_interrupt_mode Found MSI capability
    pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
    assign_interrupt_mode Found MSI capability
    pcie_portdrv_probe->Dev[005d:10de] has invalid IRQ. Check vendor BIOS
    assign_interrupt_mode Found MSI capability
    ACPI: Fan [FAN] (on)
    ACPI: CPU0 (power states: C1[C1])
    ACPI: CPU1 (power states: C1[C1])
    ACPI: Thermal Zone [THRM] (40 C)
    Real Time Clock Driver v1.12
    Linux agpgart interface v0.101 (c) Dave Jones
    PNP: PS/2 Controller [PNP0303:PS2K,PNP0f13:PS2M] at 0x60,0x64 irq 1,12
    serio: i8042 AUX port at 0x60,0x64 irq 12
    serio: i8042 KBD port at 0x60,0x64 irq 1
    Serial: 8250/16550 driver $Revision: 1.90 $ 32 ports, IRQ sharing enabled
    ˙ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
    ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
    io scheduler noop registered
    io scheduler anticipatory registered
    io scheduler deadline registered
    io scheduler cfq registered
    RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize
    Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
    ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
    NFORCE-CK804: IDE controller at PCI slot 0000:00:06.0
    NFORCE-CK804: chipset revision 242
    NFORCE-CK804: not 100% native mode: will probe irqs later
    NFORCE-CK804: 0000:00:06.0 (rev f2) UDMA133 controller
        ide0: BM-DMA at 0xf000-0xf007, BIOS settings: hda:DMA, hdb:DMA
        ide1: BM-DMA at 0xf008-0xf00f, BIOS settings: hdc:DMA, hdd:DMA
    hda: IBM-DTLA-307060, ATA DISK drive
    isa bounce pool size: 16 pages
    ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
    hdc: HL-DT-STDVD-ROM GDR8163B, ATAPI CD/DVD-ROM drive
    ide1 at 0x170-0x177,0x376 on irq 15
    hda: max request size: 128KiB
    hda: 120103200 sectors (61492 MB) w/1916KiB Cache, CHS=65535/16/63, UDMA(100)
    hda: cache flushes not supported
     hda: hda1 hda2 hda4 < hda5 >
    hdc: ATAPI 52X DVD-ROM drive, 256kB Cache, UDMA(33)
    Uniform CD-ROM driver Revision: 3.20
    ide-floppy driver 0.99.newide
    usbcore: registered new driver hiddev
    usbcore: registered new driver usbhid
    drivers/usb/input/hid-core.c: v2.6:USB HID core driver
    mice: PS/2 mouse device common for all mice
    md: md driver 0.90.2 MAX_MD_DEVS=256, MD_SB_DISKS=27
    md: bitmap version 3.39
    NET: Registered protocol family 2
    input: AT Translated Set 2 keyboard on isa0060/serio0
    IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
    TCP established hash table entries: 131072 (order: 10, 4194304 bytes)
    TCP bind hash table entries: 65536 (order: 9, 2097152 bytes)
    TCP: Hash tables configured (established 131072 bind 65536)
    TCP reno registered
    TCP bic registered
    Initializing IPsec netlink socket
    NET: Registered protocol family 1
    NET: Registered protocol family 17
    powernow-k8: Found 2 AMD Athlon 64 / Opteron processors (version 1.50.4)
    powernow-k8: 0 : fid 0xe (2200 MHz), vid 0x8 (1350 mV)
    powernow-k8: 1 : fid 0xc (2000 MHz), vid 0xa (1300 mV)
    powernow-k8: 2 : fid 0xa (1800 MHz), vid 0xc (1250 mV)
    powernow-k8: 3 : fid 0x2 (1000 MHz), vid 0x12 (1100 mV)
    cpu_init done, current fid 0xe, vid 0x8
    ACPI wakeup devices:
    HUB0 XVR0 XVR1 XVR2 XVR3 USB0 USB2 MMAC MMCI UAR1
    ACPI: (supports S0 S1 S3 S4 S5)
    Freeing unused kernel memory: 232k freed
    SCSI subsystem initialized
    ACPI: PCI Interrupt Link [APC4] enabled at IRQ 19
    ACPI: PCI Interrupt 0000:05:0a.0[A] -> Link [APC4] -> GSI 19 (level, low) -> IRQ 217
    ata1: SATA max UDMA/100 cmd 0xFFFFC20000004080 ctl 0xFFFFC2000000408A bmdma 0xFFFFC20000004000 irq 217
    ata2: SATA max UDMA/100 cmd 0xFFFFC200000040C0 ctl 0xFFFFC200000040CA bmdma 0xFFFFC20000004008 irq 217
    ata3: SATA max UDMA/100 cmd 0xFFFFC20000004280 ctl 0xFFFFC2000000428A bmdma 0xFFFFC20000004200 irq 217
    ata4: SATA max UDMA/100 cmd 0xFFFFC200000042C0 ctl 0xFFFFC200000042CA bmdma 0xFFFFC20000004208 irq 217
    input: PS2++ Logitech Mouse on isa0060/serio1
    ata1: dev 0 ATA, max UDMA/133, 490234752 sectors: lba48
    ata1: dev 0 configured for UDMA/100
    scsi0 : sata_sil
    ata2: dev 0 ATA, max UDMA/133, 490234752 sectors: lba48
    ata2: dev 0 configured for UDMA/100
    scsi1 : sata_sil
    ata3: no device found (phy stat 00000000)
    scsi2 : sata_sil
    ata4: no device found (phy stat 00000000)
    scsi3 : sata_sil
      Vendor: ATA Model: Maxtor 7L250S0 Rev: BANC
      Type: Direct-Access ANSI SCSI revision: 05
    SCSI device sda: 490234752 512-byte hdwr sectors (251000 MB)
    SCSI device sda: drive cache: write back
    SCSI device sda: 490234752 512-byte hdwr sectors (251000 MB)
    SCSI device sda: drive cache: write back
     sda: sda1 sda2 sda3
    Attached scsi disk sda at scsi0, channel 0, id 0, lun 0
      Vendor: ATA Model: Maxtor 7L250S0 Rev: BANC
      Type: Direct-Access ANSI SCSI revision: 05
    SCSI device sdb: 490234752 512-byte hdwr sectors (251000 MB)
    SCSI device sdb: drive cache: write back
    SCSI device sdb: 490234752 512-byte hdwr sectors (251000 MB)
    SCSI device sdb: drive cache: write back
     sdb: sdb1 sdb2 sdb3
    Attached scsi disk sdb at scsi1, channel 0, id 0, lun 0
    ACPI: PCI Interrupt Link [APSI] enabled at IRQ 23
    ACPI: PCI Interrupt 0000:00:07.0[A] -> Link [APSI] -> GSI 23 (level, low) -> IRQ 225
    ata5: SATA max UDMA/133 cmd 0x9F0 ctl 0xBF2 bmdma 0xD800 irq 225
    ata6: SATA max UDMA/133 cmd 0x970 ctl 0xB72 bmdma 0xD808 irq 225
    ata5: no device found (phy stat 00000000)
    scsi4 : sata_nv
    ata6: no device found (phy stat 00000000)
    scsi5 : sata_nv
    ACPI: PCI Interrupt Link [APSJ] enabled at IRQ 22
    ACPI: PCI Interrupt 0000:00:08.0[A] -> Link [APSJ] -> GSI 22 (level, low) -> IRQ 233
    ata7: SATA max UDMA/133 cmd 0x9E0 ctl 0xBE2 bmdma 0xC400 irq 233
    ata8: SATA max UDMA/133 cmd 0x960 ctl 0xB62 bmdma 0xC408 irq 233
    ata7: no device found (phy stat 00000000)
    scsi6 : sata_nv
    ata8: no device found (phy stat 00000000)
    scsi7 : sata_nv
    md: raid1 personality registered as nr 3
    md: Autodetecting RAID arrays.
    md: autorun ...
    md: considering sdb3 ...
    md: adding sdb3 ...
    md: sdb2 has different UUID to sdb3
    md: sdb1 has different UUID to sdb3
    md: adding sda3 ...
    md: sda2 has different UUID to sdb3
    md: sda1 has different UUID to sdb3
    md: hda5 has different UUID to sdb3
    md: hda2 has different UUID to sdb3
    md: hda1 has different UUID to sdb3
    md: created md2
    md: bind<sda3>
    md: bind<sdb3>
    md: running: <sdb3><sda3>
    raid1: raid set md2 active with 2 out of 2 mirrors
    md: considering sdb2 ...
    md: adding sdb2 ...
    md: sdb1 has different UUID to sdb2
    md: adding sda2 ...
    md: sda1 has different UUID to sdb2
    md: hda5 has different UUID to sdb2
    md: hda2 has different UUID to sdb2
    md: hda1 has different UUID to sdb2
    md: created md1
    md: bind<sda2>
    md: bind<sdb2>
    md: running: <sdb2><sda2>
    raid1: raid set md1 active with 2 out of 2 mirrors
    md: considering sdb1 ...
    md: adding sdb1 ...
    md: adding sda1 ...
    md: hda5 has different UUID to sdb1
    md: hda2 has different UUID to sdb1
    md: hda1 has different UUID to sdb1
    md: created md0
    md: bind<sda1>
    md: bind<sdb1>
    md: running: <sdb1><sda1>
    raid1: raid set md0 active with 2 out of 2 mirrors
    md: considering hda5 ...
    md: adding hda5 ...
    md: hda2 has different UUID to hda5
    md: hda1 has different UUID to hda5
    md: md2 already running, cannot run hda5
    md: export_rdev(hda5)
    md: considering hda2 ...
    md: adding hda2 ...
    md: hda1 has different UUID to hda2
    md: md1 already running, cannot run hda2
    md: export_rdev(hda2)
    md: considering hda1 ...
    md: adding hda1 ...
    md: md0 already running, cannot run hda1
    md: export_rdev(hda1)
    md: ... autorun DONE.
    kjournald starting. Commit interval 5 seconds
    EXT3-fs: mounted filesystem with ordered data mode.
    SELinux: Disabled at runtime.
    SELinux: Unregistering netfilter hooks
    Kernel panic - not syncing: PCI-DMA: high address but no IOMMU.
    -
    To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
    the body of a message to majordomo@vger.kernel.org
    More majordomo info at http://vger.kernel.org/majordomo-info.html
    Please read the FAQ at http://www.tux.org/lkml/

  • Next message: Jesper Juhl: "Re: New (now current development process)"

    Relevant Pages

    • acpi dock test-drive
      ... the PCI devices behind that bridge are not ... ACPI: docking ... MEM window: fd000000-feffffff ... PREFETCH window: f8000000-f9ffffff ...
      (Linux-Kernel)
    • Re: BUG: held lock freed! with 2.6.17-mm3 and 2.6.17-mm4
      ... ACPI: IRQ0 used by override. ... ACPI: bus type pci registered ... MEM window: fbe00000-fbefffff ... usb usb1: Product: EHCI Host Controller ...
      (Linux-Kernel)
    • BUG: held lock freed! with 2.6.17-mm3 and 2.6.17-mm4
      ... ACPI: IRQ0 used by override. ... ACPI: bus type pci registered ... MEM window: fbe00000-fbefffff ... usb usb1: Product: EHCI Host Controller ...
      (Linux-Kernel)
    • intel ahci problem
      ... I have problem like below with two different drives (ata3 or ata4) and ata5. ... disabling device. ... ACPI: bus type pci registered ... IO window: disabled. ...
      (Linux-Kernel)
    • Re: wrong NUMA detection on HP385 G2
      ... Allocating PCI resources starting at d4000000 ... Initializing HighMem for node 0 ... disabling MSI for SHPC device ... MEM window: disabled. ...
      (Linux-Kernel)