Re: vm86 segfaults with NX bit



At Thu, 20 Nov 2008 18:01:08 +0100,
I wrote:

At Thu, 20 Nov 2008 08:58:44 -0800,
Arjan van de Ven wrote:

On Thu, 20 Nov 2008 16:39:06 +0100
Takashi Iwai <tiwai@xxxxxxx> wrote:

Hi,

X guys reported that VESA driver segfaults in vm86 mode with a kernel
with CONFIG_X86_PAE, and it turned to be the NX bit. See Novell
bugzilla #443440:
https://bugzilla.novell.com/show_bug.cgi?id=443440

I can confirm that the latest 2.6.28-rc still causes the same problem,
and it disappears when booted with noexec=off option.

Also, when NX bit is reset for the first 1MB (or smaller) in
do_sys_vm86(), it also works as expected. But I have little clue
where to restore the bit again.

Any good suggestions / solutions?


did the code that mapped this memory setup use PROT_EXEC ?

A good question...
Luc, Egbert, how does VESA driver handle it?

Just looking through the vesa directory of xorg-server code, PROT_EXEC
is passed for all mappings, at least.

Please correct me if I'm looking at a wrong place...


thanks,

Takashi
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/



Relevant Pages

  • Re: vm86 segfaults with NX bit
    ... X guys reported that VESA driver segfaults in vm86 mode with a kernel ... Luc, Egbert, how does VESA driver handle it? ...
    (Linux-Kernel)
  • Re: vm86 segfaults with NX bit
    ... Luc, Egbert, how does VESA driver handle it? ... Just looking through the vesa directory of xorg-server code, ... spews the error messages and skips the vm86 ... Hopefully Egbert can give us a better insight... ...
    (Linux-Kernel)
  • Re: Linux 2.6.27.9
    ... REALLY like to know why each and every 2.6.27 kernel so totally fails ... the vesa driver refuses to come up ... 01:00.0 VGA compatible controller: ATI Technologies Inc Radeon RV250 ... Capabilities: ...
    (Linux-Kernel)
  • Re: ATI Radeon 9600xt (256MB DDR) on FreeBSD 6.2 ; solved?
    ... possible so that display is stretched to whole screen. ... The VESA driver is not optimal for that card. ... doesn't find your card is most likely the absence of a radeon kernel driver ... I don't recall whether you stated which version of FreeBSD you were using. ...
    (freebsd-questions)
  • Re: gdm and intel G965
    ... I'll use vesa driver until kernel 2.6.19 comes to etch. ... To UNSUBSCRIBE, email to debian-user-REQUEST@xxxxxxxxxxxxxxxx ... Trouble? ...
    (Debian-User)