APPCRASH in w3wp.exe -> clr.dll when changing tenant host setting

Topics: Troubleshooting
Jun 1, 2011 at 9:44 AM

I have a very strange problem:

I have a multi-tenant host where some days ago I added a tenant listening at

development.example.org

Everything went fine until I wanted to change it to

dev.example.org

Accessing this domain just kills the application pool:

Problemereignisame:	APPCRASH
Anwendungsname:	w3wp.exe
Anwendungsversion:	7.5.7601.17514
Anwendungszeitstempel:	4ce7afa2
Fehlermodulname:	clr.dll
Fehlermodulversion:	4.0.30319.225
Fehlermodulzeitstempel:	4d5367b6
Ausnahmecode:	c00000fd
Ausnahmeoffset:	0000000000007b13
Betriebsystemversion:	6.1.7601.2.1.0.1296.17
Gebietsschema-ID:	1031
Zusatzinformation 1:	660a
Zusatzinformation 2:	660a0a858c669b5babba54a1588eca77
Zusatzinformation 3:	c92d
Zusatzinformation 4:	c92d0a00d464aeff687ce5c872da70be

I can change the domain to whatever I want:

bullshit.example.org
evenmorebullshit.example.org

Everything works but not the domain I want "dev.example.org"

 

But now the really strange thing about this:
I can create a new tenant which receives "dev.example.org" and it works!

WTF!?

And even more scary:
Some days ago the tenant had a different host (test.example.org) and we wanted to change it to "www2.example.org" which also killed the apppool when being accessed -- so we changed it to the now existing "development.example.org". Of course "www2.example.org" works today; but today I don't need it anymore -- I definitely need "dev." now, but thats the only one of 1001 possibilities which doesn't work.

 

Any ideas?

Jun 1, 2011 at 10:05 AM

addition: I already did a full reboot of the machine: No change.

Jun 1, 2011 at 10:13 AM

another addition: I also cannot change another tenant to "dev.example.org": AppPool dies, too -- but not with a fresh created tenant: There the setup page appears at "dev.example.org.

Coordinator
Jun 1, 2011 at 6:28 PM

Please file a bug.

Jun 1, 2011 at 8:10 PM

I'd rather shoot the trouble ;)

Is there anything I could do in order to narrow the problem?

My real fear is that on monday when the domain/host should be "www.realdomain.tld" it won't work although _today_ it would work (the same as "www2.example.org" works today but didn't some days ago but I have absolutely no clue what could have been changed since then -- as said a server reboot doesn't change anything.

Coordinator
Jun 1, 2011 at 9:33 PM

What's the message in the windows event logs ?

Jun 1, 2011 at 10:18 PM

Quite the same as above (which was info from error reporting):

<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
- <System>
  <Provider Name="Application Error" /> 
  <EventID Qualifiers="0">1000</EventID> 
  <Level>2</Level> 
  <Task>100</Task> 
  <Keywords>0x80000000000000</Keywords> 
  <TimeCreated SystemTime="2011-06-01T09:09:39.000000000Z" /> 
  <EventRecordID>8277</EventRecordID> 
  <Channel>Application</Channel> 
  <Security /> 
  </System>
- <EventData>
  <Data>w3wp.exe</Data> 
  <Data>7.5.7601.17514</Data> 
  <Data>4ce7afa2</Data> 
  <Data>clr.dll</Data> 
  <Data>4.0.30319.225</Data> 
  <Data>4d5367b6</Data> 
  <Data>c00000fd</Data> 
  <Data>0000000000007b13</Data> 
  <Data>1420</Data> 
  <Data>01cc203b9b7a7c8a</Data> 
  <Data>c:\windows\system32\inetsrv\w3wp.exe</Data> 
  <Data>C:\Windows\Microsoft.NET\Framework64\v4.0.30319\clr.dll</Data> 
  <Data>e094e26a-8c2e-11e0-b4e0-406186f6ffe2</Data> 
  </EventData>
  </Event>
Coordinator
Jun 1, 2011 at 10:22 PM

Could it be that an app pool creates an account based on the host name, and DEV is already here. Is there something else called DEV in your server ?

Jun 1, 2011 at 10:38 PM

I already did a fulltextsearch on all IIS config files. As said: Days ago the "www2" did not work but works today -- but there hasn't been changed anything relevant on the server since then (at least nothing a remember or came across while searching for anything "www2." or "dev." related.

 

From the Report.wer file these are the 10 most recently loaded DLLs:

LoadedModule[206]=C:\Windows\WinSxS\amd64_microsoft.vc80.crt_1fc8b3b9a1e18e3b_8.0.50727.4940_none_88df89932faf0bf6\MSVCR80.dll
LoadedModule[207]=C:\inetpub\wwwroot\Orchard\App_Data\Dependencies\Lucene.Net.dll
LoadedModule[208]=C:\Windows\assembly\NativeImages_v4.0.30319_64\System.Web.Mobile\c5de00037d0766d4ac16c76659ad7471\System.Web.Mobile.ni.dll
LoadedModule[209]=C:\Windows\assembly\NativeImages_v4.0.30319_64\System.Web.RegularE#\9eab1ca5060f975896e6edd435e92e0e\System.Web.RegularExpressions.ni.dll
LoadedModule[210]=C:\Windows\system32\inetsrv\gzip.dll
LoadedModule[211]=C:\Windows\Microsoft.Net\assembly\GAC_MSIL\Microsoft.CSharp.resources\v4.0_4.0.0.0_de_b03f5f7f11d50a3a\Microsoft.CSharp.resources.dll
LoadedModule[212]=C:\Windows\Microsoft.NET\Framework64\v4.0.30319\Temporary ASP.NET Files\root\69a502d4\2235dbd0\App_Web_vgxun5e2.dll
LoadedModule[213]=C:\Windows\Microsoft.NET\Framework64\v4.0.30319\Temporary ASP.NET Files\root\69a502d4\2235dbd0\App_Web_34b2rkhs.dll
LoadedModule[214]=C:\Windows\Microsoft.NET\Framework64\v4.0.30319\Temporary ASP.NET Files\root\69a502d4\2235dbd0\App_Web_zllhyc0b.dll
LoadedModule[215]=C:\Windows\Microsoft.NET\Framework64\v4.0.30319\Temporary ASP.NET Files\root\69a502d4\2235dbd0\App_Web_uw2fl3kl.dll

Jun 1, 2011 at 10:59 PM

In one of the WER folders I found a minidump which I managed to transfer to my local PC but I have no matching .pdbs..

If I don't misinterpret the values a StackOverflowException occured there:

>	clr.dll!EEJitManager::JitCodeToMethodInfo()  + 0x15 bytes	
 	[Managed to Native Transition]	
 	mscorlib.ni.dll!000007fef4415cb8() 	
 	[Frames below may be incorrect and/or missing, no symbols loaded for mscorlib.ni.dll]	
 	[Managed module(s) not found, frames cannot be determined]	
 	System.Web.Mvc.dll!System.Web.Mvc.ReflectedActionDescriptor.Execute + 0x108 bytes	
 	System.Web.Mvc.dll!System.Web.Mvc.ControllerActionInvoker.InvokeActionMethod + 0x27 bytes	
 	System.Web.Mvc.dll!System.Web.Mvc.ControllerActionInvoker.<>c__DisplayClass15.b__12 + 0x81 bytes	
 	System.Web.Mvc.dll!System.Web.Mvc.ControllerActionInvoker.InvokeActionMethodFilter + 0xe6 bytes	
 	System.Web.Mvc.dll!System.Web.Mvc.ControllerActionInvoker.InvokeActionMethodFilter + 0xe6 bytes	
 	System.Web.Mvc.dll!System.Web.Mvc.ControllerActionInvoker.InvokeActionMethodFilter + 0xe6 bytes	
 	System.Web.Mvc.dll!System.Web.Mvc.ControllerActionInvoker.InvokeActionMethodWithFilters + 0x13a bytes	
 	System.Web.Mvc.dll!System.Web.Mvc.ControllerActionInvoker.InvokeAction + 0x15f bytes	
 	System.Web.Mvc.dll!System.Web.Mvc.Controller.ExecuteCore + 0x9f bytes	
 	System.Web.Mvc.dll!System.Web.Mvc.ControllerBase.Execute + 0x14f bytes	
 	System.Web.Mvc.dll!System.Web.Mvc.MvcHandler.<>c__DisplayClass6.<>c__DisplayClassb.b__5 + 0x3e bytes	
 	System.Web.Mvc.dll!System.Web.Mvc.Async.AsyncResultWrapper.<>c__DisplayClass1.b__0 + 0x14 bytes	
 	System.Web.Mvc.dll!System.Web.Mvc.MvcHandler.<>c__DisplayClasse.b__d + 0x36 bytes	
 	[Managed module(s) not found, frames cannot be determined]	
 	[Native to Managed Transition]	
 	webengine4.dll!000007fef605ba59() 	
 	[Managed to Native Transition]	
 	[Managed module(s) not found, frames cannot be determined]	
 	[Native to Managed Transition]	
 	webengine4.dll!000007fef605ba59()