Hello at all,
I having a strange issue in one of my customers environments.
My eventlog is filled with many many error saying either "The given key was not present in the dictionary." and "Resource is missing".
Here are the full details on both eventlogs:
Requestor: urn:uuid:e1603551-065e-4f84-a236-acb00d1c8e18 Correlation Identifier: 3fdbcc5d-45d2-4541-830d-a7ccffed9327 Microsoft.ResourceManagement.WebServices.Exceptions.UnwillingToPerformException: Other ---> System.Collections.Generic.KeyNotFoundException: The given key was not present in the dictionary. at System.ThrowHelper.ThrowKeyNotFoundException() at System.Collections.Generic.Dictionary`2.get_Item(TKey key) at Microsoft.ResourceManagement.Query.QueryParametersGenerator.WriteRequestedAttributes() at Microsoft.ResourceManagement.Query.QueryParametersGenerator.BuildParameterString() at Microsoft.ResourceManagement.Query.QueryProcessor.BuildSqlCommand(Query objectRepresentation, Boolean countResultsOnly) at Microsoft.ResourceManagement.Query.QueryProcessor.ExecuteQuery(Query query, Nullable`1 maximumTime, Boolean& endOfSequence, Boolean countResultsOnly, Int64& resultCount, Int64& executionTime) at Microsoft.ResourceManagement.WebServices.RequestDispatcher.ExecutePullActionImpl(PullRequestParameter pullParameter) at Microsoft.ResourceManagement.WebServices.RequestDispatcher.ExecuteEnumerateAction(RequestType request) at Microsoft.ResourceManagement.WebServices.RequestDispatcher.ExecuteAction(RequestType request) at Microsoft.ResourceManagement.WebServices.RequestDispatcher.ExecuteAction[ResponseBodyType](RequestType request) at Microsoft.ResourceManagement.WebServices.RequestDispatcher.DispatchRequest[ResponseBodyType](RequestType request, Guid requestIdentifier, Object redispatchSingleInstanceKey, Boolean isRedispatch) at Microsoft.ResourceManagement.WebServices.RequestDispatcher.DispatchRequest[ResponseBodyType](RequestType request) at Microsoft.ResourceManagement.WebServices.ResourceManagementService.Enumerate(Message request) --- End of inner exception stack trace ---
Requestor: urn:uuid:b3694817-313e-449f-b471-6484b3917c02 Correlation Identifier: 3fae4696-f7de-490f-bb77-a3603fce43f0 Microsoft.ResourceManagement.Service: Microsoft.ResourceManagement.WebServices.Exceptions.PermissionDeniedException: ResourceIsMissing at Microsoft.ResourceManagement.WebServices.RequestDispatcher.ExecuteGetAction(RequestType request) at Microsoft.ResourceManagement.WebServices.RequestDispatcher.ExecuteAction(RequestType request) at Microsoft.ResourceManagement.WebServices.RequestDispatcher.ExecuteAction[ResponseBodyType](RequestType request) at Microsoft.ResourceManagement.WebServices.RequestDispatcher.DispatchRequest[ResponseBodyType](RequestType request, Guid requestIdentifier, Object redispatchSingleInstanceKey, Boolean isRedispatch) at Microsoft.ResourceManagement.WebServices.RequestDispatcher.DispatchRequest[ResponseBodyType](RequestType request) at Microsoft.ResourceManagement.WebServices.ResourceManagementService.Get(Message request)
and also some short snippet from the FIM Service trace in verbose mode:
Microsoft.ResourceManagement Verbose: 0 : Request '' status was updated in-memory from 'NotFound' to 'Validating'. ThreadId=16 DateTime=2013-12-19T14:14:23.4651988Z Microsoft.ResourceManagement Verbose: 0 : Request created: '' ThreadId=16 DateTime=2013-12-19T14:14:23.4671990Z Microsoft.ResourceManagement Verbose: 0 : Entered RequestDispatcher with Request Object; RequestIdentifier 'dd715f67-ccba-4496-bb6e-1fba39283358'. ThreadId=16 DateTime=2013-12-19T14:14:23.4681991Z Microsoft.ResourceManagement Verbose: 0 : Add request 'dd715f67-ccba-4496-bb6e-1fba39283358' to cache with RequestStatus 'Validating'. ThreadId=16 DateTime=2013-12-19T14:14:23.4681991Z Microsoft.ResourceManagement Information: 1 : RequestDispatcher enter processing pipeline; RequestIdentifier 'dd715f67-ccba-4496-bb6e-1fba39283358'; Operation 'Get'; Object ''; RequestStatus 'Validating'. ThreadId=16 DateTime=2013-12-19T14:14:23.4691992Z Microsoft.ResourceManagement Verbose: 0 : RequestDispatcher is processing RequestIdentifier 'dd715f67-ccba-4496-bb6e-1fba39283358' for a 'Get' operation on object '' with RequestStatus 'Validating'. ThreadId=16 DateTime=2013-12-19T14:14:23.4701993Z Microsoft.ResourceManagement Verbose: 0 : Request 'dd715f67-ccba-4496-bb6e-1fba39283358' status was updated in-memory from 'Validating' to 'Validated'. ThreadId=16 DateTime=2013-12-19T14:14:23.4761999Z Microsoft.ResourceManagement Verbose: 0 : RequestDispatcher is processing RequestIdentifier 'dd715f67-ccba-4496-bb6e-1fba39283358' for a 'Get' operation on object '' with RequestStatus 'Validated'. ThreadId=16 DateTime=2013-12-19T14:14:23.4772000Z Microsoft.ResourceManagement Verbose: 0 : Executing initial authentication. ThreadId=16 DateTime=2013-12-19T14:14:23.4782001Z Microsoft.ResourceManagement Verbose: 0 : Request 'dd715f67-ccba-4496-bb6e-1fba39283358' status was updated in-memory from 'Validated' to 'Authenticating'. ThreadId=16 DateTime=2013-12-19T14:14:23.4792002Z Microsoft.ResourceManagement Verbose: 0 : Request 'dd715f67-ccba-4496-bb6e-1fba39283358' status was updated in-memory from 'Authenticating' to 'Authenticated'. ThreadId=16 DateTime=2013-12-19T14:14:23.4802003Z Microsoft.ResourceManagement Verbose: 0 : RequestDispatcher is processing RequestIdentifier 'dd715f67-ccba-4496-bb6e-1fba39283358' for a 'Get' operation on object '' with RequestStatus 'Authenticated'. ThreadId=16 DateTime=2013-12-19T14:14:23.4802003Z Microsoft.ResourceManagement Verbose: 0 : Request 'dd715f67-ccba-4496-bb6e-1fba39283358' status was updated in-memory from 'Authenticated' to 'Authorized'. ThreadId=16 DateTime=2013-12-19T14:14:23.4812004Z Microsoft.ResourceManagement Verbose: 0 : RequestDispatcher is processing RequestIdentifier 'dd715f67-ccba-4496-bb6e-1fba39283358' for a 'Get' operation on object '' with RequestStatus 'Authorized'. ThreadId=16 DateTime=2013-12-19T14:14:23.4822005Z Microsoft.ResourceManagement Information: 1 : WS: Action.Get.Execute.Enter ThreadId=16 DateTime=2013-12-19T14:14:23.4822005Z Microsoft.ResourceManagement Verbose: 0 : XPathDialectParser.ParseXPathExpression.Enter(/Person[ObjectID='fb89aefa-5ea1-47f1-8890-abe7797d6497']) ThreadId=16 DateTime=2013-12-19T14:14:23.4842007Z Microsoft.ResourceManagement Verbose: 0 : XPathDialectParser.Enumerate.BuilderResult(/Person[ObjectID = 'fb89aefa-5ea1-47f1-8890-abe7797d6497']) ThreadId=16 DateTime=2013-12-19T14:14:23.4872010Z Microsoft.ResourceManagement Verbose: 0 : XPathDialectParser.ParseXPathExpression.Exit(/Person[ObjectID = 'fb89aefa-5ea1-47f1-8890-abe7797d6497']) ThreadId=16 DateTime=2013-12-19T14:14:23.4872010Z Microsoft.ResourceManagement Information: 1 : Query: QueryProcessor.ExecuteQuery.ExecuteReader.Enter ThreadId=16 DateTime=2013-12-19T14:14:23.4882011Z Microsoft.ResourceManagement Information: 1 : Query: QueryProcessor.ExecuteQuery.ExecuteReader.Exit ThreadId=16 DateTime=2013-12-19T14:14:23.6252148Z Microsoft.ResourceManagement Verbose: 0 : Request 'dd715f67-ccba-4496-bb6e-1fba39283358' status was updated in-memory from 'Authorized' to 'Denied'. ThreadId=16 DateTime=2013-12-19T14:14:23.6282151Z Microsoft.ResourceManagement Information: 1 : RequestIdentifier 'dd715f67-ccba-4496-bb6e-1fba39283358' exited RequestDispatcher with RequestStatus 'Denied'. ThreadId=16 DateTime=2013-12-19T14:14:23.6282151Z Microsoft.ResourceManagement Information: 1 : WS: Get:PermissionDenied ThreadId=16 DateTime=2013-12-19T14:14:23.6302153Z Microsoft.ResourceManagement Error: 3 : Requestor: urn:uuid:0aac2c9a-5a8b-44c7-ba8b-909d459a3d66 Correlation Identifier: 771ee212-67a9-410a-bffe-fef76a78e366 Microsoft.ResourceManagement.Service: Microsoft.ResourceManagement.WebServices.Exceptions.PermissionDeniedException: ResourceIsMissing at Microsoft.ResourceManagement.WebServices.RequestDispatcher.ExecuteGetAction(RequestType request) at Microsoft.ResourceManagement.WebServices.RequestDispatcher.ExecuteAction(RequestType request) at Microsoft.ResourceManagement.WebServices.RequestDispatcher.ExecuteAction[ResponseBodyType](RequestType request) at Microsoft.ResourceManagement.WebServices.RequestDispatcher.DispatchRequest[ResponseBodyType](RequestType request, Guid requestIdentifier, Object redispatchSingleInstanceKey, Boolean isRedispatch) at Microsoft.ResourceManagement.WebServices.RequestDispatcher.DispatchRequest[ResponseBodyType](RequestType request) at Microsoft.ResourceManagement.WebServices.ResourceManagementService.Get(Message request) ThreadId=16 DateTime=2013-12-19T14:14:23.6312154Z Microsoft.ResourceManagement Information: 1 : WS: Get: exit ThreadId=16 DateTime=2013-12-19T14:14:24.0012524Z Microsoft.ResourceManagement Information: 1 : WS: Get: enter ThreadId=16 DateTime=2013-12-19T14:14:24.0792602Z Microsoft.ResourceManagement Information: 1 : WS: ObjectType,ObjectID,DisplayName,Locale ThreadId=16 DateTime=2013-12-19T14:14:24.0822605Z Microsoft.ResourceManagement Information: 1 : WS: GetCurrentUserFromSecurityIdentifier.Enter: S-1-5-21-1343024091-790525478-839522115-44293 ThreadId=16 DateTime=2013-12-19T14:14:24.0832606Z Microsoft.ResourceManagement Information: 1 : WS: GetCurrentUserFromSecurityIdentifier.Exit ThreadId=16 DateTime=2013-12-19T14:14:24.0842607Z Microsoft.ResourceManagement Information: 1 : Get(fb89aefa-5ea1-47f1-8890-abe7797d6497) ThreadId=16 DateTime=2013-12-19T14:14:24.0852608Z
Tracelog is nearly identical on the "key not present" error, after authorized, the request (which i can see is a read/get) is switched back todenied.
The only thing that in common in all errors in the tracelog is that it occurs on a get of a guid/reference.
In Portal everthing is working like expected i see no errors, all data is displayed like it should, not resources oder value are missing.
But at the most places I click in portal it generates one of the to event, even if I switch from one user tab to another, but only this ones which holds group reporting controls (no errors on tab where manager and assistant are displayed).
Eventlogs also apperas on displaying all users or searching for them and even in request history and MPR list.
I am the initial administrator and in addition give (for testing) explicit read to all objects with all attributes to the admin set
So the problem is not that urgent as all is working like expected but it fills up my eventlog, making it hard to seperate this errors from real issues.
Environment ist FIM 2010 R2 Sp1 with latest Hotfix (4.1.3496.0) running on SharePoint Foundation 2013 on a Server 2008 R2. SP2013 was installed with the help on the guide from FimSpecialist.
Anyone a hint on how to solve this ?
Regards
Peter
Peter Stapf - Doeres AG - My blog:JustIDM.wordpress.com