Spotlight MDSChannel errors

Originator:eddie
Number:rdar://22296938 Date Originated:8/14/15
Status:Open Resolved:
Product:OS X Product Version:10.10.4
Classification:Serious Bug Reproducible:Yes
 
When searching an Xsan volume using Spotlight, the client will unexpectedly receive an error, which seems to terminate the search. At that time, the client logs MDSChannel errors in Console, and either a limited set of results or no results will be returned to the client. This occurs when searching the SAN volume using the Spotlight menu, Finder windows, and `mdfind`.

Steps to Reproduce:
1.) Setup Xsan v.4 volume using Yosemite MDCs and clients.
2.) Mount SAN volume with > 32TB of data that was previously searchable using Spotlight in OS X v.10.7 (Xsan v.2.3.)
3.) Attempt to search largely populated Xsan volume using Spotlight menu, Finder search field, mdfind

Expected Results:
All Spotlight search results should be returned to the client.

Actual Results:
Client intermittently receives full, partial, or no results from search. Client shows the following errors in /var/log/system.log:

7/28/15 4:50:36.988 PM mds[56]: XSANFS_FSCTL_SpotlightRPC fsctl failed (errno = 7)
7/28/15 4:50:36.988 PM mds[56]: ERROR: _MDSChannelXsanRequest: _XsanMDSChannelRequest failed: 7
7/28/15 4:50:36.988 PM mds[56]: (Message.Error:142) MDSChannel RPC failure (fetchQueryResultsForContext:)
7/28/15 4:50:36.988 PM mds[56]: (Store.Error:273) <MDSDistantStore 0x7fae88f876f0 shutdown:NO got shutdown notification:NO>{channel:0x7fae9817caf0 localPath:'/Volumes/CreativeSAN'} MDSChannel failed -- initiating recovery

Version:
OS X Yosemite v.10.10.4/14E46

Notes:
Attempted to rebuild Spotlight index on primary MDC as outlined in older Apple support articles (allowing full Spotlight index rebuild while clients do not have volume mounted.) Attempted to use mdfind, Spotlight menu, and Finder search box with similar results. Performing Spotlight searches on the primary MDC provides all search results without errors. Attempted to perform search over AFP re-share of Xsan volume - same issues occur. Checked another disparate Xsan installation (running on Yosemite v.10.10.3) and observed identical issues. Attempted to use 10.10.5 developer preview on SAN client - issues persist. Attempted to use 10.11 developer preview on SAN client - issues persist.

Configuration:
Xsan volume hosted by two Xserve MDCs with Yosemite (v.10.10.4). SAN storage is a mix of Apple, Active Storage, and NEC components. Clients are all connected via QLogic 5802v FC switch. SAN configuration was upgraded from working Xsan v.2.3 (Lion) system.

Comments


Please note: Reports posted here will not necessarily be seen by Apple. All problems should be submitted at bugreport.apple.com before they are posted here. Please only post information for Radars that you have filed yourself, and please do not include Apple confidential information in your posts. Thank you!