Randomized controlled trials (RCTs) are the gold standard studies to evaluate the efficacy of therapeutic interventions. Although they are frequently identified through open searches in electronic databases, no studies have evaluated how easy it is to identify RCTs in neurosurgery using electronic search strategies.

The present study evaluated the sensitivity and specificity of different search strategies applied to commonly used databases to identify RCTs in neurosurgery.

The total number of RCTs in neurosurgery published between 1960 and 2013 was determined through a detailed search involving open keyword searches in PubMed, Cochrane Library and Center for Reviews and Dissemination (CRD) databases, a PubMed search based on clinical entity-related keywords and hand-searches on the reference list of identified articles. The sensitivity and specificity were calculated for the open keyword searches on PubMed, the Cochrane Library and the CRD database and for the Cochrane’s HSSS, based on the total number of the identified RCTs.

Compared to the total of 1102 RCTs identified, PubMed open search yielded 4660 articles, among which 365 were RCTs (sensitivity: 33.1%; specificity: 7.8%). Cochrane open search yielded 621 among which 36 were RCTs (sensitivity: 3.2%; specificity: 5.8%) and CRD open search returned 78 articles, among which 4 were RCTs (sensitivity: 0.4% sensitivity; specificity: 5.1%). The Cochrane HSSS retrieved 10702 results, among which 340 were RCTs (sensitivity: 30.9%; specificity: 3.2%).

Most RCTs in neurosurgery cannot be identified by commonly used search strategies, which emphasizes the need to improve their indexing