The low reproducibility rate in social sciences has produced hesitation among researchers in accepting published findings at their face value. Despite the advent of initiatives to increase ...transparency in research reporting, the field is still lacking tools to verify the credibility of research reports. In the present paper, we describe methodologies that let researchers craft highly credible research and allow their peers to verify this credibility. We demonstrate the application of these methods in a multi-laboratory replication of Bem's Experiment 1 (Bem 2011
, 407-425. (doi:10.1037/a0021524)) on extrasensory perception (ESP), which was co-designed by a consensus panel including both proponents and opponents of Bem's original hypothesis. In the study we applied direct data deposition in combination with born-open data and real-time research reports to extend transparency to protocol delivery and data collection. We also used piloting, checklists, laboratory logs and video-documented trial sessions to ascertain as-intended protocol delivery, and external research auditors to monitor research integrity. We found 49.89% successful guesses, while Bem reported 53.07% success rate, with the chance level being 50%. Thus, Bem's findings were not replicated in our study. In the paper, we discuss the implementation, feasibility and perceived usefulness of the credibility-enhancing methodologies used throughout the project.
Researchers and theorists have explained variations in the relationship between implicit and explicit measures of social cognition by citing differences in measurement and cognitive processing. The ...present research explored how features of measured attributes and individual differences affect the relationship between implicit and explicit measures using existing data (Hussey, Hughes, & Nosek, 2018). In the original study, participants completed measures of explicit evaluation or identification (i.e., difference scores between self-report items) and implicit evaluation or identification (i.e., the Implicit Association Test; Greenwald, McGhee, & Schwartz, 1998) for one of 95 target pairs. First, we attempted to conceptually replicate Nosek's (2005) findings that self-presentation, distinctiveness, elaboration/importance, and complementarity moderated the relationship between implicit and explicit evaluations across individuals irrespective of attribute targets. These attribute features each moderated the relationship between implicit and explicit evaluations and accounted for unique variation in implicit-explicit relations. Second, we tested whether these features affected the relationship between implicit and explicit identifications. We found moderating effects of distinctiveness and complementarity but not of the other attribute features, likely due to their operationalization. Finally, we examined whether theoretically relevant individual difference measures moderated the relationship between implicit and explicit evaluations or identifications. Across almost all analyses, these measures (i.e., socially desirable responding, self-monitoring, need for cognition, personal need for structure, and need for cognitive closure) did not moderate implicit-explicit relations. Taken together, our results suggest that relationships between implicit and explicit measures reflect individual experiences with attribute targets rather than the cultural context, targets, or individuals themselves.
Protein-fragment complementation assays (PCAs) are widely used for investigating protein interactions. However, the fragments used are structurally compromised and have not been optimized nor ...thoroughly characterized for accurately assessing these interactions. We took advantage of the small size and bright luminescence of NanoLuc to engineer a new complementation reporter (NanoBiT). By design, the NanoBiT subunits (i.e., 1.3 kDa peptide, 18 kDa polypeptide) weakly associate so that their assembly into a luminescent complex is dictated by the interaction characteristics of the target proteins onto which they are appended. To ascertain their general suitability for measuring interaction affinities and kinetics, we determined that their intrinsic affinity (K D = 190 μM) and association constants (k on = 500 M–1 s–1, k off = 0.2 s–1) are outside of the ranges typical for protein interactions. The accuracy of NanoBiT was verified under defined biochemical conditions using the previously characterized interaction between SME-1 β-lactamase and a set of inhibitor binding proteins. In cells, NanoBiT fusions to FRB/FKBP produced luminescence consistent with the linear characteristics of NanoLuc. Response dynamics, evaluated using both protein kinase A and β-arrestin-2, were rapid, reversible, and robust to temperature (21–37 °C). Finally, NanoBiT provided a means to measure pharmacology of kinase inhibitors known to induce the interaction between BRAF and CRAF. Our results demonstrate that the intrinsic properties of NanoBiT allow accurate representation of protein interactions and that the reporter responds reliably and dynamically in cells.
Bioluminescence methodologies have been extraordinarily useful due to their high sensitivity, broad dynamic range, and operational simplicity. These capabilities have been realized largely through ...incremental adaptations of native enzymes and substrates, originating from luminous organisms of diverse evolutionary lineages. We engineered both an enzyme and substrate in combination to create a novel bioluminescence system capable of more efficient light emission with superior biochemical and physical characteristics. Using a small luciferase subunit (19 kDa) from the deep sea shrimp Oplophorus gracilirostris, we have improved luminescence expression in mammalian cells ∼2.5 million-fold by merging optimization of protein structure with development of a novel imidazopyrazinone substrate (furimazine). The new luciferase, NanoLuc, produces glow-type luminescence (signal half-life >2 h) with a specific activity ∼150-fold greater than that of either firefly (Photinus pyralis) or Renilla luciferases similarly configured for glow-type assays. In mammalian cells, NanoLuc shows no evidence of post-translational modifications or subcellular partitioning. The enzyme exhibits high physical stability, retaining activity with incubation up to 55 °C or in culture medium for >15 h at 37 °C. As a genetic reporter, NanoLuc may be configured for high sensitivity or for response dynamics by appending a degradation sequence to reduce intracellular accumulation. Appending a signal sequence allows NanoLuc to be exported to the culture medium, where reporter expression can be measured without cell lysis. Fusion onto other proteins allows luminescent assays of their metabolism or localization within cells. Reporter quantitation is achievable even at very low expression levels to facilitate more reliable coupling with endogenous cellular processes.