item: #1 of 71 id: metapsychology-1481 author: de Leeuw, Joshua; Andrews, Jan; Altman, Zariah; Andrews, Rebecca; Appleby, Robert; Bonnano, James; DeStefano, Isabella; Doyle-Samay, Eileen; Faruqui, Ayela; Griesmer, Christina; Hwang, Jackie; Lee, Rena; Liang, Yunfei; Mernacaj, John; Molina, Henry; Ng, Hui Xin; Park, Steven; Possidente, Thomas; Shriver, Anne title: Similar event-related potentials to structural violations in music and language: A replication of Patel, Gibson, Ratner, Besson, & Holcomb (1998) date: 2019-11-12 words: 7845 flesch: 57 summary: Grand average waveforms for music stimuli. For music stimuli, the effect of grammaticality was also stronger at poste- rior sites, with the exception of the two most poste- rior sites (O1 and O2), where there was no clear ef- fect of grammaticality. keywords: analysis; data; effect; electrode; language; model; music; original; participants; patel; replication; stimuli cache: metapsychology-1481.pdf plain text: metapsychology-1481.txt item: #2 of 71 id: metapsychology-1592 author: Williams, Matt N; Albers, Casper title: Dealing with Distributional Assumptions in Preregistered Research date: 2019-09-12 words: 9342 flesch: 42 summary: DEALING WITH DISTRIBUTIONAL ASSUMPTIONS IN PREREGISTERED RESEARCH 3 Nevertheless, an important meta-strategy underlies the advice about dealing with distributional assumptions found in many methodological resources (see the discussion in Wells & Hintze, 2007): There are many methods for detecting distributional assumption problems, including both graphical approaches and inferential tests. keywords: analysis; assumptions; data; distributional; error; example; power; problems; research; researchers; robustness; strategies; strategy; test cache: metapsychology-1592.pdf plain text: metapsychology-1592.txt item: #3 of 71 id: metapsychology-1615 author: Zondervan-Zwijnenburg, Mariëlle; Van de Schoot, Rens; Hoijtink, Herbert title: Testing ANOVA Replications by Means of the Prior Predictive p-Value date: 2022-01-17 words: 10411 flesch: 64 summary: As such, the current study supports researchers that want to adhere to the call for replication studies in the field of psychology. Keywords: ANOVA, comparison of means, power analysis, prior predictive p-value, replication study Introduction New studies conducted to replicate earlier original studies are often referred to as replication studies. keywords: data; features; group; hrf; original; power; predictive; replication; results; sample; size; step; study; test; value cache: metapsychology-1615.pdf plain text: metapsychology-1615.txt item: #4 of 71 id: metapsychology-1635 author: Wiens, Stefan title: Dissociation Between Speech and Emotion Effects in Short-Term Memory: A Data Reanalysis. date: 2021-12-16 words: 7628 flesch: 53 summary: Critically, Marsh et al. (2018) analyzed performance data (proportion correct) with ANOVAs and t tests, but these analyses did not test specifically for a dissociation between task effects on speech and on emotion. This result is consistent with the claim for a dissociation between task effects on speech and on emotion. keywords: dissociation; effect; emotion; et al; high; load; marsh; recall; serial; speech; task cache: metapsychology-1635.pdf plain text: metapsychology-1635.txt item: #5 of 71 id: metapsychology-1645 author: Schimmack, Ulrich title: The Validation Crisis in Psychology date: 2021-03-10 words: 6387 flesch: 51 summary: Construct validity should be quantified to enable cost-benefit analyses and to replace existing measures with better measures that have superior construct validity. Meta-Psychology, 2021, vol 5, MP.2019.1645 https://doi.org/10.15626/MP.2019.1645 Article type: Commentary Published under the CC-BY4.0 license Open data: N/A Open materials: N/A Open and reproducible analysis: N/A Open reviews and editorial process: Yes Preregistration: N/A Edited by: Daniel Lakens Reviewed by: J. Gottfried, M. Wolf Analysis reproduced by: N/A All supplementary files can be accessed at OSF: https://osf.io/afusj/ The Validation Crisis in Psychology Ulrich Schimmack Department of Psychology, University of Toronto Mississauga Abstract Cronbach and Meehl (1955) introduced the concept of construct validity and described how researchers can demon- strate that their measures have construct validity. keywords: construct; cronbach; measures; meehl; method; psychology; science; validation; validity cache: metapsychology-1645.pdf plain text: metapsychology-1645.txt item: #6 of 71 id: metapsychology-1652 author: Holcombe, Alex O title: Color and Categorical Claims date: 2019-06-24 words: 3237 flesch: 52 summary: For red, one aspect of the similarity of red hues is fairly well understood – per- ceptual similarity (although color similarity is not simple, and certainly not fully understood – see Wit- zel & Gegenfurtner, 2018). Yes Preregistration: Not relevant Edited by: Rickard Carlsson Reviewed by: Andrew J. Elliot, Kenneth M. Steele, Matt N. Williams, Daniël Lakens, Thom Baguley Analysis reproduced by: No analysis All supplementary files can be accessed at the OSF project page: https://doi.org/10.17605/OSF.IO/VG5WA Color and Categorical Claims Alex O. Holcombe School of Psychology, The University of Sydney The effect of color on psychological functioning is the topic of a large literature. keywords: color; effect; elliot; literature; melanopsin; red cache: metapsychology-1652.pdf plain text: metapsychology-1652.txt item: #7 of 71 id: metapsychology-1723 author: Crede, Marcus title: A Negative Effect of a Contractive Pose is not Evidence for the Positive Effect of an Expansive Pose: Comment on Cuddy, Schultz, and Fosse (2018) date: 2019-09-09 words: 2731 flesch: 54 summary: MP.2019.1723.Crede_proofs_20190909 Meta-Psychology, 2019, vol 3, MP.2019.1723, https://doi.org/10.15626/MP.2019.1723 Article type: Commentary Published under the CC-BY4.0 license Open data: Not relevant Open materials: Not relevant Open and reproducible analysis: Not relevant Open reviews and editorial process: Yes Preregistration: Not relevant Edited by: Rickard Carlsson Reviewed by: Anne Scheel, Roland Imhoff Analysis reproduced by: No analysis All supplementary files can be accessed at the OSF project page: https://doi.org/10.17605/OSF.IO/F9UDB A Negative Effect of a Contractive Pose is not Evidence for the Positive Effect of an Expansive Pose: Comment on Cuddy, Schultz, and Fosse (2018) Marcus Credé1 Iowa State University Cuddy, Schultz and Fosse (2018) present the results of p-curve analyses that are inter- preted as providing clear evidential value for power posing effects”. Further, I discuss how the few studies that were designed to shed light on this issue indicate that any overall effect of physical pose on feelings of power, emotions, affect, and self-evaluations is almost entirely due to the negative effect of a contractive pose and not any positive effect of expansive power poses. keywords: cuddy; effect; feelings; pose; posture; power cache: metapsychology-1723.pdf plain text: metapsychology-1723.txt item: #8 of 71 id: metapsychology-1778 author: Zigerell, Lawrence James title: Perceived Discrimination against Black Americans and White Americans date: 2021-05-03 words: 5502 flesch: 50 summary: The sample size was 359 for non-Hispanic White Americans and 52 for non-Hispanic Black Americans, which included 8 non-Hispanic White participants and 1 non-Hispanic Black participant who were coded as skipping the item. Non-Hispanic White Americans’ and Non-Hispanic Black Americans’ reported perceptions of discrimination [ANES 2016 Time Series Study] Note. keywords: americans; anes; blacks; discrimination; non; participants; states; study; united; whites cache: metapsychology-1778.pdf plain text: metapsychology-1778.txt item: #9 of 71 id: metapsychology-1916 author: Williams, Matt N title: Levels of measurement and statistical analyses date: 2021-05-24 words: 9734 flesch: 50 summary: Statistical analyses, however, may produce different results depending on which coding rule is used, so we should only use statistical analyses that produce invariant results across the class of coding rules that are permissible for the data we have col- lected. Meta-Psychology, 2021, vol 5, MP.2019.1916, https://doi.org/10.15626/MP.2019.1916 Article type: Original Article Published under the CC-BY4.0 license Open data: N/A Open materials: N/A Open and reproducible analysis: Yes Open reviews and editorial process: Yes Preregistration: No Edited by: Moritz Heene Reviewed by: J. McGrane, A. Kyngdon Analysis reproduced by: André Kalmendal All supplementary files can be accessed at the OSF pro- ject page: https://doi.org/10.17605/OSF.IO/GTN9C Levels of measurement and statistical analyses Matt N. Williams School of Psychology, Massey University Most researchers and students in psychology learn of S. S. Stevens’ scales or “levels” of measurement (nominal, ordinal, interval, and ratio), and of his rules setting out which statistical analyses are admissible with each measurement level. keywords: analyses; assumptions; attribute; data; example; levels; linear; measurement; observations; rules; statistical; stevens; variable cache: metapsychology-1916.pdf plain text: metapsychology-1916.txt item: #10 of 71 id: metapsychology-1992 author: Hunter, Andrew; Beribisky, Nataly; Farmus, Linda; Cribbie, Robert A. title: Multiplicity Control vs Replication: Making an Obvious Choice Even More Obvious date: 2020-07-01 words: 7749 flesch: 57 summary: Indeed, many academic journals have stated that they are now open to accepting replication studies (e.g., Lucas & Donnellan, 2013; Vazire, 2016). However, effect sizes can be evaluated across replication studies, and thus we compare our NHST-based results with the ability of replications to prevent a conclusion that the data provides evidence for a meaningful effect size when in fact the population effect size is null. keywords: control; effect; error; multiplicity; power; replication; study; type cache: metapsychology-1992.pdf plain text: metapsychology-1992.txt item: #11 of 71 id: metapsychology-2071 author: Brown, Nicholas J L; van Rongen, Jan B; van de Velde, Jakob; Williams, Matt title: A Reproduction of the Results of Onyike et al. (2003) date: 2021-09-28 words: 6214 flesch: 60 summary: We were able to reproduce this table in its entirety, with the exception of a discrepancy of 0.01 in one percentage (possibly due to different rounding between Stata and R), and an apparent transcription error in the number of people in Obesity class 1, where Onyike et al. re- ported 910 instead of 981 (a value that Onyike et al. themselves reported correctly in their Table 4). Meta-Psychology, 2021, vol 5, MP.2019.2071 https://doi.org/10.15626/MP.2019.2071 Article type: Commentary Published under the CC-BY4.0 license Open data: Not applicable Open materials: Yes Open and reproducible analysis: Yes Open reviews and editorial process: Yes Preregistration: No Edited by: Felix D. Schönbrodt Reviewed by: Fried, E., Althouse, A. Analysis reproduced by: Alexey Guzey All supplementary files can be accessed at OSF: https://doi.org/10.17605/OSF.IO/FQJZM A Reproduction of the Results of Onyike et al. (2003) Nicholas J. L. Brown University of Groningen Jakob van de Velde Ghent University Jan van Rongen Independent consultant Matt Williams Massey University Abstract Onyike et al. keywords: data; depression; et al; iii; nhanes; onyike; onyike et; table cache: metapsychology-2071.pdf plain text: metapsychology-2071.txt item: #12 of 71 id: metapsychology-2117 author: Olvera Astivia, Oscar Lorenzo title: Issues, problems and potential solutions when simulating continuous, non-normal data in the social sciences date: 2020-07-31 words: 9905 flesch: 48 summary: When the inverse CDFs are implemented to generate the non- normal marginals, the Fréchet–Hoeffding bounds are induced, restricting the types of correlational structures that multivariate, non-normal distributions can gener- ate when compared to multivariate normal ones. Simulating mul- tivariate non-normal distributions. keywords: copula; correlation; data; distributions; doi; matrix; method; multivariate; non; normality; order; sciences; simulation; social; univariate; variables cache: metapsychology-2117.pdf plain text: metapsychology-2117.txt item: #13 of 71 id: metapsychology-2134 author: Ziano, Ignazio ; Wang, Yu Jie ; Sany, Sydney Susanto ; Ngai ‎, Long Ho ; Lau, Yuk Kwan ; Bhattal‎, Iban Kaur ; Keung, Pui Sin ; Wong, Yan To ; Tong, Wing Zhang ; Cheng, Bo Ley ; Chan, Hill Yan ; Feldman, Gilad title: Perceived morality of direct versus indirect harm: Replications of the preference for indirect harm effect date: 2021-11-09 words: 6469 flesch: 55 summary: Yes Edited by: Rickard Carlsson Reviewed by: Daniël Lakens, Arvid Erlandsson Analysis reproduced by: André Kalmendal All supplementary files can be accessed at the OSF project page: https://doi.org/10.17605/OSF.IO/3SCAF Perceived morality of direct versus indirect harm: Replications of the preference for indirect harm effect Ignazio Ziano1 Grenoble Ecole de Management, F-38000 Grenoble, France Yu Jie Wang1, Sydney Susanto Sany1 Department of Psychology, University of Hong Kong, Hong Kong SAR Long Ho Ngai2, Yuk Kwan Lau2, Iban Kaur Bhattal2, Pui Sin Keung2, Yan To Wong2, Wing Zhang Tong2 Department of Psychology, University of Hong Kong, Hong Kong SAR Bo Ley Cheng, Hill Yan Chan Department of Psychology, University of Hong Kong, Hong Kong SAR Gilad Feldman3 Department of Psychology, University of Hong Kong, Hong Kong SAR Royzman and Baron (2002) demonstrated that people prefer indirect harm to direct harm: they judge actions that produce harm as a by-product to be more moral than actions that produce harm directly. All materials, data, and code are available at osf.io/ewq8g. Keywords: direct harm, indirect harm, morality, pre-registered replication, preference for indirect harm Judgments of morality do not only depend on the result of an action, but also on the way that it was performed. keywords: action; effect; harm; indirect; morality; participants; preference; reason; replication; sample cache: metapsychology-2134.pdf plain text: metapsychology-2134.txt item: #14 of 71 id: metapsychology-2162 author: Antonoplis, Stephen; Chen, Serena title: Four Failures to Demonstrate that Scarcity Magnifies Preference for Familiarity date: 2022-08-31 words: 12121 flesch: 56 summary: Scarcity condition depicted with filled circles and solid lines; control condition, with hollow circles and dashed lines. This preference was not significantly stronger in the control versus scarcity condition (B=-0.73, z=-0.61, p=.541, OR=0.48, 95% CI [0.05,5.02]), and it varied linearly across the bet worth conditions such that the familiar option was chosen most often when it was worth more than the unfamiliar option and less often when the two were equal in value or the unfamiliar option was worth more (B=-1.00, z=-3.01, p=.003, OR=0.37, 95% CI [0.19,0.71]). keywords: condition; data; effect; familiarity; fruit; names; participants; people; preference; results; scarcity; stimuli; studies; study; time; unfamiliar cache: metapsychology-2162.pdf plain text: metapsychology-2162.txt item: #15 of 71 id: metapsychology-2238 author: Evans, Nathan title: What factors are most important in finding the best model of a psychological process? Comment on Navarro (2019) date: 2020-06-18 words: 6262 flesch: 46 summary: In contrast to Navarro, I argue that all possible data should be considered when evaluating a process model (i.e., not just data from novel contexts), that quantitative model selection meth- ods provide a more principled and complete method of selecting between process models than visual assessments of qualitative trends, and that the idea of ancillary assumptions that are not part of the core explanation in the model is a slippery slope to an infinitely flexible model. Process models make exact quantitative predic- tions about observed data that are the result of some unknown psychological process, and by attempting to see which models can best account for these observed data, we can better understand how this unknown pro- cess may actually operate. keywords: assumptions; data; methods; model; navarro; process; selection; trends cache: metapsychology-2238.pdf plain text: metapsychology-2238.txt item: #16 of 71 id: metapsychology-2266 author: Francis, Gregory; Thunell, Evelina title: Excess success in “Don’t count calorie labeling out: Calorie counts on the left side of menu items lead to lower calorie food choices” date: 2020-08-04 words: 4340 flesch: 56 summary: Many scientists take significant results that are replicated across multiple studies as strong sup- port for their conclusions. A set of studies with too much success likely misrepresents reality, and conclusions from such studies should be discount- ed until non-biased investigations can be per- formed. keywords: calorie; dallas; effect; power; studies cache: metapsychology-2266.pdf plain text: metapsychology-2266.txt item: #17 of 71 id: metapsychology-2289 author: van Sambeek, Nino; Lakens, Daniel title: Reviewers' Decision to Sign Reviews is Related to Their Recommendation date: 2021-02-19 words: 4524 flesch: 47 summary: The proportion of signed reviews was higher for more positive recommendations, than for more negative recommendations. Researchers self-report that they would be less likely to review for a journal if their identity is made pub- lic, and anecdotally mention that signed reviews would 2 make it more difficult to be honest about manuscripts they believe are poor quality (Mulligan, Hall, & Raphael, 2013). keywords: journals; peerj; recommendations; reviewers; reviews; royal; society cache: metapsychology-2289.pdf plain text: metapsychology-2289.txt item: #18 of 71 id: metapsychology-2460 author: Bartoš, František; Maier, Maximilian title: Power or Alpha? The Better Way of Decreasing the False Discovery Rate date: 2022-11-08 words: 6362 flesch: 63 summary: In this article, we compare two previously proposed solutions for decreasing the FDR: increasing statistical power and decreasing significance level α. While some papers emphasize the importance of increasing statistical power to decrease the FDR (Button et al., 2013; Christley, 2010), others call for decreasing α (Benjamin et al., 2018). keywords: effect; fdr; power; science; size; tea cache: metapsychology-2460.pdf plain text: metapsychology-2460.txt item: #19 of 71 id: metapsychology-2472 author: Miller, Jeff title: Another Warning About Median Reaction Time date: 2023-07-10 words: 11315 flesch: 48 summary: Meta-Psychology, 2023, vol 7, MP.2020.2472 https://doi.org/10.15626/MP.2020.2472 Article type: Original article Published under the CC-BY4.0 license Open data: Not Applicable Open materials: Yes Open and reproducible analysis: Yes Open reviews and editorial process: Yes Preregistration: No Edited by: Felix D. Schönbrodt Reviewed by: Lerche V., Rousselet G., Wilcox, R. Analysis reproduced by: Lucija Batinović All supplementary files can be accessed at OSF: https://doi.org/10.17605/OSF.IO/MEK4U Another Warning about Median Reaction Time Jeff Miller1 1University of Otago Contrary to the warning of Miller (1988), Rousselet and Wilcox (2020) argued that it is better to summarize each participant’s single-trial reaction times (RTs) in a given condition with the median than with the mean when comparing the central tendencies of RT distributions across experimental conditions. Miller (1988) warned that when RT distributions are skewed, as they usually are, median RTs are biased. keywords: bias; condition; difference; distributions; error; figure; means; medians; participant; power; rts; simulations; trials; type cache: metapsychology-2472.pdf plain text: metapsychology-2472.txt item: #20 of 71 id: metapsychology-2474 author: Chandrashekar, Subramanya ; Cheng‎, Yat Hin ; Fong‎, Chi Long ; Leung‎, Ying Chit ; Wong, Yui Tung; Cheng, Bo Ley ; Feldman, Gilad title: Frequency estimation and semantic ambiguity do not eliminate ‎conjunction bias, when it ‎occurs: Replication and extension of ‎Mellers, Hertwig, and Kahneman (2001)‎ date: 2021-12-09 words: 6910 flesch: 56 summary: Yes Edited by: Rickard Carlsson Reviewed by: Streamlined peer review Analysis reproduced by: Alexey Guzey All supplementary files can be accessed at the OSF project page: https://doi.org/10.17605/OSF.IO/DYNVT Frequency estimation and semantic ambiguity do not elimi- nate conjunction bias, when it occurs: Replication and exten- sion of Mellers, Hertwig, and Kahneman (2001) Subramanya Prasad Chandrashekar1 Lee Shau Kee School of Business and Administra- tion, Hong Kong Metropolitan University, Hong Kong SAR Bo Ley Cheng Department of Psychology, University of Hong Kong, Hong Kong SAR Yat Hin Cheng1, Chi Long Fong1, Ying Chit Leung1, Yui Tung Wong1 Department of Psychology, University of Hong Kong, Hong Kong SAR Gilad Feldman2 Department of Psychology, University of Hong Kong, Hong Kong SAR Mellers, Hertwig, and Kahneman (2001) conducted an adversarial collaboration to try and resolve Hertwig’s contested view that frequency formats eliminate conjunction effects, and that conjunction effects are largely due to semantic ambiguity. Linda profile findings were in sup- port of conjunction effect and consistent with Tversky and Kahneman’s (1983) arguments for a representative heuristic. keywords: condition; conjunction; effect; findings; frequency; james; linda; original; profile; replication; support cache: metapsychology-2474.pdf plain text: metapsychology-2474.txt item: #21 of 71 id: metapsychology-2506 author: Campbell, Harlan; Gustafson, Paul title: What to make of equivalence testing with a post-specified margin? date: 2021-09-06 words: 6900 flesch: 57 summary: When interpreting the results, the authors note that: “our choice of non-inferiority margin may seem to be overly generous; however, it is important to emphasize that, if the margin had been reduced to as low as 1.5%, the conclusions of this trial would not have changed,” (Jones et al., 2016). In the second case, while a margin was pre-defined, additional conclusions were made based on post-specified margins. keywords: data; equivalence; inferiority; journal; margin; non; testing; trial cache: metapsychology-2506.pdf plain text: metapsychology-2506.txt item: #22 of 71 id: metapsychology-2529 author: Hussey, Ian title: A method to streamline p-hacking date: 2021-04-01 words: 1375 flesch: 46 summary: Second, it retains a far more im- portant property of hacked p values: by guaranteeing significant results, it maintains predictive validity for publishability. Results from a simulation study demonstrate that decision making on the basis of traditional hacked p values and pointless are equivalent, and that the latter requires several orders of magni- tude less time and resources to calculate. keywords: hacking; science cache: metapsychology-2529.pdf plain text: metapsychology-2529.txt item: #23 of 71 id: metapsychology-2535 author: Mazei, Jens; Hüffmeier, Joachim title: Are Women Less Likely to Ask than Men Partly Because They Work Fewer Hours? A Commentary on Artz et al. (2018) date: 2021-12-16 words: 7676 flesch: 60 summary: Alternatively, the results by Artz et al. (2018) may suggest that weekly hours—an aspect of the division of labor—mediate gender differences in the propen- sity to initiate negotiations (see Paths 2 and 3 in Fig- ure 2). Some studies have already shed first light on the potential relevance of weekly hours for the emer- gence of gender differences in negotiation contexts (e.g., Luekemann & Abendroth, 2018; and, of course, the study by Artz et al., 2018). keywords: artz et; differences; eagly; et al; gender; hours; labor; negotiations; research; women; wood; work cache: metapsychology-2535.pdf plain text: metapsychology-2535.txt item: #24 of 71 id: metapsychology-2538 author: Tunca, Burak; Ziano, Ignazio; Wenting, Xu title: Super-Size Me: An Unsuccessful Preregistered Replication of the Effect of Product Size on Status Signaling date: 2022-01-27 words: 4640 flesch: 58 summary: We further illustrated this lack of evidence by plotting the model with portion size effect. Portion size effects vary: The size of food units is a bigger problem than the num- ber. keywords: effect; medium; original; portion; replication; size; status; study cache: metapsychology-2538.pdf plain text: metapsychology-2538.txt item: #25 of 71 id: metapsychology-2539 author: Pritsker, Joshua title: Comparing Bayesian Posterior Passing with Meta-analysis date: 2021-11-29 words: 3113 flesch: 55 summary: An alternative to creating posterior passing chains that still utilizes the posterior passing mechanism is to use it in meta-analyses. To overcome the limitations of simple posterior passing, I introduce improved posterior passing methods to account for heterogeneity and publication bias. keywords: meta; passing; posterior cache: metapsychology-2539.pdf plain text: metapsychology-2539.txt item: #26 of 71 id: metapsychology-2548 author: Vanhove, Jan title: Collinearity isn't a disease that needs curing date: 2021-04-12 words: 7058 flesch: 50 summary: Keywords: regression assumptions, multiple regression, interpreting regression models As researchers and students learn more about statisti- cal models, they sooner or later stumble across the term (multi)collinearity. Collinearity, which roughly means that the predictors in a statistical model are correlated with each other, is often cast as a problem for statis- tical analysis. tiple regression models. keywords: collinearity; estimates; figure; model; predictors; problem; regression; sample cache: metapsychology-2548.pdf plain text: metapsychology-2548.txt item: #27 of 71 id: metapsychology-2556 author: Klau, Simon; Felix; Patel, Chirag J.; Ioannidis, John P. A.; Boulesteix, Anne-Laure; Hoffmann, Sabine title: Comparing the vibration of effects due to model, data pre-processing and sampling uncertainty on a large data set in personality psychology date: 2023-05-10 words: 11728 flesch: 48 summary: Focusing on the two other types of vibration, data pre-processing vibration is larger for low sample sizes than model vibration, and decreases for increasing sample size, however, without approximating an ROR of 1. Through the joint in- vestigation of model and data pre-processing vibration, we can compare the relative impact of these two types of uncertainty and identify the most influential analytical choices. keywords: analysis; association; choices; data; effects; model; model vibration; pre; processing; results; sample; sampling; uncertainty; vibration cache: metapsychology-2556.pdf plain text: metapsychology-2556.txt item: #28 of 71 id: metapsychology-2560 author: Hanel, Paul title: Conducting High Impact Research With Limited Financial Resources (While Working from Home) date: 2020-11-06 words: 6978 flesch: 53 summary: Recommendations for performing secondary data analyses exist, for exam- ple, for social studies (Fitchett & Heafner, 2017), med- ical sciences (Cheng & Phillips, 2014), human biology (Rosinger & Ice, 2019), and qualitative research (Sherif, 2018). Importantly, encouraging researchers to conduct research using more secondary data analysis does not disregard primary empirical research. keywords: analysis; data; et al; example; meta; research; researchers; science; studies cache: metapsychology-2560.pdf plain text: metapsychology-2560.txt item: #29 of 71 id: metapsychology-2573 author: Bertoldo, Giulia; Zandonella Callegher, Claudio; Altoè, Gianmarco title: Designing Studies and Evaluating Research Results: Type M and Type S Errors for Pearson Correlation Coefficient date: 2022-01-18 words: 11683 flesch: 51 summary: Keywords: Correlation coefficient, Type M error, Type S error, Design analysis, Effect size https://doi.org/10.15626/MP.2020.2573 https://doi.org/10.17605/OSF.IO/3C6HU 2 Introduction Psychological science is increasingly committed to scrutinizing its published findings by promoting large- scale replication efforts, where the protocol of a previ- ous study is repeated as closely as possible with a new sample (Camerer et al., 2016; Camerer et al., 2018; Ebersole et al., 2016; Klein et al., 2014; Klein et al., 2018; Open Science Collaboration, 2015). Thus, given a study design, Type M error tells us what is the average overestimation of an effect that is statistically significant. Type S error is computed as the proportion of statisti- cally significant results that have the opposite sign com- pared to the plausible effect size. keywords: analysis; correlation; design; design analysis; effect; effect size; error; power; sample; size; study; type; type m cache: metapsychology-2573.pdf plain text: metapsychology-2573.txt item: #30 of 71 id: metapsychology-2577 author: Parsons, Sam title: Exploring reliability heterogeneity with multiverse analyses: Data processing decisions unpredictably influence measurement reliability date: 2022-11-08 words: 9961 flesch: 50 summary: One could use this method to perform inference testing against the curve of reliability estimates. These figures allow us to compare the patterns of reliability estimates following the same data processing decisions. keywords: analyses; data; data processing; decisions; estimates; https; measurement; multiverse; processing; reliability; reliability estimates; specifications; task; time; trials; version cache: metapsychology-2577.pdf plain text: metapsychology-2577.txt item: #31 of 71 id: metapsychology-2595 author: Mackinnon, Sean; Curtis, Robin; O'Connor, Roisin title: A Tutorial in Longitudinal Measurement Invariance and Cross-lagged Panel Models Using Lavaan date: 2022-04-04 words: 8733 flesch: 58 summary: Fortunately, testing for measurement invariance in cross-lagged panel models has become easier, thanks to the wide availability of R and its packages. This paper serves as a tutorial in testing for measurement invariance and cross-lagged panel models using the lavaan package. keywords: data; days; factor; fit; intercepts; invariance; measurement; model; panel; residual; time; variables cache: metapsychology-2595.pdf plain text: metapsychology-2595.txt item: #32 of 71 id: metapsychology-2598 author: Cipora, Krzysztof; Nuerk, Hans-Christoph title: What the Attentional-SNARC and its (null) replications can and cannot tell us date: 2023-07-10 words: 3358 flesch: 51 summary: Not only does processing of numbers influence spatial processing, but directional actions in space affect number processing as well. In a similar vein, studies on patients with neglect show the impairment of number processing when spatial process- ing is distorted (e.g., Vuilleumier et al., 2004). keywords: att; link; numbers; snarc; space cache: metapsychology-2598.pdf plain text: metapsychology-2598.txt item: #33 of 71 id: metapsychology-2601 author: Fox, Nicholas; Honeycutt, Nathan; Jussim, Lee title: Better Understanding the Population Size and Stigmatization of Psychologists Using Questionable Research Practices date: 2022-03-07 words: 13827 flesch: 52 summary: In other words, QRP users disclose their QRP-use identity information to other QRP users rather than disclose to individuals with an unknown QRP-use status. Additionally, attitudes of psychologists towards QRP users, and ego network data collected from self-reported QRP users, suggest that QRP users are a stigmatized sub-population of psychologists. keywords: estimate; group; identity; network; number; participants; population; prevalence; psychologists; qrp; qrp users; qrps; research; researchers; self; size; stigma; study cache: metapsychology-2601.pdf plain text: metapsychology-2601.txt item: #34 of 71 id: metapsychology-2625 author: van den Akker, Olmo R.; Weston, Sara; Campbell, Lorne; Chopik, Bill; Damian, Rodica; Davis-Kean, Pamela; Hall, Andrew; Kosie, Jessica; Kruse, Elliott; Olsen, Jerome; Ritchie, Stuart; Valentine, KD; van 't Veer, Anna; Bakker, Marjan title: Preregistration of secondary data analysis: A template and tutorial date: 2021-11-09 words: 12422 flesch: 57 summary: Other options exist to increase error control and illustrate sensitivity to flexibility in data analysis, however. Meta-Psychology, 2021, vol 5, MP.2020.2625, https://doi.org/10.15626/MP.2020.2625 Article type: Tutorial Published under the CC-BY4.0 license Open data: Not applicable Open materials: Not applicable Open and reproducible analysis: Not applicable Open reviews and editorial process: Yes Preregistration: No Edited by: Erin M. Buchanan Reviewed by: Williams, M. & Dunleavy, D. Analysis reproduced by: Not applicable All supplementary files can be accessed at the OSF project page: https://doi.org/10.17605/OSF.IO/U68Y7 Preregistration of secondary data analysis: A template and tutorial Olmo R. van den Akker Department of Methodology and Statistics, Tilburg Uni- versity Lorne Campbell Department of Psychology, University of Western On- tario Rodica Ioana Damian Department of Psychology, University of Houston Andrew N. Hall Department of Psychology, Northwestern University Elliott Kruse EGADE Business School, Tec de Monterrey Stuart J. Ritchie Social, Genetic and Developmental Psychiatry Centre, King’s College Anna E. van ‘t Veer Methodology and Statistics Unit, Institute of Psychol- ogy, Leiden University Sara J. Weston Department of Psychology, University of Oregon William J. Chopik Department of Psychology, Michigan State University Pamela E. Davis-Kean Department of Psychology, University of Michigan Jessica E. Kosie Department of Psychology, Princeton University Jerome Olsen Department of Applied Psychology: Work, Education and Economy, University of Vienna Max Planck Insti- tute for Research on Collective Goods K. D. Valentine Division of General Internal Medicine, Massachusetts General Hospital Marjan Bakker Department of Methodology and Statistics, Tilburg Uni- versity Preregistration has been lauded as one of the solutions to the so-called ‘crisis of confi- dence’ in the social sciences and has therefore gained popularity in recent years. keywords: analysis; data; data analysis; dataset; information; knowledge; preregistration; prosociality; question; religiosity; research; sample; size; study; template; use; variables cache: metapsychology-2625.pdf plain text: metapsychology-2625.txt item: #35 of 71 id: metapsychology-2626 author: Hostler, Tom title: The Importance of Rigorous Methods in a Growing Research Field: Five Practices for ASMR Researchers date: 2022-06-07 words: 8220 flesch: 48 summary: In addition, I invite ASMR researchers to sign up to a mailing list we have created for shar- ing ASMR research news and collaboration opportuni- ties: https://asmr-net.us1.list-manage.com/subscribe? ASMR research has a clear unique focus, which helps to differentiate it from the study of other sensory experiences. keywords: asmr; data; doi; https; research; researchers; response; science; study cache: metapsychology-2626.pdf plain text: metapsychology-2626.txt item: #36 of 71 id: metapsychology-2628 author: Sætrevik, Bjørn; Sjåstad, Hallgeir title: Mortality salience effects fail to replicate in traditional and novel measures date: 2022-01-17 words: 14273 flesch: 53 summary: No conceptual replication of MS effect on novel es- says For Experiment 1 we constructed novel essays for measuring MS effects on preferences for democratic val- ues. The dominant theoretical frame- work to account for MS effects has been the “terror management theory” (TMT, Greenberg et al., 1986; Pyszczynski et al., 2015). keywords: death; effect; essay; et al; experiment; group; manipulation; mortality; ms effects; ms group; participants; pro; task; test cache: metapsychology-2628.pdf plain text: metapsychology-2628.txt item: #37 of 71 id: metapsychology-2637 author: Denison, Alexander; Wiernik, Brenton title: Careless Response Processes are Heterogeneous: Comment on Goldammer et al. (2020) date: 2022-11-08 words: 4250 flesch: 43 summary: These two conceptualizations of careless response be- havior are reflected in the metrics that have been devel- oped to catch these respondents. Identifying careless responses in survey data [[Online; accessed 2018-08-21]]. keywords: behavior; goldammer; participants; random; responding; response cache: metapsychology-2637.pdf plain text: metapsychology-2637.txt item: #38 of 71 id: metapsychology-2640 author: Fillon, Adrien; Souchet, Lionel; Pascual, Alexandre; Girandola, Fabien title: The Effectiveness of the “But-you-are-free” technique: Meta-analysis and re-examination of the technique date: 2023-07-10 words: 13647 flesch: 63 summary: The sampling error explained 22% of the variation in effect size. Concerning the analysis of publication bias, Carpenter correlated the sample sizes and effect sizes and found an r = -.30. keywords: analysis; bias; byaf; byaf technique; carpenter; effect; et al; face; face france; france; guéguen; meta; pascual; pascual et; size; studies; technique cache: metapsychology-2640.pdf plain text: metapsychology-2640.txt item: #39 of 71 id: metapsychology-2711 author: Dienlin, Tobias; Sun, Ye title: Does the privacy paradox exist? Comment on Yu et al.’s (2020) meta-analysis date: 2021-11-29 words: 7106 flesch: 50 summary: Empirically, the privacy paradox is tested by analyz- ing the relationship between privacy cognitions (e.g., privacy attitudes, privacy concerns, or perceived privacy risk) and privacy behavior (e.g., information disclosure https://doi.org/10.15626/MP.2020.2711 https://doi.org/10.17605/OSF.IO/XWVED 2 or privacy protection) Namely, privacy paradox exists.” keywords: behavior; concerns; disclosure; effect; et al; hypothesis; privacy; privacy concerns; privacy paradox; research; yu et cache: metapsychology-2711.pdf plain text: metapsychology-2711.txt item: #40 of 71 id: metapsychology-2718 author: Heyman, Tom; Vanpaemel, Wolf title: Multiverse analyses in the classroom date: 2022-12-19 words: 9318 flesch: 49 summary: For instance, multiverse analyses have been applied in the context of meta-analyses (Voracek et al., 2019), suggested as an approach to deal with different random effect structures of multi-level models (Harder, 2020), and used in combination with so-called explorable explanations allowing readers of a paper to dynamically move through the multiverse (Dragicevic et al., 2019). In addition, Liu et al. (2020) recently devel- oped a programming tool called Boba, which helps re- searchers to conduct and visualize multiverse analyses, whereas others have developed specific R packages to facilitate multiverse analyses (e.g., Masur & Scharkow, 2019; Sarma & Kay, 2019). keywords: analysis; data; et al; https; multiverse; multiverse analysis; project; psychology; research; results; science; students cache: metapsychology-2718.pdf plain text: metapsychology-2718.txt item: #41 of 71 id: metapsychology-2741 author: Cristia, Alejandrina; Tsuji, Sho; Bergmann, Christina title: A meta-analytic approach to evaluating the explanatory adequacy of theories date: 2022-06-07 words: 10870 flesch: 52 summary: Lit contains enough studies? Y N Code CAMA studies for theory relevance Code quality in CAMA studies Do CAMA studies sample generalization space? Y N Incorporate controls for heterogeneity Consider educational opportunities Do you have enough power? The two traditional and most widespread ap- proaches use single studies and non-systematic narrative reviews to evaluate theories’ explanatory adequacy; more recently, large-scale replications entered the picture. keywords: analyses; camas; data; et al; example; meta; reviews; science; scope; step; studies; study; theories; theory cache: metapsychology-2741.pdf plain text: metapsychology-2741.txt item: #42 of 71 id: metapsychology-2762 author: Neequaye, David A. title: A Theory of Ethics to Guide Investigative Interviewing Research date: 2023-03-09 words: 11108 flesch: 40 summary: The proposed ethical standard may as- sist in regulating researchers’ creation and publication of psychological interviewing techniques. Many existing scientific publications recom- mend such psychological interviewing techniques (see, Vrij, Fisher, et al., 2017; Vrij and Granhag, 2014 for overviews). keywords: agency; ethics; information; intelligence; interviewees; interviewing; methods; principles; psychological; psychologists; psychology; research; scharff; standard; technique cache: metapsychology-2762.pdf plain text: metapsychology-2762.txt item: #43 of 71 id: metapsychology-2764 author: Bonetto, Eric; Carsel, Timothy S; Adam-Troian, Jais; Varet, Florent ; Keeran, Lindsay M; Lo Monaco, Grégory; Piermattéo, Anthony title: Group Membership and Deviance Punishment: Are Deviant Ingroup Members Actually Judged more Negatively than Outgroup Ones? date: 2023-01-27 words: 6380 flesch: 55 summary: Keywords: Deviance, Punishment, Subjective Group Dynamics, Replication An important focus of social-psychological research about deviance pertains to the way social groups re- act toward members who deviate from group norms (Abrams, 2010). Social categorization, social identification, and rejection of deviant group members. keywords: deviance; deviant; effect; fans; group; ingroup; marques; members; participants; psychology; punishment; social; studies; study cache: metapsychology-2764.pdf plain text: metapsychology-2764.txt item: #44 of 71 id: metapsychology-2803 author: McKay, Brad; Yantha, Zachary; Hussien, Julia; Carter, Michael; Ste-Marie, Diane title: Meta-Analytic Findings of the Self-Controlled Motor Learning Literature: Underpowered, Biased, and Lacking Evidential Value date: 2022-11-08 words: 19051 flesch: 58 summary: 13 -2 -1 0 1 2 3 4 Standardized Mean Difference Wulf et al., 2017 (Exp. 2) Wulf et al., 2017 (Exp. 1) Wulf et al., 2015 Wulf & Toole, 1999 Wulf & Adams, 2014 Williams et al., 2017 Tsai & Jwo, 2015 Ste-Marie et al., 2013 Post et al., 2014 Post et al., 2011 Post et al., 2016 Patterson & Carter, 2010 Marques & Correa, 2016 Lim et al., 2015 Lewthwaite et al., 2015 (Exp. 2) Lewthwaite et al., 2015 (Exp. 1) Lessa & Chiviacowsky, 2015 Leiker et al., 2016 Kim et al., 2019 Kaefer et al., 2014 Ikodome et al., 2019 (Exp. 2) Ikodome et al., 2019 (Exp. 1) Hartman, 2007 Hansen et al., 2011 Grand et al., 2017 Grand et al., 2015 Figueiredo et al., 2018 Ferreira et al., 2019 Fairbrother et al., 2012 Chiviacowsky et al., 2012.2 Chiviacowsky et al., 2008 Chiviacowsky et al., 2012.1 Chiviacowsky & Wulf, 2002 Chiviacowsky & Lessa, 2017 Chiviacowsky, 2014 Barros et al., 2018 (Exp. 2) Barros et al., 2018 (Exp. 1) Andrieux et al, 2016 Ali et al., 2012 Aiken et al., 2012 Wu, 2007 (Exp. 1) von Lindern, 2017 Rydberg, 2011 Ostrowski & Porter, 2015 Holmberg, 2013 Ho, 2016 Bass, 2015 Barros, 2010 (random) Barros, 2010 (blocked) Arsal, 2004 (Exp. 2) Arsal, 2004 (Exp. 1) Alami, 2013 0.76 [ 0.11, 1.41] 0.82 [ 0.11, 1.53] 0.63 [ 0.15, 1.11] 0.81 In one experiment by M. J. Carter et al. (2014), self-control participants were provided with choice over receiving knowledge of results, but divided into three experimental groups; those who could make their knowledge of results decision before the trial, af- ter the trial, or both (they would decide before, but could change their mind following the trial). keywords: adult; analysis; bias; control; curve; data; effect; et al; experiments; feedback; group; lab; learning; model; motor; motor learning; practice; results; self; wulf; yes cache: metapsychology-2803.pdf plain text: metapsychology-2803.txt item: #45 of 71 id: metapsychology-2808 author: Neequaye, David A.; Mac Giolla, Erik title: The Use of the Term Rapport in the Investigative Interviewing Literature: A critical Examination of Definitions date: 2022-06-14 words: 11012 flesch: 54 summary: Rather, we have drawn at- tention to the commonality and the scope of variance in rapport definitions. Even if one grants the view that different contexts require different rapport definitions, in ways, this argu- mentation only exacerbates the issue. keywords: analysis; attributes; definitions; https; interaction; interviewee; interviewing; literature; personality; psychology; rapport; research; term cache: metapsychology-2808.pdf plain text: metapsychology-2808.txt item: #46 of 71 id: metapsychology-2837 author: Höfler, Michael; Scherbaum, Stefan; Kanske, Philipp; McDonald, Brennan; Miller, Robert title: Means to valuable exploration: I. The blending of confirmation and exploration and how to resolve it date: 2022-11-08 words: 9835 flesch: 54 summary: Publication bias: The file-drawer problem in scientific inference, Journal of Scientific Exploration, 14(1), 91-106. Scheel, A. M., Schijen, M. R. M. J., & Lakens, D. (2021a). Science, 349. 10.1126/science.aac4716 Agnoli, F., Wicherts, J. M., Veldkamp, C. L. S., Albiero, P., & Cubelli, R. (2017). keywords: analysis; confirmation; data; et al; exploration; hypothesis; new; norm; preregistration; psychology; research; results; science cache: metapsychology-2837.pdf plain text: metapsychology-2837.txt item: #47 of 71 id: metapsychology-2840 author: Topor, Marta; Pickering, Jade S; Barbosa Mendes, Ana; Bishop, Dorothy V M; Büttner, Fionn; Elsherif, Mahmoud M; Evans, Thomas R; Henderson, Emma L; Kalandadze, Tamara; Nitschke, Faye T; Staaks, Janneke P C; van den Akker, Olmo R; Yeung, Siu Kit; Zaneva, Mirela; Lam, Alison; Madan, Christopher R; Moreau, David; O'Mahony, Aoife; Parker, Adam J; Riegelman, Amy ; Testerman, Meghan; Westwood, Samuel J title: An integrative framework for planning and conducting Non-Intervention, Reproducible, and Open Systematic Reviews (NIRO-SR). date: 2023-07-10 words: 8069 flesch: 40 summary: The popularity of these tools is evident through endorsement- from a number of journals (see PRISMA endorsers for an exam- ple), university libraries, and collaborative groups spe- cialised in conducting systematic reviews (see the list of recommended systematic review tools by the EQUA- TOR network). These excel- lent guidelines have been adopted as the gold-standard for systematic reviews as an evidence synthesis method. keywords: guidelines; intervention; items; meta; niro; non; pre; reporting; research; reviews; systematic; tool cache: metapsychology-2840.pdf plain text: metapsychology-2840.txt item: #48 of 71 id: metapsychology-2911 author: Leising, Daniel; Grenke, Oliver; Cramer, Marcos title: Visual Argument Structure Tool (VAST) Version 1.0 date: 2023-07-10 words: 12584 flesch: 58 summary: The word bat is a homonym for concepts X and Y, whereas the words fu- rious and enraged are synonyms for concept Z an IF-THEN relation: IF an object is an exemplar of the respective concept, THEN one may call this object by the respective name. For exam- ple: Is the thing that is called “narcissism” by author A the same as the thing that is called “narcissism” by author B (e.g., in terms of its assumed or shown re- lationships with other concepts)? keywords: argument; case; concepts; daniel; display; example; figure; note; objects; perspective; reasoning; relationship; type; use; values; vast cache: metapsychology-2911.pdf plain text: metapsychology-2911.txt item: #49 of 71 id: metapsychology-2923 author: Bucyibaruta, Joy Blaise; Maidment, Leah ; Heese, Carl August Daniel ; Peu, Mmapheko Doriccah ; Bamford, Lesley ; van der Wath, Annatjie Elizabeth ; Grobler, Estelle ; Musekiwa, Alfred title: Current Understanding of Maternal Healthcare Acceptability from Patients’ Perspectives: A scoping review protocol date: 2022-06-07 words: 6942 flesch: 47 summary: Thus, this study aims at reviewing existing literature to shed light on the definition and conceptualisation of maternal healthcare acceptability from the patients’ perspectives. However, those researchers had different conceptions of maternal healthcare acceptability. keywords: acceptability; data; experts; healthcare; healthcare acceptability; research; researchers; review; screening; studies; study cache: metapsychology-2923.pdf plain text: metapsychology-2923.txt item: #50 of 71 id: metapsychology-2932 author: Koppel, Lina ; Andersson, David ; Tinghög, Gustav ; Västfjäll, Daniel ; Feldman, Gilad title: We are all less risky and more skillful than our fellow drivers: Successful replication and extension of Svenson (1981)‎ date: 2023-05-10 words: 6453 flesch: 60 summary: 8 Maryland (n= 6 ) Iowa (n= 5 ) Colorado (n= 6 ) Pennsylvania (n= 25 ) Illinois (n= 19 ) New York (n= 17 ) Minnesota (n= 5 ) Kentucky (n= 6 ) Arkansas (n= 5 ) keywords: average; drivers; effect; participants; ratings; replication; safety; scale; skill; study cache: metapsychology-2932.pdf plain text: metapsychology-2932.txt item: #51 of 71 id: metapsychology-2938 author: McKay, Brad; Carter, Michael title: A critical re-analysis of six implicit learning papers date: 2023-07-10 words: 7587 flesch: 51 summary: Effect sizes, confidence intervals, and confidence intervals for effect sizes. Benchmarks have been suggested for small, medium, and large effect sizes as η2 = .01, .06, and .14, respectively (Cohen, 1988). keywords: article; authors; data; effect; group; lola; sizes; test; time; version cache: metapsychology-2938.pdf plain text: metapsychology-2938.txt item: #52 of 71 id: metapsychology-3078 author: Bartlett, James; Charles, Sarah title: Power to the People: A Beginner’s Tutorial to Power Analysis using jamovi date: 2022-11-08 words: 14527 flesch: 60 summary: In part two, we outline the decisions you must make when performing a power analysis, like choosing your alpha, beta, and smallest effect size of interest. If we follow the black curve towards the bot- tom left, power decreases for smaller effect sizes. keywords: alpha; effect size; group; interest; participants; power; power analysis; research; sample; sample size; sizes; study; test; use; value cache: metapsychology-3078.pdf plain text: metapsychology-3078.txt item: #53 of 71 id: metapsychology-3270 author: Höfler, Michael; McDonald, Brennan; Kanske, Philipp; Miller, Robert title: Means to valuable exploration II: How to explore data to modify existing claims and create new ones date: 2023-07-10 words: 10035 flesch: 51 summary: Such findings are the cost of enjoying comprehensiveness in data exploration. In this second article of two con- secutive parts, we outline how to explore data patterns that inform such claims. keywords: analysis; association; claims; data; doi; exploration; exploratory; https; methods; org; patterns; psychology; research; science; smoothing cache: metapsychology-3270.pdf plain text: metapsychology-3270.txt item: #54 of 71 id: metapsychology-3271 author: Hüffmeier, Joachim; Mertes, Marc title: Unfortunately, Journals in Industrial, Work, and Organizational Psychology Still Fail to Support Open Science Practices date: 2023-07-10 words: 7384 flesch: 64 summary: 1037 / met0000365 Asendorpf, J. B., Conner, M., De Fruyt, F., De Houwer, J., Denissen, J. J. A., Fiedler, K., Fiedler, S., Funder, D. C., Kliegl, R., Nosek, B. A., Perug- ini, M., Roberts, B. W., Schmitt, M., Van Aaken, M. A. G., Weber, H., & Wicherts, J. M. (2013). https://doi.org/10.1371/ journal.pone.0021101 Tipu, S. A. A., & Ryan, J. C. (2021). keywords: management; psychology; research; science cache: metapsychology-3271.pdf plain text: metapsychology-3271.txt item: #55 of 71 id: metapsychology-839 author: Carlsson, Rickard; Danielsson, Henrik; Heene, Moritz; Innes-Ker, Åse; Lakens, Daniël; Schimmack, Ulrich; Schönbrodt, Felix D.; van Asssen, Marcel; Weinstein, Yana title: Inaugural Editorial of Meta-Psychology date: 2017-12-11 words: 2160 flesch: 43 summary: We believe that it is time to create a specialized jour- Affiliations: Rickard Carlsson, Linnaeus University, Swe- den; Henrik Danielsson, Linköping University, Sweden and The Swedish Institute for Disability Research, Sweden; Moritz Heene, Ludwig-Maximilians-University Munich, Ger- many; Åse Innes-Ker, Lund University, Sweden; Daniël Lak- ens, Eindhoven University of Technology, The Netherlands; Ulrich Schimmack, University of Toronto, Canada; Felix D. Schönbrodt, Ludwig-Maximilians-University Munich, Ger- many; Marcel van Assen, Tilburg University and Utrecht Uni- versity, The Netherlands; Yana Weinstein, University of Mas- sachusetts, Lowell, USA nal that publishes articles in the emerging field of meta- psychological research; a journal that questions the ba- sic assumptions of research paradigms and monitors the progress of psychological science as a whole. Åse Innes-Ker (Lund University, Sweden) • Daniël Lakens (Eindhoven University of Technology, The Netherlands) • Felix Schönbrodt (Ludwig-Maximilians-University Munich, Germany) • Marcel van Assen (Tilburg University, and Utrecht University, The Netherlands) • Yana Weinstein (University of Massachusetts, Lowell, USA) Advisory board (2017 – 2021) • Nick Brown (University of Groningen, The Netherlands) • Paul Bürkner (University of Münster, Germany) • Gary Burns (Wright State University, USA) • Cody Christopherson (Southern Oregon University, USA) • James Coyne (University of Pennsylvania, USA) • Malte Elson (Ruhr University Bochum, Germany) • keywords: journal; meta; psychology; research; science; university cache: metapsychology-839.pdf plain text: metapsychology-839.txt item: #56 of 71 id: metapsychology-840 author: Brand, Charlotte Olivia; Ounsley, James Patrick; van der Post, Daniel Job; Morgan, Thomas Joshua Henry title: Cumulative Science via Bayesian Posterior Passing: An Introduction date: 2019-06-24 words: 8384 flesch: 52 summary: Here, we describe and test another approach to cumulative science, “pos- terior passing”, which is a straightforward extension of Bayesian methods of data analysis. The simulation In this section we present a simulation of the sci- entific process, testing the hypothesis that posterior passing will benefit science relative to other meth- ods of data analysis and avoid the accumulation of large, ambiguous literatures. keywords: analysis; bayesian; data; effect; glmm; hypothesis; meta; passing; posterior; probability; results; science cache: metapsychology-840.pdf plain text: metapsychology-840.txt item: #57 of 71 id: metapsychology-842 author: Hüffmeier, Joachim; Krumm, Stefan title: No Myth far and wide:: Relay Swimming is Faster than Individual Swimming and the Conclusion of Skorski et al. (2016) is Unfounded date: 2018-08-09 words: 6043 flesch: 51 summary: Specifically, we observed relay swimming times that were only 0.008 s (position 2) and 0.031 s (position 3) faster than the respective individual times—as com- pared to 0.202 s faster times at relay position 4. Keywords: teams; groups; performance gains; effort gains; relay swimming; reaction-time cor- rection; exchange-block times Meta-Psychology, 2018, vol 2, MP.2018.842, https://doi.org/10.15626/MP.2018.842 Article type: Commentary Published under the CC-BY4.0 license Preregistration: N/A Preprint: https://doi.org/10.17605/osf.io/szx45 Data, Code and Materials: https://doi.org/10.17605/osf.io/yt2dq Edited by: Rickard Carlsson Reviewed by: Andreas Ivarsson & Ulrich Schimmack Peer review report: https://doi.org/10.17605/osf.io/dzw8c Editorial history: https://doi.org/10.17605/osf.io/rq4fv In their recent study, Skorski, Extebarria, and Thompson (2016) set out to show that our findings (Hüffmeier, Krumm, Kanthak, & Hertel, 2012) are un- founded or, in their words, “a myth” (cf. keywords: et al; hüffmeier; individual; relay; skorski; swimming cache: metapsychology-842.pdf plain text: metapsychology-842.txt item: #58 of 71 id: metapsychology-843 author: LeBel, Etienne Philippe; Vanpaemel, Wolf; Cheung, Irene; Campbell, Lorne title: A Brief Guide to Evaluate Replications date: 2019-06-14 words: 4257 flesch: 38 summary: Finally, we propose the use of clearer and less ambiguous language to more effectively communicate the results of replication studies. Replication-Specific Study Characteristics When evaluating replication studies, the following three study characteristics are of crucial importance: keywords: effect; original; psychology; replication; results; signal; study cache: metapsychology-843.pdf plain text: metapsychology-843.txt item: #59 of 71 id: metapsychology-869 author: Beffara Bret, Brice; Beffara Bret, Amélie; Nalborczyk, Ladislas title: A fully automated, transparent, reproducible, and blind protocol for sequential analyses date: 2021-05-12 words: 10799 flesch: 49 summary: We show how to synchronise open and free experiment software programs with the Open Science Framework and how to automate sequential data analyses in R. This tutorial is intended to researchers with beginner experience with R but no previous experience with sequential analyses is required. In the context of sequential data analysis, it can be even more important. keywords: analysis; biases; collection; data; data analysis; data collection; experimenter; https; hypothesis; lisa; methods; open; osf; procedure; results; science; testing cache: metapsychology-869.pdf plain text: metapsychology-869.txt item: #60 of 71 id: metapsychology-870 author: Meule, Adrian title: Contemporary Understanding of Mediation Testing date: 2019-01-28 words: 4440 flesch: 48 summary: (2018) …closeness, dependability, and anxiety on resilience through self-care and self- efficacy - Followed the causal steps logic by stating that significant direct effects suggest “partial mediation” (p. 19) Bhalla et al. Path c’ represents the relationship between X and Y when controlling for M (direct effect). keywords: causal; doi; effect; hayes; indirect; mediation; steps; variable cache: metapsychology-870.pdf plain text: metapsychology-870.txt item: #61 of 71 id: metapsychology-871 author: Witt, Jessica K. title: Insights into Criteria for Statistical Significance from Signal Detection Analysis date: 2019-03-11 words: 7971 flesch: 56 summary: Panel b shows the relationship between p value and Bayes in the range for which p values are highest (the inset shows the relationship for the entire range, and the dotted box shows the area that has been expanded in the main figure). AUCs were equivalent for p values and Bayes factors and were slightly higher for effect size. keywords: bayes; criterion; discriminability; effect; statistical; studies; values cache: metapsychology-871.pdf plain text: metapsychology-871.txt item: #62 of 71 id: metapsychology-872 author: Williams, Donald; Bürkner, Paul-Christian title: Coding Errors Lead to Unsupported Conclusions: A critique of Hofmann et al. (2015) date: 2020-07-13 words: 2517 flesch: 56 summary: Yes Preregistration: N/A Edited by: Marcel van Assen Reviewed by: M. van Assen, R. van Aert Analysis reproduced by: André Kalmendal All supplementary files can be accessed at OSF: https://doi.org//10.17605/OSF.IO/J2QGS Coding Errors Lead to Unsupported Conclusions: A critique of Hofmann et al. (2015) Donald R. Williams University of California, Davis, USA Paul-Christian Bürkner Aalto University, Finland Abstract We have detected coding errors in the meta-analysis of Hofmann et al. We demonstrate that, after correcting these errors and reanalysing the data, the main conclusions of Hofmann et al. keywords: effect; et al; hofmann; symptoms cache: metapsychology-872.pdf plain text: metapsychology-872.txt item: #63 of 71 id: metapsychology-874 author: Brunner, Jerry; Schimmack, Ulrich title: Estimating Population Mean Power Under Conditions of Heterogeneity and Selection for Significance date: 2020-05-31 words: 16019 flesch: 58 summary: Effect size distribution for Study 3 0.0 0.5 1.0 1.5 2.0 2.5 0 1 2 3 4 5 Effect Size Distribution Cohen's d D en si ty 0.0 0.5 1.0 1.5 2.0 2.5 0 1 2 3 4 5 Effect Size Distribution Cohen's d D en si ty 0.0 0.5 1.0 1.5 2.0 2.5 0 1 2 3 4 5 Effect Size Distribution Cohen's d D en si ty 0.0 0.5 1.0 1.5 2.0 2.5 0 1 2 3 4 5 Effect Size Distribution Cohen's d D en si ty 0.0 0.5 1.0 1.5 2.0 2.5 0 1 2 3 4 5 Effect Size Distribution Cohen's d D en si ty 0.0 0.5 1.0 1.5 2.0 2.5 0 1 2 3 4 5 Effect Size Distribution Cohen's d D en si ty Correlation: black = 0; red = -.8 Power: solid = 25%, dots = 50%, dashes = 75% Average performance. For any population of sig- nificant results, there is a population of power values of the statistical tests on which conclusions are based. keywords: = n; curve; distribution; effect size; mean; mean power; model; population; power; results; sample; sample size; selection; significance; size; studies; test cache: metapsychology-874.pdf plain text: metapsychology-874.txt item: #64 of 71 id: metapsychology-880 author: Imhoff, Roland; Messer, Mario title: In search of Experimental Evidence for Secondary Antisemitism: A File Drawer Report date: 2019-02-16 words: 16369 flesch: 54 summary: The (in hindsight severely underpowered) study “worked” perfectly: Reminding German participants of ongoing Jewish suffering led to an increase in antisemitism (compared to baseline), but only if they felt that untruthful (but socially desirable) responding was futile as we would detect such lies. General Discussion Across a research program spanning two years and eight studies, we did not provide evidence for the no- tion that reminders of the Holocaust evoke negative re- sponses towards Jews among German participants. keywords: antisemitism; condition; control; effect; evidence; group; guilt; holocaust; imhoff; items; jewish; participants; person; pipeline; psychology; social; studies; study; suffering; victims; world cache: metapsychology-880.pdf plain text: metapsychology-880.txt item: #65 of 71 id: metapsychology-884 author: Niemeyer, Helen; van Aert, Robbie C.M.; Schmid, Sebastian; Uelsmann, Dominik; Knaevelsrud, Christine; Schulte-Herbrueggen, Olaf title: Publication Bias in Meta-Analyses of Posttraumatic Stress Disorder Interventions date: 2020-11-11 words: 19935 flesch: 72 summary: This study has two aims: (1) investigate whether the application of publication bias methods is warranted in psy- chotherapy research on posttraumatic stress disorder (PTSD) and (2) investigate the de- gree and impact of publication bias in meta-analyses of the efficacy of psychotherapeutic treatment for PTSD. The development of publication bias methods and recommendations to apply these methods will likely yield a more routinely assessment of publica- tion bias in meta-analyses. keywords: analysis; cbt; data; effect; kimp =; meta; methods; post; ptsd; publication bias; sets; size; studies; symptoms; z =; τ = cache: metapsychology-884.pdf plain text: metapsychology-884.txt item: #66 of 71 id: metapsychology-892 author: Clyburne-Sherin, April; Fei, Xu; Green, Seth Ariel title: Computational Reproducibility via Containers in Psychology date: 2019-11-12 words: 4459 flesch: 51 summary: the availability of psychological research data af- ter the storm. Recent studies suggest, however, that sharing code and data does not suffice for computational reproducibility —defined as the ability of researchers to reproduce “par- ticular analysis outcomes from the same data set using the same code and software” (Fidler and Wilcox, 2018). keywords: authors; capsule; code; computational; data; ocean; reproducibility; reproducible; research; results cache: metapsychology-892.pdf plain text: metapsychology-892.txt item: #67 of 71 id: metapsychology-894 author: Holtz, Peter title: Two Questions to Foster Critical Thinking in the Field of Psychology: Are There Any Reasons to Expect a Different Outcome, and What Are the Consequences If We Don’t Find What We Were Looking For? date: 2020-07-30 words: 9916 flesch: 55 summary: Of course, research questions regarding the de- gree to which behavior is under conscious control are valuable. It should be noted that Bem’s habit of using data to show his point—which he likely em- ployed during most of his prodigious 50 plus-year career in social psychology—was only regarded as problematic after he attacked a widespread com- mon sense assumption: Human beings don’t have precognitive abilities. keywords: bargh; colleagues; platt; priming; psychology; questions; research; science; studies; theories; theory; thinking cache: metapsychology-894.pdf plain text: metapsychology-894.txt item: #68 of 71 id: metapsychology-895 author: Witt, Jessica K. title: Graph Construction: An Empirical Investigation on Setting the Range of the Y-Axis date: 2019-11-08 words: 9976 flesch: 69 summary: Keywords: Graph Design, Effect size, Sensitivity, Bias One way to lie with statistics is to set the range of the y-axis to form a misleading impression of the data. When the visual size of the effect aligns with the actual size of the effect, the person reading the graph does not have to exert mental effort to decode effect size from the graph. keywords: axis; bias; data; effect; graphs; minimal; range; size cache: metapsychology-895.pdf plain text: metapsychology-895.txt item: #69 of 71 id: metapsychology-898 author: Haverkamp, Nicolas; Beauducel, André title: Differences of Type I error rates for ANOVA and Multilevel-Linear-Models using SAS and SPSS for repeated measures designs date: 2019-09-02 words: 7698 flesch: 56 summary: No Edited by: Rickard Carlsson Reviewed by: Oscar Olvera, Paul Lodder Analysis reproduced by: Jack Davis All supplementary files can be accessed at the OSF project page: https://osf.io/em62j/ Differences of Type I error rates for ANOVA and Multilevel- Linear-Models using SAS and SPSS for repeated measures designs Nicolas Haverkamp University of Bonn André Beauducel University of Bonn To derive recommendations on how to analyze longitudinal data, we examined Type I error rates of Multilevel Linear Models (MLM) and repeated measures Analysis of Variance (rANOVA) using SAS and SPSS. Moreover, we performed a literature search for simulation studies on MLM software packages. keywords: data; error; mlm; models; ranova; rates; results; sas; sphericity; spss; type cache: metapsychology-898.pdf plain text: metapsychology-898.txt item: #70 of 71 id: metapsychology-933 author: Lakens, Daniël; Delacre, Marie title: Equivalence Testing and the Second Generation P-Value date: 2020-07-13 words: 6514 flesch: 56 summary: We conclude that equivalence tests yield more consistent p-values, distinguish between datasets that yield the same second generation p-value, and allow for easier control of Type I and Type II error rates. When different p-values for equivalence tests yield the same SGPV There are three situations where p-values for TOST differentiate between observed results, while the SGPV does not differentiate. keywords: confidence; equivalence; equivalence range; range; sgpv; tost; value cache: metapsychology-933.pdf plain text: metapsychology-933.txt item: #71 of 71 id: metapsychology-935 author: Prochilo, Guy A; Louis, Winnifred R; Bode, Stefan; Zacher, Hannes; Molenberghs, Pascal title: An Extended Commentary on Post-publication Peer Review in Organizational Neuroscience date: 2019-11-11 words: 19171 flesch: 47 summary: This publication represents a single empirical study that has been reported through conference proceedings (Waldman et al., 2013a), as an unpublished pre-print (Waldman et al., 2013b), and within a textbook chapter that dis- cusses it at length (Waldman, Stikic, Wang, Korszen, & Berka, 2015). As in Peterson et al. (2008), the critical evaluation of Waldman et al. (2011a) requires qualification based on the venue through which it has been published. keywords: 0.051a; 0.637a; analysis; authors; correlation; data; eeg; effect; et al; findings; leadership; neuroscience; publication; r =; research; review; studies; study; waldman cache: metapsychology-935.pdf plain text: metapsychology-935.txt