Are you over 18 and want to see adult content?
More Annotations
A complete backup of https://compressport.com
Are you over 18 and want to see adult content?
A complete backup of https://aromaweb.com
Are you over 18 and want to see adult content?
A complete backup of https://parczoologiquedeparis.fr
Are you over 18 and want to see adult content?
A complete backup of https://dart.dev
Are you over 18 and want to see adult content?
A complete backup of https://autoshowwinnipeg.com
Are you over 18 and want to see adult content?
A complete backup of https://pepin.cl
Are you over 18 and want to see adult content?
A complete backup of https://toto-god.com
Are you over 18 and want to see adult content?
A complete backup of https://kalantur.com
Are you over 18 and want to see adult content?
A complete backup of https://radiorur.de
Are you over 18 and want to see adult content?
A complete backup of https://mushroompillow.com
Are you over 18 and want to see adult content?
A complete backup of https://smcnn.com
Are you over 18 and want to see adult content?
A complete backup of https://aurigaspa.com
Are you over 18 and want to see adult content?
Favourite Annotations
A complete backup of wildkameratest.com
Are you over 18 and want to see adult content?
A complete backup of spain-residence.com
Are you over 18 and want to see adult content?
A complete backup of ugelhuancayo.gob.pe
Are you over 18 and want to see adult content?
A complete backup of thesourcehotel.com
Are you over 18 and want to see adult content?
A complete backup of lacapital.com.ar
Are you over 18 and want to see adult content?
Text
DATA COLADA
A recent NBER paper titled "Gender and the Dynamics of Economics Seminars" (.htm) reports analyses of audience questions asked during 462 economics seminars, concluding that “women are asked more questions . . . and the questions asked of women are more likely to be patronizing or hostile . . . suggest yet another potentialexplanation
DATA REPLICADA #2: DO SELF-CONSTRUAL AND GROUP SIZE In this second installment of Data Replicada, we report two attempts to replicate a study in a recently published Journal of Consumer Research (JCR) article entitled, “Wine for the Table: Self-Construal, Group Size, and Choice for Self and Others” (.htm). Imagine that you are in a monthly book club and it is your job to GROUNDHOG: ADDRESSING THE THREAT THAT R POSES TO R, the free and open source program for statistical computing, poses a substantial threat to the reproducibility of published research. This post explains the problem and introduces a solution. The Problem: Packages R itself has some reproducibility problems (see example in this footnote ), but the big problem is its packages: the addonscripts that
DATA REPLICADA #3: DOES SELF-CONCEPT UNCERTAINTY In the third installment of Data Replicada, we report our attempt to replicate a recently published Journal of Consumer Research (JCR) article entitled, “The Uncertain Self: How Self-Concept Structure Affects Subscription Choice” (.htm). The central theory in the paper can be expressed in the following way: If you are uncertain about your own self-concept, then HOW TO PROPERLY PREREGISTER A STUDY P-hacking, the selective reporting of statistically significant analyses, continues to threaten the integrity of our discipline. P-hacking is inevitable whenever (1) a researcher hopes to find evidence for a particular result, (2) there is ambiguity about how exactly to analyze the data, and (3) the researcher does not perfectly plan out his/her analysis in advance. POWER POSING: REASSESSING THE EVIDENCE BEHIND THE A recent paper in Psych Science (.pdf) reports a failure to replicate the study that inspired a TED Talk that has been seen 25 million times. The talk invited viewers to do better in life by assuming high-power poses, just like Wonder Woman’s below, but the replication found that power-posing was inconsequential. If an A BETTER EXPLANATION OF THE ENDOWMENT EFFECT Just as loss aversion maintains that people dislike losses more than they like gains, the endowment effect seems to show that people put a higher price on losing a good than on gaining it. The endowment effect seems to perfectly follow from loss aversion. But a 2012 paper by Ray Weaver and Shane Frederick convincingly shows that loss aversion THIRTY-SOMETHINGS ARE SHRINKING AND OTHER U-SHAPED A recent Psych Science (.pdf) paper found that sports teams can perform worse when they have too much talent. For example, in Study 3 they found that NBA teams with a higher percentage of talented players win more games, but that teams with the highest levels of talented players win fewer games. The hypothesis is easy enough RAIN & HAPPINESS: WHY DIDN’T SCHWARZ & CLORE (1983 In my “Small Telescopes” paper, I introduced a new approach to evaluate replication results (SSRN). Among other examples, I described two studies as having failed to replicate the famous Schwarz and Clore (1983) finding that people report being happier with their lives when asked on sunny days. Figure and text from Small Telescopes paper(SSRN) I
GREG VS. JAMAL: WHY DIDN’T BERTRAND AND MULLAINATHAN Bertrand & Mullainathan (2004, .htm) is one of the best known and most cited American Economic Review (AER) papers . It reports a field experiment in which resumes given typically Black names (e.g., Jamal and Lakisha) received fewer callbacks than those given typically White names (e.g., Greg and Emily). This finding is interpreted as evidence of racial discriminationDATA COLADA
A recent NBER paper titled "Gender and the Dynamics of Economics Seminars" (.htm) reports analyses of audience questions asked during 462 economics seminars, concluding that “women are asked more questions . . . and the questions asked of women are more likely to be patronizing or hostile . . . suggest yet another potentialexplanation
DATA REPLICADA #2: DO SELF-CONSTRUAL AND GROUP SIZE In this second installment of Data Replicada, we report two attempts to replicate a study in a recently published Journal of Consumer Research (JCR) article entitled, “Wine for the Table: Self-Construal, Group Size, and Choice for Self and Others” (.htm). Imagine that you are in a monthly book club and it is your job to GROUNDHOG: ADDRESSING THE THREAT THAT R POSES TO R, the free and open source program for statistical computing, poses a substantial threat to the reproducibility of published research. This post explains the problem and introduces a solution. The Problem: Packages R itself has some reproducibility problems (see example in this footnote ), but the big problem is its packages: the addonscripts that
DATA REPLICADA #3: DOES SELF-CONCEPT UNCERTAINTY In the third installment of Data Replicada, we report our attempt to replicate a recently published Journal of Consumer Research (JCR) article entitled, “The Uncertain Self: How Self-Concept Structure Affects Subscription Choice” (.htm). The central theory in the paper can be expressed in the following way: If you are uncertain about your own self-concept, then HOW TO PROPERLY PREREGISTER A STUDY P-hacking, the selective reporting of statistically significant analyses, continues to threaten the integrity of our discipline. P-hacking is inevitable whenever (1) a researcher hopes to find evidence for a particular result, (2) there is ambiguity about how exactly to analyze the data, and (3) the researcher does not perfectly plan out his/her analysis in advance. POWER POSING: REASSESSING THE EVIDENCE BEHIND THE A recent paper in Psych Science (.pdf) reports a failure to replicate the study that inspired a TED Talk that has been seen 25 million times. The talk invited viewers to do better in life by assuming high-power poses, just like Wonder Woman’s below, but the replication found that power-posing was inconsequential. If an A BETTER EXPLANATION OF THE ENDOWMENT EFFECT Just as loss aversion maintains that people dislike losses more than they like gains, the endowment effect seems to show that people put a higher price on losing a good than on gaining it. The endowment effect seems to perfectly follow from loss aversion. But a 2012 paper by Ray Weaver and Shane Frederick convincingly shows that loss aversion THIRTY-SOMETHINGS ARE SHRINKING AND OTHER U-SHAPED A recent Psych Science (.pdf) paper found that sports teams can perform worse when they have too much talent. For example, in Study 3 they found that NBA teams with a higher percentage of talented players win more games, but that teams with the highest levels of talented players win fewer games. The hypothesis is easy enough RAIN & HAPPINESS: WHY DIDN’T SCHWARZ & CLORE (1983 In my “Small Telescopes” paper, I introduced a new approach to evaluate replication results (SSRN). Among other examples, I described two studies as having failed to replicate the famous Schwarz and Clore (1983) finding that people report being happier with their lives when asked on sunny days. Figure and text from Small Telescopes paper(SSRN) I
GREG VS. JAMAL: WHY DIDN’T BERTRAND AND MULLAINATHAN Bertrand & Mullainathan (2004, .htm) is one of the best known and most cited American Economic Review (AER) papers . It reports a field experiment in which resumes given typically Black names (e.g., Jamal and Lakisha) received fewer callbacks than those given typically White names (e.g., Greg and Emily). This finding is interpreted as evidence of racial discrimination DATA COLADA SEMINAR SERIES Data Colada Seminar Series. This is a weekly online seminar series on behavioral research. Everybody is welcome. Subscribe to get email reminders with links to talks Subscribe. The schedule posted below is for Spring 2021. To access 2020 seminars and links to recordings, please visit this link: .htm. HOW TO PROPERLY PREREGISTER A STUDY P-hacking, the selective reporting of statistically significant analyses, continues to threaten the integrity of our discipline. P-hacking is inevitable whenever (1) a researcher hopes to find evidence for a particular result, (2) there is ambiguity about how exactly to analyze the data, and (3) the researcher does not perfectly plan out his/her analysis in advance. DATA REPLICADA #9: ARE PROGRESSION ADS MORE CREDIBLE In the ninth installment of Data Replicada, we report our attempt to replicate a recently published Journal of Marketing Research (JMR) article entitled, “Advertising a Desired Change: When Process Simulation Fosters (vs. Hinders) Credibility and Persuasion” (.htm). Some products, such as weight loss programs, exist to help consumers attain a desired change. In this paper, TRIM-AND-FILL IS FULL OF IT (BIAS) Statistically significant findings are much more likely to be published than non-significant ones (no citation necessary). Because overestimated effects are more likely to be statistically significant than are underestimated effects, this means that most published effects are overestimates. Effects are smaller – often much smaller – than the published record suggests. For meta-analysts the POWER POSING: REASSESSING THE EVIDENCE BEHIND THE A recent paper in Psych Science (.pdf) reports a failure to replicate the study that inspired a TED Talk that has been seen 25 million times. The talk invited viewers to do better in life by assuming high-power poses, just like Wonder Woman’s below, but the replication found that power-posing was inconsequential. If an BAYES FACTORS IN TEN RECENT PSYCH SCIENCE PAPERS For this post, the third in a series on Bayes factors (.htm), I wanted to get a sense for how Bayes factors were being used with real data from real papers, so I looked at the 10 most recent empirical papers in Psychological Science containing the phrase "Bayes factor" (.zip).After browsing them all, I re-analyzed data from the first three. The picture is not encouraging. P-CURVE VS. EXCESSIVE SIGNIFICANCE TEST In this post I use data from the Many-Labs replication project to contrast the (pointless) inferences one arrives at using the Excessive Significant Test, with the (critically important) inferences one arrives at with p-curve.. The many-labs project is a collaboration of 36 labs around the world, each running a replication of 13 published effects in psychology (paper: .pdf; data: xlsx). FAKE-DATA COLADA: EXCESSIVE LINEARITY Recently, a psychology paper (.html) was flagged as possibly fraudulent based on statistical analyses (.pdf). The author defended his paper (.html), but the university committee investigating misconduct concluded it had occurred (.pdf). In this post we present new and more intuitive versions of the analyses that flagged the paper as possibly fraudulent. We then rule EIGHT THINGS I DO TO MAKE MY OPEN RESEARCH MORE It is now common for researchers to post original materials, data, and/or code behind their published research. That’s obviously great, but open research is often difficult to find and understand. In this post I discuss 8 things I do, in my papers, code, and datafiles, to combat that. Paper 1) Before all method sections, I TEENAGERS IN BIKINIS: INTERPRETING POLICE-SHOOTING DATA The New York Times, on Monday, showcased (.htm) an NBER working paper (.pdf) that proposed that “blacks are 23.8 percent less likely to be shot at by police relative to whites.” (p.22) The paper involved a monumental data collection effort to address an important societal question. The analyses are rigorous, clever and transparently reported. Nevertheless, I doDATA COLADA
A recent NBER paper titled "Gender and the Dynamics of Economics Seminars" (.htm) reports analyses of audience questions asked during 462 economics seminars, concluding that “women are asked more questions . . . and the questions asked of women are more likely to be patronizing or hostile . . . suggest yet another potentialexplanation
DATA REPLICADA #2: DO SELF-CONSTRUAL AND GROUP SIZE In this second installment of Data Replicada, we report two attempts to replicate a study in a recently published Journal of Consumer Research (JCR) article entitled, “Wine for the Table: Self-Construal, Group Size, and Choice for Self and Others” (.htm). Imagine that you are in a monthly book club and it is your job to DATA REPLICADA #3: DOES SELF-CONCEPT UNCERTAINTY In the third installment of Data Replicada, we report our attempt to replicate a recently published Journal of Consumer Research (JCR) article entitled, “The Uncertain Self: How Self-Concept Structure Affects Subscription Choice” (.htm). The central theory in the paper can be expressed in the following way: If you are uncertain about your own self-concept, then GROUNDHOG: ADDRESSING THE THREAT THAT R POSES TO R, the free and open source program for statistical computing, poses a substantial threat to the reproducibility of published research. This post explains the problem and introduces a solution. The Problem: Packages R itself has some reproducibility problems (see example in this footnote ), but the big problem is its packages: the addonscripts that
TRIM-AND-FILL IS FULL OF IT (BIAS) Statistically significant findings are much more likely to be published than non-significant ones (no citation necessary). Because overestimated effects are more likely to be statistically significant than are underestimated effects, this means that most published effects are overestimates. Effects are smaller – often much smaller – than the published record suggests. For meta-analysts the POWER POSING: REASSESSING THE EVIDENCE BEHIND THE A recent paper in Psych Science (.pdf) reports a failure to replicate the study that inspired a TED Talk that has been seen 25 million times. The talk invited viewers to do better in life by assuming high-power poses, just like Wonder Woman’s below, but the replication found that power-posing was inconsequential. If an A BETTER EXPLANATION OF THE ENDOWMENT EFFECT Just as loss aversion maintains that people dislike losses more than they like gains, the endowment effect seems to show that people put a higher price on losing a good than on gaining it. The endowment effect seems to perfectly follow from loss aversion. But a 2012 paper by Ray Weaver and Shane Frederick convincingly shows that loss aversion P-CURVE VS. EXCESSIVE SIGNIFICANCE TEST In this post I use data from the Many-Labs replication project to contrast the (pointless) inferences one arrives at using the Excessive Significant Test, with the (critically important) inferences one arrives at with p-curve.. The many-labs project is a collaboration of 36 labs around the world, each running a replication of 13 published effects in psychology (paper: .pdf; data: xlsx). THIRTY-SOMETHINGS ARE SHRINKING AND OTHER U-SHAPED A recent Psych Science (.pdf) paper found that sports teams can perform worse when they have too much talent. For example, in Study 3 they found that NBA teams with a higher percentage of talented players win more games, but that teams with the highest levels of talented players win fewer games. The hypothesis is easy enough RAIN & HAPPINESS: WHY DIDN’T SCHWARZ & CLORE (1983 In my “Small Telescopes” paper, I introduced a new approach to evaluate replication results (SSRN). Among other examples, I described two studies as having failed to replicate the famous Schwarz and Clore (1983) finding that people report being happier with their lives when asked on sunny days. Figure and text from Small Telescopes paper(SSRN) I
DATA COLADA
A recent NBER paper titled "Gender and the Dynamics of Economics Seminars" (.htm) reports analyses of audience questions asked during 462 economics seminars, concluding that “women are asked more questions . . . and the questions asked of women are more likely to be patronizing or hostile . . . suggest yet another potentialexplanation
DATA REPLICADA #2: DO SELF-CONSTRUAL AND GROUP SIZE In this second installment of Data Replicada, we report two attempts to replicate a study in a recently published Journal of Consumer Research (JCR) article entitled, “Wine for the Table: Self-Construal, Group Size, and Choice for Self and Others” (.htm). Imagine that you are in a monthly book club and it is your job to DATA REPLICADA #3: DOES SELF-CONCEPT UNCERTAINTY In the third installment of Data Replicada, we report our attempt to replicate a recently published Journal of Consumer Research (JCR) article entitled, “The Uncertain Self: How Self-Concept Structure Affects Subscription Choice” (.htm). The central theory in the paper can be expressed in the following way: If you are uncertain about your own self-concept, then GROUNDHOG: ADDRESSING THE THREAT THAT R POSES TO R, the free and open source program for statistical computing, poses a substantial threat to the reproducibility of published research. This post explains the problem and introduces a solution. The Problem: Packages R itself has some reproducibility problems (see example in this footnote ), but the big problem is its packages: the addonscripts that
TRIM-AND-FILL IS FULL OF IT (BIAS) Statistically significant findings are much more likely to be published than non-significant ones (no citation necessary). Because overestimated effects are more likely to be statistically significant than are underestimated effects, this means that most published effects are overestimates. Effects are smaller – often much smaller – than the published record suggests. For meta-analysts the POWER POSING: REASSESSING THE EVIDENCE BEHIND THE A recent paper in Psych Science (.pdf) reports a failure to replicate the study that inspired a TED Talk that has been seen 25 million times. The talk invited viewers to do better in life by assuming high-power poses, just like Wonder Woman’s below, but the replication found that power-posing was inconsequential. If an A BETTER EXPLANATION OF THE ENDOWMENT EFFECT Just as loss aversion maintains that people dislike losses more than they like gains, the endowment effect seems to show that people put a higher price on losing a good than on gaining it. The endowment effect seems to perfectly follow from loss aversion. But a 2012 paper by Ray Weaver and Shane Frederick convincingly shows that loss aversion P-CURVE VS. EXCESSIVE SIGNIFICANCE TEST In this post I use data from the Many-Labs replication project to contrast the (pointless) inferences one arrives at using the Excessive Significant Test, with the (critically important) inferences one arrives at with p-curve.. The many-labs project is a collaboration of 36 labs around the world, each running a replication of 13 published effects in psychology (paper: .pdf; data: xlsx). THIRTY-SOMETHINGS ARE SHRINKING AND OTHER U-SHAPED A recent Psych Science (.pdf) paper found that sports teams can perform worse when they have too much talent. For example, in Study 3 they found that NBA teams with a higher percentage of talented players win more games, but that teams with the highest levels of talented players win fewer games. The hypothesis is easy enough RAIN & HAPPINESS: WHY DIDN’T SCHWARZ & CLORE (1983 In my “Small Telescopes” paper, I introduced a new approach to evaluate replication results (SSRN). Among other examples, I described two studies as having failed to replicate the famous Schwarz and Clore (1983) finding that people report being happier with their lives when asked on sunny days. Figure and text from Small Telescopes paper(SSRN) I
DATA COLADA SEMINAR SERIES Data Colada Seminar Series. This is a weekly online seminar series on behavioral research. Everybody is welcome. Subscribe to get email reminders with links to talks Subscribe. The schedule posted below is for Spring 2021. To access 2020 seminars and links to recordings, please visit this link: .htm.TABLE OF CONTENTS
Fake data. "Just Posting It" works, leads to new retraction in Psychology. Fake Data: Mendel vs. Stapel. Fake-Data Colada: Excessive Linearity. Reducing Fraud in Science. In Press at Psychological Science: A New 'Nudge' Supported by Implausible Data. Number-Bunching: A New Tool for Forensic Data Analysis. TRIM-AND-FILL IS FULL OF IT (BIAS) Statistically significant findings are much more likely to be published than non-significant ones (no citation necessary). Because overestimated effects are more likely to be statistically significant than are underestimated effects, this means that most published effects are overestimates. Effects are smaller – often much smaller – than the published record suggests. For meta-analysts the POWER POSING: REASSESSING THE EVIDENCE BEHIND THE A recent paper in Psych Science (.pdf) reports a failure to replicate the study that inspired a TED Talk that has been seen 25 million times. The talk invited viewers to do better in life by assuming high-power poses, just like Wonder Woman’s below, but the replication found that power-posing was inconsequential. If an DATA REPLICADA #9: ARE PROGRESSION ADS MORE CREDIBLE In the ninth installment of Data Replicada, we report our attempt to replicate a recently published Journal of Marketing Research (JMR) article entitled, “Advertising a Desired Change: When Process Simulation Fosters (vs. Hinders) Credibility and Persuasion” (.htm). Some products, such as weight loss programs, exist to help consumers attain a desired change. In this paper, THE DATA COLADA SEMINAR SERIES It is very broadly an interdisciplinary behavioral research seminar series. Seminars will be about an hour long (and never more than an hour), and will take place at 12:00 pm Eastern (6 pm Barcelona) on Fridays. Our first talk will be this Friday, April 24 th. We are very grateful to the incomparable Yoel Inbar for agreeing to be our firstspeaker.
HOW TO PROPERLY PREREGISTER A STUDY P-hacking, the selective reporting of statistically significant analyses, continues to threaten the integrity of our discipline. P-hacking is inevitable whenever (1) a researcher hopes to find evidence for a particular result, (2) there is ambiguity about how exactly to analyze the data, and (3) the researcher does not perfectly plan out his/her analysis in advance. BAYES FACTORS IN TEN RECENT PSYCH SCIENCE PAPERS For this post, the third in a series on Bayes factors (.htm), I wanted to get a sense for how Bayes factors were being used with real data from real papers, so I looked at the 10 most recent empirical papers in Psychological Science containing the phrase "Bayes factor" (.zip).After browsing them all, I re-analyzed data from the first three. The picture is not encouraging. REVIEWERS ARE ASKING FOR IT Recent past and present The leading empirical psychology journal, Psychological Science, will begin requiring authors to disclose flexibility in data collection and analysis starting on January of 2014 (see editorial). The leading business school journal, Management Science, implemented a similar policy a few months ago. Both policies closely mirror the recommendations we made in our WHAT IF GAMES WERE SHORTER? The smaller your sample, the less likely your evidence is to reveal the truth. You might already know this, but most people don’t (.html), or at least they don’t appropriately apply it (.html). (See, for example, nearly every inference ever made by anyone). My experience trying to teach this concept suggests that it’s bestunderstood
DATA COLADA
A recent NBER paper titled "Gender and the Dynamics of Economics Seminars" (.htm) reports analyses of audience questions asked during 462 economics seminars, concluding that “women are asked more questions . . . and the questions asked of women are more likely to be patronizing or hostile . . . suggest yet another potentialexplanation
DATA REPLICADA #2: DO SELF-CONSTRUAL AND GROUP SIZE In this second installment of Data Replicada, we report two attempts to replicate a study in a recently published Journal of Consumer Research (JCR) article entitled, “Wine for the Table: Self-Construal, Group Size, and Choice for Self and Others” (.htm). Imagine that you are in a monthly book club and it is your job to DATA REPLICADA #9: ARE PROGRESSION ADS MORE CREDIBLE In the ninth installment of Data Replicada, we report our attempt to replicate a recently published Journal of Marketing Research (JMR) article entitled, “Advertising a Desired Change: When Process Simulation Fosters (vs. Hinders) Credibility and Persuasion” (.htm). Some products, such as weight loss programs, exist to help consumers attain a desired change. In this paper, POWER POSING: REASSESSING THE EVIDENCE BEHIND THE A recent paper in Psych Science (.pdf) reports a failure to replicate the study that inspired a TED Talk that has been seen 25 million times. The talk invited viewers to do better in life by assuming high-power poses, just like Wonder Woman’s below, but the replication found that power-posing was inconsequential. If an GROUNDHOG: ADDRESSING THE THREAT THAT R POSES TO R, the free and open source program for statistical computing, poses a substantial threat to the reproducibility of published research. This post explains the problem and introduces a solution. The Problem: Packages R itself has some reproducibility problems (see example in this footnote ), but the big problem is its packages: the addonscripts that
DATA REPLICADA #3: DOES SELF-CONCEPT UNCERTAINTY In the third installment of Data Replicada, we report our attempt to replicate a recently published Journal of Consumer Research (JCR) article entitled, “The Uncertain Self: How Self-Concept Structure Affects Subscription Choice” (.htm). The central theory in the paper can be expressed in the following way: If you are uncertain about your own self-concept, then TRIM-AND-FILL IS FULL OF IT (BIAS) Statistically significant findings are much more likely to be published than non-significant ones (no citation necessary). Because overestimated effects are more likely to be statistically significant than are underestimated effects, this means that most published effects are overestimates. Effects are smaller – often much smaller – than the published record suggests. For meta-analysts the MTURK VS. THE LAB: EITHER WAY WE NEED BIG SAMPLES With that said, the claim that MTurk studies require larger samples is based on intuitions unsupported by evidence. So whether we are running our studies on MTurk or in the Lab, the irrefutable fact remains: We need big samples. And 50 per cell is not big. To eliminate outliers, I trimmed open-ended responses below the 5 th and above the 95 th A BETTER EXPLANATION OF THE ENDOWMENT EFFECT Just as loss aversion maintains that people dislike losses more than they like gains, the endowment effect seems to show that people put a higher price on losing a good than on gaining it. The endowment effect seems to perfectly follow from loss aversion. But a 2012 paper by Ray Weaver and Shane Frederick convincingly shows that loss aversion GREG VS. JAMAL: WHY DIDN’T BERTRAND AND MULLAINATHAN Bertrand & Mullainathan (2004, .htm) is one of the best known and most cited American Economic Review (AER) papers . It reports a field experiment in which resumes given typically Black names (e.g., Jamal and Lakisha) received fewer callbacks than those given typically White names (e.g., Greg and Emily). This finding is interpreted as evidence of racial discriminationDATA COLADA
A recent NBER paper titled "Gender and the Dynamics of Economics Seminars" (.htm) reports analyses of audience questions asked during 462 economics seminars, concluding that “women are asked more questions . . . and the questions asked of women are more likely to be patronizing or hostile . . . suggest yet another potentialexplanation
DATA REPLICADA #2: DO SELF-CONSTRUAL AND GROUP SIZE In this second installment of Data Replicada, we report two attempts to replicate a study in a recently published Journal of Consumer Research (JCR) article entitled, “Wine for the Table: Self-Construal, Group Size, and Choice for Self and Others” (.htm). Imagine that you are in a monthly book club and it is your job to DATA REPLICADA #9: ARE PROGRESSION ADS MORE CREDIBLE In the ninth installment of Data Replicada, we report our attempt to replicate a recently published Journal of Marketing Research (JMR) article entitled, “Advertising a Desired Change: When Process Simulation Fosters (vs. Hinders) Credibility and Persuasion” (.htm). Some products, such as weight loss programs, exist to help consumers attain a desired change. In this paper, POWER POSING: REASSESSING THE EVIDENCE BEHIND THE A recent paper in Psych Science (.pdf) reports a failure to replicate the study that inspired a TED Talk that has been seen 25 million times. The talk invited viewers to do better in life by assuming high-power poses, just like Wonder Woman’s below, but the replication found that power-posing was inconsequential. If an GROUNDHOG: ADDRESSING THE THREAT THAT R POSES TO R, the free and open source program for statistical computing, poses a substantial threat to the reproducibility of published research. This post explains the problem and introduces a solution. The Problem: Packages R itself has some reproducibility problems (see example in this footnote ), but the big problem is its packages: the addonscripts that
DATA REPLICADA #3: DOES SELF-CONCEPT UNCERTAINTY In the third installment of Data Replicada, we report our attempt to replicate a recently published Journal of Consumer Research (JCR) article entitled, “The Uncertain Self: How Self-Concept Structure Affects Subscription Choice” (.htm). The central theory in the paper can be expressed in the following way: If you are uncertain about your own self-concept, then TRIM-AND-FILL IS FULL OF IT (BIAS) Statistically significant findings are much more likely to be published than non-significant ones (no citation necessary). Because overestimated effects are more likely to be statistically significant than are underestimated effects, this means that most published effects are overestimates. Effects are smaller – often much smaller – than the published record suggests. For meta-analysts the MTURK VS. THE LAB: EITHER WAY WE NEED BIG SAMPLES With that said, the claim that MTurk studies require larger samples is based on intuitions unsupported by evidence. So whether we are running our studies on MTurk or in the Lab, the irrefutable fact remains: We need big samples. And 50 per cell is not big. To eliminate outliers, I trimmed open-ended responses below the 5 th and above the 95 th A BETTER EXPLANATION OF THE ENDOWMENT EFFECT Just as loss aversion maintains that people dislike losses more than they like gains, the endowment effect seems to show that people put a higher price on losing a good than on gaining it. The endowment effect seems to perfectly follow from loss aversion. But a 2012 paper by Ray Weaver and Shane Frederick convincingly shows that loss aversion GREG VS. JAMAL: WHY DIDN’T BERTRAND AND MULLAINATHAN Bertrand & Mullainathan (2004, .htm) is one of the best known and most cited American Economic Review (AER) papers . It reports a field experiment in which resumes given typically Black names (e.g., Jamal and Lakisha) received fewer callbacks than those given typically White names (e.g., Greg and Emily). This finding is interpreted as evidence of racial discriminationTABLE OF CONTENTS
Fake data. "Just Posting It" works, leads to new retraction in Psychology. Fake Data: Mendel vs. Stapel. Fake-Data Colada: Excessive Linearity. Reducing Fraud in Science. In Press at Psychological Science: A New 'Nudge' Supported by Implausible Data. Number-Bunching: A New Tool for Forensic Data Analysis. DATA COLADA SEMINAR SERIES Data Colada Seminar Series. This is a weekly online seminar series on behavioral research. Everybody is welcome. Subscribe to get email reminders with links to talks Subscribe. The schedule posted below is for Spring 2021. To access 2020 seminars and links to recordings, please visit this link: .htm. TRIM-AND-FILL IS FULL OF IT (BIAS) Statistically significant findings are much more likely to be published than non-significant ones (no citation necessary). Because overestimated effects are more likely to be statistically significant than are underestimated effects, this means that most published effects are overestimates. Effects are smaller – often much smaller – than the published record suggests. For meta-analysts the RESEARCHBOX: OPEN RESEARCH MADE EASY This post introduces ResearchBox, a new platform for easily sharing data, code, materials, and pre-registrations. With a design and approach similar to AsPredicted, ResearchBox simplifies, standardizes, and organizes supporting materials for publishable research. Compared to the current leading platform, the OSF, ResearchBox is narrowly designed to make it easy for authors to share data, P-CURVE VS. EXCESSIVE SIGNIFICANCE TEST In this post I use data from the Many-Labs replication project to contrast the (pointless) inferences one arrives at using the Excessive Significant Test, with the (critically important) inferences one arrives at with p-curve.. The many-labs project is a collaboration of 36 labs around the world, each running a replication of 13 published effects in psychology (paper: .pdf; data: xlsx).NO-WAY INTERACTIONS
If Study 1 had 100 subjects total (n=50 per cell), Study 2 needs at least 50 x 2 x 4= 400 subjects total. If Study 2 instead tests a three-way interaction (attenuation of an attenuated effect), it needs N=50 x 2 x2 x 8= 1600 subjects . With between subject designs, two-way interactions are ambitious. Three-ways are more like no-way. FAKE-DATA COLADA: EXCESSIVE LINEARITY Recently, a psychology paper (.html) was flagged as possibly fraudulent based on statistical analyses (.pdf). The author defended his paper (.html), but the university committee investigating misconduct concluded it had occurred (.pdf). In this post we present new and more intuitive versions of the analyses that flagged the paper as possibly fraudulent. We then rule RAIN & HAPPINESS: WHY DIDN’T SCHWARZ & CLORE (1983 In my “Small Telescopes” paper, I introduced a new approach to evaluate replication results (SSRN). Among other examples, I described two studies as having failed to replicate the famous Schwarz and Clore (1983) finding that people report being happier with their lives when asked on sunny days. Figure and text from Small Telescopes paper(SSRN) I
TEENAGERS IN BIKINIS: INTERPRETING POLICE-SHOOTING DATA The New York Times, on Monday, showcased (.htm) an NBER working paper (.pdf) that proposed that “blacks are 23.8 percent less likely to be shot at by police relative to whites.” (p.22) The paper involved a monumental data collection effort to address an important societal question. The analyses are rigorous, clever and transparently reported. Nevertheless, I do MADAM SPEAKER: ARE FEMALE PRESENTERS TREATED WORSE IN A recent NBER paper titled "Gender and the Dynamics of Economics Seminars" (.htm) reports analyses of audience questions asked during 462 economics seminars, concluding that “women are asked more questions . . . and the questions asked of women are more likely to be patronizing or hostile . . . suggest yet another potentialexplanation
DATA COLADA
A recent NBER paper titled "Gender and the Dynamics of Economics Seminars" (.htm) reports analyses of audience questions asked during 462 economics seminars, concluding that “women are asked more questions . . . and the questions asked of women are more likely to be patronizing or hostile . . . suggest yet another potentialexplanation
DATA REPLICADA #2: DO SELF-CONSTRUAL AND GROUP SIZE In this second installment of Data Replicada, we report two attempts to replicate a study in a recently published Journal of Consumer Research (JCR) article entitled, “Wine for the Table: Self-Construal, Group Size, and Choice for Self and Others” (.htm). Imagine that you are in a monthly book club and it is your job to DATA REPLICADA #9: ARE PROGRESSION ADS MORE CREDIBLE In the ninth installment of Data Replicada, we report our attempt to replicate a recently published Journal of Marketing Research (JMR) article entitled, “Advertising a Desired Change: When Process Simulation Fosters (vs. Hinders) Credibility and Persuasion” (.htm). Some products, such as weight loss programs, exist to help consumers attain a desired change. In this paper, GROUNDHOG: ADDRESSING THE THREAT THAT R POSES TO R, the free and open source program for statistical computing, poses a substantial threat to the reproducibility of published research. This post explains the problem and introduces a solution. The Problem: Packages R itself has some reproducibility problems (see example in this footnote ), but the big problem is its packages: the addonscripts that
POWER POSING: REASSESSING THE EVIDENCE BEHIND THE A recent paper in Psych Science (.pdf) reports a failure to replicate the study that inspired a TED Talk that has been seen 25 million times. The talk invited viewers to do better in life by assuming high-power poses, just like Wonder Woman’s below, but the replication found that power-posing was inconsequential. If an DATA REPLICADA #3: DOES SELF-CONCEPT UNCERTAINTY In the third installment of Data Replicada, we report our attempt to replicate a recently published Journal of Consumer Research (JCR) article entitled, “The Uncertain Self: How Self-Concept Structure Affects Subscription Choice” (.htm). The central theory in the paper can be expressed in the following way: If you are uncertain about your own self-concept, then TRIM-AND-FILL IS FULL OF IT (BIAS) Statistically significant findings are much more likely to be published than non-significant ones (no citation necessary). Because overestimated effects are more likely to be statistically significant than are underestimated effects, this means that most published effects are overestimates. Effects are smaller – often much smaller – than the published record suggests. For meta-analysts the P-CURVE VS. EXCESSIVE SIGNIFICANCE TEST In this post I use data from the Many-Labs replication project to contrast the (pointless) inferences one arrives at using the Excessive Significant Test, with the (critically important) inferences one arrives at with p-curve.. The many-labs project is a collaboration of 36 labs around the world, each running a replication of 13 published effects in psychology (paper: .pdf; data: xlsx). MTURK VS. THE LAB: EITHER WAY WE NEED BIG SAMPLES With that said, the claim that MTurk studies require larger samples is based on intuitions unsupported by evidence. So whether we are running our studies on MTurk or in the Lab, the irrefutable fact remains: We need big samples. And 50 per cell is not big. To eliminate outliers, I trimmed open-ended responses below the 5 th and above the 95 th A BETTER EXPLANATION OF THE ENDOWMENT EFFECT Just as loss aversion maintains that people dislike losses more than they like gains, the endowment effect seems to show that people put a higher price on losing a good than on gaining it. The endowment effect seems to perfectly follow from loss aversion. But a 2012 paper by Ray Weaver and Shane Frederick convincingly shows that loss aversionDATA COLADA
A recent NBER paper titled "Gender and the Dynamics of Economics Seminars" (.htm) reports analyses of audience questions asked during 462 economics seminars, concluding that “women are asked more questions . . . and the questions asked of women are more likely to be patronizing or hostile . . . suggest yet another potentialexplanation
DATA REPLICADA #2: DO SELF-CONSTRUAL AND GROUP SIZE In this second installment of Data Replicada, we report two attempts to replicate a study in a recently published Journal of Consumer Research (JCR) article entitled, “Wine for the Table: Self-Construal, Group Size, and Choice for Self and Others” (.htm). Imagine that you are in a monthly book club and it is your job to DATA REPLICADA #9: ARE PROGRESSION ADS MORE CREDIBLE In the ninth installment of Data Replicada, we report our attempt to replicate a recently published Journal of Marketing Research (JMR) article entitled, “Advertising a Desired Change: When Process Simulation Fosters (vs. Hinders) Credibility and Persuasion” (.htm). Some products, such as weight loss programs, exist to help consumers attain a desired change. In this paper, GROUNDHOG: ADDRESSING THE THREAT THAT R POSES TO R, the free and open source program for statistical computing, poses a substantial threat to the reproducibility of published research. This post explains the problem and introduces a solution. The Problem: Packages R itself has some reproducibility problems (see example in this footnote ), but the big problem is its packages: the addonscripts that
POWER POSING: REASSESSING THE EVIDENCE BEHIND THE A recent paper in Psych Science (.pdf) reports a failure to replicate the study that inspired a TED Talk that has been seen 25 million times. The talk invited viewers to do better in life by assuming high-power poses, just like Wonder Woman’s below, but the replication found that power-posing was inconsequential. If an DATA REPLICADA #3: DOES SELF-CONCEPT UNCERTAINTY In the third installment of Data Replicada, we report our attempt to replicate a recently published Journal of Consumer Research (JCR) article entitled, “The Uncertain Self: How Self-Concept Structure Affects Subscription Choice” (.htm). The central theory in the paper can be expressed in the following way: If you are uncertain about your own self-concept, then TRIM-AND-FILL IS FULL OF IT (BIAS) Statistically significant findings are much more likely to be published than non-significant ones (no citation necessary). Because overestimated effects are more likely to be statistically significant than are underestimated effects, this means that most published effects are overestimates. Effects are smaller – often much smaller – than the published record suggests. For meta-analysts the P-CURVE VS. EXCESSIVE SIGNIFICANCE TEST In this post I use data from the Many-Labs replication project to contrast the (pointless) inferences one arrives at using the Excessive Significant Test, with the (critically important) inferences one arrives at with p-curve.. The many-labs project is a collaboration of 36 labs around the world, each running a replication of 13 published effects in psychology (paper: .pdf; data: xlsx). MTURK VS. THE LAB: EITHER WAY WE NEED BIG SAMPLES With that said, the claim that MTurk studies require larger samples is based on intuitions unsupported by evidence. So whether we are running our studies on MTurk or in the Lab, the irrefutable fact remains: We need big samples. And 50 per cell is not big. To eliminate outliers, I trimmed open-ended responses below the 5 th and above the 95 th A BETTER EXPLANATION OF THE ENDOWMENT EFFECT Just as loss aversion maintains that people dislike losses more than they like gains, the endowment effect seems to show that people put a higher price on losing a good than on gaining it. The endowment effect seems to perfectly follow from loss aversion. But a 2012 paper by Ray Weaver and Shane Frederick convincingly shows that loss aversion DATA COLADA SEMINAR SERIES Data Colada Seminar Series. This is a weekly online seminar series on behavioral research. Everybody is welcome. Subscribe to get email reminders with links to talks Subscribe. The schedule posted below is for Spring 2021. To access 2020 seminars and links to recordings, please visit this link: .htm.TABLE OF CONTENTS
Fake data. "Just Posting It" works, leads to new retraction in Psychology. Fake Data: Mendel vs. Stapel. Fake-Data Colada: Excessive Linearity. Reducing Fraud in Science. In Press at Psychological Science: A New 'Nudge' Supported by Implausible Data. Number-Bunching: A New Tool for Forensic Data Analysis. TRIM-AND-FILL IS FULL OF IT (BIAS) Statistically significant findings are much more likely to be published than non-significant ones (no citation necessary). Because overestimated effects are more likely to be statistically significant than are underestimated effects, this means that most published effects are overestimates. Effects are smaller – often much smaller – than the published record suggests. For meta-analysts the HOW TO PROPERLY PREREGISTER A STUDY P-hacking, the selective reporting of statistically significant analyses, continues to threaten the integrity of our discipline. P-hacking is inevitable whenever (1) a researcher hopes to find evidence for a particular result, (2) there is ambiguity about how exactly to analyze the data, and (3) the researcher does not perfectly plan out his/her analysis in advance. DATA REPLICADA #6: THE PROBLEM OF (WEIRD In this sixth installment of Data Replicada, we report our attempt to replicate a recently published Journal of Consumer Research (JCR) article entitled, “The Impact of Resource Scarcity on Price-Quality Judgments” (.html). This one was full of surprises. The primary thesis of this article is straightforward: “Scarcity decreases consumers’ tendency to use price to judge RESEARCHBOX: OPEN RESEARCH MADE EASY This post introduces ResearchBox, a new platform for easily sharing data, code, materials, and pre-registrations. With a design and approach similar to AsPredicted, ResearchBox simplifies, standardizes, and organizes supporting materials for publishable research. Compared to the current leading platform, the OSF, ResearchBox is narrowly designed to make it easy for authors to share data, REVIEWERS ARE ASKING FOR IT Recent past and present The leading empirical psychology journal, Psychological Science, will begin requiring authors to disclose flexibility in data collection and analysis starting on January of 2014 (see editorial). The leading business school journal, Management Science, implemented a similar policy a few months ago. Both policies closely mirror the recommendations we made in our DATA REPLICADA #1: DO ELEVATED VIEWPOINTS INCREASE In this post, we report our attempt to replicate a study in a recently published Journal of Marketing Research (JMR) article entitled, “Having Control Over and Above Situations: The Influence of Elevated Viewpoints on Risk Taking” (.htm). The article’s abstract summarizes the key result: “consumers’ views of scenery from a high physical elevation induce an BAYES FACTORS IN TEN RECENT PSYCH SCIENCE PAPERS For this post, the third in a series on Bayes factors (.htm), I wanted to get a sense for how Bayes factors were being used with real data from real papers, so I looked at the 10 most recent empirical papers in Psychological Science containing the phrase "Bayes factor" (.zip).After browsing them all, I re-analyzed data from the first three. The picture is not encouraging. PILOT-DROPPING BACKFIRES (SO DARYL BEM PROBABLY DID Uli Schimmack recently identified an interesting pattern in the data from Daryl Bem’s infamous “Feeling the Future” JPSP paper, in which he reported evidence for the existence of extrasensory perception (ESP; htm). In each study, the effect size is larger among participants who completed the study earlier (blogpost: .htm). Uli referred to this as the "declineDATA COLADA
A recent NBER paper titled "Gender and the Dynamics of Economics Seminars" (.htm) reports analyses of audience questions asked during 462 economics seminars, concluding that “women are asked more questions . . . and the questions asked of women are more likely to be patronizing or hostile . . . suggest yet another potentialexplanation
DATA REPLICADA #2: DO SELF-CONSTRUAL AND GROUP SIZE In this second installment of Data Replicada, we report two attempts to replicate a study in a recently published Journal of Consumer Research (JCR) article entitled, “Wine for the Table: Self-Construal, Group Size, and Choice for Self and Others” (.htm). Imagine that you are in a monthly book club and it is your job to DATA REPLICADA #9: ARE PROGRESSION ADS MORE CREDIBLE In the ninth installment of Data Replicada, we report our attempt to replicate a recently published Journal of Marketing Research (JMR) article entitled, “Advertising a Desired Change: When Process Simulation Fosters (vs. Hinders) Credibility and Persuasion” (.htm). Some products, such as weight loss programs, exist to help consumers attain a desired change. In this paper, GROUNDHOG: ADDRESSING THE THREAT THAT R POSES TO R, the free and open source program for statistical computing, poses a substantial threat to the reproducibility of published research. This post explains the problem and introduces a solution. The Problem: Packages R itself has some reproducibility problems (see example in this footnote ), but the big problem is its packages: the addonscripts that
POWER POSING: REASSESSING THE EVIDENCE BEHIND THE A recent paper in Psych Science (.pdf) reports a failure to replicate the study that inspired a TED Talk that has been seen 25 million times. The talk invited viewers to do better in life by assuming high-power poses, just like Wonder Woman’s below, but the replication found that power-posing was inconsequential. If an DATA REPLICADA #3: DOES SELF-CONCEPT UNCERTAINTY In the third installment of Data Replicada, we report our attempt to replicate a recently published Journal of Consumer Research (JCR) article entitled, “The Uncertain Self: How Self-Concept Structure Affects Subscription Choice” (.htm). The central theory in the paper can be expressed in the following way: If you are uncertain about your own self-concept, then TRIM-AND-FILL IS FULL OF IT (BIAS) Statistically significant findings are much more likely to be published than non-significant ones (no citation necessary). Because overestimated effects are more likely to be statistically significant than are underestimated effects, this means that most published effects are overestimates. Effects are smaller – often much smaller – than the published record suggests. For meta-analysts the P-CURVE VS. EXCESSIVE SIGNIFICANCE TEST In this post I use data from the Many-Labs replication project to contrast the (pointless) inferences one arrives at using the Excessive Significant Test, with the (critically important) inferences one arrives at with p-curve.. The many-labs project is a collaboration of 36 labs around the world, each running a replication of 13 published effects in psychology (paper: .pdf; data: xlsx). MTURK VS. THE LAB: EITHER WAY WE NEED BIG SAMPLES With that said, the claim that MTurk studies require larger samples is based on intuitions unsupported by evidence. So whether we are running our studies on MTurk or in the Lab, the irrefutable fact remains: We need big samples. And 50 per cell is not big. To eliminate outliers, I trimmed open-ended responses below the 5 th and above the 95 th A BETTER EXPLANATION OF THE ENDOWMENT EFFECT Just as loss aversion maintains that people dislike losses more than they like gains, the endowment effect seems to show that people put a higher price on losing a good than on gaining it. The endowment effect seems to perfectly follow from loss aversion. But a 2012 paper by Ray Weaver and Shane Frederick convincingly shows that loss aversionDATA COLADA
A recent NBER paper titled "Gender and the Dynamics of Economics Seminars" (.htm) reports analyses of audience questions asked during 462 economics seminars, concluding that “women are asked more questions . . . and the questions asked of women are more likely to be patronizing or hostile . . . suggest yet another potentialexplanation
DATA REPLICADA #2: DO SELF-CONSTRUAL AND GROUP SIZE In this second installment of Data Replicada, we report two attempts to replicate a study in a recently published Journal of Consumer Research (JCR) article entitled, “Wine for the Table: Self-Construal, Group Size, and Choice for Self and Others” (.htm). Imagine that you are in a monthly book club and it is your job to DATA REPLICADA #9: ARE PROGRESSION ADS MORE CREDIBLE In the ninth installment of Data Replicada, we report our attempt to replicate a recently published Journal of Marketing Research (JMR) article entitled, “Advertising a Desired Change: When Process Simulation Fosters (vs. Hinders) Credibility and Persuasion” (.htm). Some products, such as weight loss programs, exist to help consumers attain a desired change. In this paper, GROUNDHOG: ADDRESSING THE THREAT THAT R POSES TO R, the free and open source program for statistical computing, poses a substantial threat to the reproducibility of published research. This post explains the problem and introduces a solution. The Problem: Packages R itself has some reproducibility problems (see example in this footnote ), but the big problem is its packages: the addonscripts that
POWER POSING: REASSESSING THE EVIDENCE BEHIND THE A recent paper in Psych Science (.pdf) reports a failure to replicate the study that inspired a TED Talk that has been seen 25 million times. The talk invited viewers to do better in life by assuming high-power poses, just like Wonder Woman’s below, but the replication found that power-posing was inconsequential. If an DATA REPLICADA #3: DOES SELF-CONCEPT UNCERTAINTY In the third installment of Data Replicada, we report our attempt to replicate a recently published Journal of Consumer Research (JCR) article entitled, “The Uncertain Self: How Self-Concept Structure Affects Subscription Choice” (.htm). The central theory in the paper can be expressed in the following way: If you are uncertain about your own self-concept, then TRIM-AND-FILL IS FULL OF IT (BIAS) Statistically significant findings are much more likely to be published than non-significant ones (no citation necessary). Because overestimated effects are more likely to be statistically significant than are underestimated effects, this means that most published effects are overestimates. Effects are smaller – often much smaller – than the published record suggests. For meta-analysts the P-CURVE VS. EXCESSIVE SIGNIFICANCE TEST In this post I use data from the Many-Labs replication project to contrast the (pointless) inferences one arrives at using the Excessive Significant Test, with the (critically important) inferences one arrives at with p-curve.. The many-labs project is a collaboration of 36 labs around the world, each running a replication of 13 published effects in psychology (paper: .pdf; data: xlsx). MTURK VS. THE LAB: EITHER WAY WE NEED BIG SAMPLES With that said, the claim that MTurk studies require larger samples is based on intuitions unsupported by evidence. So whether we are running our studies on MTurk or in the Lab, the irrefutable fact remains: We need big samples. And 50 per cell is not big. To eliminate outliers, I trimmed open-ended responses below the 5 th and above the 95 th A BETTER EXPLANATION OF THE ENDOWMENT EFFECT Just as loss aversion maintains that people dislike losses more than they like gains, the endowment effect seems to show that people put a higher price on losing a good than on gaining it. The endowment effect seems to perfectly follow from loss aversion. But a 2012 paper by Ray Weaver and Shane Frederick convincingly shows that loss aversion DATA COLADA SEMINAR SERIES Data Colada Seminar Series. This is a weekly online seminar series on behavioral research. Everybody is welcome. Subscribe to get email reminders with links to talks Subscribe. The schedule posted below is for Spring 2021. To access 2020 seminars and links to recordings, please visit this link: .htm.TABLE OF CONTENTS
Fake data. "Just Posting It" works, leads to new retraction in Psychology. Fake Data: Mendel vs. Stapel. Fake-Data Colada: Excessive Linearity. Reducing Fraud in Science. In Press at Psychological Science: A New 'Nudge' Supported by Implausible Data. Number-Bunching: A New Tool for Forensic Data Analysis. TRIM-AND-FILL IS FULL OF IT (BIAS) Statistically significant findings are much more likely to be published than non-significant ones (no citation necessary). Because overestimated effects are more likely to be statistically significant than are underestimated effects, this means that most published effects are overestimates. Effects are smaller – often much smaller – than the published record suggests. For meta-analysts the HOW TO PROPERLY PREREGISTER A STUDY P-hacking, the selective reporting of statistically significant analyses, continues to threaten the integrity of our discipline. P-hacking is inevitable whenever (1) a researcher hopes to find evidence for a particular result, (2) there is ambiguity about how exactly to analyze the data, and (3) the researcher does not perfectly plan out his/her analysis in advance. DATA REPLICADA #6: THE PROBLEM OF (WEIRD In this sixth installment of Data Replicada, we report our attempt to replicate a recently published Journal of Consumer Research (JCR) article entitled, “The Impact of Resource Scarcity on Price-Quality Judgments” (.html). This one was full of surprises. The primary thesis of this article is straightforward: “Scarcity decreases consumers’ tendency to use price to judge RESEARCHBOX: OPEN RESEARCH MADE EASY This post introduces ResearchBox, a new platform for easily sharing data, code, materials, and pre-registrations. With a design and approach similar to AsPredicted, ResearchBox simplifies, standardizes, and organizes supporting materials for publishable research. Compared to the current leading platform, the OSF, ResearchBox is narrowly designed to make it easy for authors to share data, REVIEWERS ARE ASKING FOR IT Recent past and present The leading empirical psychology journal, Psychological Science, will begin requiring authors to disclose flexibility in data collection and analysis starting on January of 2014 (see editorial). The leading business school journal, Management Science, implemented a similar policy a few months ago. Both policies closely mirror the recommendations we made in our DATA REPLICADA #1: DO ELEVATED VIEWPOINTS INCREASE In this post, we report our attempt to replicate a study in a recently published Journal of Marketing Research (JMR) article entitled, “Having Control Over and Above Situations: The Influence of Elevated Viewpoints on Risk Taking” (.htm). The article’s abstract summarizes the key result: “consumers’ views of scenery from a high physical elevation induce an BAYES FACTORS IN TEN RECENT PSYCH SCIENCE PAPERS For this post, the third in a series on Bayes factors (.htm), I wanted to get a sense for how Bayes factors were being used with real data from real papers, so I looked at the 10 most recent empirical papers in Psychological Science containing the phrase "Bayes factor" (.zip).After browsing them all, I re-analyzed data from the first three. The picture is not encouraging. PILOT-DROPPING BACKFIRES (SO DARYL BEM PROBABLY DID Uli Schimmack recently identified an interesting pattern in the data from Daryl Bem’s infamous “Feeling the Future” JPSP paper, in which he reported evidence for the existence of extrasensory perception (ESP; htm). In each study, the effect size is larger among participants who completed the study earlier (blogpost: .htm). Uli referred to this as the "declineMenu
* Home
* About
* Feedback Policy
* Table of Contents
* Seminar
Menu
DATA REPLICADA #5: DO HUMAN-LIKE PRODUCTS INSPIRE MORE HOLISTICJUDGMENTS?
Posted on May 20, 2020May 18, 2020 by Joe& Leif
In the fifth installment of Data Replicada, we report our attempt to replicate a recently published Journal of Consumer Research (JCR) article entitled, “The Influence of Product Anthropomorphism on Comparative Choice” (.html). A product becomes “anthropomorphized” when it is imbued with human-like features, such as a face or a name. For example, this camera, which…Read more
THE DATA COLADA SEMINAR SERIES Posted on April 20, 2020April 20, 2020 byLeif Joe and Uri
We miss the old seminars and conferences. While we wait for those to happen again, we’ve decided to organize a seminar series ourselves. Most talks will probably be about behavioral science, but we are figuring things out as we go. The one thing that all talks will have in common is that all three of…Read more
DATA REPLICADA #4: THE PROBLEM OF HIDDEN CONFOUNDS Posted on March 10, 2020March 9, 2020 byJoe & Leif
In this installment of Data Replicada, we report on Study 3 of a recently published Journal of Consumer Research article entitled, “Does Curiosity Tempt Indulgence?” (.htm). In that study, participants were induced to feel curious or not and then were asked to (hypothetically) choose between two gym memberships, one for a “normal” gym and one…Read more
DATA REPLICADA #3: DOES SELF-CONCEPT UNCERTAINTY INFLUENCE MAGAZINE SUBSCRIPTION CHOICE? Posted on February 11, 2020February 11, 2020by Joe & Leif
In the third installment of Data Replicada, we report our attempt to replicate a recently published Journal of Consumer Research (JCR) article entitled, “The Uncertain Self: How Self-Concept Structure Affects Subscription Choice” (.htm). The central theory in the paper can be expressed in the following way: If you are uncertain about your own self-concept, then…Read more
DATA REPLICADA #2: DO SELF-CONSTRUAL AND GROUP SIZE INFLUENCE HOW PEOPLE MAKE CHOICES ON BEHALF OF A GROUP? Posted on January 15, 2020February 11, 2020by Joe & Leif
In this second installment of Data Replicada, we report two attempts to replicate a study in a recently published Journal of Consumer Research (JCR) article entitled, “Wine for the Table: Self-Construal, Group Size, and Choice for Self and Others” (.htm). Imagine that you are in a monthly book club and it is your job to…Read more
DATA REPLICADA #1: DO ELEVATED VIEWPOINTS INCREASE RISK TAKING? Posted on December 11, 2019February 11, 2020by Joe & Leif
In this post, we report our attempt to replicate a study in a recently published Journal of Marketing Research (JMR) article entitled, “Having Control Over and Above Situations: The Influence of Elevated Viewpoints on Risk Taking” (.htm). The article’s abstract summarizes the key result: “consumers’ views of scenery from a high physical elevation induce an…Read more
DATA REPLICADA
Posted on December 9, 2019December 9, 2019by Joe & Leif
With more than mild trepidation, we are introducing a new column called Data Replicada. In this column, we will report the results of exact (or close) preregistered replications of recently published findings. Anyone who has been paying attention will have noticed that the publication of exact (or close) replications has become increasingly common. So why…Read more
INTERACTION EFFECTS NEED INTERACTION CONTROLS Posted on November 20, 2019February 11, 2020by Uri Simonsohn
In a recent referee report I argued something I have argued in several reports before: if the effect of interest in a regression is an interaction, the control variables addressing possible confounds should be interactions as well. In this post I explain that argument using as a working example a 2011 QJE paper (.htm) that…Read more
EXPERIMENTATION AVERSION: RECONCILING THE EVIDENCE Posted on November 7, 2019February 11, 2020 by Berkeley Dietvorst, Rob Mislavsky, andUri Simonsohn
A PNAS paper (.htm) proposed that people object “to experiments that compare two unobjectionable policies” (their title). In our own work (.htm), we arrive at the opposite conclusion: people “don’t dislike a corporate experiment more than they dislike its worst condition” (our title). In a forthcoming PNAS letter, we identified a problem with the statistical…Read more
BAYES FACTORS IN TEN RECENT PSYCH SCIENCE PAPERS Posted on September 25, 2019February 11, 2020by Uri Simonsohn
For this post, the third in a series on Bayes factors (.htm), I wanted to get a sense for how Bayes factors were being used with real data from real papers, so I looked at the 10 most recent empirical papers in Psychological Science containing the phrase "Bayes factor" (.zip). After browsing them all, I…Read more
* 1
* 2
* 3
* 4
* …
* 9
* Next
GET COLADA EMAIL ALERTS. Join 3,129 other subscribersyou@email.com
Subscribe
TWEETER & FACEBOOK
We tweet new posts: @DataColada And link to them on our Facebook pageSEARCH POSTS
Search for:
GET BLOGPOST EMAIL ALERTS Join 3,129 other subscribersyour@email.com
Submit
TWEETER & FACEBOOK
We tweet new posts: @DataColada And link to them on our Facebook page POSTS ON SIMILAR TOPICSSEARCH
Search for:
Data Colada - All Content Licensed: CC-BYMenu
* Home
* About
* Feedback Policy
* Table of Contents
* Seminar
Details
Copyright © 2024 ArchiveBay.com. All rights reserved. Terms of Use | Privacy Policy | DMCA | 2021 | Feedback | Advertising | RSS 2.0