lingo.lol is one of the many independent Mastodon servers you can use to participate in the fediverse.
A place for linguists, philologists, and other lovers of languages.

Server stats:

59
active users

#effectsize

0 posts0 participants0 posts today
Nicola Romanò<p>When designing a scientific experiment, a key factor is the sample size to be used for the results of the experiment to be meaningful.</p><p>How many cells do I need to measure? How many people do I interview? How many patients do I try my new drug on?</p><p>This is of great importance especially for quantitative studies, where we use statistics to determine whether a treatment or condition has an effect. Indeed, when we test a drug on a (small) number of patients, we do so in the hope our results can generalise to any patient because it would be impossible to test it on everyone.</p><p>The solution is to perform a "power analysis", a calculation that tells us whether given our experimental design, the statistical test we are using is able to see an effect of a certain magnitude, if that effect is really there. In other words, this is something that tells us whether the experiment we're planning to do could give us meaningful results.</p><p>But, as I said, in order to do a power analysis we need to decide what size of effect we would like to see. So... do scientists actually do that?</p><p>We explored this question in the context of the chronic variable stress literature.</p><p>We found that only a few studies give a clear justification for the sample size used, and in those that do, only a very small fraction used a biologically meaningful effect size as part of the sample size calculation. We discuss challenges around identifying a biologically meaningful effect size and ways to overcome them.</p><p>Read more here!<br><a href="https://physoc.onlinelibrary.wiley.com/doi/10.1113/EP092884" rel="nofollow noopener" target="_blank"><span class="invisible">https://</span><span class="ellipsis">physoc.onlinelibrary.wiley.com</span><span class="invisible">/doi/10.1113/EP092884</span></a></p><p><a href="https://qoto.org/tags/experiments" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>experiments</span></a> <a href="https://qoto.org/tags/ExperimentalDesign" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ExperimentalDesign</span></a> <a href="https://qoto.org/tags/effectsize" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>effectsize</span></a> <a href="https://qoto.org/tags/statistics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>statistics</span></a> <a href="https://qoto.org/tags/stress" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>stress</span></a> <a href="https://qoto.org/tags/research" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>research</span></a> <a href="https://qoto.org/tags/article" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>article</span></a> <a href="https://qoto.org/tags/power" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>power</span></a> <a href="https://qoto.org/tags/biology" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>biology</span></a></p>
Dr Mircea Zloteanu ☀️ 🌊🌴<p>🚨New blog post 📝: Your Study Is Too Small (If You Care About Practically Significant Effects)</p><p><a href="https://mastodon.social/tags/effectsize" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>effectsize</span></a> <a href="https://mastodon.social/tags/precision" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>precision</span></a> <a href="https://mastodon.social/tags/poweranalysis" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>poweranalysis</span></a> <a href="https://mastodon.social/tags/research" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>research</span></a> <a href="https://mastodon.social/tags/Psychology" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Psychology</span></a> <a href="https://mastodon.social/tags/MCID" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MCID</span></a> <a href="https://mastodon.social/tags/SESOI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SESOI</span></a> <a href="https://mastodon.social/tags/samplesize" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>samplesize</span></a> </p><p> <a href="https://open.substack.com/pub/mzloteanu/p/your-study-is-too-small-if-you-care?r=3b457w&amp;utm_campaign=post&amp;utm_medium=web&amp;showWelcomeOnShare=true" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">open.substack.com/pub/mzlotean</span><span class="invisible">u/p/your-study-is-too-small-if-you-care?r=3b457w&amp;utm_campaign=post&amp;utm_medium=web&amp;showWelcomeOnShare=true</span></a></p>
Dr Mircea Zloteanu ☀️ 🌊🌴<p><a href="https://mastodon.social/tags/statstab" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>statstab</span></a> #353 The Abuse of Power; The Pervasive Fallacy of Power Calculations for Data Analysis</p><p>Thoughts: An seminal paper on "post hoc" power calculations.</p><p><a href="https://mastodon.social/tags/power" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>power</span></a> <a href="https://mastodon.social/tags/QRPs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>QRPs</span></a> <a href="https://mastodon.social/tags/NHST" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>NHST</span></a> <a href="https://mastodon.social/tags/posthoc" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>posthoc</span></a> <a href="https://mastodon.social/tags/samplesize" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>samplesize</span></a> <a href="https://mastodon.social/tags/effectsize" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>effectsize</span></a></p><p><a href="https://www.tandfonline.com/doi/abs/10.1198/000313001300339897" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">tandfonline.com/doi/abs/10.119</span><span class="invisible">8/000313001300339897</span></a></p>
RDN<p>An overview of 67 different effect size estimators, including confidence intervals, for two-group comparisons:</p><p><a href="https://journals.sagepub.com/doi/full/10.1177/25152459251323186" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">journals.sagepub.com/doi/full/</span><span class="invisible">10.1177/25152459251323186</span></a></p><p>The authors have also developed a Shiny web app to evaluate these.</p><p><a href="https://floss.social/tags/Science" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Science</span></a> <a href="https://floss.social/tags/Statistics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Statistics</span></a> <a href="https://floss.social/tags/EffectSize" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>EffectSize</span></a> <a href="https://floss.social/tags/RStats" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>RStats</span></a></p>
Bjørn Sætrevik<p>An even better solution would be a table where you could select which type of effect <a href="https://fediscience.org/tags/effectSize" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>effectSize</span></a> measure to show (calculated using e.g. these calculations <a href="https://www.escal.site/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="">escal.site/</span><span class="invisible"></span></a>). If anyone has the skills to implement that in <a href="https://fediscience.org/tags/wikipedia" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>wikipedia</span></a> <a href="https://fediscience.org/tags/markup" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>markup</span></a>, please do so!</p>
Bjørn Sætrevik<p>It always takes me some minutes to look up the interpretation guidelines for various effect size measures (yes, I know the rules of thumb are somewhat arbitrary). Today I edited Wikipedia to show three different guidelines for four different measures in the same table. Hopefully this can save some time for other researchers. </p><p><a href="https://fediscience.org/tags/methodology" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>methodology</span></a> <a href="https://fediscience.org/tags/psychometrics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>psychometrics</span></a> <a href="https://fediscience.org/tags/EffectSize" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>EffectSize</span></a> <a href="https://fediscience.org/tags/OpenScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>OpenScience</span></a> <a href="https://fediscience.org/tags/wikipedia" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>wikipedia</span></a></p>
Nicola Romanò<p>New <a href="https://qoto.org/tags/preprint" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>preprint</span></a> on <a href="https://qoto.org/tags/biorxiv" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>biorxiv</span></a>!</p><p>"Rodent chronic variable stress procedures: a disjunction between stress entity and impact on behaviour"</p><p><a href="https://www.biorxiv.org/content/10.1101/2024.07.04.602063v1.full.pdf+html" rel="nofollow noopener" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">biorxiv.org/content/10.1101/20</span><span class="invisible">24.07.04.602063v1.full.pdf+html</span></a></p><p>We systematically investigated 350+ studies using chronic variable stress procedures in rodents and assessed the characteristics of the procedure (how many stressors they used, and how many different types, and for how long), then measured the reported effect size for those using behavioural tests as an outcome. </p><p>Some key disconcerting findings from our study </p><p>- the large majority of articles uses a unique protocol, and articles featuring the same protocol were from the same authors (aside from one case)<br>- 91% of articles don't provide any justification for their choice of procedure</p><p>This is scientifically and ethically troubling given CVS procedures deliberately impose suffering to animals.</p><p>- when looking at the outcome behavioural procedures measured in the studies (some of which impose further stress on the animals) we found very little correlation between effect size and the characteristics (eg length, strength) of the stress protocol. When there was a statistically significant effect, this was generally very small.</p><p>We conclude </p><p>"Most of the studies in our review sought evidence for interventions that would prevent or reverse the effects of chronic stress. But if we are to have any confidence that translational CVS studies provide a foundation for potential clinical interventions, we must take an evidence- and ethics-informed approach to their design."</p><p><a href="https://qoto.org/tags/chronicVariableStress" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>chronicVariableStress</span></a> <a href="https://qoto.org/tags/stress" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>stress</span></a> <a href="https://qoto.org/tags/reproducibility" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>reproducibility</span></a> <a href="https://qoto.org/tags/ethics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ethics</span></a> <a href="https://qoto.org/tags/effectSize" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>effectSize</span></a> <a href="https://qoto.org/tags/translationalResearch" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>translationalResearch</span></a> <a href="https://qoto.org/tags/physiology" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>physiology</span></a></p>
Joel Snyder<p>Application of JNDs to meta-science. Very sensible!</p><p>"For example, in clinical settings researchers may specify this smallest effect size of interest as the smallest difference in a health condition that patients themselves notice...this practice has been used at least since the advent of psychophysics in the second half of the 19th century"</p><p><a href="https://neuromatch.social/tags/metascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>metascience</span></a> <a href="https://neuromatch.social/tags/psychology" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>psychology</span></a> <a href="https://neuromatch.social/tags/neuroscience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>neuroscience</span></a> <a href="https://neuromatch.social/tags/effectsize" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>effectsize</span></a> <a href="https://neuromatch.social/tags/psychophysics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>psychophysics</span></a> <a href="https://neuromatch.social/tags/samplesize" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>samplesize</span></a> </p><p><a href="https://www.nature.com/articles/s41562-024-01858-z?utm_source=nathumbehav_etoc&amp;utm_medium=email&amp;utm_campaign=toc_41562_8_5&amp;utm_content=20240529" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">nature.com/articles/s41562-024</span><span class="invisible">-01858-z?utm_source=nathumbehav_etoc&amp;utm_medium=email&amp;utm_campaign=toc_41562_8_5&amp;utm_content=20240529</span></a></p>
bk<p><a href="https://sfba.social/tags/MetaAnalysis" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MetaAnalysis</span></a> preprint (from <a href="https://sfba.social/tags/Stanford" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Stanford</span></a> colleagues) suggests <a href="https://sfba.social/tags/EffectSize" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>EffectSize</span></a> best predicts <a href="https://sfba.social/tags/Replication" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Replication</span></a> (followed by within-subjects design): <br><a href="https://psyarxiv.com/dpyn6/" rel="nofollow noopener" target="_blank"><span class="invisible">https://</span><span class="">psyarxiv.com/dpyn6/</span><span class="invisible"></span></a></p>