Lingolol

0 posts0 participants0 posts today

Nick Byrd, Ph.D.New <a href="https://nerdculture.de/tags/surveyMethods" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#surveyMethods</a> paper replicates and extends differences in <a href="https://nerdculture.de/tags/dataQuality" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#dataQuality</a>, attention, naivety, decision style, etc. by - online <a href="https://nerdculture.de/tags/research" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#research</a> recruitment platform (<a href="https://nerdculture.de/tags/mTurk" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#mTurk</a>, <a href="https://nerdculture.de/tags/Prolific" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Prolific</a>, <a href="https://nerdculture.de/tags/Qualtrics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Qualtrics</a>, <a href="https://nerdculture.de/tags/Pollfish" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Pollfish</a>) - device (<a href="https://nerdculture.de/tags/mobile" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#mobile</a> v. <a href="https://nerdculture.de/tags/desktop" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#desktop</a>) - person's incentive<a href="https://doi.org/10.3758/s13428-025-02618-1" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://doi.org/10.3758/s13428-025-02618-1</a>

Nick Byrd, Ph.D.🎉 In press: Reflection-<a href="https://nerdculture.de/tags/Philosophy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Philosophy</a> Order Effects & Correlations Across SamplesThought experiments caused reflective decisions? Reflection tests didn't change philosophical decisions! 18X more junk data from <a href="https://nerdculture.de/tags/mTurk" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#mTurk</a> (vs other sources)!<a href="https://nerdculture.de/tags/Preprint" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Preprint</a> + audio: <a href="https://byrdnick.com/archives/28438/upon-reflection-ep-13-reflection-philosophy-order-effects-and-correlations-across-samples" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://byrdnick.com/archives/28438/upon-reflection-ep-13-reflection-philosophy-order-effects-and-correlations-across-samples</a>

Nick Byrd, Ph.D.Excited to share YEARS of research about how to get people to think reflectively and how reflection impacts philosophical judgments at the 2025 <a href="https://nerdculture.de/tags/APA" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#APA</a> in <a href="https://nerdculture.de/tags/NewYorkCity" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#NewYorkCity</a> (January 8 to 11): <a href="https://www.apaonline.org/mpage/2025eastern" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://www.apaonline.org/mpage/2025eastern</a> Can't make it? - More about my talk: <a href="https://researchgate.net/publication/370132037" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://researchgate.net/publication/370132037</a> - More about my poster: <a href="https://researchgate.net/publication/371248872" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://researchgate.net/publication/371248872</a>Thanks to the <a href="https://nerdculture.de/tags/APA" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#APA</a>, James Beebe, and the Experimental Philosophy Society for the opportunity!<a href="https://nerdculture.de/tags/decisionScience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#decisionScience</a> <a href="https://nerdculture.de/tags/philosophy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#philosophy</a> <a href="https://nerdculture.de/tags/xPhi" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#xPhi</a> <a href="https://nerdculture.de/tags/epistemology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#epistemology</a> <a href="https://nerdculture.de/tags/bioethics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#bioethics</a> <a href="https://nerdculture.de/tags/cognitiveScience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#cognitiveScience</a> <a href="https://nerdculture.de/tags/mTurk" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#mTurk</a> <a href="https://nerdculture.de/tags/Prolific" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Prolific</a> <a href="https://nerdculture.de/tags/UniversityParticipants" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#UniversityParticipants</a> <a href="https://nerdculture.de/tags/surveyMethods" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#surveyMethods</a> <a href="https://nerdculture.de/tags/DualProcessTheory" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#DualProcessTheory</a>

Nick Byrd, Ph.D.Are moral decisions impacted by economic environment?Perhaps! “…in low-income nations, tournament-based compensation increased deontological commitments [but] in higher-income nations, the effect on deontological commitments reversed …consistent with the historical development of the doux commerce thesis.”A fun <a href="https://nerdculture.de/tags/economics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#economics</a> paper that reminds me of the early days of <a href="https://nerdculture.de/tags/xPhi" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#xPhi</a>: <a href="https://doi.org/10.1093/jleo/ewae016" rel="nofollow noopener noreferrer" translate="no" target="_blank">https://doi.org/10.1093/jleo/ewae016</a><a href="https://nerdculture.de/tags/philosophy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#philosophy</a> <a href="https://nerdculture.de/tags/psychology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#psychology</a> <a href="https://nerdculture.de/tags/policy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#policy</a> <a href="https://nerdculture.de/tags/history" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#history</a> <a href="https://nerdculture.de/tags/ethics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ethics</a> <a href="https://nerdculture.de/tags/development" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#development</a> <a href="https://nerdculture.de/tags/decisionScience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#decisionScience</a> <a href="https://nerdculture.de/tags/mTurk" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#mTurk</a>

Florian 'floe' EchtlerA question for the <a href="https://hci.social/tags/HCI" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#HCI</a> folks (please repost for more reach):Since the <a href="https://hci.social/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#LLM</a> cat is definitely out of the bag now, do you feel that <a href="https://hci.social/tags/Prolific" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Prolific</a>, <a href="https://hci.social/tags/MTurk" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MTurk</a>, etc. are still a reliable source of survey participants and consequently, survey data?

Nick Byrd, Ph.D.What's the difference between microtask platforms like <a href="https://nerdculture.de/tags/mTurk" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#mTurk</a> or Prolific and market-research panels?CloudResearch recently published an <a href="https://nerdculture.de/tags/openAccess" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#openAccess</a> paper that explains. (The paper also includes a step-by-step tutorial for using their "Prime Panels" in conjunction Qualtrics). <a href="https://doi.org/10.1177/25152459221140388" rel="nofollow noopener noreferrer" target="_blank">https://doi.org/10.1177/25152459221140388</a><a href="https://nerdculture.de/tags/humanSubjectsResearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#humanSubjectsResearch</a> <a href="https://nerdculture.de/tags/researchMethods" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#researchMethods</a> <a href="https://nerdculture.de/tags/surveyMethodology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#surveyMethodology</a> <a href="https://nerdculture.de/tags/Psychology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Psychology</a> <a href="https://nerdculture.de/tags/CogSci" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#CogSci</a> <a href="https://nerdculture.de/tags/xPhi" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#xPhi</a>

markFor the <a href="https://sciences.social/tags/polisci" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#polisci</a> & public opinion crew: In psychology there are papers that tally what types of samples are most often used in the field (E.g., XX% college students, YY% Mturk etc). Are there any examples of this from your own fields?Essentially, I'm trying to put some approximate numbers to the different norms in types of sample that I see<a href="https://a.gup.pe/u/politicalscience" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@politicalscience</a> <a href="https://a.gup.pe/u/socialpsych" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@socialpsych</a> <a href="https://sciences.social/tags/research" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#research</a> <a href="https://sciences.social/tags/sample" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#sample</a> <a href="https://sciences.social/tags/Mturk" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Mturk</a>

Fabrizio Gilardi 💬ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskswith Meysam Alizadeh & Maël Kubli We find that zero-shot <a href="https://mastodon.social/tags/ChatGPT" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#ChatGPT</a>: > has better accuracy than <a href="https://mastodon.social/tags/MTurk" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MTurk</a> > has better intercoder agreement than MTurk and trained coders > is 20x cheaper than MTurk<a href="https://arxiv.org/abs/2303.15056" rel="nofollow noopener noreferrer" target="_blank">https://arxiv.org/abs/2303.15056</a>

Alex HannaRT <a href="https://mastodon.social/@turkopticon" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@turkopticon</a> It's time to recognize the challenges we face, take into account the autonomy & well-being of those working on <a href="https://dair-community.social/tags/MTurk" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MTurk</a> & create solutions that ensure the fairest treatment of Turkers worldwide. Next Wednesday @ <a href="https://dair-community.social/tags/Mozfest" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Mozfest</a> :undefined:<a href="https://mozillafestival.org/en/tickets" rel="nofollow noopener noreferrer" target="_blank">https://mozillafestival.org/en/tickets</a> :undefined:<a href="https://schedule.mozillafestival.org/session/U7L8W8" rel="nofollow noopener noreferrer" target="_blank">https://schedule.mozillafestival.org/session/U7L8W8</a>

Alex HannaRT <a href="https://mastodon.social/@turkopticon" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@turkopticon</a>Are you curious about the challenges of virtual global organizing in the <a href="https://dair-community.social/tags/GigEconomy" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#GigEconomy</a>? Our session at <a href="https://dair-community.social/tags/Mozfest" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Mozfest</a> on "Uniting the Amazon <a href="https://dair-community.social/tags/MTurk" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MTurk</a> Workers Behind AI" is in less than 3 weeks!Don't miss it! <a href="https://mozillafestival.org/en/tickets" rel="nofollow noopener noreferrer" target="_blank">https://mozillafestival.org/en/tickets</a> <a href="https://schedule.mozillafestival.org/session/U7L8W8" rel="nofollow noopener noreferrer" target="_blank">https://schedule.mozillafestival.org/session/U7L8W8</a>

Nick Byrd, Ph.D.What conclusion do you draw, if any, when all (and only) the people who wrote in "non-binary" to the question, "What is your gender?" failed a survey's attention check?Why would someone who puts in the effort to write a (vs. select a pre-written) response have been inattentive earlier in the survey?I doubt that people reporting non-binary gender are generally less attentive on surveys.So was it most likely a fluke?<a href="https://nerdculture.de/tags/mTurk" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#mTurk</a> <a href="https://nerdculture.de/tags/CloudResearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#CloudResearch</a> <a href="https://nerdculture.de/tags/researchMethods" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#researchMethods</a> <a href="https://nerdculture.de/tags/demographics" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#demographics</a> <a href="https://nerdculture.de/tags/dataQuality" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#dataQuality</a>

Nick Byrd, Ph.D.mTurk HITs completedCan you get them automatically added to a dataset when running a survey?Sort of like you can automatically add Worker ID, Assignment ID, and HIT ID to the dataset with certain URL parameters. <a href="https://nerdculture.de/tags/psychology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#psychology</a> <a href="https://nerdculture.de/tags/survey" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#survey</a> <a href="https://nerdculture.de/tags/research" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#research</a> <a href="https://nerdculture.de/tags/mTurk" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#mTurk</a> <a href="https://nerdculture.de/tags/dataQuality" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#dataQuality</a>

Paolo PalmaI’m seeing that “Too good to be true” mturk paper uncritically shared on mastodon. That paper was not peer reviewed and the editor who approved it was asked to resign for similar editorial practices (accepting un-reviewed, one-sided commentaries)Here is another paper pointing out all the deficiencies of that paper that would have been caught in peer review: <a href="https://psyarxiv.com/w7qy9" rel="nofollow noopener noreferrer" target="_blank">https://psyarxiv.com/w7qy9</a><a href="https://mastodon.social/tags/MTurk" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#MTurk</a> <a href="https://mastodon.social/tags/Psych" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#Psych</a> <a href="https://mastodon.social/tags/SocialPsych" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#SocialPsych</a>

Nick Byrd, Ph.D.Study of <a href="https://nerdculture.de/tags/mTurk" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#mTurk</a> workers concludes that <a href="https://nerdculture.de/tags/dataQuality" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#dataQuality</a> and <a href="https://nerdculture.de/tags/replicability" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#replicability</a> are no longer ensured by mTurk's worker quality metrics (HITs completed and HIT acceptance rate) because "researchers do not reject HITs containing poor-quality data" (N = 900).Some researchers block workers who produce poor-quality data, but unless we share/aggregate our block lists, we allow known-bad work to infect our colleagues' research. It's a <a href="https://nerdculture.de/tags/collectiveActionProblem" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#collectiveActionProblem</a>!<a href="https://doi.org/10.3758/s13428-022-01999-x" rel="nofollow noopener noreferrer" target="_blank">https://doi.org/10.3758/s13428-022-01999-x</a><a href="https://nerdculture.de/tags/CogSci" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#CogSci</a> <a href="https://nerdculture.de/tags/PhilSci" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#PhilSci</a> <a href="https://nerdculture.de/tags/xPhi" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#xPhi</a>

Recent searches

Search options

Administered by:

Server stats:

#mturk