Determining optimal parameters of the Self Referent Encoding Task: A large-scale examination of self-referent cognition and depression

This file is one of a series of supplemental explanatory documents for the study “Determining optimal parameters of the Self Referent Encoding Task: A large-scale examination of self-referent cognition and depression”. Data and code are located at doi: 10.18738/T8/XK5PXX, and websites with visual R Markdown explanations are located and navigable on the paper’s github pages website.

Data description

This code looks at the reliability of three samples for the SRET, checking for a variety of types of internal reliability. If you are viewing this as an HTML file, and wish to see the code, please download the R Markdown file from the Texas Data Repository.

We used processed datasets from all three samples – that is, participants with bad or incomplete data have been dropped, and trials outside of reasonable reaction-time (RT) based boundaries have been excluded. We import the saved datasets.

Internal Reliability & Consistency

We created functions to test Cronbach’s alpha, split-half reliability, and odd/even reliability in each subset. These are wrappers for the psych package’s alpha() function, and for the base R cor.test() function.

Cronbach’s Alpha

Cronbach’s alpha was calculated separately for each sample (for both timepoints for the MTurk sample), with 10,000 bootstrapped repetitions for 95% Confidence Intervals. It was calculated separately for endorsements of positive and negative words, and separately for reaction times (RTs) to positive and negative words.

Minimum and maximum alphas

Across all samples, for endorsements:

Min & Max of all Alphas:

  mins ci.95.minalpha maxes ci.95.maxalpha
pos endorsements 0.9303 95% CI [0.913, 0.943] 0.9725 95% CI [0.965, 0.978]
neg endorsements 0.9073 95% CI [0.895, 0.918] 0.9433 95% CI [0.929, 0.954]

Min and max of all inter-item correlations

  min max
pos endorsements 0.3386 0.5637
neg endorsements 0.2665 0.4033

Across all samples, for RTs

Min & Max of all Alphas:

  mins ci.95.minalpha maxes ci.95.maxalpha
pos RT 0.9455 95% CI [0.935, 0.954] 0.9827 95% CI [0.979, 0.985]
neg RT 0.9399 95% CI [0.927, 0.949] 0.9828 95% CI [0.977, 0.986]

Min and max of all inter-item correlations

  min max
pos RT 0.4001 0.6942
neg RT 0.3772 0.6976

Detailed alphas per-sample

College Students

For the comparison endorsements, the college students sample has the following [minimum] alpha levels

  raw.alpha conf.lower conf.higher standardized.alpha interitem.cor
total-positive 0.9527 0.946 0.958 0.9513 0.4289
min-positive 0.949 NA NA 0.9478 NA
total-negative 0.9073 0.895 0.918 0.9043 0.2665
min-negative 0.8995 NA NA 0.8968 NA

For the comparison rts, the college students sample has the following [minimum] alpha levels

  raw.alpha conf.lower conf.higher standardized.alpha interitem.cor
total-positive 0.9746 0.972 0.977 0.9747 0.597
min-positive 0.9733 NA NA 0.9734 NA
total-negative 0.9722 0.969 0.975 0.9724 0.5751
min-negative 0.9706 NA NA 0.9709 NA

MTurk (T1 and then T2)

For the comparison endorsements, the MTurk T1 sample has the following [minimum] alpha levels

  raw.alpha conf.lower conf.higher standardized.alpha interitem.cor
total-positive 0.9708 0.965 0.976 0.9698 0.5528
min-positive 0.9687 NA NA 0.9678 NA
total-negative 0.9433 0.929 0.954 0.9462 0.4033
min-negative 0.9386 NA NA 0.9424 NA

For the comparison rts, the MTurk T1 sample has the following [minimum] alpha levels

  raw.alpha conf.lower conf.higher standardized.alpha interitem.cor
total-positive 0.9814 0.979 0.984 0.9815 0.6714
min-positive 0.9802 NA NA 0.9804 NA
total-negative 0.9817 0.979 0.984 0.9822 0.6799
min-negative 0.9808 NA NA 0.9813 NA

For the comparison endorsements, the MTurk T2 sample has the following [minimum] alpha levels

  raw.alpha conf.lower conf.higher standardized.alpha interitem.cor
total-positive 0.9725 0.965 0.978 0.9711 0.5637
min-positive 0.9703 NA NA 0.969 NA
total-negative 0.9397 0.919 0.954 0.943 0.3891
min-negative 0.9343 NA NA 0.9388 NA

For the comparison rts, the MTurk T2 sample has the following [minimum] alpha levels

  raw.alpha conf.lower conf.higher standardized.alpha interitem.cor
total-positive 0.9827 0.979 0.985 0.9833 0.6942
min-positive 0.9816 NA NA 0.9824 NA
total-negative 0.9828 0.977 0.986 0.9836 0.6976
min-negative 0.9817 NA NA 0.9826 NA

Adolescents

For the comparison endorsements, the adolescents sample has the following [minimum] alpha levels

  raw.alpha conf.lower conf.higher standardized.alpha interitem.cor
total-positive 0.9303 0.913 0.943 0.9301 0.3386
min-positive 0.9251 NA NA 0.9252 NA
total-negative 0.9273 0.908 0.942 0.9279 0.331
min-negative 0.9224 NA NA 0.9232 NA

For the comparison rts, the adolescents sample has the following [minimum] alpha levels

  raw.alpha conf.lower conf.higher standardized.alpha interitem.cor
total-positive 0.9455 0.935 0.954 0.9455 0.4001
min-positive 0.9425 NA NA 0.9425 NA
total-negative 0.9399 0.927 0.949 0.9403 0.3772
min-negative 0.9367 NA NA 0.9372 NA

Raw Item Statistics, per-sample

Endorsements

College students

  n raw.r std.r r.cor r.drop mean sd
happy 619 0.7869 0.796 0.7955 0.7645 0.8384 0.3683
good 619 0.6448 0.665 0.6508 0.6189 0.9128 0.2824
joyful 616 0.79 0.7892 0.7852 0.7653 0.7857 0.4107
proud 619 0.685 0.6804 0.6629 0.6503 0.7674 0.4229
brilliant 620 0.6881 0.6632 0.6508 0.6484 0.6581 0.4747
great 618 0.8135 0.7963 0.7958 0.7884 0.7621 0.4261
nice 620 0.4421 0.4876 0.4648 0.4155 0.9484 0.2214
excited 619 0.7853 0.7732 0.7679 0.7591 0.7544 0.4308
pleased 619 0.7759 0.7724 0.7681 0.7505 0.7997 0.4006
glad 620 0.7522 0.7549 0.7483 0.7251 0.8129 0.3903
excellent 619 0.8351 0.808 0.812 0.8096 0.6931 0.4616
wonderful 619 0.8194 0.804 0.8036 0.7973 0.727 0.4459
loved 617 0.4909 0.5151 0.4852 0.4594 0.9303 0.2548
fun 618 0.6955 0.7098 0.7012 0.6671 0.8689 0.3377
friendly 619 0.479 0.5112 0.482 0.4485 0.9386 0.2402
helpful 619 0.4801 0.5046 0.4741 0.4453 0.9015 0.2983
confident 618 0.718 0.7072 0.6945 0.6876 0.7832 0.4124
fantastic 620 0.8061 0.7782 0.7804 0.7792 0.6565 0.4753
cool 619 0.6273 0.6239 0.6035 0.5881 0.7787 0.4155
awesome 619 0.7809 0.7634 0.7572 0.7544 0.7641 0.4249
best 620 0.7129 0.6852 0.6736 0.6741 0.6016 0.49
content 615 0.5867 0.5858 0.5641 0.5461 0.8325 0.3737
free 615 0.6025 0.6077 0.5847 0.5672 0.8537 0.3537
playful 620 0.637 0.6431 0.6279 0.6023 0.8387 0.3681
kind 620 0.4152 0.4629 0.4385 0.3878 0.9468 0.2247
funny 620 0.5609 0.5698 0.5485 0.5244 0.8629 0.3442
  n raw.r std.r r.cor r.drop mean sd
alone 617 0.6648 0.6409 0.6352 0.6136 0.3355 0.4725
angry 620 0.5892 0.604 0.5887 0.5455 0.1435 0.3509
annoyed 619 0.6034 0.5869 0.563 0.5447 0.3489 0.477
ashamed 619 0.668 0.6626 0.6511 0.6243 0.2116 0.4088
bad 620 0.4938 0.53 0.5035 0.455 0.08226 0.275
depressed 620 0.7035 0.6877 0.683 0.6625 0.2242 0.4174
guilty 619 0.5777 0.5712 0.5509 0.5236 0.2407 0.4279
hateful 620 0.3323 0.3715 0.3254 0.2905 0.06935 0.2543
horrible 620 0.4461 0.4952 0.4721 0.4099 0.0629 0.243
lonely 619 0.6747 0.6462 0.6407 0.6236 0.3683 0.4827
lost 619 0.7074 0.6813 0.6742 0.6618 0.3263 0.4692
mad 620 0.5818 0.6005 0.5843 0.5392 0.1371 0.3442
nasty 620 0.2048 0.2499 0.2008 0.166 0.05 0.2181
naughty 619 0.2524 0.2663 0.217 0.187 0.1729 0.3784
sad 616 0.7446 0.7244 0.7243 0.7061 0.2484 0.4324
scared 618 0.6678 0.6449 0.6316 0.6196 0.2945 0.4562
silly 618 -0.03423 -0.02999 -0.09768 -0.112 0.7379 0.4402
sorry 619 0.662 0.6487 0.6361 0.6129 0.2892 0.4537
stupid 620 0.5686 0.583 0.5574 0.5228 0.1516 0.3589
terrible 619 0.3898 0.4395 0.4081 0.3504 0.06785 0.2517
unhappy 620 0.7128 0.6934 0.6896 0.6733 0.2161 0.4119
unloved 618 0.5498 0.5473 0.5289 0.505 0.1392 0.3464
unwanted 619 0.6903 0.6779 0.6745 0.6498 0.168 0.3742
upset 616 0.7076 0.6992 0.691 0.6684 0.2305 0.4215
wicked 619 0.2801 0.3248 0.2776 0.2374 0.06947 0.2545
worried 619 0.6028 0.5672 0.5477 0.5417 0.4863 0.5002

MTurk, Time 1

  n raw.r std.r r.cor r.drop mean sd
happy 300 0.8631 0.8625 0.8617 0.8491 0.7633 0.4257
good 303 0.6704 0.6869 0.6747 0.6477 0.8746 0.3317
joyful 303 0.8715 0.8622 0.8607 0.8567 0.7063 0.4562
proud 302 0.7917 0.7824 0.774 0.7705 0.6987 0.4596
brilliant 303 0.7208 0.7053 0.6937 0.6919 0.6865 0.4647
great 303 0.8702 0.8587 0.8592 0.8555 0.7162 0.4516
nice 303 0.5755 0.6129 0.6015 0.5532 0.9208 0.2705
excited 302 0.791 0.7778 0.7687 0.7693 0.6722 0.4702
pleased 302 0.8199 0.8128 0.8082 0.8013 0.755 0.4308
glad 303 0.8493 0.845 0.8428 0.8335 0.7657 0.4243
excellent 303 0.8626 0.8467 0.8467 0.8468 0.7096 0.4547
wonderful 303 0.8749 0.8585 0.8613 0.8599 0.6832 0.466
loved 303 0.6683 0.684 0.6651 0.6437 0.8515 0.3562
fun 301 0.7631 0.774 0.7693 0.7414 0.8106 0.3925
friendly 303 0.6203 0.6514 0.6381 0.5966 0.9043 0.2947
helpful 303 0.4968 0.5337 0.5201 0.4696 0.9109 0.2854
confident 303 0.8045 0.793 0.7844 0.7834 0.736 0.4415
fantastic 303 0.8727 0.8578 0.8614 0.8576 0.6832 0.466
cool 303 0.7653 0.7596 0.7467 0.7419 0.7327 0.4433
awesome 303 0.8449 0.8283 0.8293 0.8271 0.6931 0.462
best 302 0.8318 0.8152 0.8127 0.8132 0.6556 0.476
content 303 0.7901 0.7838 0.7782 0.7688 0.7558 0.4303
free 303 0.6915 0.6995 0.6835 0.6661 0.8152 0.3888
playful 303 0.7434 0.7507 0.7436 0.7206 0.802 0.3992
kind 303 0.497 0.5362 0.5222 0.4728 0.9274 0.2599
funny 302 0.6363 0.6501 0.6362 0.6092 0.8377 0.3693
  n raw.r std.r r.cor r.drop mean sd
alone 301 0.6562 0.6315 0.6206 0.613 0.3488 0.4774
angry 303 0.6522 0.6662 0.6546 0.6182 0.1485 0.3562
annoyed 302 0.643 0.6342 0.6129 0.5992 0.2881 0.4536
ashamed 303 0.7854 0.7879 0.7845 0.7612 0.1716 0.3777
bad 303 0.6514 0.6834 0.6716 0.6228 0.09241 0.2901
depressed 303 0.8031 0.78 0.7782 0.7762 0.2904 0.4547
guilty 303 0.7039 0.706 0.6986 0.674 0.1485 0.3562
hateful 303 0.5662 0.6019 0.584 0.5339 0.08581 0.2805
horrible 303 0.631 0.673 0.6661 0.6054 0.07261 0.2599
lonely 303 0.686 0.6581 0.6483 0.6456 0.3234 0.4686
lost 303 0.7895 0.7724 0.7679 0.763 0.2277 0.4201
mad 303 0.6522 0.67 0.6577 0.6181 0.1485 0.3562
nasty 302 0.5824 0.6231 0.61 0.5561 0.06291 0.2432
naughty 302 0.3521 0.3781 0.3418 0.3014 0.1457 0.3534
sad 303 0.7956 0.7688 0.7686 0.768 0.2871 0.4532
scared 303 0.7498 0.7416 0.7325 0.7205 0.198 0.3992
silly 303 0.1223 0.1027 0.0483 0.04436 0.5281 0.5
sorry 303 0.7381 0.7214 0.7157 0.7076 0.2178 0.4134
stupid 303 0.5516 0.5679 0.5413 0.5176 0.1023 0.3036
terrible 303 0.5708 0.6117 0.5985 0.5415 0.07921 0.2705
unhappy 303 0.8168 0.7905 0.7909 0.7932 0.2574 0.4379
unloved 301 0.714 0.7125 0.7089 0.6856 0.1661 0.3728
unwanted 302 0.7494 0.7322 0.7317 0.7146 0.1788 0.3838
upset 302 0.766 0.7559 0.7491 0.7353 0.2119 0.4093
wicked 302 0.4945 0.5298 0.5124 0.4541 0.07947 0.2709
worried 303 0.705 0.6748 0.6625 0.6657 0.3696 0.4835

MTurk, Time 2

  n raw.r std.r r.cor r.drop mean sd
happy 177 0.8726 0.8691 0.8672 0.8591 0.7401 0.4398
good 177 0.7755 0.784 0.7764 0.757 0.8475 0.3606
joyful 177 0.8722 0.8654 0.8642 0.8583 0.7119 0.4542
proud 176 0.8477 0.8331 0.8297 0.8246 0.6989 0.4601
brilliant 177 0.7848 0.766 0.7622 0.7613 0.6497 0.4784
great 177 0.8727 0.8582 0.8573 0.8586 0.6949 0.4617
nice 177 0.6047 0.6413 0.6305 0.5813 0.9096 0.2876
excited 176 0.8729 0.8616 0.8585 0.8596 0.6705 0.4714
pleased 177 0.8608 0.8534 0.8525 0.8464 0.7514 0.4334
glad 177 0.8687 0.8647 0.8631 0.855 0.7514 0.4334
excellent 177 0.8517 0.8322 0.8341 0.835 0.678 0.4686
wonderful 175 0.8944 0.8828 0.886 0.8864 0.68 0.4678
loved 177 0.5262 0.5516 0.5308 0.4942 0.8588 0.3493
fun 177 0.8019 0.8118 0.8079 0.7836 0.8023 0.3994
friendly 177 0.6039 0.6443 0.635 0.5825 0.9153 0.2793
helpful 177 0.4084 0.4468 0.4248 0.3794 0.9096 0.2876
confident 177 0.8664 0.8548 0.8532 0.8523 0.7401 0.4398
fantastic 177 0.8803 0.8628 0.8641 0.8665 0.6497 0.4784
cool 177 0.6662 0.6657 0.6467 0.6337 0.6893 0.4641
awesome 177 0.8151 0.7925 0.7927 0.7952 0.6893 0.4641
best 177 0.8541 0.8322 0.834 0.8375 0.6441 0.4802
content 177 0.7948 0.7934 0.7888 0.7749 0.774 0.4194
free 177 0.7023 0.7148 0.7029 0.678 0.8136 0.3906
playful 177 0.7558 0.7553 0.7458 0.7339 0.8023 0.3994
kind 177 0.4346 0.4828 0.4658 0.4131 0.9492 0.2203
funny 176 0.6767 0.689 0.6792 0.6514 0.8125 0.3914
  n raw.r std.r r.cor r.drop mean sd
alone 176 0.744 0.7177 0.7103 0.7083 0.3523 0.479
angry 177 0.6688 0.6874 0.6785 0.637 0.1243 0.3309
annoyed 176 0.639 0.6247 0.6041 0.5947 0.2727 0.4466
ashamed 177 0.7092 0.7082 0.7014 0.6782 0.1638 0.3712
bad 177 0.633 0.6647 0.6532 0.6052 0.08475 0.2793
depressed 177 0.8201 0.7957 0.7999 0.7946 0.2486 0.4334
guilty 177 0.5392 0.543 0.5241 0.4965 0.1638 0.3712
hateful 176 0.5366 0.5833 0.5693 0.5049 0.07386 0.2623
horrible 177 0.5975 0.6384 0.6282 0.5681 0.08475 0.2793
lonely 176 0.7027 0.675 0.6647 0.6615 0.3352 0.4734
lost 177 0.7486 0.728 0.7223 0.7189 0.1977 0.3994
mad 177 0.6797 0.7017 0.695 0.6516 0.1073 0.3104
nasty 177 0.582 0.6352 0.6313 0.5582 0.05085 0.2203
naughty 177 0.4215 0.4531 0.4296 0.3745 0.1299 0.3372
sad 177 0.8203 0.7891 0.7941 0.7947 0.2542 0.4367
scared 177 0.6796 0.6651 0.6501 0.6461 0.1638 0.3712
silly 176 -0.04033 -0.06747 -0.1221 -0.1209 0.5568 0.4982
sorry 177 0.7543 0.7349 0.7302 0.7227 0.2203 0.4157
stupid 177 0.4543 0.4889 0.463 0.4214 0.0678 0.2521
terrible 177 0.6438 0.6826 0.6744 0.6142 0.1017 0.3031
unhappy 176 0.8313 0.8034 0.8067 0.8087 0.2557 0.4375
unloved 177 0.7243 0.7161 0.7115 0.6932 0.1808 0.3859
unwanted 177 0.7385 0.7268 0.7255 0.7088 0.1808 0.3859
upset 177 0.781 0.7753 0.7722 0.7528 0.209 0.4078
wicked 177 0.4834 0.5356 0.5264 0.4504 0.07345 0.2616
worried 177 0.7257 0.6937 0.6824 0.6862 0.3333 0.4727

Adolescents

  n raw.r std.r r.cor r.drop mean sd
happy 358 0.6738 0.6682 0.6535 0.6338 0.9106 0.2857
good 353 0.6164 0.6215 0.6073 0.5665 0.9178 0.275
joyful 356 0.6525 0.6554 0.6435 0.6087 0.8483 0.3592
proud 353 0.6633 0.666 0.6523 0.6254 0.8329 0.3736
brilliant 344 0.6089 0.587 0.5687 0.562 0.7384 0.4402
great 351 0.755 0.7509 0.7484 0.731 0.8405 0.3667
nice 358 0.4602 0.5046 0.4845 0.4332 0.9441 0.23
excited 344 0.691 0.6823 0.67 0.6489 0.8372 0.3697
pleased 330 0.6175 0.6145 0.5964 0.58 0.8091 0.3936
glad 352 0.7045 0.706 0.6968 0.6716 0.8352 0.3715
excellent 352 0.7258 0.7046 0.7002 0.6903 0.7869 0.4101
wonderful 354 0.7561 0.7496 0.7453 0.7274 0.8051 0.3967
loved 352 0.5464 0.5309 0.5052 0.481 0.8977 0.3034
fun 359 0.5981 0.6281 0.6168 0.5735 0.9331 0.2501
friendly 356 0.3341 0.3869 0.3504 0.3102 0.9607 0.1946
helpful 342 0.4635 0.4726 0.4453 0.4108 0.8947 0.3073
confident 347 0.7132 0.712 0.7079 0.6896 0.8069 0.3953
fantastic 352 0.7451 0.7387 0.734 0.7203 0.7898 0.408
cool 340 0.5981 0.6016 0.581 0.5629 0.7676 0.423
awesome 350 0.7208 0.6994 0.6954 0.6835 0.84 0.3671
best 332 0.7047 0.6854 0.6762 0.6695 0.6717 0.4703
content 274 0.4295 0.431 0.3945 0.374 0.6496 0.478
free 318 0.5882 0.5785 0.554 0.5361 0.827 0.3788
playful 338 0.4778 0.4976 0.4705 0.4367 0.8817 0.3235
kind 350 0.342 0.3714 0.3425 0.2927 0.9343 0.2481
funny 359 0.415 0.4413 0.4097 0.3761 0.9164 0.2771
  n raw.r std.r r.cor r.drop mean sd
alone 351 0.608 0.5944 0.5776 0.5561 0.1595 0.3667
angry 351 0.6518 0.6416 0.6287 0.6121 0.1795 0.3843
annoyed 320 0.5917 0.5588 0.5355 0.5203 0.3125 0.4642
ashamed 346 0.6408 0.6378 0.6208 0.5957 0.1156 0.3202
bad 356 0.5564 0.5599 0.5424 0.5096 0.08146 0.2739
depressed 343 0.6896 0.6909 0.6798 0.6587 0.137 0.3444
dumb 351 0.5724 0.5858 0.5684 0.5365 0.1225 0.3283
guilty 335 0.5881 0.6 0.5827 0.5477 0.1433 0.3509
hateful 353 0.5486 0.5527 0.5292 0.5007 0.102 0.3031
horrible 355 0.5903 0.6002 0.5855 0.5401 0.08732 0.2827
lonely 338 0.63 0.6363 0.6254 0.601 0.2012 0.4015
lost 345 0.6504 0.648 0.6336 0.6182 0.171 0.3771
mad 346 0.667 0.6718 0.6635 0.6314 0.1474 0.355
nasty 353 0.3784 0.4104 0.3741 0.3438 0.06516 0.2472
naughty 331 0.4313 0.4298 0.3948 0.3672 0.1208 0.3264
sad 354 0.7181 0.719 0.7155 0.6918 0.1554 0.3628
scared 342 0.6972 0.6789 0.6682 0.6535 0.1784 0.3834
sorry 335 0.6167 0.6021 0.5814 0.5686 0.2239 0.4175
stupid 357 0.6475 0.6473 0.6355 0.6031 0.1457 0.3533
terrible 348 0.6173 0.6474 0.6365 0.5957 0.06322 0.2437
unhappy 352 0.6281 0.6197 0.6025 0.5843 0.1392 0.3467
unloved 333 0.4547 0.4466 0.4156 0.3795 0.08108 0.2734
unwanted 350 0.6435 0.6469 0.6319 0.6039 0.1314 0.3384
upset 345 0.654 0.6502 0.636 0.6225 0.1768 0.3821
wicked 335 0.407 0.4285 0.3962 0.3556 0.1373 0.3447
worried 331 0.6248 0.6233 0.6083 0.5973 0.2931 0.4559

Split-task reliability

We split up the task in two ways with the intent of better understanding consistency in responses. First, we looked at odd/even reliability – dividing the task into odd and even trials. Secondly, we looked at split-third reliability for the two samples that had multiple blocks.

The primary outcomes here are, of course, response (i.e., endorsements) and RT. However, we’re also able to export the results of each block, treat them as separate timepoints per participant, and run fast-dm (Voss & Voss, 2007) on each to get components of the diffusion model. This approach has some limits, given that the diffusion model is ideal for longer tasks (thus the repetition of the blocks). However, it is nonetheless an approach with the benefit of permitting us to see whether consistency is constant throughout variables, and whether patterns of response change over time.

We were able to calculate response-based odd/even reliability for all samples, by dividing the samples into odd and even trials and estimating responses. We also calculated the diffusion model results for the MTurk (at T1 and T2) and College Student samples based on these halves; there were too few responses from the adolescent sample to split it up further and get accurate diffusion model results.

For the College Student and MTurk samples, participants completed three blocks of the SRET. As such, we’re able to calculate split-third reliability—that is, to compare the first and third blocks, and determine whether patterns of response were consistent across those blocks.

(The adolescent sample only completed one block of the SRET.)

Endorsement responses

Odd/Even split

College student sample has the following correlations between parts for response:
  t df p.value r conf.on.r
positive 81.64 618 < .001 0.9566 95% CI [0.947, 0.965]
negative 55.57 618 < .001 0.9128 95% CI [0.897, 0.926] 
MTurk sample, Session 1 has the following correlations between parts for response:
  t df p.value r conf.on.r
positive 74.58 301 < .001 0.974 95% CI [0.966, 0.981]
negative 50.06 301 < .001 0.9449 95% CI [0.927, 0.959] 
MTurk sample, Session 2 has the following correlations between parts for response:
  t df p.value r conf.on.r
positive 62.05 175 < .001 0.978 95% CI [0.969, 0.985]
negative 37.34 175 < .001 0.9426 95% CI [0.918, 0.96] 
Adolescent sample has the following correlations between parts for response:
  t df p.value r conf.on.r
positive 34.7 375 < .001 0.8732 95% CI [0.839, 0.901]
negative 30.81 375 < .001 0.8466 95% CI [0.799, 0.884]

Min and max of all odd/even correlations for responses:

Minimum r-value for positive:
r.values conf.intervals
0.8732 95% CI [0.839, 0.901] 
Maximum r-value for positive:
r.values conf.intervals
0.978 95% CI [0.969, 0.985] 
Minimum r-value for negative:
r.values conf.intervals
0.8466 95% CI [0.799, 0.884] 
Maximum r-value for negative:
r.values conf.intervals
0.9449 95% CI [0.927, 0.959]

Split Thirds

The college students sample has the following correlations between parts for response:
  t df p.value r conf.on.r
positive 43.15 618 < .001 0.8665 95% CI [0.837, 0.891]
negative 41.41 618 < .001 0.8573 95% CI [0.827, 0.884] 
The MTurk sample at T1 has the following correlations between parts for response:
  t df p.value r conf.on.r
positive 32.79 301 < .001 0.8839 95% CI [0.836, 0.923]
negative 46.35 301 < .001 0.9365 95% CI [0.905, 0.958] 
The MTurk sample at T2 has the following correlations between parts for response:
  t df p.value r conf.on.r
positive 34.32 175 < .001 0.9331 95% CI [0.898, 0.957]
negative 38.07 175 < .001 0.9446 95% CI [0.912, 0.966] 
Minimum r-value for positive:
r.values conf.intervals
0.8665 95% CI [0.837, 0.891] 
Maximum r-value for positive:
r.values conf.intervals
0.9331 95% CI [0.898, 0.957] 
Minimum r-value for negative:
r.values conf.intervals
0.8573 95% CI [0.827, 0.884] 
Maximum r-value for negative:
r.values conf.intervals
0.9446 95% CI [0.912, 0.966]

Diffusion Model – positive drift rate (v)

Odd/Even split

The college student sample has the following correlations between parts for drift rate (v) to positive words:
t df p.value r conf.on.r
46.68 618 < .001 0.8826 95% CI [0.864, 0.899] 
The MTurk sample at T1 has the following correlations between parts for drift rate (v) to positive words:
t df p.value r conf.on.r
36.15 301 < .001 0.9015 95% CI [0.88, 0.92] 
The MTurk sample at T2 has the following correlations between parts for drift rate (v) to positive words:
t df p.value r conf.on.r
29.37 175 < .001 0.9118 95% CI [0.884, 0.934]

Split Thirds

The college student sample has the following correlations between parts for drift rate (v) to positive words:
t df p.value r conf.on.r
31.67 618 < .001 0.7866 95% CI [0.755, 0.815] 
The MTurk sample at T1 has the following correlations between parts for drift rate (v) to positive words:
t df p.value r conf.on.r
23.59 300 < .001 0.8061 95% CI [0.76, 0.847] 
The MTurk sample at T2 has the following correlations between parts for drift rate (v) to positive words:
t df p.value r conf.on.r
22.42 175 < .001 0.8613 95% CI [0.818, 0.897]

Diffusion Model – negative drift rate (v)

Odd/Even split

The college student sample has the following correlations between parts for drift rate (v) to negative words:
t df p.value r conf.on.r
33.33 618 < .001 0.8016 95% CI [0.775, 0.826] 
The MTurk sample at T1 has the following correlations between parts for drift rate (v) to negative words:
t df p.value r conf.on.r
29.27 301 < .001 0.8602 95% CI [0.828, 0.888] 
The MTurk sample at T2 has the following correlations between parts for drift rate (v) to negative words:
t df p.value r conf.on.r
20.98 175 < .001 0.8459 95% CI [0.799, 0.887]

Split Thirds

The college student sample has the following correlations between parts for drift rate (v) to negative words:
t df p.value r conf.on.r
24.19 618 < .001 0.6974 95% CI [0.648, 0.743] 
The MTurk sample at T1 has the following correlations between parts for drift rate (v) to negative words:
t df p.value r conf.on.r
23.18 300 < .001 0.8011 95% CI [0.745, 0.849] 
The MTurk sample at T2 has the following correlations between parts for drift rate (v) to negative words:
t df p.value r conf.on.r
17.73 175 < .001 0.8014 95% CI [0.732, 0.856]

Diffusion Model – Relative Starting Point (zr) for Negative Words

Odd/Even split

The college student sample has the following correlations between parts for relative starting point (zr) for negative words:
t df p.value r conf.on.r
10.51 618 < .001 0.3893 95% CI [0.317, 0.458] 
The MTurk sample at T1 has the following correlations between parts for relative starting point (zr) for negative words:
t df p.value r conf.on.r
8.056 301 < .001 0.4211 95% CI [0.318, 0.516] 
The MTurk sample at T2 has the following correlations between parts for relative starting point (zr) for negative words:
t df p.value r conf.on.r
7.611 175 < .001 0.4987 95% CI [0.385, 0.599]

Split Thirds

The college student sample has the following correlations between parts for relative starting point (zr) for negative words:
t df p.value r conf.on.r
7.656 618 < .001 0.2943 95% CI [0.217, 0.371] 
The MTurk sample at T1 has the following correlations between parts for relative starting point (zr) for negative words:
t df p.value r conf.on.r
8.085 300 < .001 0.423 95% CI [0.321, 0.517] 
The MTurk sample at T2 has the following correlations between parts for relative starting point (zr) for negative words:
t df p.value r conf.on.r
6.815 175 < .001 0.458 95% CI [0.319, 0.58]

Diffusion Model – szr

Odd/Even split

The college student sample has the following correlations between parts for szr:
t df p.value r conf.on.r
1.633 618 0.103 0.06553 95% CI [-0.018, 0.147] 
The MTurk sample at T1 has the following correlations between parts for szr:
t df p.value r conf.on.r
0.4075 301 0.684 0.02348 95% CI [-0.093, 0.136] 
The MTurk sample at T2 has the following correlations between parts for szr:
t df p.value r conf.on.r
1.639 175 0.103 0.123 95% CI [-0.068, 0.297]

Split Thirds

The college student sample has the following correlations between parts for szr:
t df p.value r conf.on.r
2.117 618 0.035 0.08484 95% CI [0, 0.169] 
The MTurk sample at T1 has the following correlations between parts for szr:
t df p.value r conf.on.r
2.537 300 0.012 0.1449 95% CI [0.018, 0.27] 
The MTurk sample at T2 has the following correlations between parts for szr:
t df p.value r conf.on.r
2.879 175 0.004 0.2127 95% CI [0.058, 0.354]

Diffusion Model – st0

Odd/Even split

The college student sample has the following correlations between parts for st0:
t df p.value r conf.on.r
10.95 618 < .001 0.4032 95% CI [0.315, 0.486] 
The MTurk sample at T1 has the following correlations between parts for st0:
t df p.value r conf.on.r
10.86 301 < .001 0.5307 95% CI [0.371, 0.664] 
The MTurk sample at T2 has the following correlations between parts for st0:
t df p.value r conf.on.r
7.006 175 < .001 0.468 95% CI [0.318, 0.592]

Split Thirds

The college student sample has the following correlations between parts for st0:
t df p.value r conf.on.r
3.799 618 < .001 0.1511 95% CI [0.051, 0.252] 
The MTurk sample at T1 has the following correlations between parts for st0:
t df p.value r conf.on.r
6.796 300 < .001 0.3653 95% CI [0.21, 0.495] 
The MTurk sample at T2 has the following correlations between parts for st0:
t df p.value r conf.on.r
2.886 175 0.004 0.2131 95% CI [0.018, 0.374]

Diffusion Model – a

Odd/Even split

The college student sample has the following correlations between parts for a:
t df p.value r conf.on.r
31.69 618 < .001 0.7868 95% CI [0.746, 0.823] 
The MTurk sample at T1 has the following correlations between parts for a:
t df p.value r conf.on.r
22.64 301 < .001 0.7937 95% CI [0.743, 0.835] 
The MTurk sample at T2 has the following correlations between parts for a:
t df p.value r conf.on.r
18.65 175 < .001 0.8157 95% CI [0.68, 0.896]

Split Thirds

The college student sample has the following correlations between parts for a:
t df p.value r conf.on.r
21.4 618 < .001 0.6524 95% CI [0.594, 0.706] 
The MTurk sample at T1 has the following correlations between parts for a:
t df p.value r conf.on.r
12.77 300 < .001 0.5934 95% CI [0.51, 0.671] 
The MTurk sample at T2 has the following correlations between parts for a:
t df p.value r conf.on.r
12.54 175 < .001 0.6879 95% CI [0.588, 0.765]

RTs

Odd/Even split

Not reported in the paper, but easy to calculate – note that correlations remain high.

College student sample has the following correlations between parts for response:
  t df p.value r conf.on.r
positive 87.44 618 < .001 0.9619 95% CI [0.954, 0.968]
negative 81.64 618 < .001 0.9566 95% CI [0.948, 0.964] 
MTurk sample, Session 1 has the following correlations between parts for response:
  t df p.value r conf.on.r
positive 74.92 301 < .001 0.9742 95% CI [0.966, 0.981]
negative 72.27 301 < .001 0.9724 95% CI [0.964, 0.98] 
MTurk sample, Session 2 has the following correlations between parts for response:
  t df p.value r conf.on.r
positive 69.31 175 < .001 0.9823 95% CI [0.976, 0.988]
negative 53.15 175 < .001 0.9704 95% CI [0.955, 0.981] 
Adolescent sample has the following correlations between parts for response:
  t df p.value r conf.on.r
positive 35.16 375 < .001 0.8759 95% CI [0.836, 0.909]
negative 36.52 375 < .001 0.8835 95% CI [0.855, 0.909]