##Study 1 regression logistic tables
| Argument Strength Judgment | |||
|---|---|---|---|
| Predictors | Odds Ratios | std. Error | p |
| Intercept | 1.039 | 0.091 | 0.657 |
| Logical Quality | 1.490 | 0.226 | 0.008 |
| Prior Beliefs | 1.230 | 0.069 | <0.001 |
| Partisan Identity | 1.197 | 0.099 | 0.030 |
| Argument Direction | 1.052 | 0.159 | 0.740 |
|
Logical Quality × Prior Beliefs |
1.346 | 0.092 | <0.001 |
|
Logical Quality × Partisan Identity |
0.934 | 0.070 | 0.362 |
|
Prior Beliefs × Partisan Identity |
0.779 | 0.073 | 0.008 |
|
Logical Quality × Argument Direction |
1.013 | 0.307 | 0.967 |
|
Prior Beliefs × Argument Direction |
16.085 | 1.142 | <0.001 |
|
Partisan Identity × Argument Direction |
2.251 | 0.174 | <0.001 |
|
Logical Quality × Prior Beliefs × Partisan Identity |
1.331 | 0.148 | 0.010 |
|
Logical Quality × Prior Beliefs × Argument Direction |
2.163 | 0.296 | <0.001 |
|
Logical Quality × Partisan Identity × Argument Direction |
0.990 | 0.149 | 0.949 |
|
Prior Beliefs × Partisan Identity × Argument Direction |
0.608 | 0.071 | <0.001 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction |
1.912 | 0.426 | 0.004 |
| Random Effects | |||
| σ2 | 3.29 | ||
| τ00 rid | 1.46 | ||
| τ00 unique_id | 0.24 | ||
| N rid | 1193 | ||
| N unique_id | 46 | ||
| Observations | 26415 | ||
| Marginal R2 / Conditional R2 | 0.197 / 0.470 | ||
| Argument Strength Judgment | |||
|---|---|---|---|
| Predictors | Odds Ratios | std. Error | p |
| Intercept | 0.964 | 0.084 | 0.672 |
| Logical Quality | 1.572 | 0.233 | 0.002 |
| Prior Beliefs | 1.254 | 0.105 | 0.007 |
| Partisan Identity | 1.112 | 0.101 | 0.246 |
| Argument Direction | 1.607 | 0.261 | 0.003 |
|
Logical Quality × Prior Beliefs |
1.290 | 0.184 | 0.075 |
|
Logical Quality × Partisan Identity |
0.950 | 0.092 | 0.600 |
|
Prior Beliefs × Partisan Identity |
0.803 | 0.078 | 0.025 |
|
Logical Quality × Argument Direction |
0.920 | 0.268 | 0.775 |
|
Prior Beliefs × Argument Direction |
9.951 | 1.605 | <0.001 |
|
Partisan Identity × Argument Direction |
3.730 | 0.545 | <0.001 |
|
Logical Quality × Prior Beliefs × Partisan Identity |
1.231 | 0.155 | 0.098 |
|
Logical Quality × Prior Beliefs × Argument Direction |
1.848 | 0.515 | 0.028 |
|
Logical Quality × Partisan Identity × Argument Direction |
0.914 | 0.158 | 0.603 |
|
Prior Beliefs × Partisan Identity × Argument Direction |
0.470 | 0.081 | <0.001 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction |
1.949 | 0.450 | 0.004 |
| Random Effects | |||
| σ2 | 3.29 | ||
| τ00 rid | 1.70 | ||
| τ00 unique_id | 0.22 | ||
| τ11 rid.StrengthRecoded | 0.42 | ||
| τ11 rid.DirectionRecoded | 3.27 | ||
| τ11 unique_id.prior | 0.16 | ||
| τ11 unique_id.partisanship_stat | 0.02 | ||
| ρ01 | -0.58 | ||
| -0.29 | |||
| 0.39 | |||
| 0.46 | |||
| N rid | 1193 | ||
| N unique_id | 46 | ||
| Observations | 26415 | ||
| Marginal R2 / Conditional R2 | 0.162 / 0.562 | ||
| Argument Strength Judgment | |||
|---|---|---|---|
| Predictors | Odds Ratios | std. Error | p |
| Intercept | 1.186 | 0.087 | 0.020 |
| Logical Quality | 2.446 | 0.314 | <0.001 |
| Prior Beliefs | 1.014 | 0.055 | 0.798 |
| Partisan Identity | 1.263 | 0.090 | 0.001 |
| Argument Direction | 1.610 | 0.207 | <0.001 |
|
Logical Quality × Prior Beliefs |
1.024 | 0.073 | 0.736 |
|
Logical Quality × Partisan Identity |
1.162 | 0.077 | 0.024 |
|
Prior Beliefs × Partisan Identity |
0.825 | 0.074 | 0.033 |
|
Logical Quality × Argument Direction |
2.191 | 0.563 | 0.002 |
|
Prior Beliefs × Argument Direction |
4.395 | 0.314 | <0.001 |
|
Partisan Identity × Argument Direction |
0.767 | 0.051 | <0.001 |
|
Logical Quality × Prior Beliefs × Partisan Identity |
0.942 | 0.112 | 0.615 |
|
Logical Quality × Prior Beliefs × Argument Direction |
1.236 | 0.175 | 0.134 |
|
Logical Quality × Partisan Identity × Argument Direction |
1.115 | 0.148 | 0.411 |
|
Prior Beliefs × Partisan Identity × Argument Direction |
1.220 | 0.146 | 0.097 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction |
0.820 | 0.195 | 0.403 |
| Random Effects | |||
| σ2 | 3.29 | ||
| τ00 rid | 1.17 | ||
| τ00 unique_id | 0.15 | ||
| N rid | 1189 | ||
| N unique_id | 42 | ||
| Observations | 24052 | ||
| Marginal R2 / Conditional R2 | 0.119 / 0.371 | ||
| Argument Strength Judgment | |||
|---|---|---|---|
| Predictors | Odds Ratios | std. Error | p |
| Intercept | 1.174 | 0.092 | 0.041 |
| Logical Quality | 2.607 | 0.363 | <0.001 |
| Prior Beliefs | 0.949 | 0.083 | 0.553 |
| Partisan Identity | 1.313 | 0.105 | 0.001 |
| Argument Direction | 1.659 | 0.239 | <0.001 |
|
Logical Quality × Prior Beliefs |
1.148 | 0.179 | 0.375 |
|
Logical Quality × Partisan Identity |
1.132 | 0.102 | 0.169 |
|
Prior Beliefs × Partisan Identity |
0.797 | 0.078 | 0.021 |
|
Logical Quality × Argument Direction |
2.122 | 0.577 | 0.006 |
|
Prior Beliefs × Argument Direction |
5.487 | 0.896 | <0.001 |
|
Partisan Identity × Argument Direction |
0.691 | 0.077 | 0.001 |
|
Logical Quality × Prior Beliefs × Partisan Identity |
0.982 | 0.143 | 0.899 |
|
Logical Quality × Prior Beliefs × Argument Direction |
1.093 | 0.327 | 0.765 |
|
Logical Quality × Partisan Identity × Argument Direction |
1.227 | 0.182 | 0.168 |
|
Prior Beliefs × Partisan Identity × Argument Direction |
1.445 | 0.241 | 0.027 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction |
0.758 | 0.193 | 0.276 |
| Random Effects | |||
| σ2 | 3.29 | ||
| τ00 rid | 1.44 | ||
| τ00 unique_id | 0.17 | ||
| τ11 rid.StrengthRecoded | 0.70 | ||
| τ11 rid.DirectionRecoded | 1.83 | ||
| τ11 unique_id.prior | 0.17 | ||
| τ11 unique_id.partisanship_stat | 0.01 | ||
| ρ01 | -0.39 | ||
| -0.36 | |||
| -0.02 | |||
| 0.35 | |||
| N rid | 1189 | ||
| N unique_id | 42 | ||
| Observations | 24052 | ||
| Marginal R2 / Conditional R2 | 0.120 / 0.472 | ||
| Argument Strength Judgment | |||
|---|---|---|---|
| Predictors | Odds Ratios | std. Error | p |
| Intercept | 1.221 | 0.129 | 0.059 |
| Logical Quality | 1.354 | 0.234 | 0.079 |
| Prior Beliefs | 1.013 | 0.090 | 0.885 |
| Partisan Identity | 1.278 | 0.156 | 0.044 |
| Argument Direction | 0.821 | 0.142 | 0.255 |
| Treatment (vs. Control) | 0.761 | 0.078 | 0.008 |
|
Logical Quality × Prior Beliefs |
1.555 | 0.186 | <0.001 |
|
Logical Quality × Partisan Identity |
0.716 | 0.095 | 0.011 |
|
Prior Beliefs × Partisan Identity |
0.742 | 0.110 | 0.044 |
|
Logical Quality × Argument Direction |
1.435 | 0.495 | 0.295 |
|
Prior Beliefs × Argument Direction |
17.260 | 2.111 | <0.001 |
|
Partisan Identity × Argument Direction |
2.280 | 0.307 | <0.001 |
|
Logical Quality × Treatment |
1.028 | 0.116 | 0.807 |
| Prior Beliefs × Treatment | 1.014 | 0.125 | 0.913 |
|
Partisan Identity × Treatment |
0.925 | 0.158 | 0.648 |
|
Argument Direction × Treatment |
1.176 | 0.134 | 0.155 |
|
Logical Quality × Prior Beliefs × Partisan Identity |
1.594 | 0.310 | 0.016 |
|
Logical Quality × Prior Beliefs × Argument Direction |
0.901 | 0.216 | 0.663 |
|
Logical Quality × Partisan Identity × Argument Direction |
1.125 | 0.297 | 0.656 |
|
Prior Beliefs × Partisan Identity × Argument Direction |
0.644 | 0.129 | 0.028 |
|
Logical Quality × Prior Beliefs × Treatment |
0.826 | 0.133 | 0.237 |
|
Logical Quality × Partisan Identity × Treatment |
1.492 | 0.268 | 0.026 |
|
Prior Beliefs × Partisan Identity × Treatment |
1.058 | 0.221 | 0.788 |
|
Logical Quality × Argument Direction × Treatment |
0.881 | 0.199 | 0.574 |
|
Prior Beliefs × Argument Direction × Treatment |
0.378 | 0.062 | <0.001 |
|
Partisan Identity × Argument Direction × Treatment |
1.143 | 0.208 | 0.463 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction |
0.790 | 0.307 | 0.545 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Treatment |
0.719 | 0.191 | 0.215 |
|
Logical Quality × Prior Beliefs × Argument Direction × Treatment |
1.357 | 0.438 | 0.345 |
|
Logical Quality × Partisan Identity × Argument Direction × Treatment |
1.269 | 0.456 | 0.507 |
|
Prior Beliefs × Partisan Identity × Argument Direction × Treatment |
1.623 | 0.441 | 0.075 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction × Treatment |
1.681 | 0.895 | 0.330 |
| Random Effects | |||
| σ2 | 3.29 | ||
| τ00 rid | 0.95 | ||
| τ00 unique_id | 0.27 | ||
| N rid | 920 | ||
| N unique_id | 47 | ||
| Observations | 21190 | ||
| Marginal R2 / Conditional R2 | 0.164 / 0.390 | ||
| Argument Strength Judgment | |||
|---|---|---|---|
| Predictors | Odds Ratios | std. Error | p |
| Intercept | 1.223 | 0.143 | 0.084 |
| Logical Quality | 1.421 | 0.273 | 0.068 |
| Prior Beliefs | 0.996 | 0.106 | 0.970 |
| Partisan Identity | 1.258 | 0.173 | 0.095 |
| Argument Direction | 1.258 | 0.290 | 0.318 |
| Treatment (vs. Control) | 0.737 | 0.085 | 0.008 |
|
Logical Quality × Prior Beliefs |
1.596 | 0.260 | 0.004 |
|
Logical Quality × Partisan Identity |
0.718 | 0.114 | 0.036 |
|
Prior Beliefs × Partisan Identity |
0.750 | 0.121 | 0.073 |
|
Logical Quality × Argument Direction |
1.489 | 0.560 | 0.290 |
|
Prior Beliefs × Argument Direction |
12.665 | 2.679 | <0.001 |
|
Partisan Identity × Argument Direction |
3.848 | 1.027 | <0.001 |
|
Logical Quality × Treatment |
1.061 | 0.146 | 0.664 |
| Prior Beliefs × Treatment | 1.005 | 0.135 | 0.972 |
|
Partisan Identity × Treatment |
0.938 | 0.179 | 0.736 |
|
Argument Direction × Treatment |
1.067 | 0.239 | 0.773 |
|
Logical Quality × Prior Beliefs × Partisan Identity |
1.508 | 0.325 | 0.057 |
|
Logical Quality × Prior Beliefs × Argument Direction |
0.716 | 0.224 | 0.285 |
|
Logical Quality × Partisan Identity × Argument Direction |
1.207 | 0.352 | 0.519 |
|
Prior Beliefs × Partisan Identity × Argument Direction |
0.474 | 0.150 | 0.018 |
|
Logical Quality × Prior Beliefs × Treatment |
0.833 | 0.156 | 0.328 |
|
Logical Quality × Partisan Identity × Treatment |
1.547 | 0.323 | 0.036 |
|
Prior Beliefs × Partisan Identity × Treatment |
0.977 | 0.223 | 0.919 |
|
Logical Quality × Argument Direction × Treatment |
0.825 | 0.208 | 0.447 |
|
Prior Beliefs × Argument Direction × Treatment |
0.390 | 0.104 | <0.001 |
|
Partisan Identity × Argument Direction × Treatment |
1.149 | 0.423 | 0.706 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction |
0.624 | 0.251 | 0.242 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Treatment |
0.740 | 0.226 | 0.323 |
|
Logical Quality × Prior Beliefs × Argument Direction × Treatment |
1.774 | 0.619 | 0.100 |
|
Logical Quality × Partisan Identity × Argument Direction × Treatment |
1.208 | 0.459 | 0.620 |
|
Prior Beliefs × Partisan Identity × Argument Direction × Treatment |
2.098 | 0.943 | 0.099 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction × Treatment |
2.202 | 1.251 | 0.165 |
| Random Effects | |||
| σ2 | 3.29 | ||
| τ00 rid | 1.23 | ||
| τ00 unique_id | 0.32 | ||
| τ11 rid.StrengthRecoded | 0.27 | ||
| τ11 rid.DirectionRecoded | 4.41 | ||
| τ11 unique_id.prior | 0.09 | ||
| τ11 unique_id.partisanship_stat | 0.03 | ||
| τ11 unique_id.conditiontreatment | 0.02 | ||
| ρ01 rid.StrengthRecoded | -0.37 | ||
| ρ01 rid.DirectionRecoded | -0.18 | ||
| ρ01 unique_id.prior | 0.72 | ||
| ρ01 unique_id.partisanship_stat | 0.30 | ||
| ρ01 unique_id.conditiontreatment | -0.94 | ||
| N rid | 920 | ||
| N unique_id | 47 | ||
| Observations | 21190 | ||
| Marginal R2 / Conditional R2 | 0.145 / 0.540 | ||
| Argument Strength Judgment | |||
|---|---|---|---|
| Predictors | Odds Ratios | std. Error | p |
| Intercept | 1.101 | 0.099 | 0.282 |
| Logical Quality | 2.395 | 0.354 | <0.001 |
| Prior Beliefs | 1.211 | 0.130 | 0.074 |
| Partisan Identity | 1.196 | 0.146 | 0.143 |
| Argument Direction | 1.326 | 0.196 | 0.057 |
| Treatment (vs. Control) | 0.887 | 0.082 | 0.195 |
|
Logical Quality × Prior Beliefs |
1.204 | 0.193 | 0.246 |
|
Logical Quality × Partisan Identity |
1.059 | 0.169 | 0.720 |
|
Prior Beliefs × Partisan Identity |
0.929 | 0.188 | 0.715 |
|
Logical Quality × Argument Direction |
2.604 | 0.771 | 0.001 |
|
Prior Beliefs × Argument Direction |
6.075 | 0.984 | <0.001 |
|
Partisan Identity × Argument Direction |
0.644 | 0.102 | 0.006 |
|
Logical Quality × Treatment |
1.261 | 0.153 | 0.056 |
| Prior Beliefs × Treatment | 0.962 | 0.143 | 0.795 |
|
Partisan Identity × Treatment |
0.967 | 0.164 | 0.843 |
|
Argument Direction × Treatment |
1.038 | 0.126 | 0.757 |
|
Logical Quality × Prior Beliefs × Partisan Identity |
0.828 | 0.251 | 0.534 |
|
Logical Quality × Prior Beliefs × Argument Direction |
1.300 | 0.417 | 0.413 |
|
Logical Quality × Partisan Identity × Argument Direction |
0.816 | 0.259 | 0.523 |
|
Prior Beliefs × Partisan Identity × Argument Direction |
0.980 | 0.297 | 0.946 |
|
Logical Quality × Prior Beliefs × Treatment |
0.583 | 0.132 | 0.017 |
|
Logical Quality × Partisan Identity × Treatment |
1.216 | 0.269 | 0.377 |
|
Prior Beliefs × Partisan Identity × Treatment |
0.963 | 0.265 | 0.892 |
|
Logical Quality × Argument Direction × Treatment |
0.505 | 0.122 | 0.005 |
|
Prior Beliefs × Argument Direction × Treatment |
0.587 | 0.133 | 0.019 |
|
Partisan Identity × Argument Direction × Treatment |
1.179 | 0.261 | 0.455 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction |
0.499 | 0.301 | 0.250 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Treatment |
0.853 | 0.359 | 0.706 |
|
Logical Quality × Prior Beliefs × Argument Direction × Treatment |
1.715 | 0.774 | 0.232 |
|
Logical Quality × Partisan Identity × Argument Direction × Treatment |
1.032 | 0.455 | 0.943 |
|
Prior Beliefs × Partisan Identity × Argument Direction × Treatment |
0.695 | 0.293 | 0.388 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction × Treatment |
3.055 | 2.561 | 0.183 |
| Random Effects | |||
| σ2 | 3.29 | ||
| τ00 rid | 0.83 | ||
| τ00 unique_id | 0.15 | ||
| N rid | 919 | ||
| N unique_id | 42 | ||
| Observations | 9459 | ||
| Marginal R2 / Conditional R2 | 0.128 / 0.328 | ||
| Argument Strength Judgment | |||
|---|---|---|---|
| Predictors | Odds Ratios | std. Error | p |
| Intercept | 1.108 | 0.102 | 0.264 |
| Logical Quality | 2.542 | 0.378 | <0.001 |
| Prior Beliefs | 1.181 | 0.158 | 0.213 |
| Partisan Identity | 1.235 | 0.167 | 0.119 |
| Argument Direction | 1.357 | 0.221 | 0.061 |
| Treatment (vs. Control) | 0.876 | 0.087 | 0.185 |
|
Logical Quality × Prior Beliefs |
1.298 | 0.287 | 0.238 |
|
Logical Quality × Partisan Identity |
1.030 | 0.191 | 0.874 |
|
Prior Beliefs × Partisan Identity |
0.907 | 0.197 | 0.652 |
|
Logical Quality × Argument Direction |
2.621 | 0.765 | 0.001 |
|
Prior Beliefs × Argument Direction |
7.448 | 1.817 | <0.001 |
|
Partisan Identity × Argument Direction |
0.611 | 0.136 | 0.027 |
|
Logical Quality × Treatment |
1.321 | 0.177 | 0.038 |
| Prior Beliefs × Treatment | 0.962 | 0.153 | 0.807 |
|
Partisan Identity × Treatment |
0.947 | 0.174 | 0.767 |
|
Argument Direction × Treatment |
1.081 | 0.176 | 0.632 |
|
Logical Quality × Prior Beliefs × Partisan Identity |
0.802 | 0.264 | 0.503 |
|
Logical Quality × Prior Beliefs × Argument Direction |
1.180 | 0.511 | 0.702 |
|
Logical Quality × Partisan Identity × Argument Direction |
0.817 | 0.291 | 0.571 |
|
Prior Beliefs × Partisan Identity × Argument Direction |
0.985 | 0.375 | 0.969 |
|
Logical Quality × Prior Beliefs × Treatment |
0.552 | 0.136 | 0.016 |
|
Logical Quality × Partisan Identity × Treatment |
1.293 | 0.316 | 0.293 |
|
Prior Beliefs × Partisan Identity × Treatment |
0.953 | 0.281 | 0.871 |
|
Logical Quality × Argument Direction × Treatment |
0.451 | 0.115 | 0.002 |
|
Prior Beliefs × Argument Direction × Treatment |
0.527 | 0.149 | 0.023 |
|
Partisan Identity × Argument Direction × Treatment |
1.225 | 0.364 | 0.495 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction |
0.404 | 0.258 | 0.155 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Treatment |
0.859 | 0.393 | 0.739 |
|
Logical Quality × Prior Beliefs × Argument Direction × Treatment |
2.062 | 0.984 | 0.130 |
|
Logical Quality × Partisan Identity × Argument Direction × Treatment |
0.981 | 0.458 | 0.968 |
|
Prior Beliefs × Partisan Identity × Argument Direction × Treatment |
0.677 | 0.355 | 0.457 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction × Treatment |
4.554 | 4.049 | 0.088 |
| Random Effects | |||
| σ2 | 3.29 | ||
| τ00 rid | 1.00 | ||
| τ00 unique_id | 0.13 | ||
| τ11 rid.StrengthRecoded | 0.24 | ||
| τ11 rid.DirectionRecoded | 1.61 | ||
| τ11 unique_id.prior | 0.18 | ||
| τ11 unique_id.partisanship_stat | 0.04 | ||
| τ11 unique_id.conditiontreatment | 0.00 | ||
| ρ01 rid.StrengthRecoded | -0.30 | ||
| ρ01 rid.DirectionRecoded | -0.27 | ||
| ρ01 unique_id.prior | 0.21 | ||
| ρ01 unique_id.partisanship_stat | 0.50 | ||
| ρ01 unique_id.conditiontreatment | 0.75 | ||
| N rid | 919 | ||
| N unique_id | 42 | ||
| Observations | 9459 | ||
| Marginal R2 / Conditional R2 | 0.131 / 0.419 | ||
| Argument Strength Judgment | |||
|---|---|---|---|
| Predictors | Odds Ratios | std. Error | p |
| Intercept | 1.221 | 0.129 | 0.059 |
| Logical Quality | 1.354 | 0.234 | 0.079 |
| Prior Beliefs | 1.013 | 0.090 | 0.885 |
| Partisan Identity | 1.278 | 0.156 | 0.044 |
| Argument Direction | 0.821 | 0.142 | 0.255 |
| Treatment (vs. Control) | 0.761 | 0.078 | 0.008 |
|
Logical Quality × Prior Beliefs |
1.555 | 0.186 | <0.001 |
|
Logical Quality × Partisan Identity |
0.716 | 0.095 | 0.011 |
|
Prior Beliefs × Partisan Identity |
0.742 | 0.110 | 0.044 |
|
Logical Quality × Argument Direction |
1.435 | 0.495 | 0.295 |
|
Prior Beliefs × Argument Direction |
17.260 | 2.111 | <0.001 |
|
Partisan Identity × Argument Direction |
2.280 | 0.307 | <0.001 |
|
Logical Quality × Treatment |
1.028 | 0.116 | 0.807 |
| Prior Beliefs × Treatment | 1.014 | 0.125 | 0.913 |
|
Partisan Identity × Treatment |
0.925 | 0.158 | 0.648 |
|
Argument Direction × Treatment |
1.176 | 0.134 | 0.155 |
|
Logical Quality × Prior Beliefs × Partisan Identity |
1.594 | 0.310 | 0.016 |
|
Logical Quality × Prior Beliefs × Argument Direction |
0.901 | 0.216 | 0.663 |
|
Logical Quality × Partisan Identity × Argument Direction |
1.125 | 0.297 | 0.656 |
|
Prior Beliefs × Partisan Identity × Argument Direction |
0.644 | 0.129 | 0.028 |
|
Logical Quality × Prior Beliefs × Treatment |
0.826 | 0.133 | 0.237 |
|
Logical Quality × Partisan Identity × Treatment |
1.492 | 0.268 | 0.026 |
|
Prior Beliefs × Partisan Identity × Treatment |
1.058 | 0.221 | 0.788 |
|
Logical Quality × Argument Direction × Treatment |
0.881 | 0.199 | 0.574 |
|
Prior Beliefs × Argument Direction × Treatment |
0.378 | 0.062 | <0.001 |
|
Partisan Identity × Argument Direction × Treatment |
1.143 | 0.208 | 0.463 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction |
0.790 | 0.307 | 0.545 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Treatment |
0.719 | 0.191 | 0.215 |
|
Logical Quality × Prior Beliefs × Argument Direction × Treatment |
1.357 | 0.438 | 0.345 |
|
Logical Quality × Partisan Identity × Argument Direction × Treatment |
1.269 | 0.456 | 0.507 |
|
Prior Beliefs × Partisan Identity × Argument Direction × Treatment |
1.623 | 0.441 | 0.075 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction × Treatment |
1.681 | 0.895 | 0.330 |
| Random Effects | |||
| σ2 | 3.29 | ||
| τ00 rid | 0.95 | ||
| τ00 unique_id | 0.27 | ||
| N rid | 920 | ||
| N unique_id | 47 | ||
| Observations | 21190 | ||
| Marginal R2 / Conditional R2 | 0.164 / 0.390 | ||
| Argument Strength Judgment | |||
|---|---|---|---|
| Predictors | Odds Ratios | std. Error | p |
| Intercept | 1.223 | 0.143 | 0.084 |
| Logical Quality | 1.421 | 0.273 | 0.068 |
| Prior Beliefs | 0.996 | 0.106 | 0.970 |
| Partisan Identity | 1.258 | 0.173 | 0.095 |
| Argument Direction | 1.258 | 0.290 | 0.318 |
| Treatment (vs. Control) | 0.737 | 0.085 | 0.008 |
|
Logical Quality × Prior Beliefs |
1.596 | 0.260 | 0.004 |
|
Logical Quality × Partisan Identity |
0.718 | 0.114 | 0.036 |
|
Prior Beliefs × Partisan Identity |
0.750 | 0.121 | 0.073 |
|
Logical Quality × Argument Direction |
1.489 | 0.560 | 0.290 |
|
Prior Beliefs × Argument Direction |
12.665 | 2.679 | <0.001 |
|
Partisan Identity × Argument Direction |
3.848 | 1.027 | <0.001 |
|
Logical Quality × Treatment |
1.061 | 0.146 | 0.664 |
| Prior Beliefs × Treatment | 1.005 | 0.135 | 0.972 |
|
Partisan Identity × Treatment |
0.938 | 0.179 | 0.736 |
|
Argument Direction × Treatment |
1.067 | 0.239 | 0.773 |
|
Logical Quality × Prior Beliefs × Partisan Identity |
1.508 | 0.325 | 0.057 |
|
Logical Quality × Prior Beliefs × Argument Direction |
0.716 | 0.224 | 0.285 |
|
Logical Quality × Partisan Identity × Argument Direction |
1.207 | 0.352 | 0.519 |
|
Prior Beliefs × Partisan Identity × Argument Direction |
0.474 | 0.150 | 0.018 |
|
Logical Quality × Prior Beliefs × Treatment |
0.833 | 0.156 | 0.328 |
|
Logical Quality × Partisan Identity × Treatment |
1.547 | 0.323 | 0.036 |
|
Prior Beliefs × Partisan Identity × Treatment |
0.977 | 0.223 | 0.919 |
|
Logical Quality × Argument Direction × Treatment |
0.825 | 0.208 | 0.447 |
|
Prior Beliefs × Argument Direction × Treatment |
0.390 | 0.104 | <0.001 |
|
Partisan Identity × Argument Direction × Treatment |
1.149 | 0.423 | 0.706 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction |
0.624 | 0.251 | 0.242 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Treatment |
0.740 | 0.226 | 0.323 |
|
Logical Quality × Prior Beliefs × Argument Direction × Treatment |
1.774 | 0.619 | 0.100 |
|
Logical Quality × Partisan Identity × Argument Direction × Treatment |
1.208 | 0.459 | 0.620 |
|
Prior Beliefs × Partisan Identity × Argument Direction × Treatment |
2.098 | 0.943 | 0.099 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction × Treatment |
2.202 | 1.251 | 0.165 |
| Random Effects | |||
| σ2 | 3.29 | ||
| τ00 rid | 1.23 | ||
| τ00 unique_id | 0.32 | ||
| τ11 rid.StrengthRecoded | 0.27 | ||
| τ11 rid.DirectionRecoded | 4.41 | ||
| τ11 unique_id.prior | 0.09 | ||
| τ11 unique_id.partisanship_stat | 0.03 | ||
| τ11 unique_id.conditiontreatment | 0.02 | ||
| ρ01 rid.StrengthRecoded | -0.37 | ||
| ρ01 rid.DirectionRecoded | -0.18 | ||
| ρ01 unique_id.prior | 0.72 | ||
| ρ01 unique_id.partisanship_stat | 0.30 | ||
| ρ01 unique_id.conditiontreatment | -0.94 | ||
| N rid | 920 | ||
| N unique_id | 47 | ||
| Observations | 21190 | ||
| Marginal R2 / Conditional R2 | 0.145 / 0.540 | ||
| Argument Strength Judgment | |||
|---|---|---|---|
| Predictors | Odds Ratios | std. Error | p |
| Intercept | 1.101 | 0.099 | 0.282 |
| Logical Quality | 2.395 | 0.354 | <0.001 |
| Prior Beliefs | 1.211 | 0.130 | 0.074 |
| Partisan Identity | 1.196 | 0.146 | 0.143 |
| Argument Direction | 1.326 | 0.196 | 0.057 |
| Treatment (vs. Control) | 0.887 | 0.082 | 0.195 |
|
Logical Quality × Prior Beliefs |
1.204 | 0.193 | 0.246 |
|
Logical Quality × Partisan Identity |
1.059 | 0.169 | 0.720 |
|
Prior Beliefs × Partisan Identity |
0.929 | 0.188 | 0.715 |
|
Logical Quality × Argument Direction |
2.604 | 0.771 | 0.001 |
|
Prior Beliefs × Argument Direction |
6.075 | 0.984 | <0.001 |
|
Partisan Identity × Argument Direction |
0.644 | 0.102 | 0.006 |
|
Logical Quality × Treatment |
1.261 | 0.153 | 0.056 |
| Prior Beliefs × Treatment | 0.962 | 0.143 | 0.795 |
|
Partisan Identity × Treatment |
0.967 | 0.164 | 0.843 |
|
Argument Direction × Treatment |
1.038 | 0.126 | 0.757 |
|
Logical Quality × Prior Beliefs × Partisan Identity |
0.828 | 0.251 | 0.534 |
|
Logical Quality × Prior Beliefs × Argument Direction |
1.300 | 0.417 | 0.413 |
|
Logical Quality × Partisan Identity × Argument Direction |
0.816 | 0.259 | 0.523 |
|
Prior Beliefs × Partisan Identity × Argument Direction |
0.980 | 0.297 | 0.946 |
|
Logical Quality × Prior Beliefs × Treatment |
0.583 | 0.132 | 0.017 |
|
Logical Quality × Partisan Identity × Treatment |
1.216 | 0.269 | 0.377 |
|
Prior Beliefs × Partisan Identity × Treatment |
0.963 | 0.265 | 0.892 |
|
Logical Quality × Argument Direction × Treatment |
0.505 | 0.122 | 0.005 |
|
Prior Beliefs × Argument Direction × Treatment |
0.587 | 0.133 | 0.019 |
|
Partisan Identity × Argument Direction × Treatment |
1.179 | 0.261 | 0.455 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction |
0.499 | 0.301 | 0.250 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Treatment |
0.853 | 0.359 | 0.706 |
|
Logical Quality × Prior Beliefs × Argument Direction × Treatment |
1.715 | 0.774 | 0.232 |
|
Logical Quality × Partisan Identity × Argument Direction × Treatment |
1.032 | 0.455 | 0.943 |
|
Prior Beliefs × Partisan Identity × Argument Direction × Treatment |
0.695 | 0.293 | 0.388 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction × Treatment |
3.055 | 2.561 | 0.183 |
| Random Effects | |||
| σ2 | 3.29 | ||
| τ00 rid | 0.83 | ||
| τ00 unique_id | 0.15 | ||
| N rid | 919 | ||
| N unique_id | 42 | ||
| Observations | 9459 | ||
| Marginal R2 / Conditional R2 | 0.128 / 0.328 | ||
| Argument Strength Judgment | |||
|---|---|---|---|
| Predictors | Odds Ratios | std. Error | p |
| Intercept | 1.108 | 0.102 | 0.264 |
| Logical Quality | 2.542 | 0.378 | <0.001 |
| Prior Beliefs | 1.181 | 0.158 | 0.213 |
| Partisan Identity | 1.235 | 0.167 | 0.119 |
| Argument Direction | 1.357 | 0.221 | 0.061 |
| Treatment (vs. Control) | 0.876 | 0.087 | 0.185 |
|
Logical Quality × Prior Beliefs |
1.298 | 0.287 | 0.238 |
|
Logical Quality × Partisan Identity |
1.030 | 0.191 | 0.874 |
|
Prior Beliefs × Partisan Identity |
0.907 | 0.197 | 0.652 |
|
Logical Quality × Argument Direction |
2.621 | 0.765 | 0.001 |
|
Prior Beliefs × Argument Direction |
7.448 | 1.817 | <0.001 |
|
Partisan Identity × Argument Direction |
0.611 | 0.136 | 0.027 |
|
Logical Quality × Treatment |
1.321 | 0.177 | 0.038 |
| Prior Beliefs × Treatment | 0.962 | 0.153 | 0.807 |
|
Partisan Identity × Treatment |
0.947 | 0.174 | 0.767 |
|
Argument Direction × Treatment |
1.081 | 0.176 | 0.632 |
|
Logical Quality × Prior Beliefs × Partisan Identity |
0.802 | 0.264 | 0.503 |
|
Logical Quality × Prior Beliefs × Argument Direction |
1.180 | 0.511 | 0.702 |
|
Logical Quality × Partisan Identity × Argument Direction |
0.817 | 0.291 | 0.571 |
|
Prior Beliefs × Partisan Identity × Argument Direction |
0.985 | 0.375 | 0.969 |
|
Logical Quality × Prior Beliefs × Treatment |
0.552 | 0.136 | 0.016 |
|
Logical Quality × Partisan Identity × Treatment |
1.293 | 0.316 | 0.293 |
|
Prior Beliefs × Partisan Identity × Treatment |
0.953 | 0.281 | 0.871 |
|
Logical Quality × Argument Direction × Treatment |
0.451 | 0.115 | 0.002 |
|
Prior Beliefs × Argument Direction × Treatment |
0.527 | 0.149 | 0.023 |
|
Partisan Identity × Argument Direction × Treatment |
1.225 | 0.364 | 0.495 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction |
0.404 | 0.258 | 0.155 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Treatment |
0.859 | 0.393 | 0.739 |
|
Logical Quality × Prior Beliefs × Argument Direction × Treatment |
2.062 | 0.984 | 0.130 |
|
Logical Quality × Partisan Identity × Argument Direction × Treatment |
0.981 | 0.458 | 0.968 |
|
Prior Beliefs × Partisan Identity × Argument Direction × Treatment |
0.677 | 0.355 | 0.457 |
|
Logical Quality × Prior Beliefs × Partisan Identity × Argument Direction × Treatment |
4.554 | 4.049 | 0.088 |
| Random Effects | |||
| σ2 | 3.29 | ||
| τ00 rid | 1.00 | ||
| τ00 unique_id | 0.13 | ||
| τ11 rid.StrengthRecoded | 0.24 | ||
| τ11 rid.DirectionRecoded | 1.61 | ||
| τ11 unique_id.prior | 0.18 | ||
| τ11 unique_id.partisanship_stat | 0.04 | ||
| τ11 unique_id.conditiontreatment | 0.00 | ||
| ρ01 rid.StrengthRecoded | -0.30 | ||
| ρ01 rid.DirectionRecoded | -0.27 | ||
| ρ01 unique_id.prior | 0.21 | ||
| ρ01 unique_id.partisanship_stat | 0.50 | ||
| ρ01 unique_id.conditiontreatment | 0.75 | ||
| N rid | 919 | ||
| N unique_id | 42 | ||
| Observations | 9459 | ||
| Marginal R2 / Conditional R2 | 0.131 / 0.419 | ||
We find little heterogeneity on the key results on Study 2. That is, political identity threats decrease perceived strength of prior inconsistent arguments. We observe significant argument directionality and treatment interaction for climate skeptics, \(b = -0.35, p < .001\), as well as climate believers, \(b = -0.42, p < .001\), suggesting that political identity threats decrease strength perception of prior-consistent arguments. We found similar effects for Republicans, \(b = -0.35, p < .001\), and Democrats, \(b = -0.21, p = 0.06\), though the observed effect on Democrats were smaller.
We find little heterogeneity on the key results on Study 3. That is, logical warnings decrease perceived strength of weak, but not strong arguments. We observe significant logical quality and treatment interaction for climate skeptics, \(b = 0.23, p = .05\), as well as climate believers, \(b = 0.30, p < .001\). We found similar effects for Republicans, \(b = 0.32, p < .001\), and Democrats, \(b = 0.35, p < .001\).