## STAGE 6 annotation audit
rows: 972
{'instance': 791, 'lexicalised': 103, 'excluded': 78}
instances by subcorpus: {'YZ': 306, 'YT': 286, 'IG': 102, 'CTRL': 92, 'CTRL-SUPP': 5}
lexicalised by subcorpus: {'YZ': 35, 'YT': 30, 'CTRL': 19, 'IG': 17, 'CTRL-SUPP': 2}
excluded reasons: {'fp': 41, 'kopya(YZ-02)': 17, 'quotative-yok': 5, 'nonneg': 3, 'kopya(YZ-23-içi)': 3, 'temporal(-mAdAn önce)': 2, 'temporal(-Ar -mAz)': 2, 'yoksa-bağlaç': 2, 'nonneg-anomalous': 1, 'artefact': 1, 'transkripsiyon-notu': 1}
excluded by text (dup YZ-05): {'AST-YZ-05': 17, 'AST-YT-03': 8, 'AST-YT-02': 6, 'AST-YZ-02': 4, 'AST-YZ-19': 4}
analytical instances: astro 694 ctrl 92 supp 5
fine categories used: ['ADD', 'ALT', 'ASCR', 'CONC', 'COR', 'DE', 'DI', 'DIR', 'HEDG', 'IDM', 'INT', 'NONEX', 'NPRED', 'PART', 'PROB', 'REAS', 'REJ', 'UNCL'] 18
all functions used: ['ADD', 'ALT', 'ASCR', 'CONC', 'COR', 'DE', 'DI', 'DIR', 'HEDG', 'IDM', 'INT', 'NONEX', 'NPRED', 'PART', 'PROB', 'REAS', 'REJ', 'UNCL']
n_functions check: True
primary == first listed: True
multifunctional astro: 98 / 694  ctrl: 8 / 92
commonest pairs astro: [(('DIR', 'REAS'), 20), (('HEDG', 'NPRED'), 10), (('HEDG', 'PROB'), 9), (('COR', 'REAS'), 8), (('HEDG', 'REAS'), 7), (('DI', 'HEDG'), 6), (('DI', 'NPRED'), 4), (('DI', 'PROB'), 4)]
confidence astro: {'H': 573, 'M': 117, 'L': 3, '': 1}  ctrl: {'H': 77, 'M': 8, '': 7}
reported_speech astro: {'0': 643, 'V': 47, 'R': 4}  ctrl: {'R': 65, '0': 27}
npi astro: 53  ctrl: 7  total 60
formal types astro: {'VERB': 182, 'PTCP/NMLZ': 101, 'SIZ': 89, 'DEGIL': 73, 'NMLZ': 67, 'LEX': 40, 'CVB': 33, 'PTCP/NMLZ+ABIL': 27, 'MOD-NEC': 20, 'YOK': 18, 'VERB+ABIL': 18, 'MOD-POSS': 15, 'NMLZ+ABIL': 5, 'MOD-POSS+ABIL': 3, 'LEXZ(SIZ)': 1, 'YOK-PART': 1, 'CVB+ABIL': 1}
formal types ctrl: {'SIZ': 17, 'VERB': 13, 'PTCP/NMLZ': 10, 'DEGIL': 9, 'NMLZ': 8, 'LEX': 8, 'LEXZ(SIZ)': 7, 'VERB+ABIL': 7, 'CVB': 5, 'PTCP/NMLZ+ABIL': 4, 'YOK': 3, 'NENE': 1}
recycled rows: {'0': 777, '1': 9}

## STAGE 5 corpus
texts per subcorpus: {'AST-IG': 30, 'AST-YT': 30, 'CTRL': 30, 'AST-YZ': 29}
words per subcorpus (this script): {'AST-IG': 7493, 'AST-YT': 19921, 'CTRL': 10838, 'AST-YZ': 14844} astro total 42258 grand 53096
annotation-report word counts (not reproduced exactly): IG 7386 YT 19758 YZ 14761 CTRL 10773 astro 41905

## STAGE 8 overall frequency
pooled rates per 1000 (this script): astro 16.42  ctrl 8.49
  AST-IG: n_inst=102 words=7493 rate=13.61 texts_with>=1=28
  AST-YT: n_inst=286 words=19921 rate=14.36 texts_with>=1=30
  AST-YZ: n_inst=306 words=14844 rate=20.61 texts_with>=1=28
  CTRL: n_inst=92 words=10838 rate=8.49 texts_with>=1=22
ALL astro vs ctrl per-text: n=89/30 median=14.71/4.31 mean=16.32/7.87 U=2028.5 p=2.21e-05 r=0.52
zero-instance texts: astro 3  ctrl 8
  AST-IG vs ctrl: n=30/30 median=10.52/4.31 mean=13.49/7.87 U=631.5 p=7.31e-03 r=0.40
  AST-YT vs ctrl: n=30/30 median=11.80/4.31 mean=14.71/7.87 U=669.0 p=1.22e-03 r=0.49
  AST-YZ vs ctrl: n=29/30 median=19.72/4.31 mean=20.92/7.87 U=728.0 p=8.88e-06 r=0.67
  Kruskal-Wallis among astro subcorpora: KruskalResult(statistic=np.float64(9.32328629471176), pvalue=np.float64(0.009450920381457025))
  AST-IG vs AST-YT: n=30/30 median=10.52/11.80 mean=13.49/14.71 U=415.0 p=6.10e-01 r=0.08
  AST-IG vs AST-YZ: n=30/29 median=10.52/19.72 mean=13.49/20.92 U=243.0 p=3.69e-03 r=0.44
  AST-YT vs AST-YZ: n=30/29 median=11.80/19.72 mean=14.71/20.92 U=284.0 p=2.25e-02 r=0.35
ROBUST no -sIz/LEX: n=89/30 median=11.54/2.50 mean=13.13/5.25 U=2097.5 p=2.99e-06 r=0.57
   pooled rates no -sIz/LEX: astro 13.35 ctrl 5.54
ROBUST no DIR (primary): n=89/30 median=9.90/4.31 mean=11.69/7.64 U=1783.0 p=6.13e-03 r=0.34
ROBUST no DIR (any function): n=89/30 median=9.90/4.31 mean=11.56/7.64 U=1780.0 p=6.48e-03 r=0.33
ROBUST no recycled rows: n=89/30 median=12.82/4.31 mean=16.11/7.87 U=2021.5 p=2.67e-05 r=0.51
ROBUST journalist/astrologer own voice only (reported_speech=0): n=89/30 median=13.61/0.00 mean=15.45/2.44 U=2446.5 p=9.06e-12 r=0.83
   ctrl instances in reported speech R: 65  own voice: 27
producers (IG+YT): 22  all above ctrl median? True  min producer rate 4.59  ctrl median 4.31
PRODUCER-level (22 producers pooled texts) vs 30 ctrl texts: n=22/30 median=11.16/4.31 mean=14.29/7.87 U=496.0 p=2.13e-03 r=0.50
PRODUCER-level with astrologelvan merged into Elvan Lapis (21): n=21/30 median=11.24/4.31 mean=14.50/7.87 U=475.0 p=2.22e-03 r=0.51
   per-producer rate range: 4.59 - 30.75

## STAGE 8 macro categories (primary)
Ascriptive: astro n=263 (6.22/1000; any 266) ctrl n=35 (3.23; any 35) texts>=1 71/89 vs 14/30 MW p=2.29e-03 r=0.37 Fisher p=9.46e-04
   any-function: texts>=1 71/89 vs 14/30 MW p=2.06e-03 r=0.37
Preventive: astro n=198 (4.69/1000; any 204) ctrl n=3 (0.28; any 3) texts>=1 61/89 vs 3/30 MW p=4.19e-08 r=0.64 Fisher p=1.93e-08
   any-function: texts>=1 62/89 vs 3/30 MW p=2.33e-08 r=0.65
Reassuring: astro n=49 (1.16/1000; any 73) ctrl n=2 (0.18; any 3) texts>=1 31/89 vs 2/30 MW p=4.06e-03 r=0.28 Fisher p=2.10e-03
   any-function: texts>=1 40/89 vs 3/30 MW p=8.67e-04 r=0.35
Vagueness: astro n=28 (0.66/1000; any 60) ctrl n=3 (0.28; any 3) texts>=1 23/89 vs 3/30 MW p=8.50e-02 r=0.15 Fisher p=7.86e-02
   any-function: texts>=1 41/89 vs 3/30 MW p=4.37e-04 r=0.37
Other: astro n=156 (3.69/1000; any 179) ctrl n=49 (4.52; any 52) texts>=1 56/89 vs 18/30 MW p=7.89e-01 r=0.03 Fisher p=8.29e-01
   any-function: texts>=1 60/89 vs 20/30 MW p=8.54e-01 r=0.02
Holm-adjusted MW p (5 macro tests): {'Ascriptive': '0.00916', 'Preventive': '2.1e-07', 'Reassuring': '0.0122', 'Vagueness': '0.17', 'Other': '0.789'}
chi2 primary macro distribution astro vs ctrl: 52.91 df 4 p 8.90e-11 min expected 3.6 CramerV 0.259
subcorpus      False  True 
macro_primary              
Ascriptive       263     35
Other            156     49
Preventive       198      3
Reassuring        49      2
Vagueness         28      3
share Other: astro 0.225  ctrl 0.533
Other composition astro: {'NPRED': 49, 'COR': 28, 'NONEX': 18, 'REJ': 14, 'ADD': 11, 'CONC': 10, 'INT': 8, 'DI': 8, 'DE': 5, 'IDM': 4, 'UNCL': 1}
Other composition ctrl: {'NONEX': 21, 'REJ': 9, 'ADD': 7, 'DI': 4, 'COR': 2, 'CONC': 2, 'DE': 2, 'NPRED': 1, 'IDM': 1}
  fine NONEX: astro n=18 (0.43) ctrl n=21 (1.94) texts 15/89 vs 11/30 MW p=0.00617 r=0.24
  fine REJ: astro n=14 (0.33) ctrl n=9 (0.83) texts 7/89 vs 3/30 MW p=0.661 r=0.03
  fine ADD: astro n=11 (0.26) ctrl n=7 (0.65) texts 10/89 vs 4/30 MW p=0.674 r=0.03
  fine NPRED: astro n=49 (1.16) ctrl n=1 (0.09) texts 27/89 vs 1/30 MW p=0.0027 r=0.27
  fine COR: astro n=28 (0.66) ctrl n=2 (0.18) texts 16/89 vs 2/30 MW p=0.124 r=0.12
  fine DI: astro n=8 (0.19) ctrl n=4 (0.37) texts 3/89 vs 3/30 MW p=0.163 r=0.07
  fine DE: astro n=5 (0.12) ctrl n=2 (0.18) texts 3/89 vs 1/30 MW p=0.992 r=0.00
  fine CONC: astro n=10 (0.24) ctrl n=2 (0.18) texts 8/89 vs 2/30 MW p=0.717 r=0.02
  fine INT: astro n=8 (0.19) ctrl n=0 (0.00) texts 7/89 vs 0/30 MW p=0.117 r=0.08
  fine IDM: astro n=4 (0.09) ctrl n=1 (0.09) texts 4/89 vs 1/30 MW p=0.792 r=0.01
NONEX share of instances: astro 0.026  ctrl 0.228
  Fisher NONEX share (instance level): SignificanceResult(statistic=np.float64(0.09002535925612849), pvalue=np.float64(3.477505099597918e-11))
addressee-oriented share (Asc+Prev+Reas): astro 0.735  ctrl 0.435
text-level proportion addressee-oriented (texts with >=1 instance): n=86/22 median=0.78/0.41 mean=0.72/0.39 U=1441.0 p=1.40e-04 r=0.52

## STAGE 8 hedging / vagueness
HEDG primary: astro n=16 (0.38) ctrl n=2 (0.18) texts 16/89 vs 2/30 MW p=0.168 r=0.11 Fisher p=0.236
HEDG any: astro n=49 (1.16) ctrl n=2 (0.18) texts 37/89 vs 2/30 MW p=0.000675 r=0.35 Fisher p=0.000253
Vagueness macro primary: astro n=28 (0.66) ctrl n=3 (0.28) texts 23/89 vs 3/30 MW p=0.085 r=0.15 Fisher p=0.0786
Vagueness macro any: astro n=60 (1.42) ctrl n=3 (0.28) texts 41/89 vs 3/30 MW p=0.000437 r=0.37 Fisher p=0.000354
HEDG-any astro: primary function of host: {'HEDG': 16, 'NPRED': 10, 'PROB': 8, 'REAS': 7, 'CONC': 2, 'DIR': 2, 'ALT': 1, 'ADD': 1, 'COR': 1, 'ASCR': 1}
HEDG-any astro formal types: {'MOD-POSS': 15, 'VERB': 11, 'DEGIL': 10, 'NMLZ': 3, 'MOD-POSS+ABIL': 3, 'YOK': 2, 'PTCP/NMLZ': 2, 'CVB': 2, 'VERB+ABIL': 1}
HEDG-any by subcorpus: {'YZ': 22, 'YT': 20, 'IG': 7}
-mAyAbilir (MOD-POSS) instances astro: 18  their functions: {'NPRED;HEDG': 10, 'PROB;HEDG': 7, 'HEDG;PROB': 1}
secondary HEDG share among multifunctional astro: 0.337

## STAGE 8 reassurance expectation source
REAS-any astro n= 73  expectation_source: {'': 31, 'N': 29, 'C': 10, 'W': 3}
REAS primary n= 49  exp src: {'N': 28, 'C': 10, '': 10, 'W': 1}
REAS-any by formal type: {'VERB': 30, 'DEGIL': 19, 'CVB': 5, 'NMLZ': 5, 'YOK': 4, 'SIZ': 4, 'MOD-NEC': 4, 'LEX': 1, 'PTCP/NMLZ': 1}
REAS-any host mood/tense: {'PRES(nominal)': 16, '-': 15, 'IMP/OPT': 13, 'FUT': 11, 'PRES(existential)': 4, 'PAST': 4, 'NEC(-mAlI)': 4, 'PROG': 3, 'AOR+COND': 1, 'POSS(-Abil-ir)': 1, 'AOR': 1}
REAS with a value: 42; N=29 (69.05%); binomial test N vs not-N (p0=.5): p=0.0195
DI/DE (non-REAS) with a value: 28 {'C': 14, 'W': 9, 'N': 5}
  Fisher REAS vs DI/DE on N vs C/W: [[np.int64(29), np.int64(13)], [np.int64(5), np.int64(23)]] SignificanceResult(statistic=np.float64(10.261538461538462), pvalue=np.float64(2.935101761144988e-05))
all astro rows with exp source: 71 {'N': 35, 'C': 24, 'W': 12}
ctrl rows with exp source: {'W': 7, 'C': 6, 'N': 1}

## indirect promise (old category) proxy
REAS-any in future-tense hosts (closest proxy): astro 11  ctrl 0
host_mood_tense values (astro): {'-': 353, 'IMP/OPT': 88, 'PRES(nominal)': 64, 'FUT': 32, 'PROG': 30, 'AOR': 23, 'NEC(-mAlI)': 21, 'POSS(-Abil-ir)': 19, 'PAST': 17, 'PRES(existential)': 14, 'PROG+COND': 12, 'COND': 10, 'PROG+PRESUMPTIVE': 3, 'PAST-PROG': 3, 'AOR+COND': 2}

## STAGE 12 form x function (astro, primary macro)
raw formal_type values: ['CVB', 'CVB+ABIL', 'DEGIL', 'LEX', 'LEXZ(SIZ)', 'MOD-NEC', 'MOD-POSS', 'MOD-POSS+ABIL', 'NENE', 'NMLZ', 'NMLZ+ABIL', 'PTCP/NMLZ', 'PTCP/NMLZ+ABIL', 'SIZ', 'VERB', 'VERB+ABIL', 'YOK', 'YOK-PART']
macro_primary              Ascriptive  Other  ...  Astro total  CTRL (all)
form                                          ...                         
-mAmAlI                             0      0  ...           20           0
-mAyAbilir                          7     10  ...           18           0
-sIz                               73     11  ...           90          24
Converb                             6      8  ...           34           5
Finite -mA                         38     59  ...          200          20
Lexical                             7      3  ...           40           8
Participle/nominalisation         122     16  ...          200          22
değil                               4     43  ...           73           9
yok                                 6      6  ...           19           3

[9 rows x 7 columns]
ability negation (+ABIL) astro: 54  by macro: {'Ascriptive': 44, 'Other': 7, 'Vagueness': 2, 'Preventive': 1}  ctrl: 11
-mAmAlI by subcorpus: {'YZ': 18, 'IG': 1, 'YT': 1}
person astro: {'-': 275, '2PL': 143, '3': 133, 'poss2PL': 48, 'poss3': 32, '1SG': 21, '2SG': 14, '1PL': 9}
person ctrl: {'-': 50, '3': 24, 'poss3': 8, '1SG': 5, '1PL': 3, 'poss2SG': 1, '2PL': 1}
second person in window: astro 0.778  ctrl 0.207
imperative hosts astro: 88  ctrl: 2

## fine categories by subcorpus (primary)
subcorpus         CTRL  IG  YT  YZ
primary_function                  
ADD                  7   1   3   7
ALT                  1   1   9   2
ASCR                26  19  67  86
CONC                 2   1   5   4
COR                  2   5  13  10
DE                   2   1   1   3
DI                   4   4   4   0
DIR                  3  29  82  87
HEDG                 2   3   7   6
IDM                  1   2   2   0
INT                  0   8   0   0
NONEX               21   3   7   8
NPRED                1   5  19  25
PART                 7   3  12  12
PROB                 2   7  28  29
REAS                 2   9  15  25
REJ                  9   0  12   2
UNCL                 0   1   0   0
any-function counts astro: Counter({'DIR': 204, 'ASCR': 177, 'REAS': 73, 'PROB': 65, 'HEDG': 49, 'NPRED': 49, 'COR': 33, 'DI': 27, 'PART': 27, 'NONEX': 19, 'REJ': 14, 'CONC': 13, 'ALT': 12, 'ADD': 11, 'INT': 10, 'DE': 5, 'IDM': 4, 'UNCL': 1})
any-function counts ctrl: Counter({'ASCR': 26, 'NONEX': 21, 'DI': 11, 'REJ': 9, 'PART': 7, 'ADD': 7, 'DIR': 3, 'REAS': 3, 'PROB': 2, 'COR': 2, 'CONC': 2, 'HEDG': 2, 'DE': 2, 'NPRED': 1, 'IDM': 1, 'ALT': 1})
lexicalised strings top: {'beklenmedik': 24, 'olumsuz': 11, 'sonsuz': 8, 'taşınmaz': 7, 'rahatsız': 6, 'inanılmaz': 6, 'sessiz': 5, 'bağımsız': 4, 'anlaşmazlıklar': 4, 'öksüz': 2, 'bağımsızlığımızı': 2, 'kaçınılmaz': 2}
beklenmedik rows: 24  by subcorpus: {'YT': 11, 'YZ': 9, 'IG': 4}