}$SrSSKrSSKrSSKJrJr SSKJr SSKrSSK J r SSK J r SSK Jr \"\5rSrS rS rS rS rS r\S:Xa\"5 gg)z% Convert old style SBCS model to new N)ArgumentDefaultsHelpFormatterArgumentParser) ascii_letters) __version__) LANGUAGES)SingleByteCharSetModelcJUR5nURSS5nU$)z-Convert name to proper Python constant format-_)upperreplace) charset_names 1lib/third_party/chardet/convert_language_model.pynormalize_namer+s* %%'L''S1L c r[[US55nUSnUSn[USUSUSUUUS9nU$)z@Create a SingleByteCharSetModel object representing the charset.char_to_order_maptypical_positive_ratiokeep_english_letterrlanguageN)rrrlanguage_modelrkeep_ascii_lettersalphabet)dict enumerater) old_modelr char_to_order pos_ratior curr_models rconvert_sbcs_modelr 4sa9-@#ABCM23I"#89'~.:&'(- J rc [US3US9 [UR55HBupE[[ U455nUR U5n[SU<SU<SU<3US9 MD [SUS9 g![ a SnN3f=f)N = {filez : , # } )printsorteditemsbytes bytearraydecode UnicodeError)var_name order_mapr output_filecharorder char_bytes unicode_chars rprint_char_to_orderr6Hs XJe ;/ioo/0 9dW-.  %,,\:L dXRyl-=>[Q 1 %k" L sA88 BBc d[SUS9 [US3US9 [UR55HrupEU(aXC;aM[SX4<SU<3US9 [UR55H$upgXc;aM [SX6<SU<SU<3US9 M& [S US9 Mt [S US9 g) Nz6# 3: Positive # 2: Likely # 1: Unlikely # 0: Negative r#r"z z: { # z r%r&z },r')r(r)r*)r/rr1 char_ranks first_charsub_dict second_char likelihoods rprint_language_modelr=Ts D  XJe ;/ &~';';'= > :7  Z+.hznEKX'-hnn.>'? #K, :25R ~U/#  (@ h[)!? %k"rc UR5n[R"U5nU(d[SUS35eSUR 5S3n[ R R[ R RSUS-55(d[SUS35 g [[U5n[S US 35 [S UR35 [S UR35 0n0n0n[U5HnSU;aSU;dM[X75nUSn [SU 35 [R R#5 [%XR5XI'XIR&R)5HYupU S:aM [+[-U 455n U R/U 5n X;a XU 'XU 'MCX]U :wdMM[SU 35e M [X0R5S35n0n[3SS5HFnUU;aM UUn0UU'[3SS5H!nUU;aM UUnUUS-U-UUU'M# MH [SUS35 [R R#5 [5SUR 5S3SSS9nUR75n[SUS9 US3n[9UUUU5 [SUS9 UR)5Hun n[;U 5nUSUS 3n[=UUR&U U5 USUS!3nUR&R?5 [AU5RCS"U5RCS#U5RCS$S%S&[EU5S'---5n[US(US 3US9 M S S S 5 g ![0a GM2f=f!,(df  g =f))z:Convert old SingleByteCharSetModels for the given languagezUnknown language: z[. If you are adding a model for a new language, you must first update metadata/languages.pylangmodelchardetz.pyz Skipping z' because it does not have an old model.N zA ----------------------------------------------------------------zKeep ASCII Letters: z Alphabet: Model LangModelrzConverting charset model for @zUnstable character ranking for zWriting output file for z zmodel.pywzutf-8)encodingz>+,E2M 77>>"'',,y-%2GH I I (#JKLw .H XJXY !8!8 9 :; J}--. /0NJNM8# 8(C H/  0  -l^<= '9 --( $ .;MMSSUOHrzH;/0D #{{<8 -+0<((4u%)U2 #B<.!QRR V">X..*:);9'EFNN 1b\ N " "1% $&y!q"A&'*J4BAFa<4PN9 %j 1   $XJd 34JJ X^^%&h/w G;^^%  L  L ,Wnk:N  ,  )7(<(<(> $L*(6K$/=*^!L  ",,  "- Qzl&AO  ( ( . . 0Z )12s?/Cb/H(I IK  _%S(9<; O%)?) H G3&  2 H Gs)N*%Crse2 B '0:M" ( ##.pPf*. zFr