Open brianherman opened 7 years ago
Here is a sample from the gen_language.py samples_48399.txt It seems to be operating correctly.
Even a tists , a juantly nearly
" П mo chasgicies arl by-coar Le
We ard ma here while it the last
The mosteriment prayer j it 10 p
Jess up−into naw many time , acc
Prszimeritl couries , q q с -- m
He will be a lolked peręus from
There ibout spretes hill earnes
The otpirnce , said that the res
The where dowd Fragie .`````````
These think acstarting on†the vi
Mr Haman Complay " Earr prive an
Codosoi Cayes be filchan senZre
BASBI GAPS , AR yow , a fdea vac
" It has manyover grown of the m
The previshors neval make , mati
A recone net the intmodics of Em
Herders of stike Pr Tick Alm man
Sparthslanter made ware othee ma
We have stopost es that the onte
The stab dough my Sircword . 4 s
Latther would mederaties compiny
Ohere intendite after−you that t
The stack Alg Prise .?`?ê8.8.. a
Manke ' Clotecames , Ac rex gion
With the copers is mo roiler som
Saeeeper is ofp of mow hopets ,
The neo-lolt only a thassupe in
One g actume And STCPIN , Seeps
We have yhe accpisestum presiden
An the better defurated the repu
CyantAll winh refieted in heredi
The lorse Fronse ration after th
He said crense be that Racdhos k
This relanienaty two billion cou
A loes " Will met to 39th a 4 80
Hears a speup and twe new eveny
Metiniona - spand of a potiticia
That denirue trassen I his oets
Jarth Javisevent tan will destre
Aftee feen leasures of Smissiona
The Barrer over Jin , 5P : - 8.m
The colnton of Srazatacial Dowri
The nisary stars nation ' measen
Pyll said Feepies the since roni
If now said cleam ,churmero , an
Haman Blinedwa net " Howandon ,
Neing , Mrm Ballin 's all also h
Byrtan wich uge group 's antrias
States do that on the AP 5he A a
Dohninao fell he fich up all fas
Rife drives whowkisl sises from
It †curthocts we could no spreki
Partoy 's nyleartin freachine in
It Bust Hause Mhy how all stot h
Irom learly , Mignas ′ -- Slan-t
The inAm roman hime runn ``````
She on there hee orhens .```````
Epban laters part of such , Jext
Mc. risons All the Omeretass cri
Thet have , in hoppes four the c
In after wlose the lecame sey fa
The cðhould oulefours Kate& to e
The Crenrirang loft many how abc
Sry Phewskeni cut this embers -
He say tne oo the foim¦the bil a
There is the Cobgettone fill bac
¥ AP 5 - Creal Hures to ald down
Yoynar Githias , Wllewist lemery
Ebpicies for the woped abbuy tow
The prite rationË Lake Chbin hav
Poun , sime , the Mik Dmin have
It ip 10- 'P becated of the Bire
Ariurate is anconenth releated a
The firm me cour cheased the tha
No Policin of Mingories she step
The hed wook some mankence for m
Controyed it while for Ferman Br
That is precestertations for hom
Manuad an expleagly and to do fr
Or sence in that 's epering than
" When the Humber green to troat
It is curtigitite .`````````````
In the firse in murtwing an Anio
Everonay callebusi ' eanthatery
Geakors easel Best Alten ron hav
HrabisDe.ry Jendon was partiyr -
A zycung a doffater from will ba
DOWAKEO¦ triandting that one u*
It 's bly thrst sivinue to plan
The working pancian pay†on to 11
By sudges , pasitical tolinater
More thouch of henring the last
But , the Dlthlin ' †ompreat fou
Father partfulition was deaty ar
Most of the lelentancy with of S
Luft mo 'n unnine a aored cnse h
While would perfingtary hebiner
Ane been seorier swarm and time
Cenvestin Pally tind about insid
In a commente hame in a ful tond
" The cach also looking 1108 end
What mightaeras missers aro not
Mr Bhexisia Jocsed Chadtick Bean
Caric Es the aPtorightsear Coris
Lest Anty Laniels , , the Hardol
It could cakins grice clear ilun
H50 , wart , a-1.8-time than the
Batterd t- the Deher me te messa
Mr Nady conspeal chance , abded
AnTega stolls , yite-part clame
Haller commonding offfMand cute a
Mr Chiwa K it also hear woush it
Tibe fuat out absut set an inter
Rrc Lains ' treeАfrom men of Man
It had to N.ys tazes live these
Fou only said the New Jonor shid
It is the gage it feass Alg Pous
Chat stotts bit Or ( Codelson St
Gant also une thZt``````````````
The concaiptent clthe lebates fr
Clil omesiene is sot woile crida
Even-Hear woles , 3V part feps
Many of he†dan no schardsted tcr
Berman-Zochehiin say as in edenc
The compectuve a tast to proment
After Mrszemes have crises says
And hill later the dayewite cast
Pall place hit or Canifh for wwo
" Bad not†becaming Mrc Gol-Nic n
He has 100. Brean allow out up m
Cluamss of TBy Dic Lonon E- Aide
Like fingwara will cape one of t
Macue the part of his sourth sho
Tigut when eepaetting this younc
" The hep glows looky tö coarted
Lold they recrase rupns .```````
After tild all nor allo , the ba
Lenil foors lasswant-sich renirs
BIxEx 's priyers to prosus ard g
Sennsgession to fints in that em
He said ht | 4 tild be stick in
It was 1 a lebery Sindation 'sog
And Sekzamaw s advistat is madis
Now woniols we have achmber 's u
" The bhouty to alsy or Heams su
MOIPAEс OTA new .```````````````
SAS®IIIRRROS - Tenuffhy MrcDamin
But this sat one waet the thouth
The hepe with Time fall , ? 40-1
With stare action laid in the fu
If he specles little is keep at
Man-hsaredide merree chiry , who
It 's not trre when thesespredul
Ands is on casible , Cintre-lear
Now spipimisien , The Calnto has
Airithouch the crion of prife me
Jesbils have get to of Califrici
" During DongozDiin is the Bosto
Ddlal Landey game to the which .
Saw Linilald ab eet from the 15u
He neartey , in chariel for mani
Hapa is lodal many after atriti-
He ha ple tence is , he and sew
For then town telking , his word
As ie one direts impogover oven
But now 2000 leading eapner sais
The clesera e dnither the same s
Th/ oily Santla Kaies Y Mand Ant
Ofaicα in Yoky Gan or Carneen Bi
Sc Data 'stewnal his no eorier i
He had though first that stick w
Aegueit OLama of " Conawiey Morm
Macs were from wun it in the cou
Adaddation will dit to 3V Auteci
It is us the asgnew the ma is an
Like , they Sardanieus , a meam
The riston cleas opey has under
Gard Decisiots Thtem a conprate
Start , Rovantre said here eaene
The¦ushriss Drani welk do it is
Cuman Kaid the yourchias have a1
Bytknupiny catraid Drs Gand was
That those chantitton forsine fr
Tade wirl was meesuter , the las
But on the bean funny C66 с0 - E
We siid that the asems they need
That mase should much that the o
" It het a fins or a presidly vi
Both ♥e thay cheot was ocfice fr
Sone therhianes not mission wiam
He said ehen pretice al~−win ' w
" The menbers haying it tarket o
Gilfman was a recember blead on
The wonding the acEaetin courd m
" They winning (`®`x с ?.4 Speil
This is thing apflairses .``````
It is no pry is o mastemin s on
There is worden bo get that 4.-.
Seaving state Bkevs. kodos sean
His weisher saiked me in the 101
It is as not about-ytar can y wh
Ene on the longe got the charge
But that unu cat to the grup any
He was just not†my compacts are
The Elban Pain, the crodec , my
The Corandskins as on Ton of the
The same Nits Dawden , a forge i
Sycada speena ather dlessis s gi
We are been the showeetines even
The Caldson Broun Chanton , Hill
The Zare michey GernaskrEiser at
Hainain would carly ot only nor
Y /nen reery , 46 .`````````````
¥ ά and Buto ( DeRy BhowseS 's i
Mr Gondken wilena seares use can
This iith forming 1 Inorge ' sho
New shames invusieg alts , YuNS
Anter , helmer Swawds -- Supaa
Whites by the 3y the case , he i
" An eves of held des |niins in
I /vin holicer -- a king to sume
The Mr Cubera up to no stact , t
Banhere is strÈ a years unliced
Junking swhipe them a nime of Bh
I sais the minal work , t14 stet
SBW Of q a-FBS shot minah sonver
The chareh he shotld-ccourt reni
Mohipinations it an acfiod my ca
I ave age has betchers , leal ,
" Terra h as 3nta though on iana
When at an jupgendre of Seodman
Juck 's through bustersZhere 4.1
It 's 1000 ofu hore start of t
All presiden .``````````````````
Infeeperly spend of Hopld of swa
McCoyan says he with pastig x m
Mark : Londey , These theuse swe
Mczhesoe Cipl with crasberd , Mi
The itcresic .``````````````````
On spended 's heasine have more
Paleratio ane mo ends a jine of
" Oagerishen how the Crantime mo
But Nex 2006 , Clain out−centine
Potice Parion to much all , , /R
Chinson Sunders neaded a cress n
Codeelkeni†cored missinston of E
The shot the million being tor s
He is suestes seeds it on the ma
M at net seeleage agentictions a
Cumyea in Sarth Rormined a y tri
A year a / lotal modults on Marc
Mast sice Streatedsher he as tre
Mory oveyiall Mry Amvoico Poy co
The over say bet he is eaper for
" Eltereation of Soharm , a shot
If yow , of then tapkees ahread
The news to reaees his eltighicE
Mr Pana doond where only that th
The comgrada said he could a spa
Caioto Chowth many to hit maccay
In the time great hep of fear An
T5RP5 is of the fire is becros h
So when you towders with , a rea
" We wrie in Trynill Cordey offi
In the interuoes free , leals ab
Daline Zaoterse 's earal-wark sa
Nows a vinh and they geven for m
The men of from Dapts are the fu
The teast of now fand me sew pri
Mr Bietin , Stitesen oner and un
Doyle , a breat , he was a 1lay
But it cone realting Asion pater
The birdia countytivest北ll an em
His is those repession 's off fo
Policon , the man by ane sworts
We have to gulled by loct olned
Angetting jeister Ktioniezbhear
Jut it oy the invendingize of th
Skegdan 's75 dealon , worker Fow
Wet are lerge Toround rall , a m
Hit fear to do sreachen we keeks
" The yeu bobling off , then ass
S IT is is a relidbas , whan emp
Sc LoPeiso kusted the casing eap
In the blan trazed a revulation
He is all giedly , , durid mo sa
Repret with branniss capezneVttr
This made instripas serien contr
Even Mr Cyeito Sont tensen†pake
Theeeesfact of Prive in hand exp
In a thoulh spened 3p , lome a f
Hormer Coyrow Ei was ending , sa
( ( MAsh agdews of Ms HyzDil in
Jadeelan says peunted in my sees
Okawsfia will sait Teanse if the
And shares all at a mardicks itt
The you some allemany and visiee
Share has a×many comeation manch
Fan eepharion Coyilson is a meni
But Chence , 39th fact waply tha
The pointre cholp , B6 粪 pey-all
State was you hld fill bis epend
The weuch thera is picknion and
She only al many 3V marth streat
¥ ά Plan Daerier , Hend , i seme
A shouge nold time oo the CBA с
" Alchman down a doar down ....
Thouch Carfousied Dr zondolia '
Stand , part pasticationa tbooih
The light says the rizon not see
The sungistly 26 ?`?````````````
More the way time use do qer s.u
The fuenthy though saye ore assp
Withhoners Atjedia collation was
Lanis Donson is a opfonedert tra
Sit Bria have stristed price him
Whet geven ingisgstion wicning i
Darning year achor , Michiars ,
The tittre rate of these mest ,
Wice be heart cand on dropters w
SOGAK , made pueled he shows wil
Pala rate learle fnom the uncrec
¥ Wt till , as o see rejier stu
In Hog Jema ' the trann in the
She his any he is then the testa
Samin whe cuyoing , the faner 11
The way ctimn is with " e of the
While ′ 's were clembed your et
A su‟pocatidi , the 39tmonite ,
The residss of give worden with
Sorones usen it preside , bðing
But one of Lunda Laman 's stacs
DIIG EMOс , Polite , Justimule ,
Manch 's seucchur "†we step fine
Dan-drome says he has farter sei
Y.08 piPn 's off a gueshers†- 81
The group cointry KAL HII® EP ,
Manywonen Pay crense of noet stu
Fnathing 't taker warkity was po
Malan San pain dies to of Jonden
Cauly Ere vace all searth bp to
A warto a Gide is Janefi repeose
But Pris Delson calls the mornte
Foody Athough man is the Mr zuma
Thoughergovers the firsni you cr
An the not releated on Dans of t
Whet that backing arα eouisle ,
On icisio all Sap , a bloces .`7
It 's off was cloill cacnes sevi
" Pillum , the whele Delic actov
Itsscould be moin ed that 's pas
With he stotes and An thyougco d
Thereland ′ Frints liok die as
Then , one it is man from to rea
He step down to a but thy is , a
It said the treenter $ 1008 : P
Halice of the Dustan , Lestondan
A copity Ocinamy K- TAARO ( ZER
The croduons for the frem mates
Shylrs Wacting on Broady invende
Writes uy that ind encions oo th
By pun 2006 pupra , these nerca
A fachore as Mr Orandon achters
He silsymartastani's came spink
The adminses wage dowrclears fre
The Chebaia 's oflition prefessi
Meneva has four were not become
It is stessence .```````````````
Joston the : decibse thinesemery
Teden are spekes ara out uf the
What the CAP looking the tonding
Even adcision for ensrar Caba Ka
If you†we halt made home of the
Senty attintle , Girmoreas vitti
So is all , -- compossiston , fo
IV shirieg Mr Ohenoni Wayee four
The gaml out†the Digwary two wan
Goot played my takes could norta
" We sain been anconer a should
The game in man Fey Mr. Lodeeson
She been the hop winds octured K
Bhe partfou , the aewhere think
Click Shart or Yaky ol Despi 's0
Daryiu Kurdy Coynan was sut unen
Af he was she don it by the epe
It is asyolu worty , this seattn
Lilelaln dils−has a shetching wh
Sahutani clleall epen menis , Ma
In П the mortigulited " on Dhesk
Wecans Ostan 's 15 a wact commet
Fow Bedd R. Jond 's 100 , clear
It wonted what remeosing in the
The seall cosses have name frotÓ
Chejtagengy is auwhe¦nation live
He was not on Geax ?`?6 ..8 8 ei
2n this hore leasen Naw Oriskriw
In iweted on Shhdeswo , you malk
He snisee cilled expicaty %couba
But it sonene ends , on tan said
Rubtih Loton of a Cuain Time has
Whhee fow SMr Oresielors cape ha
Loll if your hictes tellzman gav
Theunh esbict aid that the of-gi
That gets frem that , a mecision
" Whan opard is†then seart that
CLaW SAPAO , Gointmevery , thing
NEP , during nearly SMchhin was
The Goas Jesons of must−on teasu
Btacked is tloaked alst soncist
Mr. Lyeewo , Thing to nover a7an
Mach mother offiticitalle thou c
The going get the wonis Cerition
The interent if Forkealr that we
Durinh concentiswand to pack at
Even the Manders ( Dr. Lendeis "
The NKAP 's mate : Jondo Nation
The Dalan main upus gromest affi
He statins give be to cases part
It hame to desiepte product war
W6 thin atfeciies me is now pref
C.R Toyla Streal sets hree : he
The ouº to alf nater the G.1. ,
Dire much Ar Dany Ohewskon Anrui
Ane a cinioning at that my asspa
Ane we was for Derran is creatin
Cohlenrianewerth Corewsgon tamis
Fandald for membea Peffmidestigle
Mohnasies Frottative rashes car
Persiment bectel that is eam ard
Start ungurity Nak Leesin colls
The voter only othert lood have
Dr. Ry Deson saiking in think t
Hadoee Dera , Anjectering presic
As thit called measues and he an
" The surpoct all homel tradule
Boiting words out ttranth ib 't
The samα telk sets the idset " w
The phe inds were will despinm t
Anspromoting of Desrinle from as
Sr. Gard Pay no there pry-att st
" The arreng her haver : how , w
YO0EW ind of Dillean is the cour
Where hapered he canuspents - 11
" The gihas timens hill new ?``
SonÖy 's , thing of procend shot
Poinies want we will state a e
" Duensga had might you , the be
I shood he his wan jhaging that
Then ham uny wighrasd3a from hon
Weth Masch with Joneas have neec
Then the n 't make weak , the li
Oyly stick teworring play is acp
I will food theZDegest Lence han
ByeNow , Mr Sestan Ef all frse h
The Sotrations of fills that cri
Tò/seseden dip his fill , Spere
Lack San was poesident woras par
AnAwl , in Olama Binationsing th
Oniane macsionser my they comes
The ianes will hamed ir Decs Jon
Celpen was yot nakes Mithow , wo
" At† sne get another spokes , a
" Nor Dales net desplterely diff
The sintiesZHadenio said it when
Britable is roleanrspic lysten h
The grant deise , his pant .````
A Nel S Owemon os an ell of Comp
While in the our-party of might
The time got , a0so , dow Peeson
Fourtre Bay tean Bor Drs Dina 's
26 ( PE00 im a it alloves wnle i
Cracsesti for Gineagy promodg a
Shi was asyeed my tittle , Brans
When afwanden Pil-ians , lowsown
The contuvÐay close the :otne br
Soe while deãise derat caerifien
" Ney Sr. Goldon 's notr Ys Marc
At Heuta , the manh of All of as
I should White or Pendon is atte
Jespite , that will for a drofha
In the a decideng the man hass
Sosh for 'r sutreasings changini
It †upporiatinn my Toband " um B
It say f¦om the ehiry at actice
Will sofficiµston op alt the mi
He can also year of Desson in th
The CEP reasuring alto the tNS n
" It is five party as a stage ab
McS Dheiie As os he put the bays
No sine on photched or the Hust
It is is monuls as me 's long re
Serange in the wethoing the nati
It ws a wack stooed renning for
Skistens is Olakisian for who gr
" We a limber charge it hat the
Tunusho noncassed noticking . -
" Bit my think atranda G6R с ,ea
Sorwefih want to the vonie stice
Bets beldown toree seedemen , "
Oylas have Mrs Dindoni - that wh
The ptopises cale be evens are n
It is no not of thase vniney of
Somendirke, the .ugn. ``````````
Blexieh Mr. Dmbin : " Themotherz
Shill Broup could helps and hims
" T if her found movers grested
Presen is provice was where and
The q of Dandier, fotn the proce
" It seial Glace Lemer , the sta
In the centract dowe Yazinaty ab
Estas sseation coulds are some-n
No poses of−Hents be prαvex rati
The close deek -4 Seyers soy at
That iss were will betta setler
Geithence steledhouch has palt a
Theing sser are besnian report .
Ofter do do tild mission state a
Even New Gondoean ip I had pott
Norcases did t speak¦in downsaid
Be lense agrust but my oper teme
She breaty relled wored will bVt
Nemelp rate , decisioning , manc
" The dettasuly menuably seitl b
What a seready Mre Doeween of el
This have gand hit about and in
What hs gift-seartication of un
Carfarn the provated the overy '
Bong Tima Alan Chal Lennety reti
That yhe semended Ministion star
In agsow may by Bedd Sczhhowson
Ehen so " Poinison is " Landee -
What the caller trase will bn in
I was the gackees endies thinks
And just a leade the words os de
The colenly on Whe , critike Cop
Mr. Dells , the Suadir Dosson 's
Sy screated his anoin of the pri
LAL ®IIGGG O Telearty os jest th
Last Codhesok all much of also r
I fill hile Jusch Sarhaldo had s
It is the Geat do got .```.`````
He has a many Huard primely , wh
Serense neetcrish -" or zumeah J
Danzada , Dader in Mccowsen Sans
SALAKE Yleinans save the resurve
N7I stall will primi d Mr. Cumer
San Dhewici will pors , the ned
The seader clanse his ever rene
Teners were hot our Mrs Jeneran
WhilknInds - --1.80 it would ove
Not ptopist Darsis are omeric ti
Coult have neweysman miven in Go
Phove in the tender . , the some
He save effer , the seeked , dr
With Perders poline the mant att
Anothers are gave pensidere , wo
N ( ie 's reasure and Datentatio
Whan in 5 4-8 39 , Bem , Goldon
That 's patctoss PNew micht who
One nem out weenyman , a Subp ,
AnIfhia provided , cosels , deas
But he refenss of receusezswith
The -pascealan-tracs ssen Barrit
Like of rempised it is a levent
He botters hor Jangs Lewseo M.y
The soing everic .``````````````
" Dudga ders are of other Ooyinz
Most is approting worr al interm
He had oace of †inderto do last
He wordeney man me explagly gess
But the ked , That 's chicting f
" It been at thethers the mentim
Thira is neesine three others wo
HENIKGGOO Flawld torantten fiar
Sore is liven srews hid man for
Toneration is Alimation , the de
New ccaused Aity Maticols have a
Eyeny Ever fill Dninan all the n
These fill juere dillion of medi
But , who ald a dows lence and S
Live has Zhe inate consineden '
Searing spalliagly growt udged a
" Clumm , were also tives dritit
Mr. Pard Salen Gean man was not
Its dees ttainious une got the m
Gorman got oear dration , fours
At the yeo wtately coving at-.m.
By hal net †arescapiler , of 4.1
But tho new Tamerent :cCalnsian
" We centy now step about 26 , w
In Authough of−me of mation olle
But , what everter , a sttanch "
Aut though and wired protu is ,
She Bad†ummentirs for the gotett
Shadan Ceric cal shopes-tive sai
Anoshes at other Eapy Hac Dhowin
He also agrute drivite heaf Pola
But reporting drawes c ofus trum
A Amitican ho .`````````````````
So one he wa shote rot chabli Ka
There 's primate , dhow , the fr
At , who heam for agbles of you
We , in Flacksion on a home-donf
Seven he pricers alro youracdian
Other-olf-tion that vofict offic
BMRKEN A A - think ard Cadew ei
The hear Glagries , Geaghtan hav
Consedentuy reportedul oiteport
Corwere are presidensgsiciraty c
" The Colmeading fall , and oun
Easiskeps are fi ed the filmore
Sonvenexent five a depen er sovi
This sived on a manistens .`````
The came a yearnagy to have unde
Bhe Fobice nwettos sermed overs
I say 140Scrumass in the credeme
Y5 Thiffn39 , he , the powers , n
Tal senustes shawes in fached on
Iowould four saydrissed with a n
Fisture are I have than ald man
The dealt much patthers got to r
What Masifans later on Dysdanian
It 's shop has does , sse do 100
" I yoint to foret year , a fous
Derven as these shord of Ninue t
Bix jest is on the Hasconclscton
But hidged in converdois Bhew Si
There long showt Gertdy Jene h s
ManisGardh Dors Lendon cauls a s
Justriled from¦it by the misht ,
No cloaper .````````````````````
The fuworly helps - Fichhand in
Whing Mr. Doldon has fe tomed 11
It gundled more use nat leased i
In astranging , or the two tric
The alinruring ligtte the addeli
The ailehome oll overs in fany o
A mastension for , Lentin , thou
Bywha is a spbret year flown ome
This converts the project to python 3. Maybe this would be better in a separate branch? Also do you have data on which I can compare the output to? I would like to see if the data generated is the same for python 2.7 and python 3.5. Thanks a bunch!