search

chroma-core / chroma

the AI-native open-source embedding database
https://www.trychroma.com/
Apache License 2.0
13.81k stars 1.17k forks source link

[Bug]: wrong calculation of cosinus distance #1269

Open daniel173087 opened 9 months ago

daniel173087 commented 9 months ago

What happened?

i compared two vectors from the open ai embedding API. I set the metadata={"hnsw:space": "cosine"}. So this should calculate the cosinus distance which should range from 0 to 2.

But in my case it created a value of -4.76837158203125e-07

I searched with query_embeddings=[one of the vectors in chromaDB], so the closest one should be the exact vector from the database with a distance of 0. For sure this value is rounded a 0, but theoretically this value cannot come out of this kind of calculation.

Any suggestions why this appears?

Versions

Chroma v0.4.14

Relevant log output

No response

tazarov commented 9 months ago

@daniel173087, I just tried to reproduce what you described above in this notebook, I do get a distance of 0.0:

{'ids': [['1']],
 'distances': [[0.0]],
 'metadatas': [[None]],
 'embeddings': None,
 'documents': [['test doc']]}

Is it possible to share some code?

daniel173087 commented 9 months ago

thank you for your answer, here is my code:

import chromadb chroma_client = chromadb.Client()

collection = chroma_client.create_collection( name="report_embedding" ,metadata={"hnsw:space": "cosine"} )

collection.add( embeddings=[[-0.012086562812328339, -0.002069261157885194, -0.007868386805057526, 0.0019948023837059736, -0.026541953906416893, 0.022122912108898163, -0.03551856428384781, -0.027691736817359924, -0.007937651127576828, -0.03662678971886635, 0.0073073492385447025, 0.012696086429059505, -0.004138522315770388, -0.009960158728063107, -0.009586133994162083, 0.020335901528596878, 0.003958436194807291, -0.01759304851293564, 0.017232876271009445, -0.006597393192350864, 0.010812105610966682, 0.011587862856686115, 0.015598246827721596, -0.000635064032394439, -0.009122065268456936, 0.007993062026798725, 0.015085693448781967, -0.019934171810746193, -0.006735921371728182, 0.031224198639392853, 0.03640514239668846, -0.001550647197291255, -0.00042164442129433155, -0.04662850499153137, -0.0058285631239414215, -0.002275321399793029, -0.019726378843188286, -0.005125533789396286, 0.03036532551050186, -0.009052800945937634, 0.03776271641254425, -0.014614698477089405, -0.008207780309021473, 0.004522937349975109, 0.015459718182682991, 0.01433764211833477, -0.013991322368383408, -0.00502163777127862, -0.011262321844696999, -0.0011030287714675069, 0.020779192447662354, 0.027193035930395126, -0.04546486958861351, -0.000596968864556402, 0.002746316371485591, -0.0003898262802977115, 0.012883098796010017, 0.024741090834140778, -0.005845879204571247, -0.013998248614370823, 0.014545434154570103, -0.006524666212499142, -0.009932453744113445, -0.0019670967012643814, -0.026819009333848953, -0.016955820843577385, 0.011629421263933182, -0.007383539341390133, -0.008013841696083546, 0.015127251856029034, 0.015224221162497997, 0.04776443541049957, -0.004325535148382187, -0.004734192509204149, 0.022386115044355392, -0.00814544316381216, -0.010417301207780838, 0.007279643323272467, 0.010458859615027905, -0.003909951075911522, 0.006635488476604223, -0.0016510799759998918, -0.02755320817232132, -0.0004155838396400213, 0.014697814360260963, 0.0034043241757899523, -0.033745408058166504, 0.03496445342898369, -0.002593935700133443, -0.021928973495960236, 0.039037175476551056, 0.011795653961598873, 2.5392280804226175e-05, 0.0014277036534622312, 0.008886567316949368, 0.013942837715148926, -0.017842398956418037, 0.02292637526988983, -0.01020258292555809, -0.015875302255153656, -0.026652775704860687, 0.00016504306404385716, -0.03723631054162979, -0.006957565899938345, -0.012045004405081272, 0.0001043288575601764, -0.008076178841292858, 0.006389601621776819, 0.015293484553694725, -0.0030597359873354435, 0.008561027236282825, 0.0036121162120252848, 0.0033766187261790037, -0.014268377795815468, 0.028301259502768517, -0.004349777474999428, 0.004834625404328108, -0.00798613578081131, -0.019116856157779694, 0.009883969090878963, 0.005312546622008085, 0.028162730857729912, 0.02090386673808098, -0.00428397674113512, 0.029617274180054665, 0.013312535360455513, 0.014836343005299568, -0.014559286646544933, -0.017551491037011147, -0.008907346986234188, 0.060509007424116135, 0.003397397929802537, 0.017232876271009445, 0.005956701468676329, -0.02011425793170929, 0.025516847148537636, -0.04081033170223236, 0.030393030494451523, -0.024450182914733887, -0.02065451629459858, 0.01473937276750803, 0.03670990467071533, 0.015127251856029034, -0.017163611948490143, -0.0017705602804198861, -0.009489163756370544, 0.0062545365653932095, 0.001800863305106759, -0.011532451026141644, -0.024588709697127342, 0.0020398239139467478, -0.02287096343934536, 0.00032424196251668036, 0.017191316932439804, 0.01376275159418583, 0.016429414972662926, -0.0056657930836081505, 0.03061467595398426, 0.006943712942302227, 0.005464927293360233, -0.010604314506053925, 0.013063184916973114, -0.01897832751274109, 0.00025497798924334347, -0.007632889784872532, 0.020779192447662354, -0.006257999688386917, -0.017426814883947372, -0.012370545417070389, -0.011483966372907162, -0.007016440387815237, 0.02371598407626152, -0.011331586167216301, 0.016180064529180527, -0.0005173152894712985, -0.00606752373278141, 0.0037679600063711405, -0.016110800206661224, -0.01377660408616066, -0.014905606396496296, -0.011781801469624043, 0.025724638253450394, 0.01708049513399601, 0.0013662318233400583, -0.0024813818745315075, -0.025461435317993164, 0.014434611424803734, 0.010666651651263237, 0.018632007762789726, -0.02504585310816765, 0.0004835491126868874, 0.02864757925271988, -0.00033333286410197616, -0.008387867361307144, -0.5940078496932983, -0.03161207586526871, 0.004533327184617519, -0.02456100471317768, 0.025960136204957962, -0.000973158807028085, 0.010445007123053074, -0.020737633109092712, -0.006638951599597931, -0.007120336405932903, 0.006780942901968956, 0.010396522469818592, -0.00030346278799697757, -0.03330211713910103, -0.011761022731661797, -0.023605162277817726, -0.024685679003596306, -0.056076113134622574, -0.022219881415367126, 0.03202766180038452, -0.01626318134367466, 0.010548902675509453, 0.001467530382797122, 0.004228565376251936, 0.001604326767846942, -0.00716189481317997, 0.02341122180223465, -0.013361020013689995, 0.0027134160045534372, -0.02674974501132965, -0.014614698477089405, 0.006399990990757942, -0.005371421109884977, -0.009579207748174667, 0.040644098073244095, 0.004585274960845709, -0.013845868408679962, 0.005946312099695206, -0.0006203454686328769, 0.021832004189491272, -0.033496055752038956, -0.011650200001895428, 0.0026406890247017145, 0.0003709951415657997, -0.02892463468015194, 0.03823371231555939, -0.016581794247031212, -0.006112545728683472, 0.014268377795815468, -0.0062441471964120865, 0.007591331377625465, 0.006292631849646568, -0.02040516585111618, 0.0029541084077209234, 0.025821609422564507, -0.014171408489346504, 0.01224587019532919, -0.010666651651263237, 0.018798241391777992, -0.015071840025484562, -0.003040688345208764, -0.0007995659834705293, -0.019172267988324165, -0.02039131335914135, -0.011864918284118176, 0.030753202736377716, -0.01310474332422018, 0.01379045657813549, 0.008318603038787842, -0.0068328906781971455, -0.014379200525581837, 0.028730696067214012, -0.011975741013884544, -0.004315145313739777, 0.009343709796667099, 0.003726401599124074, 0.04330383613705635, -0.003397397929802537, -0.012072710320353508, 0.027705589309334755, 0.012176605872809887, -0.021444125100970268, -0.029118573293089867, -0.01022336259484291, 0.0181887187063694, 0.011116867884993553, -0.020460577681660652, 0.011705610901117325, -0.0029610348865389824, 0.021056247875094414, 0.025724638253450394, 0.0029281345196068287, 0.020169667899608612, -0.01228050235658884, 0.004772287793457508, 0.02753935568034649, -0.002670126035809517, 0.021998237818479538, -0.01764846034348011, -0.012730717658996582, -0.011622494086623192, 0.0125575577840209, 0.009038948453962803, -0.009225960820913315, 0.035657092928886414, 0.014434611424803734, -0.0017454520566388965, -0.0028190435841679573, 0.03388393670320511, -0.02953415736556053, -0.0068917651660740376, -0.012917730957269669, -0.036211203783750534, 0.012696086429059505, -0.006441549398005009, -0.037097781896591187, 0.015819890424609184, -0.0005848476430401206, -0.009475311264395714, 0.0018510796362534165, -0.008803450502455235, 0.007390465587377548, 0.0038718560244888067, 0.005177482031285763, 0.006181809585541487, 0.026292603462934494, 0.0008359295316040516, 0.011518598534166813, -0.00811081100255251, 0.014988723210990429, 0.010458859615027905, 0.009648471139371395, 0.01629088632762432, -0.022954080253839493, 0.011193057522177696, -0.02173503488302231, -0.005710814613848925, -0.004616443533450365, -0.0331081785261631, -0.033219002187252045, 0.0009696956258267164, 3.982678390457295e-05, 0.02318957820534706, -0.012869246304035187, -0.013548033311963081, -0.024186978116631508, -0.02064066380262375, 0.029922036454081535, 0.0027134160045534372, 0.04081033170223236, -0.02343892864882946, -0.0043428512290120125, -0.0004545448173303157, -0.003366229124367237, -0.01059046108275652, -0.027733294293284416, 0.021444125100970268, -0.036294322460889816, 0.001490041147917509, -0.04056098312139511, -0.01656794175505638, 0.03972981497645378, -0.012356692925095558, -0.025128968060016632, 0.02562766894698143, -0.0019480491755530238, -0.03939734771847725, -0.0014493486378341913, -0.0005398260545916855, -0.017551491037011147, 0.012432882562279701, -0.0025887410156428814, 0.0008662325562909245, 0.017412962391972542, -0.008983537554740906, 0.016443267464637756, 0.007840681821107864, -0.0055064857006073, 0.025821609422564507, -0.007438950706273317, 0.0022164471447467804, -0.009350636042654514, -0.0380120687186718, -0.018922917544841766, 0.020058846101164818, 0.02093157172203064, -0.009267519228160381, 0.010715136304497719, -0.014448464848101139, 0.025309056043624878, -0.007258864119648933, 0.011934182606637478, -0.005128996912389994, 0.004332461394369602, -0.0026666629128158092, 0.04017310217022896, -0.015002576634287834, -0.005395663436502218, -0.022954080253839493, 0.02978350780904293, 0.024685679003596306, 0.03912029042840004, 0.02539217285811901, -0.012322060763835907, 0.012356692925095558, -0.023605162277817726, 0.013818162493407726, -0.010846737772226334, 0.0129315834492445, 0.02425624243915081, 0.012190459296107292, -0.024741090834140778, -0.003464930225163698, -0.001430300995707512, 0.012661454267799854, 0.003193069016560912, 0.012848466634750366, 0.013402578420937061, -0.007792196702212095, 0.021070100367069244, -0.004692634101957083, -0.011761022731661797, 0.02751164883375168, -0.016166210174560547, 0.003103025956079364, -0.0045783487148582935, 0.001619045389816165, 0.022718582302331924, 0.013783530332148075, -0.02947874553501606, -0.021042395383119583, 0.012045004405081272, 0.005212113726884127, 0.017302140593528748, 0.013319461606442928, 0.002935060765594244, 0.038981761783361435, 0.0057592992670834064, 0.04962071031332016, 0.007951503619551659, 0.013991322368383408, 0.019407764077186584, 0.005638087168335915, 0.007286570034921169, -0.007251937873661518, -0.010174877010285854, -0.0028536757454276085, 0.02012811042368412, -0.019407764077186584, 0.016595646739006042, -0.020169667899608612, 0.019781790673732758, -0.00839479360729456, 0.02285711094737053, 0.009066654369235039, -0.03382852301001549, -0.03330211713910103, 0.01252985280007124, 0.0363774374127388, 0.025212084874510765, 0.01960170455276966, -0.01061124075204134, 0.00627877889201045, 0.009579207748174667, -0.02010040543973446, 0.009433752857148647, -0.006122935097664595, -0.0003290038730483502, -0.02123633399605751, -0.02835666947066784, 0.0003387441101949662, -0.009648471139371395, -0.005118607543408871, 0.0005199126899242401, -0.0054164426401257515, -0.008948905393481255, 0.04083803668618202, 0.017025085166096687, 0.02097313106060028, 0.004325535148382187, 0.005755836144089699, -0.029672686010599136, 0.02041901834309101, -0.004034626297652721, 0.01871512457728386, 0.0022008626256138086, -0.00634111650288105, -0.01046578586101532, -0.018022485077381134, 0.006060597486793995, -0.016401708126068115, -0.0028415543492883444, -0.003688306547701359, 0.002941987244412303, -0.03272030130028725, 0.02173503488302231, 0.02591857872903347, -0.014143703505396843, -0.002190473023802042, 0.001603460987098515, -0.026320308446884155, 0.013589591719210148, -0.006206051912158728, 0.005056269932538271, 0.05203109607100487, -0.01708049513399601, -0.01654023677110672, -0.029922036454081535, 0.006902155000716448, -0.015889154747128487, -0.013554959557950497, -0.012017299421131611, -0.022704729810357094, 0.020543694496154785, -0.01654023677110672, -0.02396533451974392, 0.007909945212304592, 0.0029679611325263977, 0.02043287083506584, 0.014185260981321335, 0.013769677840173244, -0.014559286646544933, -0.01685885153710842, 0.0178701039403677, 0.016609501093626022, 0.022427674382925034, -0.015210368670523167, 0.0068086483515799046, -0.025433730334043503, -0.010964486747980118, -0.011587862856686115, -0.05280685052275658, 0.019435470923781395, -0.003674453590065241, 0.018922917544841766, -0.021721182391047478, 0.011213837191462517, -0.02174888737499714, -0.024131568148732185, 0.01602768339216709, 0.01240517757833004, -0.012439809739589691, 0.0192553848028183, -0.0015385259175673127, -0.027442386373877525, 0.009364488534629345, -0.01336794625967741, 0.022746289148926735, 0.011006045155227184, 0.009690029546618462, 0.03274800628423691, 0.014102145098149776, 0.014254525303840637, -0.03338523581624031, -0.023785248398780823, 0.0214579775929451, 0.020834602415561676, 0.030254503712058067, -0.0030320303048938513, 0.002973156049847603, -0.002592204138636589, -0.017468374222517014, -0.008180075325071812, 0.03028220869600773, -0.006493497174233198, 0.022732434794306755, 0.013097817078232765, -0.004114279989153147, 0.01735755056142807, -0.0036675273440778255, -0.037374839186668396, 0.005804320797324181, 0.023203430697321892, -0.010992192663252354, 0.008858862332999706, -0.0342441089451313, -0.004415578208863735, -0.0012303013354539871, -0.023258842527866364, 0.0016173137119039893, -0.03856617957353592, -0.015224221162497997, 0.004027700051665306, -0.04244496300816536, -0.04831854626536369, -0.015930714085698128, 0.018008632585406303, 0.002090040361508727, 0.00591860618442297, -0.0003489172668196261, -0.005752373021095991, -0.029811212792992592, -0.0026112517807632685, -1.4163941159495153e-05, -0.0043532405979931355, -0.02118092216551304, -0.03252636268734932, 0.0071411156095564365, 0.029395628720521927, -0.012896951287984848, 0.018147161230444908, 0.001989607699215412, 0.010756694711744785, 0.0006549774552695453, -0.02012811042368412, -0.042860545217990875, 0.008235486224293709, -0.01842421665787697, -0.01127617433667183, 0.000786578981205821, -0.0016354955732822418, 1.134671038016677e-06, -0.0026060568634420633, -0.001982681220397353, 0.0065870038233697414, 0.0016458851750940084, 0.004516011103987694, -0.03357917442917824, 0.030642380937933922, -0.0026614682283252478, 0.00993937999010086, 0.004952373914420605, 0.021291745826601982, -0.009994790889322758, 0.002805190859362483, -0.009793926030397415, -0.009406046941876411, 0.006690899841487408, 0.0025783514138311148, 0.01187184453010559, -0.0002733762376010418, 0.003352376166731119, 0.00020129841868765652, -0.031057965010404587, 0.006590466946363449, -0.023535897955298424, 0.004522937349975109, -0.005482243373990059, 0.019781790673732758, -0.008034620434045792, -0.006372285541146994, -0.015071840025484562, -0.016609501093626022, -0.0024242389481514692, 0.0008108213660307229, -0.005128996912389994, 0.027137624099850655, -0.03175060451030731, -0.010881369933485985, 0.04527093097567558, 0.01115842629224062, -0.003276185831055045, -0.006649341434240341, 0.010694357566535473, -0.00647618155926466, 0.010597387328743935, 0.0034337614197283983, -0.020294344052672386, -0.01961555704474449, -0.0007008648244664073, 0.009593060240149498, 0.012211238034069538, -0.013430284336209297, -0.01282076071947813, -0.02339736931025982, 0.0007294362294487655, -0.007840681821107864, 0.0038649295456707478, -0.01624932698905468, -0.03172289952635765, 0.0021315987687557936, -0.0021714256145060062, 0.012391324155032635, -0.006012112833559513, 0.002654541749507189, 0.010950634256005287, -0.008034620434045792, 0.0054857064969837666, -0.01391513179987669, -0.039868343621492386, 0.006296094972640276, -0.010230288840830326, 0.04180773347616196, 0.023535897955298424, 0.029367923736572266, -0.020737633109092712, 0.04017310217022896, 0.02201209031045437, -0.01403980702161789, -0.011961887590587139, 0.018535038456320763, -0.01764846034348011, -0.022663172334432602, 0.013042406179010868, 0.016360150650143623, -0.00828397087752819, 0.01878438889980316, -0.018022485077381134, -0.0016995647456496954, 0.015141104348003864, -0.031085669994354248, -0.00427358690649271, 0.00022315986279863864, -0.03344064578413963, -0.01252985280007124, 0.01597227156162262, 0.0010025959927588701, -0.008055400103330612, -0.039286524057388306, -0.01072898879647255, 0.005007785279303789, -0.006178346462547779, 0.003650211263448, 0.01871512457728386, 0.05239126831293106, -0.016581794247031212, 0.025212084874510765, 0.0004922071238979697, 0.031057965010404587, -0.011220763437449932, 0.008657996542751789, -0.006583540700376034, -0.008872714824974537, 0.02173503488302231, -0.009648471139371395, 0.01555668842047453, 0.036820728331804276, -0.00856795348227024, 0.0006017307750880718, 0.014365348033607006, -0.00797228328883648, -0.0021350618917495012, 0.0005398260545916855, -0.011899550445377827, 0.0035705578047782183, -0.037901245057582855, -0.008193927817046642, 0.002522940281778574, 0.01705279015004635, 0.02095927856862545, -0.02481035515666008, 0.03000515326857567, -0.013977469876408577, 0.0012657990446314216, 0.0070579987950623035, -0.032332420349121094, 0.037873540073633194, 0.03030991367995739, 0.03305276855826378, 0.02758091315627098, 0.001703027868643403, -0.03468739613890648, 0.017759282141923904, 0.00627877889201045, -0.007445876952260733, 0.020474430173635483, 0.027636324986815453, 0.010161024518311024, -0.026015548035502434, 0.006271852646023035, 0.0027116844430565834, -0.04540945962071419, -0.022649317979812622, 0.03554626926779747, -0.008034620434045792, 0.010832885280251503, -0.007432023994624615, 0.01004327554255724, -0.017980927601456642, 0.001603460987098515, -0.0010657993843778968, -0.007882240228354931, 0.0010311673395335674, -0.0012675307225435972, -0.00018484822066966444, 0.003961899317800999, -0.03881552815437317, 0.03000515326857567, 0.0031913374550640583, -0.03130731359124184, -0.020848454907536507, 0.0002242421032860875, -0.005890900734812021, 0.016623353585600853, 0.009018168784677982, 0.034576576203107834, 0.02043287083506584, 0.027719441801309586, 0.003123805159702897, -0.007958430796861649, -0.010167950764298439, -0.004775750916451216, -0.01732984557747841, 0.028273552656173706, 0.0011809506686404347, -0.02148568443953991, 0.008117737248539925, 0.009572280570864677, 0.02481035515666008, -0.018590450286865234, -0.021083952859044075, -0.03227701038122177, -0.02155494876205921, -0.019199972972273827, 0.019116856157779694, -0.014614698477089405, 0.01796707510948181, 0.01872897706925869, 0.013236344791948795, -0.01417833473533392, 0.008803450502455235, 0.012065784074366093, 0.00421124929562211, -0.03889864683151245, 0.008090032264590263, 0.018022485077381134, 0.008664922788739204, 0.037070076912641525, 0.013444136828184128, 0.003087441436946392, 0.014822489582002163, 0.018812093883752823, -0.03499215841293335, -0.008505615405738354, -0.0012917730491608381, 0.008083105087280273, -0.01760690100491047, 0.0073073492385447025, -0.02925710193812847, 0.0026060568634420633, 0.014046733267605305, -0.024325506761670113, -0.0215272419154644, -0.018313394859433174, 0.02287096343934536, 0.016124652698636055, -0.01021643541753292, -0.029312513768672943, 0.007750638294965029, 0.033496055752038956, -0.011989593505859375, -0.01131080649793148, 0.026541953906416893, 0.005430295597761869, 0.02481035515666008, 9.231588774127886e-05, -0.008159295655786991, -0.024117715656757355, 0.01845192164182663, -0.02784411609172821, -0.010257993824779987, -0.010147172026336193, -0.021444125100970268, 0.0030372252222150564, 0.023522045463323593, 0.014164482243359089, -0.025973988696932793, 0.018909065052866936, -0.029146280139684677, -0.012238943949341774, -0.016069240868091583, 0.024048451334238052, 0.01681729219853878, -0.029007751494646072, -0.007619036827236414, -0.0059116799384355545, -0.000459739618236199, 0.020308196544647217, -0.021111657842993736, -0.014046733267605305, -0.017842398956418037, -0.01310474332422018, -0.019380059093236923, -0.005845879204571247, -0.00881730392575264, 0.027082212269306183, 0.020335901528596878, -0.006081376690417528, -0.02922939695417881, 0.006961029022932053, -0.034548867493867874, -0.018604302778840065, -0.008103884756565094, 0.01629088632762432, 0.04189084842801094, -0.006424233317375183, -0.027220740914344788, 0.03305276855826378, -0.015141104348003864, -0.00419739680364728, -0.026334162801504135, 0.020003434270620346, 0.01458699256181717, 0.0056623294949531555, 0.03274800628423691, -0.0032207746990025043, -0.015293484553694725, -0.003125536721199751, 0.006524666212499142, 0.007612110581248999, 0.01899218186736107, 0.0068917651660740376, 0.007348907180130482, -0.02587701939046383, 0.01622162200510502, 0.00641384394839406, -0.011511672288179398, -0.023632867261767387, 0.0038787825033068657, -0.02589087188243866, -8.279208850581199e-05, -0.0027861432172358036, 0.014081365428864956, 0.016110800206661224, 0.006334190256893635, 0.006836353801190853, -0.03809518367052078, -0.0023238062858581543, 0.014081365428864956, 0.00412466935813427, -0.0018666640389710665, -0.0022060575429350138, 0.024976588785648346, 0.01878438889980316, 0.003283112309873104, 0.04183543846011162, 0.03230471536517143, 0.017980927601456642, -0.010354964062571526, 0.011006045155227184, -0.00964154489338398, -0.0032952334731817245, 0.016138505190610886, -0.00039870073669590056, -0.002857138868421316, -0.02615407668054104, -0.002699563279747963, -0.007632889784872532, -0.034631986171007156, -0.0008047607843764126, 0.01570906862616539, -0.014822489582002163, 0.008761892095208168, -0.0028692600317299366, -0.015099545940756798, -0.003009519539773464, -0.015916861593723297, -0.023522045463323593, -0.020031141117215157, 0.001627703313715756, 0.02126403898000717, -0.011691758409142494, -0.029284806922078133, 0.006801722105592489, -0.03798436373472214, -0.0012268380960449576, 0.005873584654182196, 0.00042207734077237546, -0.005645013879984617, 0.017745429649949074, 0.2124464511871338, 0.018382657319307327, -0.0021870099008083344, 0.03327441215515137, -1.682898073340766e-05, 0.03163978084921837, 0.009572280570864677, -0.0014839805662631989, 1.853352296166122e-05, 0.03554626926779747, -0.018853653222322464, 0.011477040126919746, 0.03465969115495682, -0.00348224607296288, 0.024602562189102173, -0.0004692634101957083, -0.01309089083224535, -0.015515130013227463, -0.06887609511613846, -0.013894353061914444, 0.02647268958389759, -0.032914239913225174, -0.010140245780348778, -0.01183721236884594, 0.0001519478391855955, -0.008921199478209019, 0.005274451337754726, 0.013264050707221031, 0.047515083104372025, -0.0020519450772553682, -0.015321190468966961, 0.022233735769987106, 0.0019359280122444034, 0.004394799005240202, 0.002356706652790308, -0.014254525303840637, 0.0028086539823561907, -0.011650200001895428, 0.004308219067752361, -0.0036675273440778255, -0.003186142770573497, -0.001292638829909265, -0.01270301267504692, -0.015598246827721596, -0.021056247875094414, -0.0059844073839485645, 0.003253675065934658, -0.008775745518505573, 0.006458865478634834, -0.002569693373516202, -0.021361008286476135, 0.01185799203813076, 0.019213825464248657, 0.029284806922078133, 0.0035913370084017515, 0.004796530120074749, 0.011712538078427315, -0.004301292821764946, 0.004065795335918665, -0.02069607563316822, -0.028758401051163673, 0.044772230088710785, -0.002486576559022069, -0.019726378843188286, -0.006361895706504583, 0.007376613095402718, -0.004055405501276255, 0.0031740216072648764, -0.004121206235140562, -0.006819038186222315, -0.021305598318576813, -0.019366206601262093, -0.012425956316292286, -0.004322072025388479, -0.03684843331575394, -0.010410374961793423, 0.0036432850174605846, 0.022261440753936768, 0.023272695019841194, 0.04912200942635536, -0.008678775280714035, -0.02810731902718544, -0.045049287378787994, -0.002564498456194997, -0.030697792768478394, -0.01788395829498768, 0.019754085689783096, -0.0075774784199893475, -0.023037197068333626, -0.03280341625213623, 0.000687877822201699, -0.005800857674330473, -0.02809346653521061, -0.03161207586526871, 0.009295225143432617, 0.013319461606442928, 0.026888273656368256, 0.004935057833790779, 0.010541976429522038, 0.01156015694141388, -0.021111657842993736, 0.05532805994153023, 0.00824933871626854, 0.00046623311936855316, -0.009482237510383129, -0.00530562037602067, 0.01627703383564949, 0.011580935679376125, -0.004858867730945349, -0.0185073334723711, 0.018936770036816597, -0.026666630059480667, -0.02346663363277912, -0.003388739889487624, -0.0060640606097877026, 0.00991860032081604, -0.011948035098612309, 0.01129695400595665, 0.002150646410882473, -0.024644121527671814, 0.01018873043358326, -0.006774016655981541, 0.004038089420646429, -0.0009714271873235703, -0.02097313106060028, -0.005956701468676329, -0.013174007646739483, 0.0011948035098612309, -0.02672204002737999, -0.021679623052477837, 0.005077049136161804, -0.011040677316486835, 0.011920329183340073, 0.0011463187402114272, 0.0009913406101986766, 0.013949763961136341, 0.01046578586101532, -0.006109082140028477, -0.01983720064163208, -0.019172267988324165, -0.018410364165902138, -0.012335913255810738, 0.002401728183031082, -0.01183721236884594, 0.017745429649949074, -0.0024606026709079742, 0.02395148202776909, -0.010638945735991001, -0.012606042437255383, -0.026832861825823784, -0.004204323049634695, -0.02697139047086239, 0.03327441215515137, -0.011068382300436497, 0.020515987649559975, 0.005883974488824606, -0.010431153699755669, -0.02898004651069641, -0.004630296491086483, 0.003605189733207226, -0.05175403878092766, 0.009593060240149498, 0.031279608607292175, 0.014282231219112873, -0.023909922689199448, -0.003979215398430824, -0.1759859025478363, 0.016470972448587418, 0.01391513179987669, -0.027927232906222343, 0.018881358206272125, -0.0021471830550581217, 0.030697792768478394, 0.0018839800031855702, -0.011615567840635777, 0.0003458869468886405, 0.020529842004179955, 0.03244324401021004, -0.03332982212305069, -0.003224237821996212, -0.017302140593528748, -0.0009463190217502415, -0.03975751996040344, 0.031002553179860115, 0.029866624623537064, 0.011920329183340073, 0.0071757473051548, -0.01654023677110672, -0.004017310217022896, -0.0050978283397853374, -0.007033756468445063, 0.02008655108511448, -0.022275293245911598, 0.0020415554754436016, 0.002905623521655798, -0.013471842743456364, 0.004256271291524172, -0.031030260026454926, 0.02122248150408268, -0.04025622084736824, 0.006112545728683472, -0.0010259725386276841, -0.008699554949998856, -0.018548890948295593, -0.03579562157392502, 0.019103003665804863, 0.03427181392908096, 0.012993921525776386, 0.024186978116631508, 0.0036155793350189924, 0.0019982655066996813, 0.035657092928886414, 0.035989560186862946, -0.007210379466414452, 0.025447582826018333, 9.799769759410992e-05, 0.0069887349382042885, -0.03299735486507416, 0.0045887380838394165, 0.009752367623150349, 0.0056623294949531555, 0.027109919115900993, 0.008685702458024025, 0.0007385271019302309, -0.01351340115070343, -0.016069240868091583, 0.01171946432441473, -0.02285711094737053, 0.0023238062858581543, -0.0027393901254981756, -0.012834614142775536, 0.005942848976701498, 0.0009238081984221935, 0.03601726517081261, 0.009856263175606728, -0.001892638043500483, -0.01897832751274109, -0.011677905917167664, -0.009350636042654514, -0.002652810188010335, 0.004987006075680256, 0.008096958510577679, -0.012024225667119026, 0.009170549921691418, 0.011359291151165962, 0.014067512936890125, 0.00039675270090810955, 0.03111337684094906, -0.005575749557465315, 0.013146301731467247, 0.0017549758777022362, 0.002677052514627576, 0.01127617433667183, -0.00772293284535408, 0.012765349820256233, 0.002431165426969528, 0.003361034207046032, -0.036543671041727066, 0.013998248614370823, 0.00015595216245856136, 0.030808614566922188, 0.0020242396276444197, -0.028245847672224045, 0.016734175384044647, 0.0143514946103096, -0.025516847148537636, 0.0022528106346726418, 0.007653668988496065, -0.06001030653715134, 0.037624187767505646, 0.013596517965197563, 0.017274433746933937, -0.0018649324774742126, 0.02731771022081375, 0.03283112123608589, 0.0015627683605998755, -0.01712205447256565, 0.02341122180223465, 0.020308196544647217, 0.012917730957269669, 0.0005134192178957164, 0.015085693448781967, -0.02622333914041519, -0.007473582401871681, -0.015875302255153656, 0.00447098957374692, 0.045880455523729324, -0.02122248150408268, -0.0386492945253849, 0.010195656679570675, 0.012834614142775536, 0.008013841696083546, -0.08716177940368652, -0.03939734771847725, 0.021568801254034042, 0.03906488046050072, -0.011684832163155079, -0.0059844073839485645, -0.02068222127854824, 0.016720322892069817, -0.035158392041921616, 0.01764846034348011, -0.015639804303646088, -0.034299518913030624, -0.002121209166944027, -0.00482077244669199, 0.02314801886677742, -0.0036536746192723513, -0.008540247566998005, -0.0009999986505135894, -0.0009541112231090665, 0.040671803057193756, 0.013437210582196712, -0.005045880563557148, 0.02126403898000717, -0.02230299822986126, -0.006292631849646568, 0.007570552174001932, 0.0037298649549484253, 0.008484836667776108, 0.01543201319873333, 0.03058696910738945, 0.024367066100239754, -0.014490023255348206, 0.009593060240149498, 0.013423358090221882, -0.035380035638809204, -0.028301259502768517, -0.03499215841293335, -0.01213504746556282, -0.009856263175606728, -0.01403980702161789, 0.022690877318382263, -0.008498689159750938, -0.005537654738873243, -0.02230299822986126, -0.023937629535794258, -0.0014043269911780953, -0.026569658890366554, 0.036543671041727066, 0.000654544506687671, -0.022455379366874695, 0.007667521480470896, -0.03909258544445038, 0.012155827134847641, -0.01872897706925869, 0.007487435359507799, 0.011352364905178547, 0.01473937276750803, 0.027691736817359924, -0.027677882462739944, -0.01407443918287754, -0.036820728331804276, -0.01213504746556282, -0.014919459819793701, 0.03950817137956619, 0.017565343528985977, 0.0008623364265076816, -0.00391341419890523, -0.01845192164182663, 0.004779214039444923, -0.020280491560697556, -0.024616414681077003, 0.01005020271986723, -0.021153217181563377, -0.01871512457728386, -0.02950645238161087, 0.007951503619551659, -0.010839811526238918, -0.03030991367995739, -0.007245011627674103, -0.045381754636764526, -0.03141813725233078, -0.022427674382925034, -0.01762075535953045, -0.03130731359124184, 0.017163611948490143, 0.022510791197419167, 0.0017090884502977133, -0.008775745518505573, 0.015348896384239197, -0.027109919115900993, 0.009322931058704853, 0.0043289982713758945, 0.021970530971884727, -0.034881334751844406, -0.013437210582196712, -0.005274451337754726, 0.022413821890950203, 0.00853332132101059, -0.013825088739395142, -0.0035844105295836926, -0.03950817137956619, -0.012862319126725197, -0.06300251185894012, 0.029922036454081535, -0.016872704029083252, -0.016138505190610886, -0.025253644213080406, 0.015418159775435925, -0.0048484778963029385, -0.008069252595305443, -0.001041556941345334, 0.03363458439707756, -0.035961855202913284, 0.011684832163155079, 0.0008891762117855251, 0.00935756228864193, -0.033191293478012085, -0.02702680230140686, 0.01792551577091217, 0.03150125592947006, 0.00536795798689127, -0.00842249859124422, -0.005302157253026962, -0.004048479255288839, 0.008367087692022324, 0.01684499718248844, -0.0057350569404661655, 0.0026666629128158092, -0.020225079730153084, 0.004865793976932764, -0.016166210174560547, -0.017703870311379433, 0.02338351681828499, -0.006853669881820679, -0.010936780832707882, 0.06433237344026566, -0.01225972268730402, -0.029367923736572266, 0.012924657203257084, 0.013180933892726898, 0.05571593716740608, -0.004221639130264521, -0.003125536721199751, -0.03227701038122177, 4.9080015742219985e-05, -0.009191328659653664, -0.0009290029993280768, 0.0024744553957134485, 0.0008510810439474881, 0.0036155793350189924, 0.006521203089505434, 0.02950645238161087, 0.004786140285432339, 0.002567961812019348, -0.01903373934328556, 0.003625968936830759, 0.022524643689393997, -0.014891753904521465, -0.00910821184515953, 0.010895222425460815, 0.020612958818674088, -0.005835489835590124, 0.02176273986697197, 0.0030545410700142384, 0.05430295318365097, 0.025475289672613144, -0.01555668842047453, -0.01767616532742977, -0.021014688536524773, 0.023078754544258118, 0.005852805450558662, 0.000987877370789647, -0.010618166998028755, 0.008713407441973686, -0.006095229648053646, 0.02615407668054104, 0.03906488046050072, -0.013298682868480682, 0.002850212389603257, 0.014656256884336472, 0.004443283658474684, 0.014067512936890125, 0.04496616870164871, 0.03055926412343979, -0.03934193775057793, 0.014379200525581837, 0.02122248150408268, 0.04540945962071419, -0.015473571605980396, 0.012536779046058655, 0.0062441471964120865, -0.006019039079546928, 0.004315145313739777, 0.02179044485092163, -0.015903007239103317, -0.010472712107002735, 0.0030978310387581587, 0.0012727255234494805, -0.00194631761405617, -0.007051072549074888, 0.0019064907683059573, 0.03560168296098709, 0.008214707486331463, 0.010569682344794273, -0.01597227156162262, -0.003018177580088377, -0.04463370516896248, 0.0014259719755500555, -0.016637206077575684, -0.019740231335163116, 0.007508214563131332, 0.017496079206466675, -0.017191316932439804, -0.0025437192525714636, 0.03224930539727211, 0.007896092720329762, -0.01021643541753292, -0.003764496883377433, 0.0028935023583471775, -0.03006056323647499, -0.03942505270242691, 0.006309947930276394, -0.009225960820913315, 0.01712205447256565, 0.03352376073598862, 0.03720860555768013, 0.01622162200510502, 0.035463154315948486, 0.012065784074366093, -0.032637182623147964, 0.024090008810162544, -0.0026666629128158092, 0.02759476564824581, 0.0215272419154644, -0.0031601686496287584, -0.015418159775435925, -0.03529692068696022, -0.010902149602770805, 0.006438086275011301, -0.006081376690417528, -0.018354952335357666, 0.07818517088890076, 0.009038948453962803, -0.0008662325562909245, -0.015071840025484562, -0.022981785237789154, -0.0018735904013738036, 0.03299735486507416, -0.005135923624038696, 0.004703023470938206, -0.04654539003968239, 0.041198208928108215, 0.0033471814822405577, -0.003466661786660552, -0.03136272728443146, -0.015833744779229164, -0.0015774869825690985, 0.008235486224293709, 0.02758091315627098, 0.0114562613889575, 0.01737140491604805, 0.00612986134365201, -0.010701283812522888, 0.0215272419154644, 0.04277743026614189, -0.02317572571337223, -0.006424233317375183, 0.00881730392575264, 0.019186120480298996, -0.007459729909896851, -0.030947143211960793, 0.00019318154954817146, 0.026555806398391724, -0.026375720277428627, -0.009960158728063107, 0.004100427031517029, -0.018950622528791428, -0.009544575586915016, 0.005291767418384552, 0.021347155794501305, 0.004917742218822241, 0.01021643541753292, 0.018299540504813194, -0.024186978116631508, -0.004394799005240202, -0.011788727715611458, -0.016609501093626022, -0.02402074635028839, -0.009565354324877262, -0.022413821890950203], [-0.007154680322855711, 0.0018733511678874493, 0.000820455199573189, -0.005312436725944281, -0.022659944370388985, 0.024374302476644516, -0.037688229233026505, -0.028162481263279915, -0.007047533057630062, -0.03810299560427666, 0.005471429787576199, 0.022922629490494728, -0.0036326420959085226, -0.0030346906278282404, -0.008350583724677563, 0.023724505677819252, -0.00035946222487837076, -0.008571791462600231, 0.015208016149699688, -0.010652524419128895, 0.00544032221660018, 0.008129375986754894, 0.012290842831134796, -0.0013367501087486744, -0.008074074052274227, 0.0060313609428703785, 0.014945332892239094, -0.022411085665225983, -0.005443778820335865, 0.03453602269291878, 0.03694165498018265, -0.006397736258804798, 0.0007660174160264432, -0.04081278666853905, -0.006069381255656481, 0.0030675260350108147, -0.018028412014245987, -0.0010230847401544452, 0.02796892449259758, -0.013721778988838196, 0.03539320081472397, -0.018733510747551918, -0.012124937027692795, -0.005312436725944281, 0.013929160311818123, 0.016327880322933197, -0.015747210010886192, -0.0007262692088261247, -0.0012779918033629656, 0.000770769955124706, 0.020710553973913193, 0.03384475037455559, -0.041421107947826385, 0.007258371450006962, 0.0012010877253487706, 0.002519691828638315, 0.01037601474672556, 0.031494420021772385, -0.006708809174597263, -0.008924340829253197, 0.01479325257241726, -0.004334284923970699, -0.01003729086369276, 0.0036430112086236477, -0.025908930227160454, -0.025231482461094856, 0.0050566657446324825, -0.012760908342897892, 0.0006299229571595788, 0.02046169526875019, 0.029088787734508514, 0.0491357184946537, -0.005191463977098465, -0.0050946855917572975, 0.01664586551487446, -0.005343543831259012, -0.00937366858124733, 0.017627473920583725, 0.0082883695140481, -0.0007418228778988123, 0.008779172785580158, -0.0010611048201099038, -0.02154008112847805, -0.0031124588567763567, 0.010479706339538097, 0.00195630406960845, -0.03696930408477783, 0.03414890915155411, -0.006062468513846397, -0.021678335964679718, 0.04874860495328903, 0.010092592798173428, -0.0027115202974528074, 0.001913099316880107, 0.004500190261751413, 0.013680302537977695, -0.01883029006421566, 0.02263229340314865, -0.014807078056037426, -0.01665969006717205, -0.024056317284703255, -0.002015062142163515, -0.03564206138253212, -0.00790125597268343, -0.01620345003902912, 0.0008049015887081623, -0.0016832508845254779, 0.005239853169769049, 0.015595129691064358, -0.010244673117995262, 0.015608955174684525, 0.008309107273817062, 0.0043964991346001625, -0.017074454575777054, 0.023060882464051247, -0.0010490075219422579, 0.0004977168864570558, -0.01092212088406086, -0.021885719150304794, 0.0064392127096652985, -0.0028843386098742485, 0.017171233892440796, 0.02199632301926613, -0.0009651905857026577, 0.03318112716078758, 0.01688089780509472, 0.013113457709550858, -0.011800038628280163, -0.020724378526210785, -0.004949518013745546, 0.055357180535793304, 0.004821632523089647, 0.010832255706191063, 0.010064941830933094, -0.018954718485474586, 0.02697349153459072, -0.04269304871559143, 0.02625456638634205, -0.03246220201253891, -0.020323440432548523, 0.011730911210179329, 0.029088787734508514, 0.010659436695277691, -0.02162303403019905, 0.0006186897517181933, -0.007244545966386795, 0.0042340499348938465, 0.00422022445127368, -0.009352929890155792, -0.024540208280086517, 0.0018698947969824076, -0.027028793469071388, 0.003916064277291298, 0.02098706364631653, 0.005872368346899748, 0.019231228157877922, -0.003027777886018157, 0.030969051644206047, 0.010797691531479359, -0.004417237360030413, -0.010355276986956596, 0.0073758880607783794, -0.01553982775658369, -0.002891251351684332, -0.008205416612327099, 0.018401701003313065, -0.006826325785368681, -0.013929160311818123, -0.013514396734535694, -0.009511923417448997, -0.002675228286534548, 0.021429477259516716, -0.011329972185194492, 0.015996068716049194, 0.006795218214392662, -0.00991286151111126, 0.0027910165954381227, -0.015622780658304691, -0.014226408675312996, -0.011641045100986958, -0.011406012810766697, 0.018318748101592064, 0.012463660910725594, 0.003337122732773423, -0.0036533803213387728, -0.027720065787434578, 0.019175926223397255, 0.017337139695882797, 0.017848681658506393, -0.027941273525357246, -0.0015726471319794655, 0.03221334517002106, -0.0028394057881087065, -0.009767694398760796, -0.6105327606201172, -0.03442541882395744, 0.005938039161264896, -0.028701674193143845, 0.018457001075148582, -0.0033906963653862476, 0.0050946855917572975, -0.016714992001652718, -0.011240107007324696, -0.005651160608977079, 0.008931253105401993, 0.008412797935307026, -0.002429826185107231, -0.031245561316609383, -0.006535990629345179, -0.016314053907990456, -0.014502917416393757, -0.05060121789574623, -0.021429477259516716, 0.037467021495103836, -0.008219242095947266, 0.016383182257413864, -0.0003134493308607489, 0.004697203170508146, 0.0022293569054454565, -0.006432299967855215, 0.025438863784074783, -0.018304921686649323, 0.002478215377777815, -0.02379363402724266, -0.011440576054155827, 0.008855213411152363, -0.006795218214392662, -0.002877425868064165, 0.044269151985645294, 0.008509576320648193, -0.012892250902950764, 0.005153443664312363, 0.009200850501656532, 0.02270142175257206, -0.03384475037455559, -0.014108891598880291, 0.0075556193478405476, 0.002419457072392106, -0.028342213481664658, 0.03879426792263985, -0.014862379990518093, -0.005232940427958965, 0.009207762777805328, -0.007244545966386795, 0.0051672691479325294, 0.0036914004012942314, -0.02084880881011486, 0.0039817350916564465, 0.022687595337629318, -0.015152715146541595, 0.016756469383835793, -0.01457204483449459, 0.02123592048883438, -0.010355276986956596, -0.006902365945279598, 0.0022276288364082575, -0.020129883661866188, -0.02207927592098713, -0.010389840230345726, 0.027761543169617653, -0.01595459133386612, 0.015940766781568527, 0.009712392464280128, -0.008004946634173393, -0.01688089780509472, 0.02944825030863285, -0.004427606705576181, -0.004852739628404379, 0.006159246899187565, 6.226862024050206e-05, 0.053504567593336105, -0.005371194798499346, -0.007486491929739714, 0.023530948907136917, 0.010258498601615429, -0.02534208633005619, -0.03121791034936905, -0.013175672851502895, 0.018733510747551918, 0.018249619752168655, -0.015940766781568527, 0.011723998002707958, -0.000915073265787214, 0.01999162882566452, 0.026918189600110054, -0.002129122382029891, 0.022812025621533394, -0.017019152641296387, 0.005519818980246782, 0.01820814423263073, 0.00309863337315619, 0.017724251374602318, -0.01697767712175846, -0.023600077256560326, -0.017420092597603798, 0.0004370144451968372, 0.008219242095947266, -0.009518835693597794, 0.033900052309036255, 0.019936326891183853, -0.0034598237834870815, -0.010064941830933094, 0.037301115691661835, -0.025300608947873116, -0.007852866314351559, -0.011482052505016327, -0.027844496071338654, 0.013763255439698696, -0.004206398967653513, -0.03279401361942291, 0.021913370117545128, -0.0035877092741429806, -0.014157281257212162, 0.007258371450006962, -0.006964580155909061, 0.00739662628620863, 0.005813609808683395, 0.0015527730574831367, 0.007541793864220381, 0.02285350114107132, 0.010106418281793594, 0.013728691264986992, -0.010797691531479359, 0.017779553309082985, 0.012035070918500423, 0.0029327278025448322, 0.011869166046380997, -0.022272830829024315, 0.007963470183312893, -0.02059995010495186, -0.0058689117431640625, -0.010507357306778431, -0.027014967054128647, -0.037771183997392654, 0.004458713810890913, -0.0015614139847457409, 0.02796892449259758, -0.006432299967855215, -0.013569698669016361, -0.019659817218780518, -0.02340652048587799, 0.02689053863286972, 0.00028515030862763524, 0.03412126004695892, -0.02478906698524952, -0.002507594646885991, 0.002464389894157648, -0.0007375024142675102, -0.006739916279911995, -0.024236047640442848, 0.019659817218780518, -0.03749467432498932, 0.0005564751336351037, -0.03625038266181946, -0.015788685530424118, 0.03879426792263985, -0.013410705141723156, -0.027471208944916725, 0.022742897272109985, -0.0016581922536715865, -0.04565170034766197, -0.00030091998632997274, 0.0006770159816369414, -0.019701294600963593, 0.010555746033787727, -0.004980625584721565, 0.010507357306778431, 0.025521816685795784, 0.0024505644105374813, 0.012422184459865093, 0.00449327751994133, -0.010645611211657524, 0.02480289340019226, -0.01003729086369276, 0.006397736258804798, -0.003978278953582048, -0.04360553249716759, -0.017641298472881317, 0.017876332625746727, 0.019963977858424187, -0.014281710609793663, 0.005115423817187548, -0.017558345571160316, 0.014599695801734924, -0.003387239994481206, 0.01766894944012165, -0.0018819920951500535, -0.0008321204804815352, -0.0037328768521547318, 0.04449035972356796, -0.010956685058772564, -0.013355404138565063, -0.02401483990252018, 0.025991883128881454, 0.017724251374602318, 0.040868088603019714, 0.023226788267493248, -0.012760908342897892, 0.019770421087741852, -0.02021283656358719, 0.013037418015301228, -0.014295535162091255, 0.005851630121469498, 0.016079021617770195, 0.014544393867254257, -0.01719888485968113, -0.0056684426963329315, -0.0013134196633473039, 0.006726090796291828, 0.009809170849621296, 0.01479325257241726, 0.008163940161466599, -0.0048803905956447124, 0.02401483990252018, -0.000751327839680016, -0.008661656640470028, 0.03456367552280426, -0.01015480700880289, 0.0010455511510372162, -0.008011859841644764, -0.0017541064880788326, 0.02387658692896366, 0.014184932224452496, -0.025549467653036118, -0.018028412014245987, 0.004662639461457729, 0.008820649236440659, 0.020586123690009117, 0.016410833224654198, 0.0017515141516923904, 0.039015475660562515, 0.007845954038202763, 0.04921867325901985, 0.003798547899350524, 0.013279363512992859, 0.01618962548673153, 0.0023036689963191748, 0.006297501269727945, -0.010127156972885132, -0.010528095066547394, 0.0012961378088220954, 0.017876332625746727, -0.012629566714167595, 0.010058029554784298, -0.022590817883610725, 0.018069889396429062, -0.010064941830933094, 0.019576864317059517, 0.01247057318687439, -0.024457255378365517, -0.0316326729953289, 0.010721651837229729, 0.041946474462747574, 0.028950532898306847, 0.021125318482518196, -0.01274017058312893, 0.007258371450006962, 0.004507103003561497, -0.019950153306126595, 0.010230847634375095, -0.002438467228785157, -0.004469083156436682, -0.02377980761229992, -0.022217528894543648, 0.0011069016763940454, -0.009325278922915459, -0.009242326021194458, -0.003212693613022566, -0.008779172785580158, -0.015857813879847527, 0.03489548712968826, 0.016217276453971863, 0.026945840567350388, -0.0027547248173505068, 0.008938166312873363, -0.030250128358602524, 0.022894978523254395, -0.0012961378088220954, 0.02029578946530819, 0.0015095684211701155, -0.00020381766080390662, -0.009000380523502827, -0.01728183776140213, 0.0021688705310225487, -0.018774988129734993, 0.0004886439419351518, -0.0010032106656581163, 0.005029014777392149, -0.03387239947915077, 0.021332699805498123, 0.02416692115366459, -0.013535134494304657, 0.0009729674202390015, 0.008267630822956562, -0.028480468317866325, 0.009187025018036366, -0.005554382223635912, 0.0032749080564826727, 0.051651954650878906, -0.012152587994933128, -0.00991286151111126, -0.02819013223052025, 0.005143074784427881, -0.016908548772335052, -0.016300229355692863, -0.018802639096975327, -0.030084222555160522, 0.022217528894543648, -0.004897672683000565, -0.024747591465711594, -0.0035531457979232073, 0.007265284191817045, 0.02611631155014038, 0.01394989900290966, 0.013514396734535694, -0.016604388132691383, -0.010569571517407894, 0.01553982775658369, 0.01859525591135025, 0.019010020419955254, -0.01805606298148632, 0.011959031224250793, -0.01765512488782406, -0.011668696068227291, -0.009366755373775959, -0.043356671929359436, 0.01905149780213833, -0.004178748000413179, 0.019106799736618996, -0.019383307546377182, 0.021125318482518196, -0.01251204963773489, -0.020323440432548523, 0.017406266182661057, 0.01088064443320036, -0.01495915837585926, 0.015691908076405525, -0.0006027040653862059, -0.024056317284703255, 0.010127156972885132, -0.007368975318968296, 0.01920357719063759, 0.01289916317909956, 0.00899346824735403, 0.030664891004562378, 0.012560439296066761, 0.011647958308458328, -0.036996956914663315, -0.026918189600110054, 0.0175030454993248, 0.020281963050365448, 0.030581938102841377, -0.001502655679360032, 0.008786085993051529, -0.004863108973950148, -0.01881646364927292, -0.013507483527064323, 0.03542085364460945, -0.000791940197814256, 0.017392441630363464, 0.015028285793960094, -0.005360825918614864, 0.017102105543017387, -0.010044204071164131, -0.028231609612703323, 0.006591292563825846, 0.014392313547432423, -0.016217276453971863, 0.0067295474000275135, -0.03362354263663292, -0.004921867046505213, -0.006072837393730879, -0.027872147038578987, 0.0017644756007939577, -0.04252714291214943, -0.017240360379219055, 0.0007046668906696141, -0.04186352342367172, -0.04462861642241478, -0.01491768192499876, 0.026406647637486458, -0.001543268095701933, 0.006684614345431328, 0.0037363332230597734, -0.017019152641296387, -0.02509322762489319, 0.007223807740956545, -0.00042297295294702053, 0.0031815862748771906, -0.02246638759970665, -0.026766108348965645, 0.012947551906108856, 0.03354058787226677, -0.009857559576630592, 0.014129630289971828, 0.00019010021060239524, 0.0017316400771960616, 0.0058654556050896645, -0.023517124354839325, -0.03907077759504318, -0.004078513476997614, -0.018968544900417328, -0.011634132824838161, -0.00213085045106709, 0.0012071363162249327, -0.0004998771473765373, -0.009857559576630592, 0.0015328989829868078, 0.00747957918792963, -0.002649305621162057, 0.0031522070057690144, -0.029973618686199188, 0.03307052329182625, 0.0005992476944811642, 0.013804731890559196, 0.004344653803855181, 0.021954845637083054, -0.012878425419330597, 0.005979515612125397, -0.01674264296889305, -0.009138635359704494, 0.007085553370416164, 0.0023192225489765406, 0.006266394164413214, 0.0005646840436384082, 0.004078513476997614, 0.010576484724879265, -0.034065958112478256, 0.002962106838822365, -0.025134703144431114, 0.003940258640795946, -0.015705732628703117, 0.016562912613153458, -0.016231101006269455, -0.004140728153288364, -0.015982242301106453, -0.0068919965997338295, -0.000754352193325758, -0.0034252600744366646, -0.007541793864220381, 0.02348947338759899, -0.023282090201973915, -0.009000380523502827, 0.03926433250308037, 0.012235540896654129, -0.00036896721576340497, -0.01728183776140213, 0.003489202819764614, -0.013189498335123062, 0.016079021617770195, 0.00211011222563684, -0.015774860978126526, -0.02611631155014038, -0.003292189911007881, 0.014890030957758427, 0.009387494064867496, -0.009470446966588497, -0.006390823516994715, -0.020558472722768784, -0.0015847444301471114, -0.007327498868107796, 0.0022431823890656233, -0.015788685530424118, -0.03099670261144638, -0.002694238442927599, -0.0015933853574097157, 0.015208016149699688, -0.0012676226906478405, 0.004990994464606047, 0.004475995898246765, -0.007956557907164097, 0.0037155949976295233, -0.014779427088797092, -0.045458145439624786, 0.0022846588399261236, -0.015055936761200428, 0.03472958132624626, 0.02619926445186138, 0.029005834832787514, -0.02495497278869152, 0.03951319307088852, 0.01797311007976532, -0.007569444831460714, -0.0082883695140481, 0.02263229340314865, -0.016148148104548454, -0.016521437093615532, 0.014807078056037426, 0.01905149780213833, -0.008716958574950695, 0.015553653240203857, -0.012131849303841591, 0.0012494768016040325, 0.015429223887622356, -0.02726382575929165, -0.0012762636179104447, -0.0005707326927222311, -0.03434246778488159, -0.014433789998292923, 0.01374942995607853, -0.002523148199543357, -0.003694856772199273, -0.03564206138253212, -0.014682648703455925, 0.014212583191692829, -0.003421803703531623, 0.01227701734751463, 0.02037874236702919, 0.05129249393939972, -0.020116059109568596, 0.02471994049847126, -0.0067330035381019115, 0.026710808277130127, -0.011924467980861664, 0.005029014777392149, -0.013832381926476955, -0.004631532356142998, 0.016479959711432457, -0.00906950794160366, 0.021512430161237717, 0.03251750394701958, -0.0030001269187778234, -0.00013587845023721457, 0.00898655503988266, -0.007915081456303596, 0.002716704737395048, 0.004323915578424931, -0.01672881841659546, 0.006242199335247278, -0.03307052329182625, -0.009470446966588497, 0.0016944841481745243, 0.017309488728642464, 0.02270142175257206, -0.025853628292679787, 0.025549467653036118, -0.010452055372297764, 0.0008360088686458766, 0.003660293063148856, -0.02418074570596218, 0.03724581375718117, 0.02286732755601406, 0.035061389207839966, 0.02308853343129158, -0.0021014714147895575, -0.030360732227563858, 0.018539953976869583, 0.002129122382029891, -0.007887430489063263, 0.02214840240776539, 0.030969051644206047, 0.005620053503662348, -0.03392770141363144, 0.0071062915958464146, -0.0013557601487264037, -0.03990030661225319, -0.022812025621533394, 0.03625038266181946, -0.014095066115260124, 0.008675482124090195, -0.001831874717026949, 0.0005245037609711289, -0.018387874588370323, 0.002269105287268758, -0.001439577084966004, -0.009981988929212093, 0.003292189911007881, -0.0036775749176740646, -0.00499790720641613, 0.00414418475702405, -0.03918138146400452, 0.032268647104501724, -0.002486856421455741, -0.026130137965083122, -0.026614028960466385, 0.00020262954058125615, -0.010472793132066727, 0.01765512488782406, 0.008965817280113697, 0.02836986444890499, 0.013528222218155861, 0.02588127925992012, -0.0006601662025786936, -0.0009003836894407868, -0.013576610945165157, -0.005395389627665281, -0.01483472902327776, 0.0313008651137352, -0.0006126411026343703, -0.021111492067575455, 0.017337139695882797, 0.008170852437615395, 0.029116438701748848, -0.020185185596346855, -0.022673770785331726, -0.03251750394701958, -0.024858195334672928, -0.015166540630161762, 0.021830417215824127, -0.01305815577507019, 0.009110984392464161, 0.011613394133746624, 0.01189681701362133, -0.009346017614006996, 0.007873605005443096, 0.007673135492950678, -0.001474140677601099, -0.03757762536406517, 0.009380580857396126, 0.025314435362815857, 0.009636352770030499, 0.045845258980989456, 0.011723998002707958, -0.0008334165904670954, 0.014502917416393757, 0.020337264984846115, -0.03318112716078758, -0.007659310009330511, -0.002281202469021082, 0.0011336884927004576, -0.026282217353582382, 0.005917300935834646, -0.02765093930065632, 0.004558948799967766, 0.009263064712285995, -0.027623288333415985, -0.022424912080168724, -0.013410705141723156, 0.019867200404405594, 0.01596841774880886, -0.002371068112552166, -0.026627855375409126, 0.01294063962996006, 0.03558675944805145, -0.009525748901069164, -0.008509576320648193, 0.018401701003313065, -0.0033665017690509558, 0.02975241094827652, -0.0029085332062095404, -0.012525875121355057, -0.018484652042388916, 0.02098706364631653, -0.035835616290569305, -0.005917300935834646, -0.010286149568855762, -0.030277779325842857, 0.007196156773716211, 0.023268265649676323, 0.02054464817047119, -0.02231430821120739, 0.01827727071940899, -0.02611631155014038, -0.013313927687704563, -0.01204889640212059, 0.025314435362815857, 0.0070164259523153305, -0.030581938102841377, -0.005087772849947214, -0.01340379286557436, -0.0029068049043416977, 0.024360477924346924, -0.01704680360853672, -0.013514396734535694, -0.016009893268346786, -0.01610667258501053, -0.02330974116921425, -0.005792871583253145, -0.008502664044499397, 0.028452817350625992, 0.028839929029345512, -0.013341578654944897, -0.032655760645866394, 0.008654744364321232, -0.03694165498018265, -0.018940893933176994, -0.00890360213816166, 0.011364536359906197, 0.042969558387994766, -0.00370868225581944, -0.022839676588773727, 0.034287165850400925, -0.018304921686649323, -0.007299847900867462, -0.030194826424121857, 0.018014587461948395, 0.016673516482114792, 0.005360825918614864, 0.02548034116625786, -0.0024557490833103657, -0.009311453439295292, -0.008578703738749027, 0.010182457976043224, 0.004621163010597229, 0.015567478723824024, 0.006580923683941364, 0.009000380523502827, -0.02230048179626465, 0.012954465113580227, 0.01394989900290966, -0.007292935159057379, -0.03602917492389679, 0.007244545966386795, -0.03113495744764805, -0.0021809679456055164, -0.005029014777392149, 0.009477359242737293, 0.0075556193478405476, 0.01184842735528946, 0.004731766879558563, -0.04272070154547691, -0.00202543125487864, 0.016632039099931717, 0.010058029554784298, -0.0019770420622080564, -0.005906932055950165, 0.023503297939896584, 0.02160920947790146, 0.007583270315080881, 0.03835185244679451, 0.033817097544670105, 0.011364536359906197, -0.0035531457979232073, 0.012221715413033962, -0.014129630289971828, -0.007085553370416164, 0.014309360645711422, -0.0026268393266946077, 0.007832128554582596, -0.023683030158281326, -0.001646959106437862, -0.006432299967855215, -0.02658637799322605, 0.0017316400771960616, 0.017696600407361984, -0.011053463444113731, 0.009981988929212093, -0.00806024856865406, -0.023143835365772247, -0.00105505611281842, -0.01247057318687439, -0.025203831493854523, -0.013514396734535694, -0.0008494022767990828, 0.015249492600560188, -0.013472920283675194, -0.03207508847117424, 0.012719431892037392, -0.03594622015953064, 0.0016806586645543575, 0.00996125116944313, -0.001980498433113098, -0.007424277253448963, 0.01866438426077366, 0.20505936443805695, 0.009477359242737293, 0.005664986092597246, 0.03597387298941612, -0.004586599767208099, 0.02751268446445465, 0.008398972451686859, 0.005125792697072029, 0.0043757613748312, 0.026323694735765457, -0.023420345038175583, 0.01096359733492136, 0.032821666449308395, -0.009905949234962463, 0.02253551594913006, 0.0020772768184542656, -0.004662639461457729, -0.012118023820221424, -0.06785540282726288, -0.013459094800055027, 0.018719686195254326, -0.026544902473688126, -0.011647958308458328, -0.013797818683087826, -0.005640791729092598, -0.007686960976570845, 0.006383910775184631, 0.011917554773390293, 0.04418620094656944, -0.0024488363415002823, -0.012836948968470097, 0.017074454575777054, 0.005661529954522848, -0.004351566545665264, 0.007445015478879213, -0.016161974519491196, 0.002875697799026966, -0.009539574384689331, 0.003566971281543374, -0.003950627986341715, -0.004448344931006432, -0.004023211542516947, -0.006200723350048065, -0.012290842831134796, -0.022411085665225983, -0.00084292161045596, 0.0036326420959085226, -0.006739916279911995, 0.0044310628436505795, 0.0008649559458717704, -0.018304921686649323, 0.01298211608082056, 0.01797311007976532, 0.030858447775244713, 0.0005893106572329998, 0.009083333425223827, 0.015913115814328194, -0.00019042423809878528, 0.005025558173656464, -0.01635553129017353, -0.02727765217423439, 0.038075342774391174, 0.0012313309125602245, -0.017959285527467728, -0.0023537862580269575, 0.009339104406535625, -0.0007884838269092143, 0.00801877211779356, -0.0024937691632658243, -0.0033440354745835066, -0.018650557845830917, -0.01344526931643486, -0.006670789327472448, -0.0007448471733368933, -0.03121791034936905, -0.009622527286410332, 0.007292935159057379, 0.02293645404279232, 0.028839929029345512, 0.04949518293142319, -0.0076316590420901775, -0.034591324627399445, -0.04302486032247543, 0.002120481338351965, -0.03409360721707344, -0.029116438701748848, 0.024664638563990593, -0.0024004471488296986, -0.01332083996385336, -0.03138381615281105, 0.0010602406691759825, -0.00223626964725554, -0.029558854177594185, -0.031660325825214386, 0.006574010942131281, 0.012719431892037392, 0.027084095403552055, 0.0011846699053421617, 0.004002473317086697, 0.00501864543184638, -0.02519000507891178, 0.04996524751186371, 0.01201433315873146, -0.0006096168071962893, -0.0035254948306828737, -0.009145548567175865, 0.01088755764067173, 0.005893106572329998, -0.002454020781442523, -0.019728945568203926, 0.019120624288916588, -0.02495497278869152, -0.02509322762489319, -0.005029014777392149, -0.00933219213038683, 0.011399099603295326, -0.006774479988962412, 0.006622400134801865, 0.003535863943397999, -0.026531076058745384, 0.010016553103923798, -0.008468099869787693, 0.00029292714316397905, 0.0015285784611478448, -0.02525913342833519, -0.005699549801647663, -0.012249366380274296, 0.0012175054289400578, -0.025756850838661194, -0.018788812682032585, -1.5644787936253124e-06, -0.011620307341217995, 0.005174181889742613, -0.008205416612327099, 0.0010706097818911076, 0.020558472722768784, 0.012995941564440727, -0.010147894732654095, -0.01805606298148632, -0.010203196667134762, -0.016286402940750122, -0.005879281088709831, 0.0002123505691997707, -0.007638571783900261, 0.010666349902749062, -0.0006683750543743372, 0.023351218551397324, -0.007389713544398546, -0.018774988129734993, -0.026544902473688126, -0.0026631311047822237, -0.028480468317866325, 0.0314667671918869, -0.007002600468695164, 0.02635134570300579, -0.0025525272358208895, -0.010631785728037357, -0.03251750394701958, -0.003950627986341715, 0.006878171116113663, -0.04750431329011917, 0.014862379990518093, 0.028618721291422844, 0.009256151504814625, -0.01681177131831646, -0.000760400842409581, -0.17630238831043243, 0.012677955441176891, 0.017226535826921463, -0.0156504325568676, 0.018581431359052658, -0.001284904545173049, 0.029171740636229515, 0.0017515141516923904, -0.006636225618422031, 0.0007915081223472953, 0.007541793864220381, 0.03099670261144638, -0.03213039040565491, -0.0052191149443387985, -0.009200850501656532, 0.000855018908623606, -0.03666514530777931, 0.030471334233880043, 0.023420345038175583, 0.014696474187076092, 0.017240360379219055, -0.007562532089650631, 0.0025490708649158478, -0.003053700551390648, 0.0024661181960254908, 0.016673516482114792, -0.017530694603919983, 0.0032679953146725893, -0.002312309807166457, -0.009705479256808758, 0.007299847900867462, -0.03154972195625305, 0.019963977858424187, -0.040342722088098526, 0.003871131455525756, -0.003200596198439598, -0.0073067606426775455, -0.015097413212060928, -0.03251750394701958, 0.012194064445793629, 0.029697109013795853, 0.012180238962173462, 0.02091793529689312, 0.007728437427431345, 0.008765347301959991, 0.03423186391592026, 0.03464662656188011, -0.010694000869989395, 0.02758181281387806, -0.0017376886680722237, 0.006632769014686346, -0.027056444436311722, -0.0012823123252019286, 0.008170852437615395, -0.0004873478028457612, 0.031964484602212906, 0.007299847900867462, -0.0002315766178071499, -0.01483472902327776, -0.022328132763504982, 0.008779172785580158, -0.018968544900417328, 0.0012425640597939491, -0.009885210543870926, -0.01618962548673153, 0.004075057338923216, 0.005298611242324114, 0.029227042570710182, 0.010770040564239025, -0.004811263643205166, -0.01851230300962925, -0.004621163010597229, -0.009608701802790165, 0.0006584380171261728, 0.007894342765212059, 0.0028947077225893736, -0.007811390329152346, 0.007113204337656498, 0.007956557907164097, 0.011440576054155827, -0.0046453578397631645, 0.03555910661816597, -0.007673135492950678, 0.008806823752820492, -0.003407978219911456, 0.00250932271592319, 0.012802384793758392, -0.015318620018661022, 0.011212456040084362, -0.0009107528021559119, 0.01139218732714653, -0.030498985201120377, 0.007742262911051512, 0.00020144142035860568, 0.029973618686199188, 0.0006623264052905142, -0.017171233892440796, 0.010369102470576763, 0.01883029006421566, -0.013714865781366825, -0.0033112000674009323, 0.0033993374090641737, -0.06166159361600876, 0.03354058787226677, 0.008260718546807766, 0.01790398359298706, -0.007061358541250229, 0.025895103812217712, 0.03578031435608864, 0.0023658834397792816, -0.02021283656358719, 0.020116059109568596, 0.01595459133386612, 0.01580251194536686, -0.0006342434207908809, 0.01836022362112999, -0.02914408966898918, -0.013714865781366825, -0.014198757708072662, 0.006135052070021629, 0.04294190928339958, -0.019493911415338516, -0.042195335030555725, 0.01860908232629299, 0.015567478723824024, 0.014392313547432423, -0.08660273998975754, -0.02813483029603958, 0.023185312747955322, 0.042886607348918915, -0.008260718546807766, 0.002644121181219816, -0.019853373989462852, 0.014613521285355091, -0.033264078199863434, 0.024305175989866257, -0.023143835365772247, -0.034674279391765594, -0.0025836345739662647, 0.0022863871417939663, 0.02579832635819912, 0.0040335808880627155, -0.005872368346899748, 0.007894342765212059, 0.004113077186048031, 0.037688229233026505, 0.00518800737336278, -0.008938166312873363, 0.021899543702602386, -0.012622653506696224, -0.007292935159057379, 0.008475013077259064, 0.0021705988328903913, 0.014309360645711422, 0.021111492067575455, 0.03594622015953064, 0.021526256576180458, -0.01674264296889305, 0.008675482124090195, 0.00995433796197176, -0.04462861642241478, -0.02966945804655552, -0.033264078199863434, -0.017337139695882797, -0.014226408675312996, -0.013168759644031525, 0.02029578946530819, -0.00743810273706913, -0.002718433039262891, -0.018871765583753586, -0.01968746818602085, -0.00372942048124969, -0.03232394903898239, 0.031107306480407715, -0.0011924467980861664, -0.02726382575929165, 0.009000380523502827, -0.03492313623428345, 0.0007578085642307997, -0.018622906878590584, -0.004223681055009365, 0.01126775797456503, 0.017461568117141724, 0.02162303403019905, -0.02324061468243599, -0.013369228690862656, -0.031162608414888382, -0.015028285793960094, -0.0165767390280962, 0.03215804323554039, 0.018567604944109917, 0.003992104437202215, -0.005803240928798914, -0.02007458172738552, -0.0025369736831635237, -0.021111492067575455, -0.02448490634560585, 0.017793379724025726, -0.020406393334269524, -0.01297520287334919, -0.027485033497214317, 0.006325152236968279, -0.01379090640693903, -0.03174327686429024, -0.0020893740002065897, -0.039153728634119034, -0.029890665784478188, -0.019659817218780518, -0.013811644166707993, -0.032047439366579056, 0.01983954943716526, 0.02093176171183586, 0.002018518513068557, -0.014012113213539124, 0.012311580590903759, -0.028950532898306847, 0.004711028654128313, 0.0038538496010005474, 0.01697767712175846, -0.04111694544553757, -0.014337011612951756, -0.010763128288090229, 0.025991883128881454, 0.01286459993571043, -0.01332083996385336, -0.011447489261627197, -0.037937089800834656, -0.010673262178897858, -0.05649086833000183, 0.031494420021772385, -0.02037874236702919, -0.006128139328211546, -0.027526510879397392, 0.008578703738749027, 0.0006467727362178266, -0.006425387226045132, -0.003784722415730357, 0.032655760645866394, -0.03069254197180271, 0.012539700604975224, -0.003178129903972149, 0.007006056606769562, -0.030167175456881523, -0.028452817350625992, 0.012200976721942425, 0.03069254197180271, 0.0027720066718757153, -0.008813736960291862, -0.005716831889003515, 0.0015640062047168612, 0.002704607555642724, 0.013120370917022228, -0.013085806742310524, 0.00449327751994133, -0.01953538879752159, -0.005796328186988831, -0.010998161509633064, -0.01625875197350979, 0.024457255378365517, -0.010721651837229729, -0.003822742262855172, 0.05397463217377663, -0.013196410611271858, -0.03450837358832359, 0.015028285793960094, 0.018401701003313065, 0.0626017302274704, 0.0026181982830166817, 0.0033198408782482147, -0.02936529740691185, 0.0021878806874156, -0.008392060175538063, -0.0015104325721040368, 0.01239453349262476, 0.0002566352777648717, 0.0044829086400568485, -0.00035903017851524055, 0.023669203743338585, 0.012843861244618893, 0.006546359974890947, -0.015235667116940022, 0.01029997505247593, 0.01243600994348526, -0.02176128886640072, -0.003871131455525756, 0.004776699934154749, 0.018927067518234253, -0.0012192336143925786, 0.02393188886344433, -0.0004804350610356778, 0.055440131574869156, 0.02285350114107132, -0.01483472902327776, -0.014081240631639957, -0.018111364915966988, 0.02098706364631653, 0.008495750837028027, 0.0017013968899846077, -0.00691273482516408, -0.0009072964312508702, -0.0019735856913030148, 0.022369610145688057, 0.030250128358602524, -0.017724251374602318, 0.0022189877927303314, 0.018650557845830917, 0.004863108973950148, 0.017876332625746727, 0.04039802402257919, 0.02433282695710659, -0.036056824028491974, 0.019092973321676254, 0.01844317652285099, 0.038241248577833176, -0.009657090529799461, 0.0165767390280962, -0.00019992925808764994, -0.00895199179649353, -0.0008273679413832724, 0.022977931424975395, -0.013714865781366825, -0.014724125154316425, 0.0063182394951581955, 0.007548706606030464, -0.007313673384487629, -0.011827689595520496, 0.010113331489264965, 0.03168797492980957, 0.009304541163146496, 0.007099378854036331, -0.011952118948101997, -0.01138527411967516, -0.04755961522459984, 0.0011924467980861664, -0.024927321821451187, -0.01874733716249466, 0.007832128554582596, 0.01664586551487446, -0.010555746033787727, -0.0007928042905405164, 0.029420599341392517, 0.0009911133674904704, -0.010134069249033928, -0.0021256660111248493, 0.0019182838732376695, -0.02711174637079239, -0.03561440855264664, -0.0005262319464236498, -0.004870021715760231, 0.024913495406508446, 0.03182623162865639, 0.03608447685837746, 0.024360477924346924, 0.043660834431648254, 0.008329845033586025, -0.03503374010324478, 0.036443937569856644, -0.0078252162784338, 0.023765983060002327, 0.021678335964679718, 0.003050244180485606, -0.012256278656423092, -0.040563926100730896, -0.016383182257413864, 0.011959031224250793, -0.008239979855716228, -0.013970636762678623, 0.07548706233501434, 0.00945662148296833, -0.0013652651105076075, -0.012677955441176891, -0.024111619219183922, -0.004275526385754347, 0.02510705217719078, -0.011578830890357494, 0.004005929920822382, -0.05096068233251572, 0.03370649367570877, 8.36548933875747e-05, 0.005585489794611931, -0.02966945804655552, -0.012912988662719727, 0.0014490820467472076, 0.012270104140043259, 0.02371068112552166, 0.000943588325753808, 0.014461440965533257, 0.011323059909045696, -0.008329845033586025, 0.01332775317132473, 0.04330136999487877, -0.025825977325439453, -0.01088064443320036, 0.011530441232025623, 0.012456747703254223, -0.006262937560677528, -0.029254693537950516, -0.0023434171453118324, 0.02611631155014038, -0.016618214547634125, -0.018304921686649323, 0.00041001159115694463, -0.01975659653544426, -0.0017662037862464786, 0.0017307759262621403, 0.02177511528134346, 0.011965944431722164, 0.012892250902950764, 0.01881646364927292, -0.029945967718958855, 0.0010032106656581163, -0.018263446167111397, -0.012028158642351627, -0.022908803075551987, -0.018083713948726654, -0.01867820881307125]], documents=["""create view INFI_RnDAnalysis_SSAS_CSC2.V_ResultPlan_V1_IFCT0_G5_DemoSystem as

SELECT 

[SourceSystem], 

[ScenarioDimId], 

[ProfitCenterDimId], 

[ProductHierarchyDimId], 

[LegalShareDimId], 

[CompanyCodeDimId], 

[CostCenterDimId], 

[WBSElementDimId], 

[JunkResultRnDDimId], 

[PostingYear], 

[PostingYearPeriodId], 

[PostingPeriodId], 

[TotalAmountCOAreaCurrency] *( 

    1 -( 

        CAST([ProfitCenterDimId] as decimal) / 10 - FLOOR(CAST([ProfitCenterDimId] as decimal) / 10) 

    ) / 10 * 5 

) * ( 

    1 +( 

        CAST([CompanyCodeDimId] as decimal) / 10 - FLOOR(CAST([CompanyCodeDimId] as decimal) / 10) 

    ) / 10 * 3 

) as [TotalAmountCOAreaCurrency], 

[TotalAmountObjectCurrency] *( 

    1 -( 

        CAST([ProfitCenterDimId] as decimal) / 10 - FLOOR(CAST([ProfitCenterDimId] as decimal) / 10) 

    ) / 10 * 5 

) * ( 

    1 +( 

        CAST([CompanyCodeDimId] as decimal) / 10 - FLOOR(CAST([CompanyCodeDimId] as decimal) / 10) 

    ) / 10 * 3 

) as [TotalAmountObjectCurrency]

FROM 

[INFI_RnDAnalysis_SSAS_CSC2].[V_ResultPlan_V1_IFCT0_G5] fact --Select only projects from one company code   INNER JOIN (SELECT ccdi_bs.DimensionId FROM [BUSV_FBI_OH_CSC1].[CompanyCodeDimensionID_BSATC_XX_X] ccdi_bs              INNER JOIN [RAWV_RB_CSC1].[CompanyCode_WHUB0] cc_wh                 on cc_wh.CompanyCode_HK         = ccdi_bs.CompanyCode_HK                WHERE cc_wh.CompanyCode_BK LIKE ('9417') ) ccdi_bs_demo -->RBOS-PS Company Code     ON ccdi_bs_demo.DimensionId                 = fact.CompanyCodeDimId " 

INFI_TM1_CSC2;

9;

INFormation Mart as Interface;

V_INTF_PNL_FACT_ELEMENT_NameOfValueField;

847394138;

"V ";

VIEW;

3296;""", "create view INFI_RnDAnalysis_SSAS_CSC2.V_ResultPlan_V1_IFCT0_G5_DemoSystem as SELECT [SourceSystem],[ScenarioDimId],[ProfitCenterDimId],[ProductHierarchyDimId],[LegalShareDimId],[CompanyCodeDimId],[CostCenterDimId],[WBSElementDimId],[JunkResultRnDDimId],[PostingYear],[PostingYearPeriodId],[PostingPeriodId],[TotalAmountCOAreaCurrency] (1-(CAST([ProfitCenterDimId] as decimal)/10-FLOOR(CAST([ProfitCenterDimId] as decimal)/10) )/10 5) (1+(CAST([CompanyCodeDimId] as decimal)/10-FLOOR(CAST([CompanyCodeDimId] as decimal)/10) )/10 3) as [TotalAmountCOAreaCurrency],[TotalAmountObjectCurrency] (1-(CAST([ProfitCenterDimId] as decimal)/10-FLOOR(CAST([ProfitCenterDimId] as decimal)/10) )/10 5) (1+(CAST([CompanyCodeDimId] as decimal)/10-FLOOR(CAST([CompanyCodeDimId] as decimal)/10) )/10 3) as [TotalAmountObjectCurrency] FROM [INFI_RnDAnalysis_SSAS_CSC2].[V_ResultPlan_V1_IFCT0_G5] fact INNER JOIN (SELECT ccdi_bs.DimensionId FROM [BUSV_FBI_OH_CSC1].[CompanyCodeDimensionID_BSATC_XX_X] ccdi_bs INNER JOIN [RAWV_RB_CSC1].[CompanyCode_WHUB0] cc_wh on cc_wh.CompanyCode_HK = ccdi_bs.CompanyCode_HK WHERE cc_wh.CompanyCode_BK LIKE ('9417') ) ccdi_bs_demo ON ccdi_bs_demo.DimensionId = fact.CompanyCodeDimId INFI_TM1_CSC2;9;INFormation Mart as Interface;V_INTF_PNL_FACT_ELEMENT_NameOfValueField;847394138;'V ';VIEW;3296;"], metadatas=[{"formatted": "yes"}, {"formatted": "no"}], ids=["id1", "id2"] )

results = collection.query( query_embeddings=[[-0.012086562812328339, -0.002069261157885194, -0.007868386805057526, 0.0019948023837059736, -0.026541953906416893, 0.022122912108898163, -0.03551856428384781, -0.027691736817359924, -0.007937651127576828, -0.03662678971886635, 0.0073073492385447025, 0.012696086429059505, -0.004138522315770388, -0.009960158728063107, -0.009586133994162083, 0.020335901528596878, 0.003958436194807291, -0.01759304851293564, 0.017232876271009445, -0.006597393192350864, 0.010812105610966682, 0.011587862856686115, 0.015598246827721596, -0.000635064032394439, -0.009122065268456936, 0.007993062026798725, 0.015085693448781967, -0.019934171810746193, -0.006735921371728182, 0.031224198639392853, 0.03640514239668846, -0.001550647197291255, -0.00042164442129433155, -0.04662850499153137, -0.0058285631239414215, -0.002275321399793029, -0.019726378843188286, -0.005125533789396286, 0.03036532551050186, -0.009052800945937634, 0.03776271641254425, -0.014614698477089405, -0.008207780309021473, 0.004522937349975109, 0.015459718182682991, 0.01433764211833477, -0.013991322368383408, -0.00502163777127862, -0.011262321844696999, -0.0011030287714675069, 0.020779192447662354, 0.027193035930395126, -0.04546486958861351, -0.000596968864556402, 0.002746316371485591, -0.0003898262802977115, 0.012883098796010017, 0.024741090834140778, -0.005845879204571247, -0.013998248614370823, 0.014545434154570103, -0.006524666212499142, -0.009932453744113445, -0.0019670967012643814, -0.026819009333848953, -0.016955820843577385, 0.011629421263933182, -0.007383539341390133, -0.008013841696083546, 0.015127251856029034, 0.015224221162497997, 0.04776443541049957, -0.004325535148382187, -0.004734192509204149, 0.022386115044355392, -0.00814544316381216, -0.010417301207780838, 0.007279643323272467, 0.010458859615027905, -0.003909951075911522, 0.006635488476604223, -0.0016510799759998918, -0.02755320817232132, -0.0004155838396400213, 0.014697814360260963, 0.0034043241757899523, -0.033745408058166504, 0.03496445342898369, -0.002593935700133443, -0.021928973495960236, 0.039037175476551056, 0.011795653961598873, 2.5392280804226175e-05, 0.0014277036534622312, 0.008886567316949368, 0.013942837715148926, -0.017842398956418037, 0.02292637526988983, -0.01020258292555809, -0.015875302255153656, -0.026652775704860687, 0.00016504306404385716, -0.03723631054162979, -0.006957565899938345, -0.012045004405081272, 0.0001043288575601764, -0.008076178841292858, 0.006389601621776819, 0.015293484553694725, -0.0030597359873354435, 0.008561027236282825, 0.0036121162120252848, 0.0033766187261790037, -0.014268377795815468, 0.028301259502768517, -0.004349777474999428, 0.004834625404328108, -0.00798613578081131, -0.019116856157779694, 0.009883969090878963, 0.005312546622008085, 0.028162730857729912, 0.02090386673808098, -0.00428397674113512, 0.029617274180054665, 0.013312535360455513, 0.014836343005299568, -0.014559286646544933, -0.017551491037011147, -0.008907346986234188, 0.060509007424116135, 0.003397397929802537, 0.017232876271009445, 0.005956701468676329, -0.02011425793170929, 0.025516847148537636, -0.04081033170223236, 0.030393030494451523, -0.024450182914733887, -0.02065451629459858, 0.01473937276750803, 0.03670990467071533, 0.015127251856029034, -0.017163611948490143, -0.0017705602804198861, -0.009489163756370544, 0.0062545365653932095, 0.001800863305106759, -0.011532451026141644, -0.024588709697127342, 0.0020398239139467478, -0.02287096343934536, 0.00032424196251668036, 0.017191316932439804, 0.01376275159418583, 0.016429414972662926, -0.0056657930836081505, 0.03061467595398426, 0.006943712942302227, 0.005464927293360233, -0.010604314506053925, 0.013063184916973114, -0.01897832751274109, 0.00025497798924334347, -0.007632889784872532, 0.020779192447662354, -0.006257999688386917, -0.017426814883947372, -0.012370545417070389, -0.011483966372907162, -0.007016440387815237, 0.02371598407626152, -0.011331586167216301, 0.016180064529180527, -0.0005173152894712985, -0.00606752373278141, 0.0037679600063711405, -0.016110800206661224, -0.01377660408616066, -0.014905606396496296, -0.011781801469624043, 0.025724638253450394, 0.01708049513399601, 0.0013662318233400583, -0.0024813818745315075, -0.025461435317993164, 0.014434611424803734, 0.010666651651263237, 0.018632007762789726, -0.02504585310816765, 0.0004835491126868874, 0.02864757925271988, -0.00033333286410197616, -0.008387867361307144, -0.5940078496932983, -0.03161207586526871, 0.004533327184617519, -0.02456100471317768, 0.025960136204957962, -0.000973158807028085, 0.010445007123053074, -0.020737633109092712, -0.006638951599597931, -0.007120336405932903, 0.006780942901968956, 0.010396522469818592, -0.00030346278799697757, -0.03330211713910103, -0.011761022731661797, -0.023605162277817726, -0.024685679003596306, -0.056076113134622574, -0.022219881415367126, 0.03202766180038452, -0.01626318134367466, 0.010548902675509453, 0.001467530382797122, 0.004228565376251936, 0.001604326767846942, -0.00716189481317997, 0.02341122180223465, -0.013361020013689995, 0.0027134160045534372, -0.02674974501132965, -0.014614698477089405, 0.006399990990757942, -0.005371421109884977, -0.009579207748174667, 0.040644098073244095, 0.004585274960845709, -0.013845868408679962, 0.005946312099695206, -0.0006203454686328769, 0.021832004189491272, -0.033496055752038956, -0.011650200001895428, 0.0026406890247017145, 0.0003709951415657997, -0.02892463468015194, 0.03823371231555939, -0.016581794247031212, -0.006112545728683472, 0.014268377795815468, -0.0062441471964120865, 0.007591331377625465, 0.006292631849646568, -0.02040516585111618, 0.0029541084077209234, 0.025821609422564507, -0.014171408489346504, 0.01224587019532919, -0.010666651651263237, 0.018798241391777992, -0.015071840025484562, -0.003040688345208764, -0.0007995659834705293, -0.019172267988324165, -0.02039131335914135, -0.011864918284118176, 0.030753202736377716, -0.01310474332422018, 0.01379045657813549, 0.008318603038787842, -0.0068328906781971455, -0.014379200525581837, 0.028730696067214012, -0.011975741013884544, -0.004315145313739777, 0.009343709796667099, 0.003726401599124074, 0.04330383613705635, -0.003397397929802537, -0.012072710320353508, 0.027705589309334755, 0.012176605872809887, -0.021444125100970268, -0.029118573293089867, -0.01022336259484291, 0.0181887187063694, 0.011116867884993553, -0.020460577681660652, 0.011705610901117325, -0.0029610348865389824, 0.021056247875094414, 0.025724638253450394, 0.0029281345196068287, 0.020169667899608612, -0.01228050235658884, 0.004772287793457508, 0.02753935568034649, -0.002670126035809517, 0.021998237818479538, -0.01764846034348011, -0.012730717658996582, -0.011622494086623192, 0.0125575577840209, 0.009038948453962803, -0.009225960820913315, 0.035657092928886414, 0.014434611424803734, -0.0017454520566388965, -0.0028190435841679573, 0.03388393670320511, -0.02953415736556053, -0.0068917651660740376, -0.012917730957269669, -0.036211203783750534, 0.012696086429059505, -0.006441549398005009, -0.037097781896591187, 0.015819890424609184, -0.0005848476430401206, -0.009475311264395714, 0.0018510796362534165, -0.008803450502455235, 0.007390465587377548, 0.0038718560244888067, 0.005177482031285763, 0.006181809585541487, 0.026292603462934494, 0.0008359295316040516, 0.011518598534166813, -0.00811081100255251, 0.014988723210990429, 0.010458859615027905, 0.009648471139371395, 0.01629088632762432, -0.022954080253839493, 0.011193057522177696, -0.02173503488302231, -0.005710814613848925, -0.004616443533450365, -0.0331081785261631, -0.033219002187252045, 0.0009696956258267164, 3.982678390457295e-05, 0.02318957820534706, -0.012869246304035187, -0.013548033311963081, -0.024186978116631508, -0.02064066380262375, 0.029922036454081535, 0.0027134160045534372, 0.04081033170223236, -0.02343892864882946, -0.0043428512290120125, -0.0004545448173303157, -0.003366229124367237, -0.01059046108275652, -0.027733294293284416, 0.021444125100970268, -0.036294322460889816, 0.001490041147917509, -0.04056098312139511, -0.01656794175505638, 0.03972981497645378, -0.012356692925095558, -0.025128968060016632, 0.02562766894698143, -0.0019480491755530238, -0.03939734771847725, -0.0014493486378341913, -0.0005398260545916855, -0.017551491037011147, 0.012432882562279701, -0.0025887410156428814, 0.0008662325562909245, 0.017412962391972542, -0.008983537554740906, 0.016443267464637756, 0.007840681821107864, -0.0055064857006073, 0.025821609422564507, -0.007438950706273317, 0.0022164471447467804, -0.009350636042654514, -0.0380120687186718, -0.018922917544841766, 0.020058846101164818, 0.02093157172203064, -0.009267519228160381, 0.010715136304497719, -0.014448464848101139, 0.025309056043624878, -0.007258864119648933, 0.011934182606637478, -0.005128996912389994, 0.004332461394369602, -0.0026666629128158092, 0.04017310217022896, -0.015002576634287834, -0.005395663436502218, -0.022954080253839493, 0.02978350780904293, 0.024685679003596306, 0.03912029042840004, 0.02539217285811901, -0.012322060763835907, 0.012356692925095558, -0.023605162277817726, 0.013818162493407726, -0.010846737772226334, 0.0129315834492445, 0.02425624243915081, 0.012190459296107292, -0.024741090834140778, -0.003464930225163698, -0.001430300995707512, 0.012661454267799854, 0.003193069016560912, 0.012848466634750366, 0.013402578420937061, -0.007792196702212095, 0.021070100367069244, -0.004692634101957083, -0.011761022731661797, 0.02751164883375168, -0.016166210174560547, 0.003103025956079364, -0.0045783487148582935, 0.001619045389816165, 0.022718582302331924, 0.013783530332148075, -0.02947874553501606, -0.021042395383119583, 0.012045004405081272, 0.005212113726884127, 0.017302140593528748, 0.013319461606442928, 0.002935060765594244, 0.038981761783361435, 0.0057592992670834064, 0.04962071031332016, 0.007951503619551659, 0.013991322368383408, 0.019407764077186584, 0.005638087168335915, 0.007286570034921169, -0.007251937873661518, -0.010174877010285854, -0.0028536757454276085, 0.02012811042368412, -0.019407764077186584, 0.016595646739006042, -0.020169667899608612, 0.019781790673732758, -0.00839479360729456, 0.02285711094737053, 0.009066654369235039, -0.03382852301001549, -0.03330211713910103, 0.01252985280007124, 0.0363774374127388, 0.025212084874510765, 0.01960170455276966, -0.01061124075204134, 0.00627877889201045, 0.009579207748174667, -0.02010040543973446, 0.009433752857148647, -0.006122935097664595, -0.0003290038730483502, -0.02123633399605751, -0.02835666947066784, 0.0003387441101949662, -0.009648471139371395, -0.005118607543408871, 0.0005199126899242401, -0.0054164426401257515, -0.008948905393481255, 0.04083803668618202, 0.017025085166096687, 0.02097313106060028, 0.004325535148382187, 0.005755836144089699, -0.029672686010599136, 0.02041901834309101, -0.004034626297652721, 0.01871512457728386, 0.0022008626256138086, -0.00634111650288105, -0.01046578586101532, -0.018022485077381134, 0.006060597486793995, -0.016401708126068115, -0.0028415543492883444, -0.003688306547701359, 0.002941987244412303, -0.03272030130028725, 0.02173503488302231, 0.02591857872903347, -0.014143703505396843, -0.002190473023802042, 0.001603460987098515, -0.026320308446884155, 0.013589591719210148, -0.006206051912158728, 0.005056269932538271, 0.05203109607100487, -0.01708049513399601, -0.01654023677110672, -0.029922036454081535, 0.006902155000716448, -0.015889154747128487, -0.013554959557950497, -0.012017299421131611, -0.022704729810357094, 0.020543694496154785, -0.01654023677110672, -0.02396533451974392, 0.007909945212304592, 0.0029679611325263977, 0.02043287083506584, 0.014185260981321335, 0.013769677840173244, -0.014559286646544933, -0.01685885153710842, 0.0178701039403677, 0.016609501093626022, 0.022427674382925034, -0.015210368670523167, 0.0068086483515799046, -0.025433730334043503, -0.010964486747980118, -0.011587862856686115, -0.05280685052275658, 0.019435470923781395, -0.003674453590065241, 0.018922917544841766, -0.021721182391047478, 0.011213837191462517, -0.02174888737499714, -0.024131568148732185, 0.01602768339216709, 0.01240517757833004, -0.012439809739589691, 0.0192553848028183, -0.0015385259175673127, -0.027442386373877525, 0.009364488534629345, -0.01336794625967741, 0.022746289148926735, 0.011006045155227184, 0.009690029546618462, 0.03274800628423691, 0.014102145098149776, 0.014254525303840637, -0.03338523581624031, -0.023785248398780823, 0.0214579775929451, 0.020834602415561676, 0.030254503712058067, -0.0030320303048938513, 0.002973156049847603, -0.002592204138636589, -0.017468374222517014, -0.008180075325071812, 0.03028220869600773, -0.006493497174233198, 0.022732434794306755, 0.013097817078232765, -0.004114279989153147, 0.01735755056142807, -0.0036675273440778255, -0.037374839186668396, 0.005804320797324181, 0.023203430697321892, -0.010992192663252354, 0.008858862332999706, -0.0342441089451313, -0.004415578208863735, -0.0012303013354539871, -0.023258842527866364, 0.0016173137119039893, -0.03856617957353592, -0.015224221162497997, 0.004027700051665306, -0.04244496300816536, -0.04831854626536369, -0.015930714085698128, 0.018008632585406303, 0.002090040361508727, 0.00591860618442297, -0.0003489172668196261, -0.005752373021095991, -0.029811212792992592, -0.0026112517807632685, -1.4163941159495153e-05, -0.0043532405979931355, -0.02118092216551304, -0.03252636268734932, 0.0071411156095564365, 0.029395628720521927, -0.012896951287984848, 0.018147161230444908, 0.001989607699215412, 0.010756694711744785, 0.0006549774552695453, -0.02012811042368412, -0.042860545217990875, 0.008235486224293709, -0.01842421665787697, -0.01127617433667183, 0.000786578981205821, -0.0016354955732822418, 1.134671038016677e-06, -0.0026060568634420633, -0.001982681220397353, 0.0065870038233697414, 0.0016458851750940084, 0.004516011103987694, -0.03357917442917824, 0.030642380937933922, -0.0026614682283252478, 0.00993937999010086, 0.004952373914420605, 0.021291745826601982, -0.009994790889322758, 0.002805190859362483, -0.009793926030397415, -0.009406046941876411, 0.006690899841487408, 0.0025783514138311148, 0.01187184453010559, -0.0002733762376010418, 0.003352376166731119, 0.00020129841868765652, -0.031057965010404587, 0.006590466946363449, -0.023535897955298424, 0.004522937349975109, -0.005482243373990059, 0.019781790673732758, -0.008034620434045792, -0.006372285541146994, -0.015071840025484562, -0.016609501093626022, -0.0024242389481514692, 0.0008108213660307229, -0.005128996912389994, 0.027137624099850655, -0.03175060451030731, -0.010881369933485985, 0.04527093097567558, 0.01115842629224062, -0.003276185831055045, -0.006649341434240341, 0.010694357566535473, -0.00647618155926466, 0.010597387328743935, 0.0034337614197283983, -0.020294344052672386, -0.01961555704474449, -0.0007008648244664073, 0.009593060240149498, 0.012211238034069538, -0.013430284336209297, -0.01282076071947813, -0.02339736931025982, 0.0007294362294487655, -0.007840681821107864, 0.0038649295456707478, -0.01624932698905468, -0.03172289952635765, 0.0021315987687557936, -0.0021714256145060062, 0.012391324155032635, -0.006012112833559513, 0.002654541749507189, 0.010950634256005287, -0.008034620434045792, 0.0054857064969837666, -0.01391513179987669, -0.039868343621492386, 0.006296094972640276, -0.010230288840830326, 0.04180773347616196, 0.023535897955298424, 0.029367923736572266, -0.020737633109092712, 0.04017310217022896, 0.02201209031045437, -0.01403980702161789, -0.011961887590587139, 0.018535038456320763, -0.01764846034348011, -0.022663172334432602, 0.013042406179010868, 0.016360150650143623, -0.00828397087752819, 0.01878438889980316, -0.018022485077381134, -0.0016995647456496954, 0.015141104348003864, -0.031085669994354248, -0.00427358690649271, 0.00022315986279863864, -0.03344064578413963, -0.01252985280007124, 0.01597227156162262, 0.0010025959927588701, -0.008055400103330612, -0.039286524057388306, -0.01072898879647255, 0.005007785279303789, -0.006178346462547779, 0.003650211263448, 0.01871512457728386, 0.05239126831293106, -0.016581794247031212, 0.025212084874510765, 0.0004922071238979697, 0.031057965010404587, -0.011220763437449932, 0.008657996542751789, -0.006583540700376034, -0.008872714824974537, 0.02173503488302231, -0.009648471139371395, 0.01555668842047453, 0.036820728331804276, -0.00856795348227024, 0.0006017307750880718, 0.014365348033607006, -0.00797228328883648, -0.0021350618917495012, 0.0005398260545916855, -0.011899550445377827, 0.0035705578047782183, -0.037901245057582855, -0.008193927817046642, 0.002522940281778574, 0.01705279015004635, 0.02095927856862545, -0.02481035515666008, 0.03000515326857567, -0.013977469876408577, 0.0012657990446314216, 0.0070579987950623035, -0.032332420349121094, 0.037873540073633194, 0.03030991367995739, 0.03305276855826378, 0.02758091315627098, 0.001703027868643403, -0.03468739613890648, 0.017759282141923904, 0.00627877889201045, -0.007445876952260733, 0.020474430173635483, 0.027636324986815453, 0.010161024518311024, -0.026015548035502434, 0.006271852646023035, 0.0027116844430565834, -0.04540945962071419, -0.022649317979812622, 0.03554626926779747, -0.008034620434045792, 0.010832885280251503, -0.007432023994624615, 0.01004327554255724, -0.017980927601456642, 0.001603460987098515, -0.0010657993843778968, -0.007882240228354931, 0.0010311673395335674, -0.0012675307225435972, -0.00018484822066966444, 0.003961899317800999, -0.03881552815437317, 0.03000515326857567, 0.0031913374550640583, -0.03130731359124184, -0.020848454907536507, 0.0002242421032860875, -0.005890900734812021, 0.016623353585600853, 0.009018168784677982, 0.034576576203107834, 0.02043287083506584, 0.027719441801309586, 0.003123805159702897, -0.007958430796861649, -0.010167950764298439, -0.004775750916451216, -0.01732984557747841, 0.028273552656173706, 0.0011809506686404347, -0.02148568443953991, 0.008117737248539925, 0.009572280570864677, 0.02481035515666008, -0.018590450286865234, -0.021083952859044075, -0.03227701038122177, -0.02155494876205921, -0.019199972972273827, 0.019116856157779694, -0.014614698477089405, 0.01796707510948181, 0.01872897706925869, 0.013236344791948795, -0.01417833473533392, 0.008803450502455235, 0.012065784074366093, 0.00421124929562211, -0.03889864683151245, 0.008090032264590263, 0.018022485077381134, 0.008664922788739204, 0.037070076912641525, 0.013444136828184128, 0.003087441436946392, 0.014822489582002163, 0.018812093883752823, -0.03499215841293335, -0.008505615405738354, -0.0012917730491608381, 0.008083105087280273, -0.01760690100491047, 0.0073073492385447025, -0.02925710193812847, 0.0026060568634420633, 0.014046733267605305, -0.024325506761670113, -0.0215272419154644, -0.018313394859433174, 0.02287096343934536, 0.016124652698636055, -0.01021643541753292, -0.029312513768672943, 0.007750638294965029, 0.033496055752038956, -0.011989593505859375, -0.01131080649793148, 0.026541953906416893, 0.005430295597761869, 0.02481035515666008, 9.231588774127886e-05, -0.008159295655786991, -0.024117715656757355, 0.01845192164182663, -0.02784411609172821, -0.010257993824779987, -0.010147172026336193, -0.021444125100970268, 0.0030372252222150564, 0.023522045463323593, 0.014164482243359089, -0.025973988696932793, 0.018909065052866936, -0.029146280139684677, -0.012238943949341774, -0.016069240868091583, 0.024048451334238052, 0.01681729219853878, -0.029007751494646072, -0.007619036827236414, -0.0059116799384355545, -0.000459739618236199, 0.020308196544647217, -0.021111657842993736, -0.014046733267605305, -0.017842398956418037, -0.01310474332422018, -0.019380059093236923, -0.005845879204571247, -0.00881730392575264, 0.027082212269306183, 0.020335901528596878, -0.006081376690417528, -0.02922939695417881, 0.006961029022932053, -0.034548867493867874, -0.018604302778840065, -0.008103884756565094, 0.01629088632762432, 0.04189084842801094, -0.006424233317375183, -0.027220740914344788, 0.03305276855826378, -0.015141104348003864, -0.00419739680364728, -0.026334162801504135, 0.020003434270620346, 0.01458699256181717, 0.0056623294949531555, 0.03274800628423691, -0.0032207746990025043, -0.015293484553694725, -0.003125536721199751, 0.006524666212499142, 0.007612110581248999, 0.01899218186736107, 0.0068917651660740376, 0.007348907180130482, -0.02587701939046383, 0.01622162200510502, 0.00641384394839406, -0.011511672288179398, -0.023632867261767387, 0.0038787825033068657, -0.02589087188243866, -8.279208850581199e-05, -0.0027861432172358036, 0.014081365428864956, 0.016110800206661224, 0.006334190256893635, 0.006836353801190853, -0.03809518367052078, -0.0023238062858581543, 0.014081365428864956, 0.00412466935813427, -0.0018666640389710665, -0.0022060575429350138, 0.024976588785648346, 0.01878438889980316, 0.003283112309873104, 0.04183543846011162, 0.03230471536517143, 0.017980927601456642, -0.010354964062571526, 0.011006045155227184, -0.00964154489338398, -0.0032952334731817245, 0.016138505190610886, -0.00039870073669590056, -0.002857138868421316, -0.02615407668054104, -0.002699563279747963, -0.007632889784872532, -0.034631986171007156, -0.0008047607843764126, 0.01570906862616539, -0.014822489582002163, 0.008761892095208168, -0.0028692600317299366, -0.015099545940756798, -0.003009519539773464, -0.015916861593723297, -0.023522045463323593, -0.020031141117215157, 0.001627703313715756, 0.02126403898000717, -0.011691758409142494, -0.029284806922078133, 0.006801722105592489, -0.03798436373472214, -0.0012268380960449576, 0.005873584654182196, 0.00042207734077237546, -0.005645013879984617, 0.017745429649949074, 0.2124464511871338, 0.018382657319307327, -0.0021870099008083344, 0.03327441215515137, -1.682898073340766e-05, 0.03163978084921837, 0.009572280570864677, -0.0014839805662631989, 1.853352296166122e-05, 0.03554626926779747, -0.018853653222322464, 0.011477040126919746, 0.03465969115495682, -0.00348224607296288, 0.024602562189102173, -0.0004692634101957083, -0.01309089083224535, -0.015515130013227463, -0.06887609511613846, -0.013894353061914444, 0.02647268958389759, -0.032914239913225174, -0.010140245780348778, -0.01183721236884594, 0.0001519478391855955, -0.008921199478209019, 0.005274451337754726, 0.013264050707221031, 0.047515083104372025, -0.0020519450772553682, -0.015321190468966961, 0.022233735769987106, 0.0019359280122444034, 0.004394799005240202, 0.002356706652790308, -0.014254525303840637, 0.0028086539823561907, -0.011650200001895428, 0.004308219067752361, -0.0036675273440778255, -0.003186142770573497, -0.001292638829909265, -0.01270301267504692, -0.015598246827721596, -0.021056247875094414, -0.0059844073839485645, 0.003253675065934658, -0.008775745518505573, 0.006458865478634834, -0.002569693373516202, -0.021361008286476135, 0.01185799203813076, 0.019213825464248657, 0.029284806922078133, 0.0035913370084017515, 0.004796530120074749, 0.011712538078427315, -0.004301292821764946, 0.004065795335918665, -0.02069607563316822, -0.028758401051163673, 0.044772230088710785, -0.002486576559022069, -0.019726378843188286, -0.006361895706504583, 0.007376613095402718, -0.004055405501276255, 0.0031740216072648764, -0.004121206235140562, -0.006819038186222315, -0.021305598318576813, -0.019366206601262093, -0.012425956316292286, -0.004322072025388479, -0.03684843331575394, -0.010410374961793423, 0.0036432850174605846, 0.022261440753936768, 0.023272695019841194, 0.04912200942635536, -0.008678775280714035, -0.02810731902718544, -0.045049287378787994, -0.002564498456194997, -0.030697792768478394, -0.01788395829498768, 0.019754085689783096, -0.0075774784199893475, -0.023037197068333626, -0.03280341625213623, 0.000687877822201699, -0.005800857674330473, -0.02809346653521061, -0.03161207586526871, 0.009295225143432617, 0.013319461606442928, 0.026888273656368256, 0.004935057833790779, 0.010541976429522038, 0.01156015694141388, -0.021111657842993736, 0.05532805994153023, 0.00824933871626854, 0.00046623311936855316, -0.009482237510383129, -0.00530562037602067, 0.01627703383564949, 0.011580935679376125, -0.004858867730945349, -0.0185073334723711, 0.018936770036816597, -0.026666630059480667, -0.02346663363277912, -0.003388739889487624, -0.0060640606097877026, 0.00991860032081604, -0.011948035098612309, 0.01129695400595665, 0.002150646410882473, -0.024644121527671814, 0.01018873043358326, -0.006774016655981541, 0.004038089420646429, -0.0009714271873235703, -0.02097313106060028, -0.005956701468676329, -0.013174007646739483, 0.0011948035098612309, -0.02672204002737999, -0.021679623052477837, 0.005077049136161804, -0.011040677316486835, 0.011920329183340073, 0.0011463187402114272, 0.0009913406101986766, 0.013949763961136341, 0.01046578586101532, -0.006109082140028477, -0.01983720064163208, -0.019172267988324165, -0.018410364165902138, -0.012335913255810738, 0.002401728183031082, -0.01183721236884594, 0.017745429649949074, -0.0024606026709079742, 0.02395148202776909, -0.010638945735991001, -0.012606042437255383, -0.026832861825823784, -0.004204323049634695, -0.02697139047086239, 0.03327441215515137, -0.011068382300436497, 0.020515987649559975, 0.005883974488824606, -0.010431153699755669, -0.02898004651069641, -0.004630296491086483, 0.003605189733207226, -0.05175403878092766, 0.009593060240149498, 0.031279608607292175, 0.014282231219112873, -0.023909922689199448, -0.003979215398430824, -0.1759859025478363, 0.016470972448587418, 0.01391513179987669, -0.027927232906222343, 0.018881358206272125, -0.0021471830550581217, 0.030697792768478394, 0.0018839800031855702, -0.011615567840635777, 0.0003458869468886405, 0.020529842004179955, 0.03244324401021004, -0.03332982212305069, -0.003224237821996212, -0.017302140593528748, -0.0009463190217502415, -0.03975751996040344, 0.031002553179860115, 0.029866624623537064, 0.011920329183340073, 0.0071757473051548, -0.01654023677110672, -0.004017310217022896, -0.0050978283397853374, -0.007033756468445063, 0.02008655108511448, -0.022275293245911598, 0.0020415554754436016, 0.002905623521655798, -0.013471842743456364, 0.004256271291524172, -0.031030260026454926, 0.02122248150408268, -0.04025622084736824, 0.006112545728683472, -0.0010259725386276841, -0.008699554949998856, -0.018548890948295593, -0.03579562157392502, 0.019103003665804863, 0.03427181392908096, 0.012993921525776386, 0.024186978116631508, 0.0036155793350189924, 0.0019982655066996813, 0.035657092928886414, 0.035989560186862946, -0.007210379466414452, 0.025447582826018333, 9.799769759410992e-05, 0.0069887349382042885, -0.03299735486507416, 0.0045887380838394165, 0.009752367623150349, 0.0056623294949531555, 0.027109919115900993, 0.008685702458024025, 0.0007385271019302309, -0.01351340115070343, -0.016069240868091583, 0.01171946432441473, -0.02285711094737053, 0.0023238062858581543, -0.0027393901254981756, -0.012834614142775536, 0.005942848976701498, 0.0009238081984221935, 0.03601726517081261, 0.009856263175606728, -0.001892638043500483, -0.01897832751274109, -0.011677905917167664, -0.009350636042654514, -0.002652810188010335, 0.004987006075680256, 0.008096958510577679, -0.012024225667119026, 0.009170549921691418, 0.011359291151165962, 0.014067512936890125, 0.00039675270090810955, 0.03111337684094906, -0.005575749557465315, 0.013146301731467247, 0.0017549758777022362, 0.002677052514627576, 0.01127617433667183, -0.00772293284535408, 0.012765349820256233, 0.002431165426969528, 0.003361034207046032, -0.036543671041727066, 0.013998248614370823, 0.00015595216245856136, 0.030808614566922188, 0.0020242396276444197, -0.028245847672224045, 0.016734175384044647, 0.0143514946103096, -0.025516847148537636, 0.0022528106346726418, 0.007653668988496065, -0.06001030653715134, 0.037624187767505646, 0.013596517965197563, 0.017274433746933937, -0.0018649324774742126, 0.02731771022081375, 0.03283112123608589, 0.0015627683605998755, -0.01712205447256565, 0.02341122180223465, 0.020308196544647217, 0.012917730957269669, 0.0005134192178957164, 0.015085693448781967, -0.02622333914041519, -0.007473582401871681, -0.015875302255153656, 0.00447098957374692, 0.045880455523729324, -0.02122248150408268, -0.0386492945253849, 0.010195656679570675, 0.012834614142775536, 0.008013841696083546, -0.08716177940368652, -0.03939734771847725, 0.021568801254034042, 0.03906488046050072, -0.011684832163155079, -0.0059844073839485645, -0.02068222127854824, 0.016720322892069817, -0.035158392041921616, 0.01764846034348011, -0.015639804303646088, -0.034299518913030624, -0.002121209166944027, -0.00482077244669199, 0.02314801886677742, -0.0036536746192723513, -0.008540247566998005, -0.0009999986505135894, -0.0009541112231090665, 0.040671803057193756, 0.013437210582196712, -0.005045880563557148, 0.02126403898000717, -0.02230299822986126, -0.006292631849646568, 0.007570552174001932, 0.0037298649549484253, 0.008484836667776108, 0.01543201319873333, 0.03058696910738945, 0.024367066100239754, -0.014490023255348206, 0.009593060240149498, 0.013423358090221882, -0.035380035638809204, -0.028301259502768517, -0.03499215841293335, -0.01213504746556282, -0.009856263175606728, -0.01403980702161789, 0.022690877318382263, -0.008498689159750938, -0.005537654738873243, -0.02230299822986126, -0.023937629535794258, -0.0014043269911780953, -0.026569658890366554, 0.036543671041727066, 0.000654544506687671, -0.022455379366874695, 0.007667521480470896, -0.03909258544445038, 0.012155827134847641, -0.01872897706925869, 0.007487435359507799, 0.011352364905178547, 0.01473937276750803, 0.027691736817359924, -0.027677882462739944, -0.01407443918287754, -0.036820728331804276, -0.01213504746556282, -0.014919459819793701, 0.03950817137956619, 0.017565343528985977, 0.0008623364265076816, -0.00391341419890523, -0.01845192164182663, 0.004779214039444923, -0.020280491560697556, -0.024616414681077003, 0.01005020271986723, -0.021153217181563377, -0.01871512457728386, -0.02950645238161087, 0.007951503619551659, -0.010839811526238918, -0.03030991367995739, -0.007245011627674103, -0.045381754636764526, -0.03141813725233078, -0.022427674382925034, -0.01762075535953045, -0.03130731359124184, 0.017163611948490143, 0.022510791197419167, 0.0017090884502977133, -0.008775745518505573, 0.015348896384239197, -0.027109919115900993, 0.009322931058704853, 0.0043289982713758945, 0.021970530971884727, -0.034881334751844406, -0.013437210582196712, -0.005274451337754726, 0.022413821890950203, 0.00853332132101059, -0.013825088739395142, -0.0035844105295836926, -0.03950817137956619, -0.012862319126725197, -0.06300251185894012, 0.029922036454081535, -0.016872704029083252, -0.016138505190610886, -0.025253644213080406, 0.015418159775435925, -0.0048484778963029385, -0.008069252595305443, -0.001041556941345334, 0.03363458439707756, -0.035961855202913284, 0.011684832163155079, 0.0008891762117855251, 0.00935756228864193, -0.033191293478012085, -0.02702680230140686, 0.01792551577091217, 0.03150125592947006, 0.00536795798689127, -0.00842249859124422, -0.005302157253026962, -0.004048479255288839, 0.008367087692022324, 0.01684499718248844, -0.0057350569404661655, 0.0026666629128158092, -0.020225079730153084, 0.004865793976932764, -0.016166210174560547, -0.017703870311379433, 0.02338351681828499, -0.006853669881820679, -0.010936780832707882, 0.06433237344026566, -0.01225972268730402, -0.029367923736572266, 0.012924657203257084, 0.013180933892726898, 0.05571593716740608, -0.004221639130264521, -0.003125536721199751, -0.03227701038122177, 4.9080015742219985e-05, -0.009191328659653664, -0.0009290029993280768, 0.0024744553957134485, 0.0008510810439474881, 0.0036155793350189924, 0.006521203089505434, 0.02950645238161087, 0.004786140285432339, 0.002567961812019348, -0.01903373934328556, 0.003625968936830759, 0.022524643689393997, -0.014891753904521465, -0.00910821184515953, 0.010895222425460815, 0.020612958818674088, -0.005835489835590124, 0.02176273986697197, 0.0030545410700142384, 0.05430295318365097, 0.025475289672613144, -0.01555668842047453, -0.01767616532742977, -0.021014688536524773, 0.023078754544258118, 0.005852805450558662, 0.000987877370789647, -0.010618166998028755, 0.008713407441973686, -0.006095229648053646, 0.02615407668054104, 0.03906488046050072, -0.013298682868480682, 0.002850212389603257, 0.014656256884336472, 0.004443283658474684, 0.014067512936890125, 0.04496616870164871, 0.03055926412343979, -0.03934193775057793, 0.014379200525581837, 0.02122248150408268, 0.04540945962071419, -0.015473571605980396, 0.012536779046058655, 0.0062441471964120865, -0.006019039079546928, 0.004315145313739777, 0.02179044485092163, -0.015903007239103317, -0.010472712107002735, 0.0030978310387581587, 0.0012727255234494805, -0.00194631761405617, -0.007051072549074888, 0.0019064907683059573, 0.03560168296098709, 0.008214707486331463, 0.010569682344794273, -0.01597227156162262, -0.003018177580088377, -0.04463370516896248, 0.0014259719755500555, -0.016637206077575684, -0.019740231335163116, 0.007508214563131332, 0.017496079206466675, -0.017191316932439804, -0.0025437192525714636, 0.03224930539727211, 0.007896092720329762, -0.01021643541753292, -0.003764496883377433, 0.0028935023583471775, -0.03006056323647499, -0.03942505270242691, 0.006309947930276394, -0.009225960820913315, 0.01712205447256565, 0.03352376073598862, 0.03720860555768013, 0.01622162200510502, 0.035463154315948486, 0.012065784074366093, -0.032637182623147964, 0.024090008810162544, -0.0026666629128158092, 0.02759476564824581, 0.0215272419154644, -0.0031601686496287584, -0.015418159775435925, -0.03529692068696022, -0.010902149602770805, 0.006438086275011301, -0.006081376690417528, -0.018354952335357666, 0.07818517088890076, 0.009038948453962803, -0.0008662325562909245, -0.015071840025484562, -0.022981785237789154, -0.0018735904013738036, 0.03299735486507416, -0.005135923624038696, 0.004703023470938206, -0.04654539003968239, 0.041198208928108215, 0.0033471814822405577, -0.003466661786660552, -0.03136272728443146, -0.015833744779229164, -0.0015774869825690985, 0.008235486224293709, 0.02758091315627098, 0.0114562613889575, 0.01737140491604805, 0.00612986134365201, -0.010701283812522888, 0.0215272419154644, 0.04277743026614189, -0.02317572571337223, -0.006424233317375183, 0.00881730392575264, 0.019186120480298996, -0.007459729909896851, -0.030947143211960793, 0.00019318154954817146, 0.026555806398391724, -0.026375720277428627, -0.009960158728063107, 0.004100427031517029, -0.018950622528791428, -0.009544575586915016, 0.005291767418384552, 0.021347155794501305, 0.004917742218822241, 0.01021643541753292, 0.018299540504813194, -0.024186978116631508, -0.004394799005240202, -0.011788727715611458, -0.016609501093626022, -0.02402074635028839, -0.009565354324877262, -0.022413821890950203]], n_results=2, include= ["distances"] )

print(results)

tazarov commented 9 months ago

@daniel173087, I stand corrected, I have forgotten to set the hnsw:space=cosine now that I did I get --0.0000002384185791015625 as a distance which is not 0 indeed (although most people will call it 0 🤣 ). I think your issue might be related to this: #1214

kristopher-smith commented 4 months ago

Hey @daniel173087, depending on the embedding function you passed upon creating Chroma, it may or may not be a deterministic embedding model.

For example see: https://community.openai.com/t/can-text-embedding-ada-002-be-made-deterministic/318054/12

Some embedding models may have a random component upon initialization or encoding.

If you need that kind of precision this persons work may be useful: https://github.com/EliahKagan/embed-encode

May be worth a quick cycle through your options:

for embeddor in embeddors:
    query = "What is up with embedding models?" 
    embedding_1 = embeddor.encode(query)
    embedding_2 = embeddor.encode(query)
    print(embedding_1.all()==embedding_2.all())

Will result in: True==deterministic False==non-deterministic

Happy Vectorin!