liyucheng09 / Selective_Context

Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.
310 stars 14 forks source link

CUDA error - RuntimeError - dimension do not match #26

Open petrLorenc opened 7 months ago

petrLorenc commented 7 months ago

Hello, I am encoutering this error

RuntimeError: The size of tensor a (1024) must match the size of tensor b (1452) at non-singleton dimension 3

I am using it to compress the prompt for RAG

text = """A novel naphthylmethylimidazole derivative 1 and its related compounds were 
identified as 17,20-lyase inhibitors. Based on the structure-activity 
relationship around the naphthalene scaffold and the results of a docking study 
of 1a in the homology model of 17,20-lyase, the 
6,7-dihydro-5H-pyrrolo[1,2-c]imidazole derivative (+)-3c was synthesized and 
identified as a potent and highly selective 17,20-lyase inhibitor. Biological 
evaluation of (+)-3c at a dose of 1mg/kg in a male monkey model revealed marked 
reductions in both serum testosterone and dehydroepiandrosterone concentrations. 
Therefore, (+)-3c (termed orteronel [TAK-700]) was selected as a candidate for 
clinical evaluation and is currently in phase III clinical trials for the 
treatment of castration-resistant prostate cancer.
PURPOSE: The androgen receptor pathway remains active in men with prostate 
cancer whose disease has progressed following surgical or medical castration. 
Orteronel (TAK-700) is an investigational, oral, nonsteroidal, selective, 
reversible inhibitor of 17,20-lyase, a key enzyme in the production of 
androgenic hormones.
EXPERIMENTAL DESIGN: We conducted a phase I/II study in men with progressive, 
chemotherapy-naïve, metastatic castration-resistant prostate cancer, and serum 
testosterone <50 ng/dL. In the phase I part, patients received orteronel 100 to 
600 mg twice daily or 400 mg twice a day plus prednisone 5 mg twice a day. In 
phase II, patients received orteronel 300 mg twice a day, 400 mg twice a day 
plus prednisone, 600 mg twice a day plus prednisone, or 600 mg once a day 
without prednisone.
RESULTS: In phase I (n = 26), no dose-limiting toxicities were observed and 13 
of 20 evaluable patients (65%) achieved ≥50% prostate-specific antigen (PSA) 
decline from baseline at 12 weeks. In phase II (n = 97), 45 of 84 evaluable 
patients (54%) achieved a ≥50% decline in PSA and at 12 weeks, substantial mean 
reductions from baseline in testosterone (-7.5 ng/dL) and 
dehydroepiandrosterone-sulfate (-45.3 μg/dL) were observed. Unconfirmed partial 
responses were reported in 10 of 51 evaluable phase II patients (20%). Decreases 
in circulating tumor cells were documented. Fifty-three percent of phase II 
patients experienced grade ≥3 adverse events irrespective of causality; most 
common were fatigue, hypokalemia, hyperglycemia, and diarrhea.
CONCLUSIONS: 17,20-Lyase inhibition by orteronel was tolerable and results in 
declines in PSA and testosterone, with evidence of radiographic responses.
Orteronel (also known as TAK-700) is a novel hormonal therapy that is currently 
in testing for the treatment of prostate cancer. Orteronel inhibits the 17,20 
lyase activity of the enzyme CYP17A1, which is important for androgen synthesis 
in the testes, adrenal glands and prostate cancer cells. Preclinical studies 
demonstrate that orteronel treatment suppresses androgen levels and causes 
shrinkage of androgen-dependent organs, such as the prostate gland. Early 
reports of clinical studies demonstrate that orteronel treatment leads to 
reduced prostate-specific antigen levels, a marker of prostate cancer tumor 
burden, and more complete suppression of androgen synthesis than conventional 
androgen deprivation therapies that act in the testes alone. Treatment with 
single-agent orteronel has been well tolerated with fatigue as the most common 
adverse event, while febrile neutropenia was the dose-limiting toxicity in a 
combination study of orteronel with docetaxel. Recently, the ELM-PC5 Phase III 
clinical trial in patients with advanced-stage prostate cancer who had received 
prior docetaxel was unblinded as the overall survival primary end point was not 
achieved. However, additional Phase III orteronel trials are ongoing in men with 
earlier stages of prostate cancer.
Author information:
(1)Karim Fizazi, Institut Gustave Roussy, University of Paris Sud, Villejuif; 
Stephane Oudard, Université Paris Descartes, Paris, France; Robert Jones, 
Institute of Cancer Sciences, University of Glasgow, Glasgow; Johann De Bono, 
The Institute of Cancer Research, London, United Kingdom; Eleni Efstathiou, 
University of Athens Medical School, Athens; George Fountzilas, Aristotle 
University of Thessaloniki School of Medicine, Thessaloniki, Greece; Fred Saad, 
University of Montreal Hospital Center, Montreal, Canada; Ronald de Wit, Erasmus 
University Medical Center, Rotterdam, the Netherlands; Felipe Melo Cruz, ABC 
Foundation School of Medicine, Santo André; Flavio Carcano, Hospital de Cancer 
de Barretos, Barretos, Brazil; Albertas Ulys, Institut of Oncology, Vilnius 
University, Vilnius, Lithuania; Neeraj Agarwal, Huntsman Cancer Institute, 
University of Utah, Salt Lake City, UT; David Agus, University of Southern 
California, Los Angeles, CA; Daniel P. Petrylak, Yale University Cancer Center, 
New Haven, CT; Shih-Yuan Lee, Bindu Tejura, Niels Borgstein, Takeda 
Pharmaceuticals International; Iain J. Webb, Millennium: The Takeda Oncology 
Company, Cambridge, MA; Robert Dreicer, Cleveland Clinic, Cleveland, OH; Joaquim 
Bellmunt, University Hospital del Mar-IMIM, Barcelona, Spain. 
karim.fizazi@gustaveroussy.fr.
(2)Karim Fizazi, Institut Gustave Roussy, University of Paris Sud, Villejuif; 
Stephane Oudard, Université Paris Descartes, Paris, France; Robert Jones, 
Institute of Cancer Sciences, University of Glasgow, Glasgow; Johann De Bono, 
The Institute of Cancer Research, London, United Kingdom; Eleni Efstathiou, 
University of Athens Medical School, Athens; George Fountzilas, Aristotle 
University of Thessaloniki School of Medicine, Thessaloniki, Greece; Fred Saad, 
University of Montreal Hospital Center, Montreal, Canada; Ronald de Wit, Erasmus 
University Medical Center, Rotterdam, the Netherlands; Felipe Melo Cruz, ABC 
Foundation School of Medicine, Santo André; Flavio Carcano, Hospital de Cancer 
de Barretos, Barretos, Brazil; Albertas Ulys, Institut of Oncology, Vilnius 
University, Vilnius, Lithuania; Neeraj Agarwal, Huntsman Cancer Institute, 
University of Utah, Salt Lake City, UT; David Agus, University of Southern 
California, Los Angeles, CA; Daniel P. Petrylak, Yale University Cancer Center, 
New Haven, CT; Shih-Yuan Lee, Bindu Tejura, Niels Borgstein, Takeda 
Pharmaceuticals International; Iain J. Webb, Millennium: The Takeda Oncology 
Company, Cambridge, MA; Robert Dreicer, Cleveland Clinic, Cleveland, OH; Joaquim 
Bellmunt, University Hospital del Mar-IMIM, Barcelona, Spain.
Collaborators: Troon S, Underhill C, Dittrich C, Krainer M, Kramer G, Loidl W, 
Pummer K, Belyakovskiy V, Polyakov S, Goeminne JC, Hoekx L, Luyten D, Van Poppel 
H, Werbrouck P, Azambuja A, Barrios C, Brust L, Cabral Filho S, Carcano F, Cruz 
F, Damião R, Delgado G, Diógenes Â, Dzik C, Faccio A, de Faria G, Faulhaber A, 
Fernandes H, Ferreira U, Filho R, Franke F, Girotto G, Koff W, Kussumoto C, 
Malzyner A, de Moraes A, Padílha S, de Pádua C, Pinto L, Portella M, Reiriz A, 
da Silva Teixeira V, Vieiralves L, Dimitrov B, Dudov A, Micheva R, Petrov P, 
Taskova V, Carmel M, Casey R, Chin J, Jacobson A, Jansz G, Kapoor A, Kinahan T, 
Love W, Martin AG, Saad F, Trachtenberg J, Webster T, Acevedo Gaete A, Arén 
Frontera O, Leyton Naranjo R, Miranda Benabarre A, Pastor Arroyo P, Neira Reyes 
L, Ramirez Pinto G, Restrepo Molina J, Grgic M, Babjuk M, Domes L, Jansa J, 
Lukes M, Pavlik I, Zachoval R, Kahu J, Tamm T, Marttila T, Tammela T, Vaarala M, 
Vitanen J, Bompas E, Colombel M, Delva R, Deplanque G, Fizazi K, Flechon A, 
Giroux J, Joly F, Lechevallier E, Mottet Auselo N, Priou F, Roubaud G, Roupret 
M, Spaeth D, De La Taille A, Tourani JM, Feyerabend S, De Geeter P, Geiges G, 
Gleißner J, Hammerer P, Klotz T, Kuczyk M, Marin J, Schrader A, Stenzl A, 
Steuber T, Wirth M, Efstathiou E, Georgoulias V, Hatzimouratidis K, Kalofonos H, 
Papandreou C, Thanos A, Leung KC, Ng C, Farkas L, Pintér J, McDermott R, 
Sullivan F, Berger R, Gabizon A, Gez E, Rosenbaum E, Sella A, Semenisty V, Tavdy 
E, Alabiso O, Ciuffreda L, Fratino L, Sternberg C, Tubaro A, Akakura K, Arai Y, 
Egawa S, Fujimoto H, Ichikawa T, Kakehi Y, Kitamura H, Maniwa A, Miyanaga N, 
Mizokami A, Nakatani T, Nishimura K, Niwakawa M, Sato F, Sugiyama T, Suzuki H, 
Suzuki K, Takahashi S, Tomita Y, Ueda T, Uemura H, Yamaguchi R, Yokomizo A, 
Yoshimura K, Brize A, Litavnience D, Vjaters E, Jankevicius F, Jievaltas M, 
Jocys G, Ulys A, Calvo Domínguez D, González Perez J, de Leon Jaen S, Pérez O, 
Rodriguez Rivera J, Valdés A, Blaisse R, Hamberg A, Loosveld O, Los M, Van Oort 
I, de la Rosette J, De Vries P, Vrijhof H, de Wit R, Costello S, Davidson P, 
Fong C, Gilling P, Neill M, Abrill Mendoza G, Cano Rivera J, Garcia Ahumada S, 
Huaringa Leiva R, Pazos Franco A, Jablonska Z, Kmieciak R, Coelho J, Sousa N, 
Bucuras C, Cebotaru C, Ciuleanu T, Jinga V, Anatolyevich I, Yurievich P, Hiang 
T, Sing N, Balaz V, Brezovsky M, Kliment J, Mikulas J, Mincik I, Sokol R, Botha 
M, Hart G, Kraus P, Landers G, Malan J, Bellmunt J, Castellano D, Climent Duran 
M, Veiga F, González B, Pérez Gracia J, Valderrama B, Provencio M, Damber JE, 
Häggman M, Nyman C, Berthold D, Fischer N, Popescu R, Stenner F, Chang YH, Ou 
YC, Tsai YC, Wu HC, Wu TL, Bondarenko I, Ivashchenko P, Kobets V, Pasiechnikov 
S, Semenukha V, Sernyak Y, Stus V, Bahl A, Birtle A, Chowdhury S, Crabb S, Dixit 
S, Elliott P, Hoskin P, Jones R, Khoo V, MacDonald A, Malik Z, O'Sullivan J, 
Simms M, Stockdale A, Agarwal N, Alter R, Anderson TC, Bailen J, Berry W, Bidair 
M, Clark W, Cohn AL, Crawford E, DiSimone C, Feliciano L, Fleming MT, Forero L, 
Friday B, Fruehauf JP, Gelmann E, George D, Gignac G, Given R, Gullo J, 
Hainsworth J, Hajdenberg J, Haluschak JJ, Hamid O, Hammers H, Hart LL, Hussain 
A, Hutson TE, Ibrahim E, Jain SK, Khojasteh A, Kohli M, Lara PN Jr, Lilly M, 
Lipton A, Mackey DW, Mao SS, Mehta AR, Modiano MR, Morris M, Muscato JJ, 
Nordquist LT, Richards DA, Ryan C, Sartor AO, Schnadig ID, Sieber PR, Singal R, 
Smith F, Somer B, Srkalovic G, Tagawa S, Tan W, Twardowski P, Van Veldhuizen PJ, 
Vogelzang N, Watkins DL, Wertheim M, Wong YN, Zhang J.
OBJECTIVE: We performed a systematic review of the literature to assess the 
efficacy and the safety of second-line agents targeting metastatic 
castration-resistant prostate cancer (mCRPC) that has progressed after 
docetaxel. Pooled-analysis was also performed, to assess the effectiveness of 
agents targeting the androgen axis via identical mechanisms of action 
(abiraterone acetate, orteronel).
MATERIALS AND METHODS: We included phase III randomized controlled trials that 
enrolled patients with mCRPC progressing during or after first-line docetaxel 
treatment. Trials were identified by electronic database searching. The primary 
outcome of the review was overall survival. Secondary outcomes were radiographic 
progression-free survival (rPFS) and severe adverse effects (grade 3 or higher).
RESULTS: Ten articles met the inclusion criteria for the review. These articles 
reported the results of five clinical trials, enrolling in total 5047 patients. 
The experimental interventions tested in these studies were enzalutamide, 
ipilimumab, abiraterone acetate, orteronel and cabazitaxel. Compared to control 
cohorts (active drug-treated or placebo-treated), the significant overall 
survival advantages achieved were 4.8 months for enzalutamide (hazard ratio for 
death vs. placebo: 0.63; 95% CI 0.53 to 0.75, P < 0.0001), 4.6 months for 
abiraterone (hazard ratio for death vs. placebo: 0.66, 95% CI 0.58 to 0.75, P < 
0.0001) and 2.4 months for cabazitaxel (hazard ratio for death vs. 
mitoxantrone-prednisone: 0.70, 95% CI 0.59 to 0.83, p < 0.0001). Pooled analysis 
of androgen synthesis inhibitors orteronel and abiraterone resulted in 
significantly increased overall and progression-free survival for anti-androgen 
agents, compared to placebo (hazard ratio for death: 0.76, 95% CI 0.67 to 0.87, 
P < 0.0001; hazard ratio for radiographic progression: 0.7, 95% CI 0.63 to 0.77, 
P < 0.00001). Androgen synthesis inhibitors induced significant increases in 
risk ratios for adverse effects linked to elevated mineralocorticoid secretion, 
compared to placebo (risk ratio for hypokalemia: 5.75, 95% CI 2.08 to 15.90; P = 
0.0008; risk-ratio for hypertension: 2.29, 95% CI 1.02 to 5.17; P = 0.05).
CONCLUSIONS: In docetaxel-pretreated patients enzalutamide, 
abiraterone-prednisone and cabazitaxel-prednisone can improve overall survival 
of patients, compared to placebo or to best of care at the time of study 
(mitoxantrone-prednisone). Agents targeting the androgen axis (enzalutamide, 
abiraterone, orteronel) significantly prolonged rPFS, compared to placebo. 
Further investigation is warranted to evaluate the benefit of combination or 
sequential administration of these agents. Large-scale studies are also 
necessary to evaluate the impact of relevant toxic effects observed in a limited 
number of patients (e.g., enzalutamide-induced seizures, orteronel-induced 
pancreatitis, and others)."""

# Setup LLMLingua
from selective_context import SelectiveContext

# text = "But Ms Atwell has promised to donate the money from the Global Teacher Prize to the school that she founded.\nThere was one UK representative in the top 10, Richard Spencer, who teaches science in Middlesbrough.\nThe prize was created to raise the status of teaching.\nThe winner of the inaugural Global Teacher Prize, who received her award at the Global Education and Skills Forum in Dubai on Sunday, was recognised for her work in teaching reading and writing.\nOn receiving the award, she said it was a \"privilege\" to work as a teacher and to help young people.\nGiving away the prize money was \"not being selfless, but being committed to public service\", she said.\nFormer US president, Bill Clinton, told the audience that he could still remember almost all the names of his teachers and that the prize would help to remind the public of the importance of the profession.\nIt was \"critically important\" to \"attract the best people into teaching\" and to hold them in \"high regard\", said Mr Clinton.\nIn 1990, Ms Atwell founded a school, the Center for Teaching and Learning in Edgecomb, Maine, where ideas for improving the teaching of reading and writing could be tested and shared.\nThis school, which will receive Ms Atwell's prize cash, has a library in every room and pupils read an average of 40 books a year.\nShe is also a prolific author, with nine books published about teaching, including In The Middle, which sold half a million copies.\nThe award has been created by the Varkey Foundation, the charitable arm of the GEMS education group, as a high-profile way of demonstrating the importance of teaching.\nThe attention-grabbing top prize is meant to show that teaching should be recognised as much as other high-paying careers, such as finance or sport.\n\"We introduced the prize in order to return teachers to their rightful position, belonging to one of the most respected professions in society,\" said Sunny Varkey, founder of the Varkey Foundation.\nThe prize is \"not only about money, it's also about unearthing thousands of stories of inspiration\", he said.\nAndreas Schleicher, the OECD's education director, said that the status of teachers was reflected in international test results, with a high value put on teaching in high-performing Asian countries.\n\"Where teachers feel that society values their job, outcomes can be a lot better,\" he said\nAmong those supporting the project have been Bill Gates, UK Prime Minister David Cameron, UN secretary-general Ban Ki-Moon and Sheikh Mohammed Bin Rashid Al Maktoum, the vice-president and prime minister of the United Arab Emirates and ruler of Dubai.\nThe winner was one of three US entries in the final top 10, which included Stephen Ritz, a teacher in the South Bronx in New York, who has developed a project growing food in the inner city, so that pupils can eat healthily as well as learning.\nAhead of the announcement of the winner, the US secretary for education, Arne Duncan, rang the US finalists to congratulate them.\nAnother finalist was Phalla Neang from Cambodia, who has been working with blind students in that country since the 1990s. She helped to develop a Braille version of the Khmer language and worked to prevent blind children from being treated as \"outcasts\" by the education system.\nRichard Spencer, who teaches science at Middlesbrough College in the north east of England, was commended for his success in making science accessible, with an active style of teaching that includes using song and dance.\nThe international panel of judges included educators, entrepreneurs and leaders of education charities.\nThe 10 finalists were:\nNancie Atwell, US\nGuy Etienne, Haiti\nJacqueline Jumbe-Kahura, Kenya\nNeang Phalla, Cambodia\nStephen Ritz, US\nAzizullah Royesh, Afghanistan\nKiran Bir Sethi, India\nMadenjit Singh, Malaysia\nRichard Spencer, UK\nNaomi Volain, US"

sc = SelectiveContext(model_type='gpt2', lang='en') 
sc(text, reduce_ratio=0.25, reduce_level="phrase")
liyucheng09 commented 6 months ago

are you still facing this issue?

I cannot reproduce your error locally.