ijyliu anlp23-project issues

ijyliu / anlp23-project

An empirical study of the costs and practicalities of prompt engineering techniques on standard and novel benchmarks

0 stars 0 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

more focused study of creative writing and another human evaluation

#84 ijyliu opened 7 months ago
0
cleaner math description?

#83 ijyliu opened 7 months ago
0
Note fixed effects

#82 ijyliu closed 7 months ago
0
improve table* floats

#81 ijyliu closed 7 months ago
0
fix table column width

#80 ijyliu closed 7 months ago
0
table centering

#79 ijyliu closed 8 months ago
0
cut complexity differences table and discussion

#78 ijyliu closed 8 months ago
0
stepwise regressions

#77 ijyliu opened 8 months ago
0
Remove unneeded complexity table items

#76 ijyliu closed 8 months ago
0
add findings to abstract

#75 ijyliu closed 8 months ago
1
probably cut length vs dp graphics and straighten out accompanying explanation

#74 ijyliu closed 8 months ago
0
add notes for contacting the author about probability sim and correlation coefs

#73 ijyliu opened 8 months ago
1
Cutting interaction regressions?

#72 ijyliu closed 8 months ago
0
Add math for cosine similarity

#71 ijyliu closed 8 months ago
0
Gains per cost in cents, not tokens

#70 ijyliu closed 8 months ago
1
Variance discussion and can we trust benchmark results

#69 ijyliu closed 8 months ago
1
possibly add linear correlation of human scores and interparagraph cosine sim

#68 ijyliu closed 8 months ago
0
fine-tuned open-source model experiments

#67 ijyliu opened 8 months ago
0
histograms of coherence cosine similarities

#66 ijyliu closed 8 months ago
1
acknowledgement to feedback group and mingyu and kent and prof b

#65 ijyliu closed 8 months ago
0
coherence with embeddings and cosine similarity

#64 ijyliu closed 8 months ago
5
Cut Presentation Points Still useful for paper

#63 ijyliu closed 8 months ago
0
coherence methodology

#62 ijyliu closed 8 months ago
5
few shot prompt design for grading creative writing

#61 ijyliu closed 8 months ago
0
checking ballparking of llms

#60 ijyliu opened 9 months ago
1
Run McNemar's Test Between Methods

#59 ijyliu opened 9 months ago
0
Combine Zero-Shot CoT and Self-Refine

#58 ijyliu opened 9 months ago
0
tree of thoughts glitches, early stops, edge cases

#57 ijyliu opened 9 months ago
0
tree of thoughts compliance tracking

#56 ijyliu closed 9 months ago
0
Finetuning or Prompting for Grading

#55 ijyliu closed 8 months ago
2
Theorize about which techniques have examples in the training data

#54 ijyliu closed 8 months ago
2
track compliance with prompt instructions

#53 ijyliu closed 8 months ago
3
Langchain

#52 ijyliu closed 8 months ago
0
compelxity and accuracy

#51 ijyliu closed 8 months ago
0
strip punctuation before using NLTK word tokenizer

#50 ijyliu closed 8 months ago
0
are regressions allowed with our dependent data structure

#49 ijyliu closed 8 months ago
2
Non linearities note in Gen discussion

#48 ijyliu closed 9 months ago
0
track conversation steps as prompt response etc

#47 ijyliu closed 9 months ago
1
may need to note prompting method implementations differ a little based on task

#46 ijyliu closed 9 months ago
0
Tree of thoughts needs to allow backtracking?

#45 ijyliu closed 9 months ago
0
Clean up metrics section and figure out what to do with literature comments on costs/benefits

#44 ijyliu closed 9 months ago
2
Finalize GSM8K Prompts

#43 ijyliu closed 9 months ago
0
Choice of prompt engineering methods

#42 ijyliu closed 9 months ago
0
Choice of Evaluation

#41 ijyliu closed 9 months ago
0
Running topic models and having GPT-X name the topics

#40 ijyliu closed 10 months ago
0
Potential Sources for a More Formal List of Techniques

#39 ijyliu closed 10 months ago
1
Automated Prompting Not Consistently Better

#38 ijyliu closed 10 months ago
0
Paper on the practicality of prompting with a costs section but no evaluation

#37 ijyliu closed 10 months ago
0
Finding the Most Common Prompt Engineering Techniques

#36 ijyliu closed 10 months ago
3
Asking the Right Questions

#35 ijyliu closed 10 months ago
0