issues
search
ijyliu
/
anlp23-project
An empirical study of the costs and practicalities of prompt engineering techniques on standard and novel benchmarks
0
stars
0
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
more focused study of creative writing and another human evaluation
#84
ijyliu
opened
7 months ago
0
cleaner math description?
#83
ijyliu
opened
7 months ago
0
Note fixed effects
#82
ijyliu
closed
7 months ago
0
improve table* floats
#81
ijyliu
closed
7 months ago
0
fix table column width
#80
ijyliu
closed
7 months ago
0
table centering
#79
ijyliu
closed
8 months ago
0
cut complexity differences table and discussion
#78
ijyliu
closed
8 months ago
0
stepwise regressions
#77
ijyliu
opened
8 months ago
0
Remove unneeded complexity table items
#76
ijyliu
closed
8 months ago
0
add findings to abstract
#75
ijyliu
closed
8 months ago
1
probably cut length vs dp graphics and straighten out accompanying explanation
#74
ijyliu
closed
8 months ago
0
add notes for contacting the author about probability sim and correlation coefs
#73
ijyliu
opened
8 months ago
1
Cutting interaction regressions?
#72
ijyliu
closed
8 months ago
0
Add math for cosine similarity
#71
ijyliu
closed
8 months ago
0
Gains per cost in cents, not tokens
#70
ijyliu
closed
8 months ago
1
Variance discussion and can we trust benchmark results
#69
ijyliu
closed
8 months ago
1
possibly add linear correlation of human scores and interparagraph cosine sim
#68
ijyliu
closed
8 months ago
0
fine-tuned open-source model experiments
#67
ijyliu
opened
8 months ago
0
histograms of coherence cosine similarities
#66
ijyliu
closed
8 months ago
1
acknowledgement to feedback group and mingyu and kent and prof b
#65
ijyliu
closed
8 months ago
0
coherence with embeddings and cosine similarity
#64
ijyliu
closed
8 months ago
5
Cut Presentation Points Still useful for paper
#63
ijyliu
closed
8 months ago
0
coherence methodology
#62
ijyliu
closed
8 months ago
5
few shot prompt design for grading creative writing
#61
ijyliu
closed
8 months ago
0
checking ballparking of llms
#60
ijyliu
opened
9 months ago
1
Run McNemar's Test Between Methods
#59
ijyliu
opened
9 months ago
0
Combine Zero-Shot CoT and Self-Refine
#58
ijyliu
opened
9 months ago
0
tree of thoughts glitches, early stops, edge cases
#57
ijyliu
opened
9 months ago
0
tree of thoughts compliance tracking
#56
ijyliu
closed
9 months ago
0
Finetuning or Prompting for Grading
#55
ijyliu
closed
8 months ago
2
Theorize about which techniques have examples in the training data
#54
ijyliu
closed
8 months ago
2
track compliance with prompt instructions
#53
ijyliu
closed
8 months ago
3
Langchain
#52
ijyliu
closed
8 months ago
0
compelxity and accuracy
#51
ijyliu
closed
8 months ago
0
strip punctuation before using NLTK word tokenizer
#50
ijyliu
closed
8 months ago
0
are regressions allowed with our dependent data structure
#49
ijyliu
closed
8 months ago
2
Non linearities note in Gen discussion
#48
ijyliu
closed
9 months ago
0
track conversation steps as prompt response etc
#47
ijyliu
closed
9 months ago
1
may need to note prompting method implementations differ a little based on task
#46
ijyliu
closed
9 months ago
0
Tree of thoughts needs to allow backtracking?
#45
ijyliu
closed
9 months ago
0
Clean up metrics section and figure out what to do with literature comments on costs/benefits
#44
ijyliu
closed
9 months ago
2
Finalize GSM8K Prompts
#43
ijyliu
closed
9 months ago
0
Choice of prompt engineering methods
#42
ijyliu
closed
9 months ago
0
Choice of Evaluation
#41
ijyliu
closed
9 months ago
0
Running topic models and having GPT-X name the topics
#40
ijyliu
closed
10 months ago
0
Potential Sources for a More Formal List of Techniques
#39
ijyliu
closed
10 months ago
1
Automated Prompting Not Consistently Better
#38
ijyliu
closed
10 months ago
0
Paper on the practicality of prompting with a costs section but no evaluation
#37
ijyliu
closed
10 months ago
0
Finding the Most Common Prompt Engineering Techniques
#36
ijyliu
closed
10 months ago
3
Asking the Right Questions
#35
ijyliu
closed
10 months ago
0
Next