pokt-scan pocket-ml-testbench issues

pokt-scan / pocket-ml-testbench

MIT License

0 stars 0 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

71 manager evaluator add tracking of requests response times

#100 RawthiL opened 6 days ago
0
92 manager sampler evaluator config signature support

#99 RawthiL closed 1 week ago
0
Update lm-eval-harness to `0.4.4`

#98 AguirreNicolas opened 1 week ago
0
Manager / Sampler / Evaluator : Random Signature Test

#97 RawthiL opened 2 weeks ago
0
73 manager sepparate node data update from task triggering

#96 RawthiL closed 2 weeks ago
0
Web : Add indications of partial metrics and incomplete averages

#95 RawthiL opened 1 month ago
0
75 manager sampler add minimum tokens per second accepted

#94 AguirreNicolas closed 1 month ago
0
69 go tests circular buffers

#93 RawthiL closed 1 month ago
0
Manager / Sampler / Evaluator : Config Signature Support

#92 RawthiL closed 1 week ago
0
Update `lm-eval-harness` to `0.4.3`

#91 AguirreNicolas closed 2 months ago
0
adding ruff

#90 RawthiL closed 2 months ago
0
Update to `lm-eval-harness== 0.4.3`

#89 AguirreNicolas closed 2 months ago
0
82 report june 2024

#88 AguirreNicolas closed 2 months ago
0
Python Linting

#87 RawthiL closed 2 months ago
0
Update READMEs

#86 RawthiL closed 2 months ago
0
Update READMES

#85 RawthiL closed 2 months ago
0
Working API with MongoDB data

#84 RawthiL closed 2 months ago
0
59 full app integration

#83 RawthiL closed 2 months ago
0
Report - June 2024

#82 AguirreNicolas closed 2 months ago
0
Feature/add website to show metrics

#81 Alann27 closed 3 months ago
0
task configs: metrics and filters as list + clean code

#80 AguirreNicolas closed 3 months ago
0
Requester : Randomize time between requests

#79 RawthiL opened 3 months ago
0
Fix `generation_until` in LM classes.

#78 AguirreNicolas closed 3 months ago
0
Manager : Numerical Task Process Sample - Add Boostrap

#77 RawthiL opened 3 months ago
0
Leaderboard Site

#76 RawthiL closed 2 months ago
0
Manager / Sampler : Add minimum tokens per second accepted

#75 RawthiL closed 1 month ago
0
Sampler : Invalidate pending tasks if postgress data changes

#74 RawthiL opened 3 months ago
0
Manager : Sepparate node data update from task triggering

#73 RawthiL closed 2 weeks ago
0
Manager / Evaluator : Add tracking of failure rates

#72 RawthiL opened 3 months ago
0
Manager / Evaluator : Add tracking of requests response times

#71 RawthiL opened 3 months ago
1
GO Tests : Manager Tasks Mechanics

#70 RawthiL opened 3 months ago
0
GO Tests : Circular Buffers

#69 RawthiL closed 1 month ago
0
Remove LLM and LMEH specific code

#68 RawthiL opened 3 months ago
0
64 manager add same trigger restrictions based on blocks 1159

#67 RawthiL closed 3 months ago
0
Fix `generate_until` calls in `Sampler` and `Evaluator`

#66 AguirreNicolas closed 3 months ago
0
61 evalator finish code for lmeh

#65 AguirreNicolas closed 3 months ago
0
Manager: Add same trigger restrictions based on blocks

#64 RawthiL closed 3 months ago
3
58 evaluator add signatures tokenizer evaluation

#63 RawthiL closed 3 months ago
0
42 manager create logic for tokenizer signature task

#62 RawthiL closed 3 months ago
0
Evalator: Finish code for LMEH

#61 AguirreNicolas closed 3 months ago
0
44 evaluator create initial code for lmeh processing

#60 AguirreNicolas closed 3 months ago
0
Full App Integration

#59 RawthiL closed 2 months ago
0
Evaluator: Add [signatures] [tokenizer] evaluation

#58 RawthiL closed 3 months ago
0
43 sampler create logic for tokenizer signature task

#57 RawthiL closed 3 months ago
0
Added sidecar for tokenizer endpoint in llm nodes

#56 RawthiL closed 3 months ago
0
POKT Side Car : Create tokenizer endpoint

#55 RawthiL closed 3 months ago
0
modularizing the tasks to allow signatures

#54 RawthiL closed 3 months ago
0
Report may 2024

#53 RawthiL closed 3 months ago
0
Combine Manager Sampler and Requester into initial PoC Code

#52 RawthiL closed 3 months ago
0
General fixes and enhancements to create the first version of Morse POC

#51 jorgecuesta closed 3 months ago
0