search

tenstorrent / tt-metal

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
Apache License 2.0
387 stars 47 forks source link

Demo for functional bloom #4503

Closed Sudharsan-V closed 7 months ago

Sudharsan-V commented 8 months ago

GS e2e Demo

test uses batched real inputs and produces batched outputs

this test is looped (takes several batches of inputs, produces several batches of outputs)

test evaluates results of TT model against validation data in selected data set

test is documented

how to run test (commands to execute) what does the model do (high-level explanation in a couple of sentences) description of what is input and what is output this demo should load inputs and expected outputs from a data set on Weka (TBD which one)

punithsekar commented 8 months ago

The end-to-end demo for the functional bloom model . corresponding commit

Working on batch_size>1 support for bloom_causalLM_inference.

punithsekar commented 8 months ago

The end-to-end demo for the functional bloom model(causalLM) . corresponding PR #4554

saichandax commented 7 months ago

PR merged. Hence, closing the ticket.