Add time to first token for llama runner - Githubissues

pytorch / executorch

On-device AI across mobile, embedded and edge for PyTorch

https://pytorch.org/executorch/

Other

1.39k stars 228 forks source link

Add time to first token for llama runner #2141

Closed vmpuri closed 3 months ago

vmpuri commented 3 months ago

Summary: Add time to first generated

Differential Revision: D54223564

pytorch-bot[bot] commented 3 months ago

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/2141

:page_facing_up: Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

:white_check_mark: No Failures

As of commit 6c28e7f46e161a236d91f851e6682d1cbeae3299 with merge base 3e414fb5fad9b2959a4e86b514614a6add1b8e4f (): :green_heart: Looks good so far! There are no failures yet. :green_heart:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request was exported from Phabricator. Differential Revision: D54223564

facebook-github-bot commented 3 months ago

This pull request has been merged in pytorch/executorch@caee336d6842713937daf717882aa146edb29ace.