This pull request includes several changes related to the integration of a new Python Lambda function for processing large language models. The main changes are:
Added a new Python Lambda function (notebook/lambda_function.py) and its associated zipped package (notebook/lambda_function.zip) for handling LLM inference on AWS Lambda.
Included a Jupyter Notebook (notebook/llama2-13b.ipynb) with code examples and documentation for using the new Lambda function.
Added utility scripts (src/code_layout.sh, dist/code_layout.sh) for generating and formatting code structure.
Updated testing infrastructure with new test files (src/index.test.ts, dist/index.test.d.ts) and configuration (jest.config.js).
Added type definition files (dist/index.d.ts, dist/ut_py.d.ts, dist/ut_ts.d.ts) for better TypeScript support.
Modified existing source files (src/index.ts, src/ut_py.ts, src/ut_ts.ts) to integrate with the new Lambda function.
Updated project configuration files (package.json, package-lock.json, tsconfig.json) to include new dependencies and settings.
Modified CI/CD workflow file (.github/workflows/code-review.yml) to accommodate the new changes.
Updated documentation (README.md) with instructions for using the new Lambda function.
The motivation behind this change is to enable efficient and scalable inference of large language models using AWS Lambda, leveraging its serverless architecture and cost-effective pricing model. No additional dependencies are required for this change.
Type of change
[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[x] This change requires a documentation update
How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration
[ ] Test A
[ ] Test B
Test Configuration:
Firmware version:
Hardware:
Toolchain:
SDK:
Checklist:
[ ] My code follows the style guidelines of this project
[ ] I have performed a self-review of my code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream modules
Description
This pull request includes several changes related to the integration of a new Python Lambda function for processing large language models. The main changes are:
notebook/lambda_function.py) and its associated zipped package (notebook/lambda_function.zip) for handling LLM inference on AWS Lambda.notebook/llama2-13b.ipynb) with code examples and documentation for using the new Lambda function.src/code_layout.sh,dist/code_layout.sh) for generating and formatting code structure.src/index.test.ts,dist/index.test.d.ts) and configuration (jest.config.js).dist/index.d.ts,dist/ut_py.d.ts,dist/ut_ts.d.ts) for better TypeScript support.src/index.ts,src/ut_py.ts,src/ut_ts.ts) to integrate with the new Lambda function.package.json,package-lock.json,tsconfig.json) to include new dependencies and settings..github/workflows/code-review.yml) to accommodate the new changes.README.md) with instructions for using the new Lambda function.The motivation behind this change is to enable efficient and scalable inference of large language models using AWS Lambda, leveraging its serverless architecture and cost-effective pricing model. No additional dependencies are required for this change.
Type of change
How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration
Test Configuration:
Checklist: