I have updated a test and added a new test to show that adding new batch to a live model chat evaluation project does not fail as expected
FYI the reason my initial test passed, i.e. project.create_batch() threw an exception, was because I used incorrect data row type for my test. So exception was for that reason, not because api explicitly disallowed created new batches for live model evaluation projects as it should.
FYI Project create_batch() uses two apis, depending whether we are adding less than or more than 1K rows:
createEmptyBatch / addDataRowsToBatchAsync for async
createBatchV2 for sync
Fixes # (issue)
Type of change
Please delete options that are not relevant.
[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Document change (fix typo or modifying any markdown files, code comments or anything in the examples folder only)
All Submissions
[ ] Have you followed the guidelines in our Contributing document?
[ ] Have you provided a description?
[ ] Are your changes properly formatted?
New Feature Submissions
[ ] Does your submission pass tests?
[ ] Have you added thorough tests for your new feature?
[ ] Have you commented your code, particularly in hard-to-understand areas?
[ ] Have you added a Docstring?
Changes to Core Features
[ ] Have you written new tests for your core changes, as applicable?
[ ] Have you successfully run tests with your changes locally?
[ ] Have you updated any code comments, as applicable?
Description
I have updated a test and added a new test to show that adding new batch to a live model chat evaluation project does not fail as expected
FYI the reason my initial test passed, i.e. project.create_batch() threw an exception, was because I used incorrect data row type for my test. So exception was for that reason, not because api explicitly disallowed created new batches for live model evaluation projects as it should.
FYI Project create_batch() uses two apis, depending whether we are adding less than or more than 1K rows:
createEmptyBatch
/addDataRowsToBatchAsync
for asynccreateBatchV2
for syncFixes # (issue)
Type of change
Please delete options that are not relevant.
All Submissions
New Feature Submissions
Changes to Core Features