search

Standard-Labs / real-intent

Python SDK and abstracted interface for Real Intent operations.
https://realintent.co
0 stars 0 forks source link

OpenAI o1-preview foundational for lead analysis #90

Closed preritdas closed 2 months ago

preritdas commented 2 months ago

Test using o1-preview for runtime lead analysis, with a fallback to 4o. Or, to Sonnet 3.5 with structured output to reduce provider dependency.

preritdas commented 2 months ago

Abandoning...

  1. Too expensive ($60 per million output tokens vs. $7.5)
  2. No support for structured outputs (can't validate)

Could re-explore this with vanilla JSON mode (no structured outputs) and then fallback to the existing implementation if it doesn't go through, to compare the quality of insights.