search

google / langfun

OO for LLMs
Apache License 2.0
122 stars 18 forks source link

Allow `metadata_.*` fields/contextual attributes to be carried as prompt metadata. #183

Closed copybara-service[bot] closed 4 months ago

copybara-service[bot] commented 4 months ago

Allow metadata_.* fields/contextual attributes to be carried as prompt metadata.

Example:

with lf.context(metadata_weights=[1.0]):
  m = lf.query('hi', ..., returns_message=True)
assert m.source.metadata.weights == 1.0

#or:

m = lf.query('hi', ..., metadata_weights=[1.0], returns_message=True)
assert m.source.metadata.weights == 1.0