[Feature Request]: context caching for gemini-1.5

[yeounoh]

Is your feature request related to a problem? Please describe.

Context caching is critical in reducing the cost over repeated prompts and/or requests. We can also expose and leverage this as part of the ongoing gemini integration efforts.

Describe the solution you'd like

Provide an API for caching and provide examples for the usage.

Additional context

https://ai.google.dev/gemini-api/docs/caching?utm_source=gais&utm_medium=email&utm_campaign=june&lang=python

[yeounoh]

I can raise a PR for this, but currently not allowed to claim (assign to myself) the issue.

[LittleLittleCloud]

@yeounoh just assign this task to you, let us know if you need further assistance.

[yeounoh]

@yeounoh just assign this task to you, let us know if you need further assistance.

Thank you, will do!