Agenda items for Bidding&Auction Service - TPAC 2024

[fhoering]

@michaelkleber @thegreatfatzby @bjschnei @peiwenhu @akshaypundle, @itaysharfi and members of the WICG

I'd like to suggest adding on the following topics, as part of a WICG - B&A service sessions at TPAC:

• Criteo benchmarking results (https://github.com/privacysandbox/protected-auction-key-value-service/issues/43#issuecomment-2218079475)
• Define common benchmarking methodology
• ROMA BYOB (https://github.com/privacysandbox/data-plane-shared-libraries/blob/main/docs/roma/roma_byob.md, https://github.com/WICG/protected-auction-services-discussion/issues/83, https://github.com/privacysandbox/protected-auction-key-value-service/issues/66)
• Datastructures for caching/storage (https://github.com/WICG/protected-auction-services-discussion/issues/81, https://github.com/privacysandbox/protected-auction-key-value-service/issues/62)

Would you be interested in that? Should we reserve a slot in https://github.com/WICG/admin/issues/194 ?

[yhkumargoogle]

@fhoering Do you want to discuss this in tomorrow's WICG call ? https://github.com/WICG/protected-auction-services-discussion/issues/27

[fhoering]

Yes. I added it to the agenda items.

[fhoering]

Sorry. I meant we can discuss tomorrow about the TPAC agenda and who attends but I would prefer discussing this in TPAC during a physical session.

[yhkumargoogle]

Understood. I have updated the agenda to reflect this.

[fhoering]

Closing. has been discussed here:

https://github.com/WICG/privacy-preserving-ads/blob/main/Open%20Discussions/20240924-WICG_TPAC_Criteo_OnDeviceVsServerSide.pdf https://github.com/WICG/privacy-preserving-ads/blob/main/Open%20Discussions/2024-09-24-tpac.md

[yhkumargoogle]

@fhoering As discussed on Sep 11, we had added the following to the agenda for today (Oct 9)

• Criteo benchmarking results (Performance of triggering UDF execution engine privacysandbox/protected-auction-key-value-service#43 (comment))
• Define common benchmarking methodology

But we dismissed the session as you were not available on the call. Do you want to discuss this on the next call (Oct 23)?

[fhoering]

I presented some of the benchmarks here: https://github.com/WICG/privacy-preserving-ads/blob/main/Open%20Discussions/20240924-WICG_TPAC_Criteo_OnDeviceVsServerSide.pdf

If you think this is still of interest I can present them in the next meeting yes.

On the common benchmarking methodology I have not much to discuss yet beyond saying that I think it is important for several reasons in particular given RTB constraints and given several factors that can significantly increase the cloud infrastructure cost.

Potentially, as a next step, someone from Google could present what has been done, the features this supports, how to start using this and the next steps on how to simplify those tools and make them more generic

I'm mostly thinking of those tools:

• https://github.com/privacysandbox/protected-auction-key-value-service/tree/release-0.17/tools/benchmarking
• https://github.com/privacysandbox/bidding-auction-servers/tree/main/tools/load_testing
• https://github.com/privacysandbox/data-plane-shared-libraries/tree/main/src/roma/benchmark
• https://github.com/privacysandbox/data-plane-shared-libraries/blob/main/docs/roma/byob/Benchmarking.md

What do you think ?

[fhoering]

@yhkumargoogle I will be in holidays on 23th of October. Available 6th of November.

[yhkumargoogle]

@fhoering I have added it to the agenda for Nov 6.

[fhoering]

Ok. Thanks. If it is possible, rather than a discussion, it could be useful also to have a presentation/overview of the existing benchmarking tools, what they allow to do and how to use them. I could add more people also on Criteo side to attend.

[yhkumargoogle]

@fhoering We wanted to discuss https://github.com/privacysandbox/protected-auction-key-value-service/issues/72 asap. So, we would like to use the Nov 6 meeting for it.

Can we discuss this in the following session?

[fhoering]

Yes. no problem.