Small HW cluster for Jaeger/ClickHouse GSoC project

[yurishkuro]

Please fill out the details below to file a request for access to the CNCF Community Infrastructure Lab. Please note that access is targeted to people working on specific open source projects; this is not designed just to get your feet wet. The most important answer is the URL of the project you'll be working with. If you're looking to learn Kubernetes and related technologies, please try out Katacoda.

First and Last Name

Yuri Shkuro

Email

github@ysh.us

Project Title (i.e., a summary of what do you want to do, not what is the name of the open source project you're working with)

ClickHouse as a core storage backend for Jaeger

Briefly describe the project (i.e., what is the detail of what you're planning to do with these servers?)

This is a mentorship project part of GSoC. The aim is to develop storage implementation in Jaeger using ClickHouse as the backend. The servers are needed to run performance benchmarks to determine the optimal database schema and the write/query methods.

https://github.com/jaegertracing/jaeger/issues/4196

Is the code that you’re going to run 100% open source? If so, what is the URL or URLs where it is located? What is your association with that project?

https://github.com/jaegertracing/jaeger

I am a maintainer of Jaeger, but the work will be done by GSoC mentee @haanhvu.

What kind of machines and how many do you expect to use (see: https://metal.equinix.com/product/servers/)?

Five c3.small.x86 or m3.small.x86 machines.

What operating system and networking are you planning to use?

Linux

Any other relevant details we should know about?

Reservation will be needed through GSoC project completion at the end of Aug 2023.

[idvoretskyi]

PTAL @caniszczyk

[caniszczyk]

+1

On Wed, May 17, 2023 at 11:22 AM Ihor Dvoretskyi @.***> wrote:

PTAL @caniszczyk https://github.com/caniszczyk

— Reply to this email directly, view it on GitHub https://github.com/cncf/cluster/issues/239#issuecomment-1551707916, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAAPSINWLQXLGGZX2HN2RFTXGT3MDANCNFSM6AAAAAAYFJLNRY . You are receiving this because you were mentioned.Message ID: @.***>

-- Cheers,

Chris Aniszczyk https://aniszczyk.org

[yurishkuro]

@idvoretskyi what's the follow-up here? Does someone need to approve ? Who can action the ticket? Thx.

[caniszczyk]

@RobertKielty can you take care of this

[jeefy]

@yurishkuro You should have an invite to a new Equinix project now. :) Feel free to reach out if you need anything else!

[yurishkuro]

@jeefy thanks, I got it. Are there any guidelines on how to use this service? We don't want to accidentally rack up a huge usage bill.

[yurishkuro]

@jeefy also, please invite haanh6594@gmail.com, I don't seem to have that option.

[jeefy]

Use responsibly. :) Don't leave machines around that you don't need. Technically Equinix is all bare metal so even leaving a machine powered off is still considered "consumption".

In terms of using too much, we'll ping you to let you know if consumption is a bit too wild.

cc @vielmetti

[vielmetti]

@yurishkuro - the project currently has 12 systems provisioned, which is more than the original expectation of 5 systems. Can you please take a look to see if there's any infrastructure that can be cleaned up or consolidated? Or, if project scope has expanded, please describe the additional resources and how they are being used.

(I also note that the project original completion date is end of August 2023, so if this is the final burst of systems needed to complete your work that's fine - just don't want to have machines running idle.)

cc @jeefy @idvoretskyi @caniszczyk

[yurishkuro]

will check. We're wrapping up the work.

[haanhvu]

@vielmetti @yurishkuro I'll delete all the hosts by the end of this week.

Or, if project scope has expanded, please describe the additional resources and how they are being used.

We have been having more performance benchmarks to run than we originally expected. The benchmarks are going to be finished this week.

Update: Sorry it's already end of the week but we haven't closed all the servers yet... We closed 5/12 of them. We'll try to close the remaining in last week of August.

[vielmetti]

Sounds great @haanhvu ! Looking forward to seeing your report and results.

[idvoretskyi]

@yurishkuro anything else should be done here (or we can close the ticket)?