search

grantjenks / py-tree-sitter-languages

Binary Python wheels for all tree sitter languages.
Other
116 stars 35 forks source link

Improve build time #38

Closed sansmoraxz closed 6 days ago

sansmoraxz commented 5 months ago

I have noticed that the majority of the bottleneck is of git clones, taking insanely long if there are a lot of languages. This PR will parallelize the process.

Also the cloned folder list are already available. No need to explicitly pass it.

sansmoraxz commented 5 months ago

Found the issue. Lemme rollback to explicit list passing.

grantjenks commented 5 months ago

I don’t see any speed up in the CI build time. Looks like it’s still 3h11m. I do see the parallelization but I don’t think this is the slow part.

sansmoraxz commented 5 months ago

OK the Linux builds are taking long. That auto flag is building for all architectures and versions. Will look into it.

Probably matrix items can be increased.

sansmoraxz commented 4 months ago

Also the biggest bottlenecks are building for QEMU based ppc64le, s390x and aarch64 distros.