search

grantjenks / py-tree-sitter-languages

Binary Python wheels for all tree sitter languages.
Other
169 stars 48 forks source link

Improve build time #38

Closed sansmoraxz closed 5 months ago

sansmoraxz commented 11 months ago

I have noticed that the majority of the bottleneck is of git clones, taking insanely long if there are a lot of languages. This PR will parallelize the process.

Also the cloned folder list are already available. No need to explicitly pass it.

sansmoraxz commented 11 months ago

Found the issue. Lemme rollback to explicit list passing.

grantjenks commented 10 months ago

I don’t see any speed up in the CI build time. Looks like it’s still 3h11m. I do see the parallelization but I don’t think this is the slow part.

sansmoraxz commented 10 months ago

OK the Linux builds are taking long. That auto flag is building for all architectures and versions. Will look into it.

Probably matrix items can be increased.

sansmoraxz commented 10 months ago

Also the biggest bottlenecks are building for QEMU based ppc64le, s390x and aarch64 distros.