fluent-package 5.0.3 - Githubissues

fluent / fluent-package-builder

td-agent (Fluentd) Building and Packaging System

Apache License 2.0

21 stars 23 forks source link

fluent-package 5.0.3 #627

Closed kenhys closed 3 months ago

kenhys commented 4 months ago

fluent-package 5.0.3

As LTS update, basically updates patch versions.

Exceptions for updated:

tzinfo-data
- Timezone database should be updated.
nokogiri
- CVE-2024-25062

Exceptions for NOT updated:

async-http 0.61.0 -> 0.63.0
- No bug fixes
oj 3.16.1 -> 3.16.3
- No need to update because it adds new option and fix for ruby 3.3.0 or later
uri 0.12.2 -> 0.13.0
- ruby 3.2.3 bundles 0.12.2. No CVE furthermore.

Others:

AWS gems are usually updated to the latest every release, but it is not updated this time to limit the impact.

kenhys commented 4 months ago

nokogiri 1.16 series are not allowed by fluent plugin parser winevt_xml.

kenhys commented 3 months ago

fluent-plugin-parser-winevt_xml v0.2.7 has been published, now it can be updated.

kenhys commented 3 months ago

still sticked to v1.16.3, need to follow up.

kenhys commented 3 months ago

fixed sticked version.

kenhys commented 3 months ago

fluent-diagtool should not abort even though sysctl command is not available.

https://github.com/fluent/diagtool/pull/21

kenhys commented 3 months ago

changed to use $env:TEMP instead of tmp on Windows (c:\fluent\tmp can't be writable)

kenhys commented 3 months ago

Let's bundle https://github.com/fluent/diagtool/pull/22

kenhys commented 3 months ago

need to check https://github.com/fluent/fluent-package-builder/actions/runs/8324666759/job/22776747302?pr=627 failure.

kenhys commented 3 months ago

With fluent-plugin prompt, it works.

C:\opt\fluent>fluent-diagtool -t fluentd -o %TEMP%
2024-03-19 10:16:09 +0900: [Diagtool] [INFO] Parsing command options...
2024-03-19 10:16:09 +0900: [Diagtool] [INFO]    Option : Output directory = C:\Users\kenhys\AppData\Local\Temp
2024-03-19 10:16:09 +0900: [Diagtool] [INFO] Initializing parameters...
2024-03-19 10:16:09 +0900: [Diagtool] [INFO] [Collect] Collecting fluent-package gem information...
2024-03-19 10:16:11 +0900: [Diagtool] [INFO] [Collect] fluent-package gem information is stored in C:\Users\kenhys\AppData\Local\Temp/20240319101609/output/tdgem_list.output
2024-03-19 10:16:11 +0900: [Diagtool] [INFO] [Collect] fluent-package gem information (bundled by default) is stored in C:\Users\kenhys\AppData\Local\Temp/20240319101609/output/gem_bundled_list.output
2024-03-19 10:16:11 +0900: [Diagtool] [INFO] [Collect] fluent-package manually installed gem information is stored in C:\Users\kenhys\AppData\Local\Temp/20240319101609/output/gem_local_list.output
2024-03-19 10:16:11 +0900: [Diagtool] [INFO] [Collect] fluent-package manually installed gems:
2024-03-19 10:16:11 +0900: [Diagtool] [INFO] [Collect]   * fluent-plugin-concat

kenhys commented 3 months ago

Even though invoked from cmd.exe, it works

c:\opt\fluent\bin>fluent-diagtool -t fluentd -o %TEMP%
2024-03-19 10:17:55 +0900: [Diagtool] [INFO] Parsing command options...
2024-03-19 10:17:55 +0900: [Diagtool] [INFO]    Option : Output directory = C:\Users\kenhys\AppData\Local\Temp
2024-03-19 10:17:55 +0900: [Diagtool] [INFO] Initializing parameters...
2024-03-19 10:17:55 +0900: [Diagtool] [INFO] [Collect] Collecting fluent-package gem information...
2024-03-19 10:17:56 +0900: [Diagtool] [INFO] [Collect] fluent-package gem information is stored in C:\Users\kenhys\AppData\Local\Temp/20240319101755/output/tdgem_list.output
2024-03-19 10:17:56 +0900: [Diagtool] [INFO] [Collect] fluent-package gem information (bundled by default) is stored in C:\Users\kenhys\AppData\Local\Temp/20240319101755/output/gem_bundled_list.output
2024-03-19 10:17:56 +0900: [Diagtool] [INFO] [Collect] fluent-package manually installed gem information is stored in C:\Users\kenhys\AppData\Local\Temp/20240319101755/output/gem_local_list.output
2024-03-19 10:17:56 +0900: [Diagtool] [INFO] [Collect] fluent-package manually installed gems:
2024-03-19 10:17:56 +0900: [Diagtool] [INFO] [Collect]   * fluent-plugin-concat

kenhys commented 3 months ago

it was reproduced when set TD_AGENT_TOPDIR= ; set FLUENT_PACKAGE_TOPDIR=.

kenhys commented 3 months ago

now CI has passed.

kenhys commented 3 months ago

checking on arm build.

kenhys commented 3 months ago

package can be built on arm:

kenhys@M1-Mac-mini f-p-b.work % find fluent-package -name '*.deb'
fluent-package/apt/repositories/debian/pool/bullseye/main/f/fluent-package/fluent-package_5.0.3-1_arm64.deb
fluent-package/apt/repositories/debian/pool/bullseye/main/f/fluent-package/fluent-package-dbgsym_5.0.3-1_arm64.deb
fluent-package/apt/repositories/debian/pool/bullseye/main/f/fluent-package/td-agent_5.0.3-1_all.deb
fluent-package/apt/repositories/debian/pool/bookworm/main/f/fluent-package/fluent-package_5.0.3-1_arm64.deb
fluent-package/apt/repositories/debian/pool/bookworm/main/f/fluent-package/fluent-package-dbgsym_5.0.3-1_arm64.deb
fluent-package/apt/repositories/debian/pool/bookworm/main/f/fluent-package/td-agent_5.0.3-1_all.deb
fluent-package/apt/repositories/ubuntu/pool/focal/universe/f/fluent-package/fluent-package_5.0.3-1_arm64.deb
fluent-package/apt/repositories/ubuntu/pool/focal/universe/f/fluent-package/td-agent_5.0.3-1_all.deb
fluent-package/apt/repositories/ubuntu/pool/jammy/universe/f/fluent-package/fluent-package_5.0.3-1_arm64.deb
fluent-package/apt/repositories/ubuntu/pool/jammy/universe/f/fluent-package/td-agent_5.0.3-1_all.deb
kenhys@M1-Mac-mini f-p-b.work % find fluent-package -name '*.rpm'
fluent-package/yum/repositories/amazon/2023/source/SRPMS/fluent-package-5.0.3-1.amzn2023.src.rpm
fluent-package/yum/repositories/amazon/2023/aarch64/Packages/fluent-package-debugsource-5.0.3-1.amzn2023.aarch64.rpm
fluent-package/yum/repositories/amazon/2023/aarch64/Packages/fluent-package-debuginfo-5.0.3-1.amzn2023.aarch64.rpm
fluent-package/yum/repositories/amazon/2023/aarch64/Packages/fluent-package-5.0.3-1.amzn2023.aarch64.rpm
fluent-package/yum/repositories/amazon/2/source/SRPMS/fluent-package-5.0.3-1.amzn2.src.rpm
fluent-package/yum/repositories/amazon/2/aarch64/Packages/fluent-package-debuginfo-5.0.3-1.amzn2.aarch64.rpm
fluent-package/yum/repositories/amazon/2/aarch64/Packages/fluent-package-5.0.3-1.amzn2.aarch64.rpm
fluent-package/yum/repositories/rocky/8/source/SRPMS/fluent-package-5.0.3-1.el8.src.rpm
fluent-package/yum/repositories/rocky/8/aarch64/Packages/fluent-package-debuginfo-5.0.3-1.el8.aarch64.rpm
fluent-package/yum/repositories/rocky/8/aarch64/Packages/fluent-package-debugsource-5.0.3-1.el8.aarch64.rpm
fluent-package/yum/repositories/rocky/8/aarch64/Packages/fluent-package-5.0.3-1.el8.aarch64.rpm
fluent-package/yum/repositories/centos/7/source/SRPMS/fluent-package-5.0.0-1.el7.src.rpm
fluent-package/yum/repositories/centos/7/source/SRPMS/fluent-package-5.0.3-1.el7.src.rpm
fluent-package/yum/repositories/centos/7/aarch64/Packages/fluent-package-debuginfo-5.0.3-1.el7.aarch64.rpm
fluent-package/yum/repositories/centos/7/aarch64/Packages/fluent-package-debuginfo-5.0.0-1.el7.aarch64.rpm
fluent-package/yum/repositories/centos/7/aarch64/Packages/fluent-package-5.0.0-1.el7.aarch64.rpm
fluent-package/yum/repositories/centos/7/aarch64/Packages/fluent-package-5.0.3-1.el7.aarch64.rpm
fluent-package/yum/repositories/almalinux/9/source/SRPMS/fluent-package-5.0.3-1.el9.src.rpm
fluent-package/yum/repositories/almalinux/9/aarch64/Packages/fluent-package-5.0.3-1.el9.aarch64.rpm
fluent-package/yum/repositories/almalinux/9/aarch64/Packages/fluent-package-debugsource-5.0.3-1.el9.aarch64.rpm
fluent-package/yum/repositories/almalinux/9/aarch64/Packages/fluent-package-debuginfo-5.0.3-1.el9.aarch64.rpm

kenhys commented 3 months ago

OT: downloading artifacts via script may stall. checking why...

kenhys commented 3 months ago

@daipom could you merge this PR?

kenhys commented 3 months ago

Uploaded to test/experimental:

OK: debian:bullseye exp/5 OK: debian:bullseye exp/lts/5 OK: debian:bookworm exp/5 OK: debian:bookworm exp/lts/5 OK: ubuntu:focal exp/5 OK: ubuntu:focal exp/lts/5 OK: ubuntu:jammy exp/5 OK: ubuntu:jammy exp/lts/5 OK: centos:7 exp/5 OK: centos:7 exp/lts/5 OK: almalinux:8 exp/5 OK: almalinux:8 exp/lts/5 OK: rockylinux:9 exp/5 OK: rockylinux:9 exp/lts/5 OK: amazonlinux:2 exp/5 OK: amazonlinux:2 exp/lts/5 OK: amazonlinux:2023 exp/5 OK: amazonlinux:2023 exp/lts/5