bazelbuild / continuous-integration

Bazel's Continuous Integration Setup
https://buildkite.com
Apache License 2.0
253 stars 133 forks source link

ERROR: missing input file '@androidsdk//:emulator/emulator64-x86' #644

Closed jin closed 5 years ago

jin commented 5 years ago

https://buildkite.com/bazel/rules-jvm-external-examples/builds/267#5034434a-1370-4c30-afd0-8d329f944a77

ERROR: missing input file '@androidsdk//:emulator/emulator64-x86'
--
  | ERROR: missing input file '@androidsdk//:emulator/emulator64-arm'
  | INFO: From ProtoCompile external/com_google_protobuf/python/google/protobuf/any_pb2.py [for host]:
  | external/com_google_protobuf/python: warning: directory does not exist.
  | ERROR: /home/bazel/.cache/bazel/_bazel_bazel/f6a3957ea6a274c56104ddfb22eb6d18/external/android_test_support/tools/android/emulated_devices/generic_phone/BUILD.bazel:43:1: @android_test_support//tools/android/emulated_devices/generic_phone:android_23_x86_qemu2: missing input file '@androidsdk//:emulator/emulator64-x86'
  | ERROR: /home/bazel/.cache/bazel/_bazel_bazel/f6a3957ea6a274c56104ddfb22eb6d18/external/android_test_support/tools/android/emulated_devices/generic_phone/BUILD.bazel:43:1: @android_test_support//tools/android/emulated_devices/generic_phone:android_23_x86_qemu2: missing input file '@androidsdk//:emulator/emulator64-arm'

This test has been passing without any changes to the code under test: https://buildkite.com/bazel/rules-jvm-external-examples/builds/264

Was there a new image pushed out recently?

philwo commented 5 years ago

Yes, we pushed new images yesterday, but there weren't any changes related to Android. I'm having a look at the failure now.

philwo commented 5 years ago

Yeah, seems like the Android SDK changed something and we picked up these changes when I rebuilt the images yesterday. Here's a diff of the list of files in /opt/android-sdk-linux. I don't think I can do anything about it - it's an upstream change and there doesn't seem to be a mechanism to explicitly install an older version of the emulator, right?

diff philwo@philwo-imacpro ~ diff -u old.s new.s
--- old.s   2019-05-09 14:14:24.000000000 +0200
+++ new.s   2019-05-09 14:14:26.000000000 +0200
@@ -416,18 +416,21 @@
 /opt/android-sdk-linux/emulator/bin64/tune2fs
 /opt/android-sdk-linux/emulator/emulator
 /opt/android-sdk-linux/emulator/emulator-check
-/opt/android-sdk-linux/emulator/emulator64-arm
+/opt/android-sdk-linux/emulator/emulator-headless
 /opt/android-sdk-linux/emulator/emulator64-crash-service
-/opt/android-sdk-linux/emulator/emulator64-x86
+/opt/android-sdk-linux/emulator/goldfish-webrtc-bridge
 /opt/android-sdk-linux/emulator/lib
 /opt/android-sdk-linux/emulator/lib/advancedFeatures.ini
 /opt/android-sdk-linux/emulator/lib/advancedFeaturesCanary.ini
 /opt/android-sdk-linux/emulator/lib/ca-bundle.pem
 /opt/android-sdk-linux/emulator/lib/emu-original-feature-flags.protobuf
+/opt/android-sdk-linux/emulator/lib/emulator_controller.proto
 /opt/android-sdk-linux/emulator/lib/hardware-properties.ini
 /opt/android-sdk-linux/emulator/lib/pc-bios
 /opt/android-sdk-linux/emulator/lib/pc-bios/bios-256k.bin
 /opt/android-sdk-linux/emulator/lib/pc-bios/bios.bin
+/opt/android-sdk-linux/emulator/lib/pc-bios/efi-e1000.rom
+/opt/android-sdk-linux/emulator/lib/pc-bios/efi-e1000e.rom
 /opt/android-sdk-linux/emulator/lib/pc-bios/efi-virtio.rom
 /opt/android-sdk-linux/emulator/lib/pc-bios/keymaps
 /opt/android-sdk-linux/emulator/lib/pc-bios/keymaps/Makefile
@@ -471,107 +474,49 @@
 /opt/android-sdk-linux/emulator/lib/pc-bios/kvmvapic.bin
 /opt/android-sdk-linux/emulator/lib/pc-bios/linuxboot.bin
 /opt/android-sdk-linux/emulator/lib/pc-bios/linuxboot_dma.bin
+/opt/android-sdk-linux/emulator/lib/pc-bios/multiboot.bin
 /opt/android-sdk-linux/emulator/lib/pc-bios/vgabios-cirrus.bin
+/opt/android-sdk-linux/emulator/lib/pc-bios/vgabios-stdvga.bin
 /opt/android-sdk-linux/emulator/lib/pc-bios/vgabios-virtio.bin
 /opt/android-sdk-linux/emulator/lib64
-/opt/android-sdk-linux/emulator/lib64/android-emu-shared.so
+/opt/android-sdk-linux/emulator/lib64/gles_mesa
+/opt/android-sdk-linux/emulator/lib64/gles_mesa/libGL.so
+/opt/android-sdk-linux/emulator/lib64/gles_mesa/libGL.so.1
 /opt/android-sdk-linux/emulator/lib64/gles_swiftshader
 /opt/android-sdk-linux/emulator/lib64/gles_swiftshader/libEGL.so
 /opt/android-sdk-linux/emulator/lib64/gles_swiftshader/libGLES_CM.so
 /opt/android-sdk-linux/emulator/lib64/gles_swiftshader/libGLESv2.so
-/opt/android-sdk-linux/emulator/lib64/gralloc.goldfish.so
-/opt/android-sdk-linux/emulator/lib64/gralloc.ranchu.so
-/opt/android-sdk-linux/emulator/lib64/lib64EGL_translator.so
-/opt/android-sdk-linux/emulator/lib64/lib64GLES12Translator.so
-/opt/android-sdk-linux/emulator/lib64/lib64GLES_CM_translator.so
-/opt/android-sdk-linux/emulator/lib64/lib64GLES_V2_translator.so
-/opt/android-sdk-linux/emulator/lib64/lib64OpenglRender.so
-/opt/android-sdk-linux/emulator/lib64/lib64emugl_test_shared_library.so
-/opt/android-sdk-linux/emulator/lib64/libEGL_emulation.so
-/opt/android-sdk-linux/emulator/lib64/libGLESv1_CM_emulation.so
-/opt/android-sdk-linux/emulator/lib64/libGLESv1_enc.so
-/opt/android-sdk-linux/emulator/lib64/libGLESv2_emulation.so
-/opt/android-sdk-linux/emulator/lib64/libGLESv2_enc.so
-/opt/android-sdk-linux/emulator/lib64/libOpenglCodecCommon_host.so
-/opt/android-sdk-linux/emulator/lib64/libOpenglSystemCommon.so
-/opt/android-sdk-linux/emulator/lib64/lib_renderControl_enc.so
-/opt/android-sdk-linux/emulator/lib64/libaemugraphics.so
+/opt/android-sdk-linux/emulator/lib64/libEGL_translator.so
+/opt/android-sdk-linux/emulator/lib64/libGLES12Translator.so
+/opt/android-sdk-linux/emulator/lib64/libGLES_CM_translator.so
+/opt/android-sdk-linux/emulator/lib64/libGLES_V2_translator.so
+/opt/android-sdk-linux/emulator/lib64/libOpenglRender.so
+/opt/android-sdk-linux/emulator/lib64/libc++.so
 /opt/android-sdk-linux/emulator/lib64/libc++.so.1
-/opt/android-sdk-linux/emulator/lib64/libcutils.so
-/opt/android-sdk-linux/emulator/lib64/libgui.so
-/opt/android-sdk-linux/emulator/lib64/liblog.so
+/opt/android-sdk-linux/emulator/lib64/libemugl_common.so
 /opt/android-sdk-linux/emulator/lib64/libtcmalloc_minimal.so.4
-/opt/android-sdk-linux/emulator/lib64/libutils.so
+/opt/android-sdk-linux/emulator/lib64/libunwind-x86_64.so.8
+/opt/android-sdk-linux/emulator/lib64/libunwind.so.8
 /opt/android-sdk-linux/emulator/lib64/qt
 /opt/android-sdk-linux/emulator/lib64/qt/lib
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Concurrent.so
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Concurrent.so.5
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Concurrent.so.5.7
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Concurrent.so.5.7.0
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Core.so
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Core.so.5
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Core.so.5.7
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Core.so.5.7.0
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5DBus.so
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5DBus.so.5
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5DBus.so.5.7
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5DBus.so.5.7.0
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Gui.so
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Gui.so.5
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Gui.so.5.7
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Gui.so.5.7.0
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Network.so
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Network.so.5
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Network.so.5.7
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Network.so.5.7.0
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5OpenGL.so
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5OpenGL.so.5
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5OpenGL.so.5.7
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5OpenGL.so.5.7.0
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5PrintSupport.so
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5PrintSupport.so.5
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5PrintSupport.so.5.7
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5PrintSupport.so.5.7.0
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Sql.so
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Sql.so.5
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Sql.so.5.7
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Sql.so.5.7.0
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Svg.so
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Svg.so.5
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Svg.so.5.7
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Svg.so.5.7.0
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Test.so
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Test.so.5
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Test.so.5.7
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Test.so.5.7.0
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Widgets.so
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Widgets.so.5
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Widgets.so.5.7
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Widgets.so.5.7.0
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5XcbQpa.so
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5XcbQpa.so.5
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5XcbQpa.so.5.7
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5XcbQpa.so.5.7.0
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Xml.so
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Xml.so.5
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Xml.so.5.7
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5Xml.so.5.7.0
-/opt/android-sdk-linux/emulator/lib64/qt/lib/libc++.so
+/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5CoreAndroidEmu.so.5
+/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5DBusAndroidEmu.so.5
+/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5GuiAndroidEmu.so.5
+/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5NetworkAndroidEmu.so.5
+/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5PrintSupportAndroidEmu.so.5
+/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5SvgAndroidEmu.so.5
+/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5WidgetsAndroidEmu.so.5
+/opt/android-sdk-linux/emulator/lib64/qt/lib/libQt5XcbQpaAndroidEmu.so.5
+/opt/android-sdk-linux/emulator/lib64/qt/lib/libfreetype.so.6
+/opt/android-sdk-linux/emulator/lib64/qt/lib/libsoftokn3.so
+/opt/android-sdk-linux/emulator/lib64/qt/lib/libsqlite3.so
+/opt/android-sdk-linux/emulator/lib64/qt/lib/libxkbcommon.so
+/opt/android-sdk-linux/emulator/lib64/qt/lib/libxkbcommon.so.0
+/opt/android-sdk-linux/emulator/lib64/qt/lib/libxkbcommon.so.0.0.0
 /opt/android-sdk-linux/emulator/lib64/qt/plugins
-/opt/android-sdk-linux/emulator/lib64/qt/plugins/bearer
-/opt/android-sdk-linux/emulator/lib64/qt/plugins/bearer/libqconnmanbearer.so
-/opt/android-sdk-linux/emulator/lib64/qt/plugins/bearer/libqgenericbearer.so
-/opt/android-sdk-linux/emulator/lib64/qt/plugins/bearer/libqnmbearer.so
-/opt/android-sdk-linux/emulator/lib64/qt/plugins/generic
-/opt/android-sdk-linux/emulator/lib64/qt/plugins/generic/libqevdevkeyboardplugin.so
-/opt/android-sdk-linux/emulator/lib64/qt/plugins/generic/libqevdevmouseplugin.so
-/opt/android-sdk-linux/emulator/lib64/qt/plugins/generic/libqevdevtabletplugin.so
-/opt/android-sdk-linux/emulator/lib64/qt/plugins/generic/libqevdevtouchplugin.so
-/opt/android-sdk-linux/emulator/lib64/qt/plugins/generic/libqtuiotouchplugin.so
 /opt/android-sdk-linux/emulator/lib64/qt/plugins/iconengines
 /opt/android-sdk-linux/emulator/lib64/qt/plugins/iconengines/libqsvgicon.so
 /opt/android-sdk-linux/emulator/lib64/qt/plugins/imageformats
-/opt/android-sdk-linux/emulator/lib64/qt/plugins/imageformats/libqdds.so
 /opt/android-sdk-linux/emulator/lib64/qt/plugins/imageformats/libqgif.so
 /opt/android-sdk-linux/emulator/lib64/qt/plugins/imageformats/libqicns.so
 /opt/android-sdk-linux/emulator/lib64/qt/plugins/imageformats/libqico.so
@@ -583,14 +528,27 @@
 /opt/android-sdk-linux/emulator/lib64/qt/plugins/imageformats/libqwebp.so
 /opt/android-sdk-linux/emulator/lib64/qt/plugins/platforminputcontexts
 /opt/android-sdk-linux/emulator/lib64/qt/plugins/platforminputcontexts/libcomposeplatforminputcontextplugin.so
-/opt/android-sdk-linux/emulator/lib64/qt/plugins/platforminputcontexts/libibusplatforminputcontextplugin.so
 /opt/android-sdk-linux/emulator/lib64/qt/plugins/platforms
-/opt/android-sdk-linux/emulator/lib64/qt/plugins/platforms/libqlinuxfb.so
-/opt/android-sdk-linux/emulator/lib64/qt/plugins/platforms/libqminimal.so
-/opt/android-sdk-linux/emulator/lib64/qt/plugins/platforms/libqoffscreen.so
 /opt/android-sdk-linux/emulator/lib64/qt/plugins/platforms/libqxcb.so
-/opt/android-sdk-linux/emulator/lib64/qt/plugins/sqldrivers
-/opt/android-sdk-linux/emulator/lib64/qt/plugins/sqldrivers/libqsqlite.so
+/opt/android-sdk-linux/emulator/lib64/vulkan
+/opt/android-sdk-linux/emulator/lib64/vulkan/glslangValidator
+/opt/android-sdk-linux/emulator/lib64/vulkan/libvk_swiftshader.so
+/opt/android-sdk-linux/emulator/lib64/vulkan/libvulkan.so
+/opt/android-sdk-linux/emulator/lib64/vulkan/libvulkan.so.1
+/opt/android-sdk-linux/emulator/lib64/vulkan/shaders
+/opt/android-sdk-linux/emulator/lib64/vulkan/shaders/EacR11Snorm_2DArray.spv
+/opt/android-sdk-linux/emulator/lib64/vulkan/shaders/EacR11Snorm_3D.spv
+/opt/android-sdk-linux/emulator/lib64/vulkan/shaders/EacR11Unorm_2DArray.spv
+/opt/android-sdk-linux/emulator/lib64/vulkan/shaders/EacR11Unorm_3D.spv
+/opt/android-sdk-linux/emulator/lib64/vulkan/shaders/EacRG11Snorm_2DArray.spv
+/opt/android-sdk-linux/emulator/lib64/vulkan/shaders/EacRG11Snorm_3D.spv
+/opt/android-sdk-linux/emulator/lib64/vulkan/shaders/EacRG11Unorm_2DArray.spv
+/opt/android-sdk-linux/emulator/lib64/vulkan/shaders/EacRG11Unorm_3D.spv
+/opt/android-sdk-linux/emulator/lib64/vulkan/shaders/Etc2RGB8_2DArray.spv
+/opt/android-sdk-linux/emulator/lib64/vulkan/shaders/Etc2RGB8_3D.spv
+/opt/android-sdk-linux/emulator/lib64/vulkan/shaders/Etc2RGBA8_2DArray.spv
+/opt/android-sdk-linux/emulator/lib64/vulkan/shaders/Etc2RGBA8_3D.spv
+/opt/android-sdk-linux/emulator/lib64/vulkan/vk_swiftshader_icd.json
 /opt/android-sdk-linux/emulator/mksdcard
 /opt/android-sdk-linux/emulator/package.xml
 /opt/android-sdk-linux/emulator/qemu
@@ -599,9 +557,7 @@
 /opt/android-sdk-linux/emulator/qemu/linux-x86_64/qemu-system-aarch64
 /opt/android-sdk-linux/emulator/qemu/linux-x86_64/qemu-system-aarch64-headless
 /opt/android-sdk-linux/emulator/qemu/linux-x86_64/qemu-system-armel
-/opt/android-sdk-linux/emulator/qemu/linux-x86_64/qemu-system-armel-headless
 /opt/android-sdk-linux/emulator/qemu/linux-x86_64/qemu-system-i386
-/opt/android-sdk-linux/emulator/qemu/linux-x86_64/qemu-system-i386-headless
 /opt/android-sdk-linux/emulator/qemu/linux-x86_64/qemu-system-x86_64
 /opt/android-sdk-linux/emulator/qemu/linux-x86_64/qemu-system-x86_64-headless
 /opt/android-sdk-linux/emulator/resources
@@ -610,6 +566,16 @@
 /opt/android-sdk-linux/emulator/resources/Toren1BD.posters
 /opt/android-sdk-linux/emulator/resources/Toren1BD_Decor.png
 /opt/android-sdk-linux/emulator/resources/Toren1BD_Main.png
+/opt/android-sdk-linux/emulator/resources/macroPreviews
+/opt/android-sdk-linux/emulator/resources/macroPreviews/Reset_position.mp4
+/opt/android-sdk-linux/emulator/resources/macroPreviews/Track_horizontal_plane.mp4
+/opt/android-sdk-linux/emulator/resources/macroPreviews/Track_vertical_plane.mp4
+/opt/android-sdk-linux/emulator/resources/macroPreviews/Walk_to_image_room.mp4
+/opt/android-sdk-linux/emulator/resources/macros
+/opt/android-sdk-linux/emulator/resources/macros/Reset_position
+/opt/android-sdk-linux/emulator/resources/macros/Track_horizontal_plane
+/opt/android-sdk-linux/emulator/resources/macros/Track_vertical_plane
+/opt/android-sdk-linux/emulator/resources/macros/Walk_to_image_room
 /opt/android-sdk-linux/emulator/resources/poster.png
 /opt/android-sdk-linux/emulator/source.properties
 /opt/android-sdk-linux/extras
jin commented 5 years ago

ugh, definitely looks like the there was an upstream change to the emulator files. I'll look into this. Thank you for the diff!

jin commented 5 years ago

https://github.com/bazelbuild/bazel/issues/7499#issuecomment-491066987

cc @meteorcloudy for downstream projects

meteorcloudy commented 5 years ago

Do we need to cherry-pick this for 0.25?

jin commented 5 years ago

This affects all Bazel versions, so it should be backported as much as possible.

jin commented 5 years ago

This is now fixed on CI: https://buildkite.com/bazel/rules-jvm-external-examples/builds/274#2190a88b-4283-4a82-b132-8cd8c1d38aad

Thanks all for helping out!

meteorcloudy commented 5 years ago

\o/ Thank yoU!