search

clariusdev / solum

APIs for OEMs to Create Standalone Applications
https://www.clarius.com
BSD 3-Clause "New" or "Revised" License
16 stars 10 forks source link

Ultrasound image stream not displaying Android Example #29

Closed SeeDeePee closed 1 year ago

SeeDeePee commented 1 year ago

Describe the bug When running the solum android example on an external Samsung android device the ultrasound image stream does not display inside the ImageView widget. All the Toast prompts indicate that the probe is in an imaging state and the probe's temperature does increase which would also indicate an imaging state. The image view's default image does not change.

To Reproduce Steps to reproduce the behavior:

  1. Fetch the Clarius certificate and place inside the appropriate project java file
  2. Run the solum android example inside android studio with an external android device connected
  3. Follow the UI to: Scan for probe, select probe, auto join wifi, connect to probe, load application, toggle run to true

Environment:

Android Studio Terminal Output

04/12 09:16:25: Launching 'app' on samsung SM-T505N. Install successfully finished in 14 s 800 ms. $ adb shell am start -n "me.clarius.sdk.solum.example/me.clarius.sdk.solum.example.MainActivity" -a android.intent.action.MAIN -c android.intent.category.LAUNCHER Connected to process 30296 on device 'samsung-sm_t505n-R9WR501LEBJ'. Capturing and displaying logcat messages from application. This behavior can be disabled in the "Logcat output" section of the "Debugger" settings page. D/ActivityThread: handleBindApplication()++ app=me.clarius.sdk.solum.example D/CompatibilityChangeReporter: Compat change id reported: 171979766; UID 10288; state: ENABLED V/GraphicsEnvironment: ANGLE Developer option for 'me.clarius.sdk.solum.example' set to: 'default' V/GraphicsEnvironment: Neither updatable production driver nor prerelease driver is supported. D/LoadedApk: LoadedApk::makeApplication() appContext.mOpPackageName=me.clarius.sdk.solum.example appContext.mBasePackageName=me.clarius.sdk.solum.example D/NetworkSecurityConfig: No Network Security Config specified, using platform default D/NetworkSecurityConfig: No Network Security Config specified, using platform default D/ActivityThread: handleBindApplication() -- D/OpenGLRenderer: RenderThread::requireGlContext() I/AdrenoGLES-0: QUALCOMM build : 5eaa426211, I07ee46fc66 Build Date : 10/08/21 OpenGL ES Shader Compiler Version: EV031.32.02.16 Local Branch : Remote Branch : Remote Branch : Reconstruct Branch : I/AdrenoGLES-0: Build Config : S P 10.0.7 AArch64 I/AdrenoGLES-0: Driver Path : /vendor/lib64/egl/libGLESv2_adreno.so I/AdrenoGLES-0: PFP: 0x016ee197, ME: 0x00000000 D/AppCompatDelegate: Checking for metadata for AppLocalesMetadataHolderService : Service not found D/OpenGLRenderer: RenderThread::setGrContext() D/CompatibilityChangeReporter: Compat change id reported: 171228096; UID 10288; state: ENABLED W/k.solum.exampl: Accessing hidden method Landroid/view/View;->computeFitSystemWindows(Landroid/graphics/Rect;Landroid/graphics/Rect;)Z (unsupported, reflection, allowed) I/QtCore: Start I/Solum: Start D/qt.core.plugin.loader: : Trying... "/data/app/~~CK00dBR99h_5R-e_Lzw4FQ==/me.clarius.sdk.solum.example-CyfALdOGpYNb8Kvj-kVeMw==/lib/arm64/libplugins_imageformats_qjpeg" D/qt.core.plugin.loader: : Trying... "/data/app/~~CK00dBR99h_5R-e_Lzw4FQ==/me.clarius.sdk.solum.example-CyfALdOGpYNb8Kvj-kVeMw==/lib/arm64/plugins_imageformats_qjpeg" D/qt.core.plugin.loader: : Trying... "/data/app/~~CK00dBR99h_5R-e_Lzw4FQ==/me.clarius.sdk.solum.example-CyfALdOGpYNb8Kvj-kVeMw==/lib/arm64/libplugins_imageformats_qjpeg.so" D/qt.core.plugin.loader: : Trying... "/data/app/~~CK00dBR99h_5R-e_Lzw4FQ==/me.clarius.sdk.solum.example-CyfALdOGpYNb8Kvj-kVeMw==/lib/arm64/plugins_imageformats_qjpeg.so" D/qt.core.plugin.loader: : Trying... "/data/app/~~CK00dBR99h_5R-e_Lzw4FQ==/me.clarius.sdk.solum.example-CyfALdOGpYNb8Kvj-kVeMw==/lib/arm64/libplugins_imageformats_qjpeg_arm64-v8a.so" D/qt.core.plugin.loader: : Found metadata in lib /data/app/~~CK00dBR99h_5R-e_Lzw4FQ==/me.clarius.sdk.solum.example-CyfALdOGpYNb8Kvj-kVeMw==/lib/arm64/libplugins_imageformats_qjpeg_arm64-v8a.so, metadata= { "IID": "org.qt-project.Qt.QImageIOHandlerFactoryInterface", "MetaData": { "Keys": [ "jpg", "jpeg" ], "MimeTypes": [ "image/jpeg", "image/jpeg" ] }, "archlevel": 0, "className": "QJpegPlugin", "debug": false, "version": 393984 } I/Solum: Create W/ClariusConfig: Trying to access property 'clariusProbeSSID' which is missing from file 'local.properties'. W/ClariusConfig: Trying to access property 'clariusProbePassphrase' which is missing from file 'local.properties'. W/ClariusConfig: Trying to access property 'clariusProbeMacAddress' which is missing from file 'local.properties'. I/DecorView: [INFO] isPopOver=false, config=true I/DecorView: updateCaptionType >> DecorView@8d398c[], isFloating=false, isApplication=true, hasWindowControllerCallback=true, hasWindowDecorCaption=false D/DecorView: setCaptionType = 0, this = DecorView@8d398c[] I/DecorView: getCurrentDensityDpi: from real metrics. densityDpi=240 msg=resources_loaded W/k.solum.exampl: Accessing hidden method Landroid/view/ViewGroup;->makeOptionalFitsSystemWindows()V (unsupported, reflection, allowed) I/ViewRootImpl@b387cd8[MainActivity]: setView = com.android.internal.policy.DecorView@8d398c TM=true I/Choreographer: Skipped 79 frames! The application may be doing too much work on its main thread. I/ViewRootImpl@b387cd8[MainActivity]: Relayout returned: old=(0,0,2000,1200) new=(0,0,2000,1200) req=(2000,1200)0 dur=42 res=0x7 s={true -5476376635742523392} ch=true fn=-1 D/hw-ProcessState: Binder ioctl to enable oneway spam detection failed: Invalid argument D/OpenGLRenderer: eglCreateWindowSurface I/ViewRootImpl@b387cd8[MainActivity]: [DP] dp(1) 1 android.view.ViewRootImpl.reportNextDraw:11410 android.view.ViewRootImpl.performTraversals:4185 android.view.ViewRootImpl.doTraversal:2911 D/ViewRootImpl@b387cd8[MainActivity]: Creating frameDrawingCallback nextDrawUseBlastSync=false reportNextDraw=true hasBlurUpdates=false D/ViewRootImpl@b387cd8[MainActivity]: Creating frameCompleteCallback D/ViewRootImpl@b387cd8[MainActivity]: Received frameDrawingCallback frameNum=1. Creating transactionCompleteCallback=false D/ViewRootImpl@b387cd8[MainActivity]: Received frameCompleteCallback lastAcquiredFrameNum=1 lastAttemptedDrawFrameNum=1 I/ViewRootImpl@b387cd8[MainActivity]: [DP] pdf(0) 1 android.view.ViewRootImpl.lambda$addFrameCompleteCallbackIfNeeded$3$ViewRootImpl:4987 android.view.ViewRootImpl$$ExternalSyntheticLambda16.run:6 android.os.Handler.handleCallback:938 I/ViewRootImpl@b387cd8[MainActivity]: [DP] rdf() D/ViewRootImpl@b387cd8[MainActivity]: reportDrawFinished (fn: -1) D/Solum: Initialization result: true D/Solum: Retrieved FW version: 10.2.0-477+694cae9e6b I/Choreographer: Skipped 31 frames! The application may be doing too much work on its main thread. I/OpenGLRenderer: Davey! duration=1875ms; Flags=1, FrameTimelineVsyncId=2190512, IntendedVsync=240944233249160, Vsync=240945549915774, InputEventId=0, HandleInputStart=240945553907095, AnimationStart=240945553914334, PerformTraversalsStart=240945554126730, DrawStart=240945862562303, FrameDeadline=240944249915826, FrameInterval=240945553676261, FrameStartTime=16666666, SyncQueued=240945952032459, SyncStart=240945952145324, IssueDrawCommandsStart=240945952661261, SwapBuffers=240946102001053, FrameCompleted=240946109213188, DequeueBufferDuration=3974844, QueueBufferDuration=1170729, GpuCompleted=240946109213188, SwapBuffersCompleted=240946104266678, DisplayPresentTime=0, D/InsetsSourceConsumer: ensureControlAlpha: for ITYPE_NAVIGATION_BAR on me.clarius.sdk.solum.example/me.clarius.sdk.solum.example.MainActivity D/InsetsSourceConsumer: ensureControlAlpha: for ITYPE_STATUS_BAR on me.clarius.sdk.solum.example/me.clarius.sdk.solum.example.MainActivity D/CompatibilityChangeReporter: Compat change id reported: 147798919; UID 10288; state: ENABLED V/Toast: show: caller = me.clarius.sdk.solum.example.FirstFragment.lambda$showMessage$26$me-clarius-sdk-solum-example-FirstFragment:321 V/Toast: show: focusDisplayId = 0, isFocusInDesktop = false mCustomDisplayId=-1 isDexDualMode=false V/Toast: show: isActivityContext = true I/ViewRootImpl@b387cd8[MainActivity]: MSG_WINDOW_FOCUS_CHANGED 1 1 D/InputMethodManager: startInputInner - Id : 0 I/InputMethodManager: startInputInner - mService.startInputOrWindowGainedFocus D/InputMethodManager: startInputInner - Id : 0 D/ProfileInstaller: Installing profile for me.clarius.sdk.solum.example I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 I/k.solum.exampl: Compiler allocated 4163KB to compile void android.widget.TextView.(android.content.Context, android.util.AttributeSet, int, int) I/Solum: Release I/ViewRootImpl@b387cd8[MainActivity]: Relayout returned: old=(0,0,2000,1200) new=(0,0,2000,1200) req=(2000,1200)0 dur=9 res=0x1 s={true -5476376635742523392} ch=false fn=28 D/BLE(scan): Creating bluetooth scan service I/BluetoothAdapter: BluetoothAdapter() : me.clarius.sdk.solum.example I/BluetoothAdapter: STATE_ON D/BLE(gatt): Creating bluetooth gatt service I/BluetoothAdapter: BluetoothAdapter() : me.clarius.sdk.solum.example I/BluetoothAdapter: STATE_ON I/BluetoothAdapter: STATE_ON I/BluetoothAdapter: STATE_ON D/BluetoothLeScanner: Start Scan with callback D/BluetoothLeScanner: onScannerRegistered() - status=0 scannerId=10 mScannerId=0 D/BLE(scan): Scan started I/BLE(scan): Found clarius probe: CUS-L15HD**A0175 with address: F8:33:31:32:87:92 D/BLE: Manufacturer data: batt: 100% temp: 0 avail: AVAILABLE listen: DISABLED charging: NONE on: false I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 I/BLE(gatt): Connecting to probe: CUS-L15HD**A0175 I/BluetoothAdapter: STATE_ON D/BluetoothGatt: connect() - device: F8:33:31:32:87:92, auto: false I/BluetoothAdapter: isSecureModeEnabled D/BluetoothGatt: registerApp() D/BluetoothGatt: registerApp() - UUID=f779f06c-2929-48da-8b2c-4545f60f1e2a D/BluetoothGatt: onClientRegistered() - status=0 clientIf=11 D/BluetoothGatt: onClientConnectionState() - status=0 clientIf=11 device=F8:33:31:32:87:92 D/BLE(gatt): Connected to probe CUS-L15HD**A0175 D/BluetoothGatt: discoverServices() - device: F8:33:31:32:87:92 D/BluetoothGatt: onConnectionUpdated() - Device=F8:33:31:32:87:92 interval=6 latency=0 timeout=500 status=0 D/BluetoothGatt: onSearchComplete() = Device=F8:33:31:32:87:92 Status=0 D/BLE(gatt): Probe services discovered D/BluetoothGatt: configureMTU() - device: F8:33:31:32:87:92 mtu: 256 D/BluetoothGatt: onConfigureMTU() - Device=F8:33:31:32:87:92 mtu=256 status=0 D/BluetoothGatt: onConnectionUpdated() - Device=F8:33:31:32:87:92 interval=36 latency=0 timeout=500 status=0 D/BluetoothGatt: setCharacteristicNotification() - uuid: 8c853b6a-2297-44c1-8277-73627c8d2abd enable: true D/BluetoothGatt: setCharacteristicNotification() - uuid: f9eb3fae-947a-4e5b-ab7c-c799e91ed781 enable: true I/BLE(gatt): Probe wifi changed: null I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 D/BLE(gatt): Powering on probe: CUS-L15HD**A0175 I/BLE(gatt): Probe power changed: true D/BLE(scan): Scan finished, found 1 probe(s) I/BluetoothAdapter: STATE_ON D/BluetoothLeScanner: Stop Scan with callback I/BLE(gatt): Probe wifi changed: SSID: DIRECT-L15HD**A0175 passphrase: YqIi@OA3 IP: 192.168.1.1 TCP port: 46661 Mac: f8:33:31:32:87:93 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 D/BLE: Selecting probe serial: L15HD**A0175 I/Solum: Create W/ClariusConfig: Trying to access property 'clariusProbeSSID' which is missing from file 'local.properties'. W/ClariusConfig: Trying to access property 'clariusProbePassphrase' which is missing from file 'local.properties'. W/ClariusConfig: Trying to access property 'clariusProbeMacAddress' which is missing from file 'local.properties'. D/Solum: Received bluetooth info I/ViewRootImpl@b387cd8[MainActivity]: Relayout returned: old=(0,0,2000,1200) new=(0,0,2000,1200) req=(2000,1200)0 dur=13 res=0x1 s={true -5476376635742523392} ch=false fn=164 D/Solum: Initialization result: true D/Solum: Retrieved FW version: 10.2.0-477+694cae9e6b I/OpenGLRenderer: Davey! duration=749ms; Flags=0, FrameTimelineVsyncId=2191093, IntendedVsync=240986917357330, Vsync=240987384023978, InputEventId=0, HandleInputStart=240987389399579, AnimationStart=240987389402652, PerformTraversalsStart=240987389878850, DrawStart=240987612561506, FrameDeadline=240986934023996, FrameInterval=240987389389683, FrameStartTime=16666666, SyncQueued=240987663179266, SyncStart=240987663241818, IssueDrawCommandsStart=240987663629006, SwapBuffers=240987665813589, FrameCompleted=240987667308381, DequeueBufferDuration=21771, QueueBufferDuration=993594, GpuCompleted=240987667308381, SwapBuffersCompleted=240987667308381, DisplayPresentTime=0, V/Toast: show: caller = me.clarius.sdk.solum.example.FirstFragment.lambda$showMessage$26$me-clarius-sdk-solum-example-FirstFragment:321 V/Toast: show: focusDisplayId = 0, isFocusInDesktop = false mCustomDisplayId=-1 isDexDualMode=false V/Toast: show: isActivityContext = true I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 D/Solum: Auto-joining Wi-Fi DIRECT-L15HD**A0175 I/SolumAutoJoin: Requesting connection to network: DIRECT-L15HD**A0175 D/ConnectivityManager: StackLog: [android.net.ConnectivityManager.sendRequestForNetwork(ConnectivityManager.java:4191)] [android.net.ConnectivityManager.sendRequestForNetwork(ConnectivityManager.java:4233)] [android.net.ConnectivityManager.requestNetwork(ConnectivityManager.java:4371)] [android.net.ConnectivityManager.requestNetwork(ConnectivityManager.java:4349)] [me.clarius.sdk.solum.example.WifiAutoJoin.join(WifiAutoJoin.java:46)] [me.clarius.sdk.solum.example.FirstFragment.doWifiAutoJoin(FirstFragment.java:305)] [me.clarius.sdk.solum.example.FirstFragment.lambda$onViewCreated$12$me-clarius-sdk-solum-example-FirstFragment(FirstFragment.java:174)] [me.clarius.sdk.solum.example.FirstFragment$$ExternalSyntheticLambda6.onClick(Unknown Source:2)] [android.view.View.performClick(View.java:7792)] [android.widget.TextView.performClick(TextView.java:16112)] [com.google.android.material.button.MaterialButton.performClick(MaterialButton.java:1202)] [android.view.View.performClickInternal(View.java:7769)] [android.view.View.access$3800(View.java:910)] [android.view.View$PerformClick.run(View.java:30218)] V/Toast: show: caller = me.clarius.sdk.solum.example.FirstFragment.lambda$showMessage$26$me-clarius-sdk-solum-example-FirstFragment:321 V/Toast: show: focusDisplayId = 0, isFocusInDesktop = false mCustomDisplayId=-1 isDexDualMode=false V/Toast: show: isActivityContext = true I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/k.solum.exampl: Compiler allocated 4546KB to compile void android.view.ViewRootImpl.performTraversals() I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 I/SolumAutoJoin: Successfully connected to network: DIRECT-L15HD**A0175 with network ID: 574636347405 D/Solum: Joined Wi-Fi DIRECT-L15HD**A0175 V/Toast: show: caller = me.clarius.sdk.solum.example.FirstFragment.lambda$showMessage$26$me-clarius-sdk-solum-example-FirstFragment:321 V/Toast: show: focusDisplayId = 0, isFocusInDesktop = false mCustomDisplayId=-1 isDexDualMode=false V/Toast: show: isActivityContext = true D/SolumAutoJoin: Network DIRECT-L15HD**A0175 capabilities changed to [ Transports: WIFI Capabilities: NOT_METERED&NOT_RESTRICTED&TRUSTED&NOT_VPN&NOT_ROAMING&FOREGROUND&NOT_CONGESTED&NOT_SUSPENDED&NOT_VCN_MANAGED LinkUpBandwidth>=12000Kbps LinkDnBandwidth>=60000Kbps TransportInfo: <SSID: , BSSID: 02:00:00:00:00:00, MAC: 02:00:00:00:00:00, Security type: 2, Supplicant state: COMPLETED, Wi-Fi standard: 1, RSSI: -63, Link speed: 24Mbps, Tx Link speed: 24Mbps, Max Supported Tx Link speed: 54Mbps, Rx Link speed: 24Mbps, Max Supported Rx Link speed: 54Mbps, Frequency: 5240MHz, Net ID: -1, Metered hint: false, score: 0, CarrierMerged: false, SubscriptionId: -1, IsPrimary: -1> SignalStrength: -63 RequestorUid: 10288 RequestorPkg: me.clarius.sdk.solum.example UnderlyingNetworks: Null] D/SolumAutoJoin: Network DIRECT-L15HD052102A0175 capabilities changed to [ Transports: WIFI Capabilities: NOT_METERED&NOT_RESTRICTED&TRUSTED&NOT_VPN&VALIDATED&NOT_ROAMING&FOREGROUND&NOT_CONGESTED&NOT_SUSPENDED&NOT_VCN_MANAGED LinkUpBandwidth>=12000Kbps LinkDnBandwidth>=60000Kbps TransportInfo: <SSID: , BSSID: 02:00:00:00:00:00, MAC: 02:00:00:00:00:00, Security type: 2, Supplicant state: COMPLETED, Wi-Fi standard: 1, RSSI: -63, Link speed: 24Mbps, Tx Link speed: 24Mbps, Max Supported Tx Link speed: 54Mbps, Rx Link speed: 24Mbps, Max Supported Rx Link speed: 54Mbps, Frequency: 5240MHz, Net ID: -1, Metered hint: false, score: 0, CarrierMerged: false, SubscriptionId: -1, IsPrimary: -1> SignalStrength: -63 RequestorUid: 10288 RequestorPkg: me.clarius.sdk.solum.example UnderlyingNetworks: Null] D/CompatibilityChangeReporter: Compat change id reported: 163400105; UID 10288; state: ENABLED I/AssistStructure: Flattened final assist data: 7520 bytes, containing 1 windows, 52 views D/SolumAutoJoin: Network DIRECT-L15HD**A0175 capabilities changed to [ Transports: WIFI Capabilities: NOT_METERED&NOT_RESTRICTED&TRUSTED&NOT_VPN&VALIDATED&NOT_ROAMING&FOREGROUND&NOT_CONGESTED&NOT_SUSPENDED&NOT_VCN_MANAGED LinkUpBandwidth>=12000Kbps LinkDnBandwidth>=60000Kbps TransportInfo: <SSID: , BSSID: 02:00:00:00:00:00, MAC: 02:00:00:00:00:00, Security type: 2, Supplicant state: COMPLETED, Wi-Fi standard: 1, RSSI: -64, Link speed: 36Mbps, Tx Link speed: 36Mbps, Max Supported Tx Link speed: 54Mbps, Rx Link speed: 24Mbps, Max Supported Rx Link speed: 54Mbps, Frequency: 5240MHz, Net ID: -1, Metered hint: false, score: 0, CarrierMerged: false, SubscriptionId: -1, IsPrimary: -1> SignalStrength: -64 RequestorUid: 10288 RequestorPkg: me.clarius.sdk.solum.example UnderlyingNetworks: Null] I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 D/Solum: Connecting to 192.168.1.1:46661 V/Toast: show: caller = me.clarius.sdk.solum.example.FirstFragment.lambda$showMessage$26$me-clarius-sdk-solum-example-FirstFragment:321 V/Toast: show: focusDisplayId = 0, isFocusInDesktop = false mCustomDisplayId=-1 isDexDualMode=false V/Toast: show: isActivityContext = true D/Solum: Connection result: ProbeConnected, port: 43111, status: connected D/Solum: Connected V/Toast: show: caller = me.clarius.sdk.solum.example.FirstFragment.lambda$showMessage$26$me-clarius-sdk-solum-example-FirstFragment:321 V/Toast: show: focusDisplayId = 0, isFocusInDesktop = false mCustomDisplayId=-1 isDexDualMode=false V/Toast: show: isActivityContext = true D/Solum: Days valid for cert: 85 V/Toast: show: caller = me.clarius.sdk.solum.example.FirstFragment.lambda$showMessage$26$me-clarius-sdk-solum-example-FirstFragment:321 V/Toast: show: focusDisplayId = 0, isFocusInDesktop = false mCustomDisplayId=-1 isDexDualMode=false V/Toast: show: isActivityContext = true I/BLE(gatt): Probe wifi changed: SSID: DIRECT-L15HD**A0175 passphrase: YqIi@OA3 IP: 192.168.1.1 TCP port: 46661 Mac: f8:33:31:32:87:93 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: setView = android.widget.PopupWindow$PopupDecorView@79396fd TM=true I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: Resizing android.view.ViewRootImpl@e533643: frame=[153,521][1904,1128] reportDraw=true forceLayout=false backDropFrame=Rect(0, 0 - 1751, 607) D/InsetsSourceConsumer: ensureControlAlpha: for ITYPE_NAVIGATION_BAR on PopupWindow:3cbbfc1 D/InsetsSourceConsumer: ensureControlAlpha: for ITYPE_STATUS_BAR on PopupWindow:3cbbfc1 I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: Relayout returned: old=(0,36,2000,1128) new=(153,521,1904,1128) req=(1751,607)0 dur=26 res=0x7 s={true -5476376635742142464} ch=true fn=-1 D/OpenGLRenderer: eglCreateWindowSurface D/AbsListView: in onLayout changed I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: [DP] dp(1) 0 android.view.ViewRootImpl.reportNextDraw:11410 android.view.ViewRootImpl.performTraversals:4185 android.view.ViewRootImpl.doTraversal:2911 D/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: Creating frameDrawingCallback nextDrawUseBlastSync=false reportNextDraw=true hasBlurUpdates=false D/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: Creating frameCompleteCallback D/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: Received frameDrawingCallback frameNum=1. Creating transactionCompleteCallback=false D/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: Received frameCompleteCallback lastAcquiredFrameNum=1 lastAttemptedDrawFrameNum=1 I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: [DP] pdf(0) 0 android.view.ViewRootImpl.lambda$addFrameCompleteCallbackIfNeeded$3$ViewRootImpl:4987 android.view.ViewRootImpl$$ExternalSyntheticLambda16.run:6 android.os.Handler.handleCallback:938 I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: [DP] rdf() D/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: reportDrawFinished (fn: -1) I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: handleResized, msg = 5 frames=ClientWindowFrames{frame=[153,521][1904,1128] display=[-10000,-10000][10000,10000] backdrop=[0,0][1751,607]} forceNextWindowRelayout=false displayId=0 frameChanged=false backdropFrameChanged=true configChanged=false displayChanged=false mNextDrawUseBlastSync=false mergedConfiguration={mGlobalConfig={1.0 ?mcc?mnc [en_ZA] ldltr sw800dp w1333dp h728dp 240dpi xlrg land finger -keyb/v/h -nav/h winConfig={ mBounds=Rect(0, 0 - 2000, 1200) mAppBounds=Rect(0, 0 - 2000, 1128) mMaxBounds=Rect(0, 0 - 2000, 1200) mWindowingMode=fullscreen mDisplayWindowingMode=fullscreen mActivityType=undefined mAlwaysOnTop=undefined mRotation=ROTATION_90 mPopOver=off mFreeformTaskPinningState=unpinned} s.873 fontWeightAdjustment=0 ff=0 bf=0 bts=0 enb/d themeSeq=0} mOverrideConfig={1.0 ?mcc?mnc [en_ZA] ldltr sw800dp w1333dp h728dp 240dpi xlrg land finger -keyb/v/h -nav/h winConfig={ mBounds=Rect(0, 0 - 2000, 1200) mAppBounds=Rect(0, 0 - 2000, 1128) mMaxBounds=Rect(0, 0 - 2000, 1200) mWindowingMode=fullscreen mDisplayWindowingMode=fullscreen mActivityType=standard mAlwaysOnTop=undefined mRotation=ROTATION_90 mPopOver=off mFreeformTaskPinningState=unpinned} s.1 fontWeightAdjustment=0 ff=0 bf=0 bts=0 enb/d themeSeq=0}} I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: [DP] dp(1) 0 android.view.ViewRootImpl.reportNextDraw:11410 android.view.ViewRootImpl.handleResized:2222 android.view.ViewRootImpl.access$1200:294 I/ViewRootImpl@b387cd8[MainActivity]: MSG_WINDOW_FOCUS_CHANGED 0 1 D/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: Creating frameDrawingCallback nextDrawUseBlastSync=false reportNextDraw=true hasBlurUpdates=false D/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: Creating frameCompleteCallback D/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: Received frameDrawingCallback frameNum=2. Creating transactionCompleteCallback=false D/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: Received frameCompleteCallback lastAcquiredFrameNum=2 lastAttemptedDrawFrameNum=2 I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: [DP] pdf(0) 0 android.view.ViewRootImpl.lambda$addFrameCompleteCallbackIfNeeded$3$ViewRootImpl:4987 android.view.ViewRootImpl$$ExternalSyntheticLambda16.run:6 android.os.Handler.handleCallback:938 I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: [DP] rdf() D/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: reportDrawFinished (fn: -1) I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: MSG_WINDOW_FOCUS_CHANGED 1 1 I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: ViewPostIme pointer 0 D/AbsListView: reportScrollStateChange() newState : 1 I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: ViewPostIme pointer 1 D/AbsListView: onTouchUp() mTouchMode : 3 D/AbsListView: reportScrollStateChange() newState : 0 I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: ViewPostIme pointer 0 I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: ViewPostIme pointer 1 D/AbsListView: onTouchUp() mTouchMode : 0 I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: Relayout returned: old=(153,521,1904,1128) new=(153,521,1904,1128) req=(1751,607)0 dur=23 res=0x1 s={true -5476376635742142464} ch=false fn=70 D/InsetsSourceConsumer: ensureControlAlpha: for ITYPE_NAVIGATION_BAR on me.clarius.sdk.solum.example/me.clarius.sdk.solum.example.MainActivity D/InsetsSourceConsumer: ensureControlAlpha: for ITYPE_STATUS_BAR on me.clarius.sdk.solum.example/me.clarius.sdk.solum.example.MainActivity I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: MSG_WINDOW_FOCUS_CHANGED 0 1 I/ViewRootImpl@b387cd8[MainActivity]: MSG_WINDOW_FOCUS_CHANGED 1 1 D/InputMethodManager: startInputInner - Id : 0 I/InputMethodManager: startInputInner - mService.startInputOrWindowGainedFocus D/OpenGLRenderer: setSurface called with nullptr D/OpenGLRenderer: setSurface() destroyed EGLSurface D/OpenGLRenderer: destroyEglSurface I/ViewRootImpl@273a366[PopupWindow:3cbbfc1]: dispatchDetachedFromWindow D/InputTransport: Input channel destroyed: 'e426488', fd=114 D/SolumAutoJoin: Network DIRECT-L15HD052102A0175 capabilities changed to [ Transports: WIFI Capabilities: NOT_METERED&NOT_RESTRICTED&TRUSTED&NOT_VPN&VALIDATED&NOT_ROAMING&FOREGROUND&NOT_CONGESTED&NOT_SUSPENDED&NOT_VCN_MANAGED LinkUpBandwidth>=12000Kbps LinkDnBandwidth>=30000Kbps TransportInfo: <SSID: , BSSID: 02:00:00:00:00:00, MAC: 02:00:00:00:00:00, Security type: 2, Supplicant state: COMPLETED, Wi-Fi standard: 1, RSSI: -76, Link speed: 12Mbps, Tx Link speed: 12Mbps, Max Supported Tx Link speed: 54Mbps, Rx Link speed: 54Mbps, Max Supported Rx Link speed: 54Mbps, Frequency: 5240MHz, Net ID: -1, Metered hint: false, score: 0, CarrierMerged: false, SubscriptionId: -1, IsPrimary: -1> SignalStrength: -76 RequestorUid: 10288 RequestorPkg: me.clarius.sdk.solum.example UnderlyingNetworks: Null] I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 D/Solum: Loading application 'breast' for probe L15HD V/Toast: show: caller = me.clarius.sdk.solum.example.FirstFragment.lambda$showMessage$26$me-clarius-sdk-solum-example-FirstFragment:321 V/Toast: show: focusDisplayId = 0, isFocusInDesktop = false mCustomDisplayId=-1 isDexDualMode=false V/Toast: show: isActivityContext = true D/Solum: Imaging state: ImagingReady imaging? false V/Toast: show: caller = me.clarius.sdk.solum.example.FirstFragment.lambda$showMessage$26$me-clarius-sdk-solum-example-FirstFragment:321 V/Toast: show: focusDisplayId = 0, isFocusInDesktop = false mCustomDisplayId=-1 isDexDualMode=false V/Toast: show: isActivityContext = true D/Solum: Imaging state: ImagingReady imaging? true V/Toast: show: caller = me.clarius.sdk.solum.example.FirstFragment.lambda$showMessage$26$me-clarius-sdk-solum-example-FirstFragment:321 V/Toast: show: focusDisplayId = 0, isFocusInDesktop = false mCustomDisplayId=-1 isDexDualMode=false V/Toast: show: isActivityContext = true I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 D/SolumAutoJoin: Network DIRECT-L15HD**A0175 capabilities changed to [ Transports: WIFI Capabilities: NOT_METERED&NOT_RESTRICTED&TRUSTED&NOT_VPN&VALIDATED&NOT_ROAMING&FOREGROUND&NOT_CONGESTED&NOT_SUSPENDED&NOT_VCN_MANAGED LinkUpBandwidth>=12000Kbps LinkDnBandwidth>=60000Kbps TransportInfo: <SSID: , BSSID: 02:00:00:00:00:00, MAC: 02:00:00:00:00:00, Security type: 2, Supplicant state: COMPLETED, Wi-Fi standard: 1, RSSI: -66, Link speed: 48Mbps, Tx Link speed: 48Mbps, Max Supported Tx Link speed: 54Mbps, Rx Link speed: 54Mbps, Max Supported Rx Link speed: 54Mbps, Frequency: 5240MHz, Net ID: -1, Metered hint: false, score: 0, CarrierMerged: false, SubscriptionId: -1, IsPrimary: -1> SignalStrength: -66 RequestorUid: 10288 RequestorPkg: me.clarius.sdk.solum.example UnderlyingNetworks: Null] I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 D/Solum: Imaging state: ImagingReady imaging? true V/Toast: show: caller = me.clarius.sdk.solum.example.FirstFragment.lambda$showMessage$26$me-clarius-sdk-solum-example-FirstFragment:321 V/Toast: show: focusDisplayId = 0, isFocusInDesktop = false mCustomDisplayId=-1 isDexDualMode=false V/Toast: show: isActivityContext = true D/SolumAutoJoin: Network DIRECT-L15HD**A0175 capabilities changed to [ Transports: WIFI Capabilities: NOT_METERED&NOT_RESTRICTED&TRUSTED&NOT_VPN&VALIDATED&NOT_ROAMING&FOREGROUND&NOT_CONGESTED&NOT_SUSPENDED&NOT_VCN_MANAGED LinkUpBandwidth>=12000Kbps LinkDnBandwidth>=60000Kbps TransportInfo: <SSID: , BSSID: 02:00:00:00:00:00, MAC: 02:00:00:00:00:00, Security type: 2, Supplicant state: COMPLETED, Wi-Fi standard: 1, RSSI: -53, Link speed: 54Mbps, Tx Link speed: 54Mbps, Max Supported Tx Link speed: 54Mbps, Rx Link speed: 54Mbps, Max Supported Rx Link speed: 54Mbps, Frequency: 5240MHz, Net ID: -1, Metered hint: false, score: 0, CarrierMerged: false, SubscriptionId: -1, IsPrimary: -1> SignalStrength: -53 RequestorUid: 10288 RequestorPkg: me.clarius.sdk.solum.example UnderlyingNetworks: Null] D/qt.core.plugin.factoryloader: : checking directory path "/" ... I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 D/Solum: Toggling run to: false V/Toast: show: caller = me.clarius.sdk.solum.example.FirstFragment.lambda$showMessage$26$me-clarius-sdk-solum-example-FirstFragment:321 V/Toast: show: focusDisplayId = 0, isFocusInDesktop = false mCustomDisplayId=-1 isDexDualMode=false V/Toast: show: isActivityContext = true D/InputTransport: Input channel destroyed: 'ClientS', fd=133 D/OpenGLRenderer: setSurface called with nullptr I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 D/Solum: Toggling run to: true V/Toast: show: caller = me.clarius.sdk.solum.example.FirstFragment.lambda$showMessage$26$me-clarius-sdk-solum-example-FirstFragment:321 V/Toast: show: focusDisplayId = 0, isFocusInDesktop = false mCustomDisplayId=-1 isDexDualMode=false V/Toast: show: isActivityContext = true I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 D/Solum: Toggling run to: false V/Toast: show: caller = me.clarius.sdk.solum.example.FirstFragment.lambda$showMessage$26$me-clarius-sdk-solum-example-FirstFragment:321 V/Toast: show: focusDisplayId = 0, isFocusInDesktop = false mCustomDisplayId=-1 isDexDualMode=false V/Toast: show: isActivityContext = true I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 D/Solum: Toggling run to: true V/Toast: show: caller = me.clarius.sdk.solum.example.FirstFragment.lambda$showMessage$26$me-clarius-sdk-solum-example-FirstFragment:321 V/Toast: show: focusDisplayId = 0, isFocusInDesktop = false mCustomDisplayId=-1 isDexDualMode=false V/Toast: show: isActivityContext = true I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 0 I/ViewRootImpl@b387cd8[MainActivity]: ViewPostIme pointer 1

julien-l commented 1 year ago

If probe is imaging but images are not shown, it usually means the solum lib fails to convert the raw images to jpeg. Conversion is done with the Qt plugin plugins_imageformats_qjpeg but your the logs show the plugin is found and loaded:

D/qt.core.plugin.loader: : Found metadata in lib /data/app/~~CK00dBR99h_5R-e_Lzw4FQ==/me.clarius.sdk.solum.example-CyfALdOGpYNb8Kvj-kVeMw==/lib/arm64/libplugins_imageformats_qjpeg_arm64-v8a.so, metadata=...

I am not sure what happens, could you try to following to help isolate the issue:

  1. ensure the newProcessedImage() callback is executed, if so, it means the conversion is successful. Maybe add a print statement and check if it is printed when the probe is imaging (you can tell it is imaging when the LED is green): https://github.com/clariusdev/solum/blob/89e556a78dab95195836d0b9d2d35b8e26816f01/android/src/examples/solum_android/app/src/main/java/me/clarius/sdk/solum/example/FirstFragment.java#L84
  2. try on a different android device
shawafoncoustics commented 1 year ago

Hi @julien-l I'm facing the same issue with the new Android Example so I tried

julien-l commented 1 year ago

In both cases, I cannot see the log line "Got keys from plugin meta data QList("jpg", "jpeg")in your logs so I think the jpeg plugin is not loaded properly. For comparison, here is my log output when starting imaging, you can see that Qt finds the plugin in lineGot keys from plugin meta data QList("jpg", "jpeg")`, which is missing from your logs:

D/Solum: Toggling run to: true
D/qt.core.plugin.factoryloader: : checking directory path "/data/app/me.clarius.sdk.solum.example-iU8xtOyDHwniTlciaATA2Q==/lib/arm64" ...
D/qt.core.plugin.factoryloader: : looking at "/data/app/me.clarius.sdk.solum.example-iU8xtOyDHwniTlciaATA2Q==/lib/arm64/libplugins_imageformats_qjpeg_arm64-v8a.so"
D/qt.core.plugin.factoryloader: : Got keys from plugin meta data QList("jpg", "jpeg")
D/qt.core.plugin.factoryloader: : checking directory path "/" ...

Maybe related to https://github.com/clariusdev/solum/issues/24 (deploying from app bundle). Ensure your build.gradle file contains:

android {
   packagingOptions {
        jniLibs {
            useLegacyPackaging = true
        }
    }
}
shawafoncoustics commented 1 year ago

Hi @julien-l Just updating here about the issue, the issue wasn't related to the lib, it's because of the firstFragment was releasing solum when moving to Bluetooth fragment and when back to it it's just not working correctly again. Anyway comment solum.release() or moving it to the activity is solving it.

julien-l commented 1 year ago

I see. For your application, you should probably keep Solum in an Android service and bind/unbind when needed. In the example app, it is constantly released/re-created in order to detect issues in the native code. Thanks!