cloudquery / cloudquery

The open source high performance ELT framework powered by Apache Arrow
https://cloudquery.io
Mozilla Public License 2.0
5.86k stars 513 forks source link

bug: OCI db_systems are missing #19028

Open MohamedMSaeed opened 2 months ago

MohamedMSaeed commented 2 months ago

Is there an existing issue for this?

Current Behavior

I enabled oracledatabase* tables but I can't find the DBs from OCI listed in any table. All are empty.

Expected Behavior

Get all of DBs scraped from OCI.

When I run the following command I can get the list.

oci mysql db-system list --compartment-id ${COMPARTMENT_ID} --region ${REGION} --all

CloudQuery (redacted) config

kind: source
spec:
  name: "oracle"
  path: cloudquery/oracle
  registry: cloudquery
  version: "v7.2.4"
  destinations: ["postgres-devops-port-forward"]
  tables:
    - "oracle_database_*"
  # Learn more about the configuration options at https://cql.ink/oracle_source
  spec:
    # Optional parameters
    # concurrency: 10000

Steps To Reproduce

No response

CloudQuery (redacted) logs

will be provided separately

CloudQuery version

cloudquery version 6.2.0

Additional Context

No response

Pull request (optional)

MohamedMSaeed commented 2 months ago

Logs: cloudquery.log

bbernays commented 1 month ago

These DBs are missing because we don't support any of the resources from the mysql service. Which we need to add support for!

MohamedMSaeed commented 1 month ago

@bbernays Thank you for the clarification. I'm hoping that you'll be able to add it soon.