meltano / hub

The single source of truth for all Meltano plugins, including all available Singer Taps and Targets: https://hub.meltano.com
https://hub.meltano.com
50 stars 68 forks source link

chore: [Hub Bot] Refresh metadata 2024-11-11 #1893

Closed MeltyBot closed 1 week ago

MeltyBot commented 1 week ago

Updates Plugin Definitions

netlify[bot] commented 1 week ago

Deploy Preview for meltano-hub ready!

Name Link
Latest commit b06905b48968115ca9e9bf50af2080855c060881
Latest deploy log https://app.netlify.com/sites/meltano-hub/deploys/6731f9cd840a930008158f13
Deploy Preview https://deploy-preview-1893--meltano-hub.netlify.app
Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

github-actions[bot] commented 1 week ago

Testing plugin target-redshift (ticketswap variant):

Starting test job... ... Job completed.

Auto-generated README.md # `target-redshift` Target for Redshift. Built with the [Meltano Singer SDK](https://sdk.meltano.com). ## Capabilities * `about` * `stream-maps` * `schema-flattening` * `validate-records` * `target-schema` * `hard-delete` ## Supported Python Versions * 3.9 * 3.10 * 3.11 * 3.12 ## Settings | Setting | Required | Default | Description | |:--------|:--------:|:-------:|:------------| | host | False | None | Hostname for redshift instance. | | port | False | 5432 | The port on which redshift is awaiting connection. | | enable_iam_authentication | False | None | If true, use temporary credentials (https://docs.aws.amazon.com/redshift/latest/mgmt/generating-iam-credentials-cli-api.html). | | cluster_identifier | False | None | Redshift cluster identifier. Note if sqlalchemy_url is set or enable_iam_authentication is false this will be ignored. | | user | False | None | User name used to authenticate. Note if sqlalchemy_url is set this will be ignored. | | password | False | None | Password used to authenticate. Note if sqlalchemy_url is set this will be ignored. | | dbname | False | None | Database name. Note if sqlalchemy_url is set this will be ignored. | | aws_redshift_copy_role_arn | True | None | Redshift copy role arn to use for the COPY command from s3 | | s3_bucket | True | None | S3 bucket to save staging files before using COPY command | | s3_region | False | None | AWS region for S3 bucket. If not specified, region will be detected by boto config resolution. See https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html | | s3_key_prefix | False | | S3 key prefix to save staging files before using COPY command | | remove_s3_files | False | 0 | If you want to remove staging files in S3 | | temp_dir | False | temp | Where you want to store your temp data files. | | default_target_schema | False | None | Redshift schema to send data to, example: tap-clickup | | activate_version | False | 0 | If set to false, the tap will ignore activate version messages. If set to true, add_record_metadata must be set to true as well. | | hard_delete | False | 0 | When activate version is sent from a tap this specefies if we should delete the records that don't match, or mark them with a date in the `_sdc_deleted_at` column. This config option is ignored if `activate_version` is set to false. | | add_record_metadata | False | 0 | Note that this must be enabled for activate_version to work!This adds _sdc_extracted_at, _sdc_batched_at, and more to every table. See https://sdk.meltano.com/en/latest/implementation/record_metadata.html for more information. | | ssl_enable | False | 0 | Whether or not to use ssl to verify the server's identity. Use ssl_certificate_authority and ssl_mode for further customization. To use a client certificate to authenticate yourself to the server, use ssl_client_certificate_enable instead. | | ssl_mode | False | verify-full | SSL Protection method, see [redshift documentation](https://docs.aws.amazon.com/redshift/latest/mgmt/connecting-ssl-support.html for more information. Must be one of disable, allow, prefer, require, verify-ca, or verify-full. | | load_method | False | append-only | The method to use when loading data into the destination. `append-only` will always write all input records whether that records already exists or not. `upsert` will update existing records and insert new records. `overwrite` will delete all existing records and insert all input records. | | batch_size_rows | False | None | Maximum number of rows in each batch. | | validate_records | False | 1 | Whether to validate the schema of the incoming streams. | | stream_maps | False | None | Config object for stream maps capability. For more information check out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html). | | stream_map_config | False | None | User-defined config values to be used within map expressions. | | faker_config | False | None | Config for the [`Faker`](https://faker.readthedocs.io/en/master/) instance variable `fake` used within map expressions. Only applicable if the plugin specifies `faker` as an addtional dependency (through the `singer-sdk` `faker` extra or directly). | | faker_config.seed | False | None | Value to seed the Faker generator for deterministic output: https://faker.readthedocs.io/en/master/#seeding-the-generator | | faker_config.locale | False | None | One or more LCID locale strings to produce localized output for: https://faker.readthedocs.io/en/master/#localization | | flattening_enabled | False | None | 'True' to enable schema flattening and automatically expand nested properties. | | flattening_max_depth | False | None | The max depth to flatten schemas. | A full list of supported settings and capabilities is available by running: `target-redshift --about`
Version info ``` target-redshift v0.1.0, Meltano SDK v0.41.0 ```
Usage info ``` melty-bot % target-redshift --help Usage: target-redshift [OPTIONS] Execute the Singer target. Options: --version Display the package version. --about Display package metadata and settings. --format [json|markdown] Specify output style for --about --config TEXT Configuration file location or 'ENV' to use environment variables. --input FILENAME A path to read messages from instead of from standard in. --help Show this message and exit. ```
Detected capabilities > - ❌ 'discover' > - ❌ 'catalog' > - ❌ 'properties' > - ❌ 'state' > - ✅ 'about'
JSON Metadata ```json { "name": "target-redshift", "description": "Target for Redshift.", "version": "0.1.0", "sdk_version": "0.41.0", "supported_python_versions": [ "3.9", "3.10", "3.11", "3.12" ], "capabilities": [ "about", "stream-maps", "schema-flattening", "validate-records", "target-schema", "hard-delete" ], "settings": { "type": "object", "properties": { "host": { "type": [ "string", "null" ], "description": "Hostname for redshift instance." }, "port": { "type": [ "string", "null" ], "default": "5432", "description": "The port on which redshift is awaiting connection." }, "enable_iam_authentication": { "type": [ "boolean", "null" ], "description": "If true, use temporary credentials (https://docs.aws.amazon.com/redshift/latest/mgmt/generating-iam-credentials-cli-api.html)." }, "cluster_identifier": { "type": [ "string", "null" ], "description": "Redshift cluster identifier. Note if sqlalchemy_url is set or enable_iam_authentication is false this will be ignored." }, "user": { "type": [ "string", "null" ], "description": "User name used to authenticate. Note if sqlalchemy_url is set this will be ignored." }, "password": { "type": [ "string", "null" ], "description": "Password used to authenticate. Note if sqlalchemy_url is set this will be ignored." }, "dbname": { "type": [ "string", "null" ], "description": "Database name. Note if sqlalchemy_url is set this will be ignored." }, "aws_redshift_copy_role_arn": { "type": [ "string" ], "description": "Redshift copy role arn to use for the COPY command from s3", "secret": true, "writeOnly": true }, "s3_bucket": { "type": [ "string" ], "description": "S3 bucket to save staging files before using COPY command" }, "s3_region": { "type": [ "string", "null" ], "description": "AWS region for S3 bucket. If not specified, region will be detected by boto config resolution. See https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html" }, "s3_key_prefix": { "type": [ "string", "null" ], "default": "", "description": "S3 key prefix to save staging files before using COPY command" }, "remove_s3_files": { "type": [ "boolean", "null" ], "default": false, "description": "If you want to remove staging files in S3" }, "temp_dir": { "type": [ "string", "null" ], "default": "temp", "description": "Where you want to store your temp data files." }, "default_target_schema": { "type": [ "string", "null" ], "description": "Redshift schema to send data to, example: tap-clickup" }, "activate_version": { "type": [ "boolean", "null" ], "default": false, "description": "If set to false, the tap will ignore activate version messages. If set to true, add_record_metadata must be set to true as well." }, "hard_delete": { "type": [ "boolean", "null" ], "default": false, "description": "When activate version is sent from a tap this specefies if we should delete the records that don't match, or mark them with a date in the `_sdc_deleted_at` column. This config option is ignored if `activate_version` is set to false." }, "add_record_metadata": { "type": [ "boolean", "null" ], "default": false, "description": "Note that this must be enabled for activate_version to work!This adds _sdc_extracted_at, _sdc_batched_at, and more to every table. See https://sdk.meltano.com/en/latest/implementation/record_metadata.html for more information." }, "ssl_enable": { "type": [ "boolean", "null" ], "default": false, "description": "Whether or not to use ssl to verify the server's identity. Use ssl_certificate_authority and ssl_mode for further customization. To use a client certificate to authenticate yourself to the server, use ssl_client_certificate_enable instead." }, "ssl_mode": { "type": [ "string", "null" ], "default": "verify-full", "description": "SSL Protection method, see [redshift documentation](https://docs.aws.amazon.com/redshift/latest/mgmt/connecting-ssl-support.html for more information. Must be one of disable, allow, prefer, require, verify-ca, or verify-full." }, "load_method": { "type": [ "string", "null" ], "default": "append-only", "description": "The method to use when loading data into the destination. `append-only` will always write all input records whether that records already exists or not. `upsert` will update existing records and insert new records. `overwrite` will delete all existing records and insert all input records.", "enum": [ "append-only", "upsert", "overwrite" ] }, "batch_size_rows": { "type": [ "integer", "null" ], "description": "Maximum number of rows in each batch." }, "validate_records": { "type": [ "boolean", "null" ], "default": true, "description": "Whether to validate the schema of the incoming streams." }, "stream_maps": { "type": [ "object", "null" ], "properties": {}, "description": "Config object for stream maps capability. For more information check out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html)." }, "stream_map_config": { "type": [ "object", "null" ], "properties": {}, "description": "User-defined config values to be used within map expressions." }, "faker_config": { "type": [ "object", "null" ], "properties": { "seed": { "oneOf": [ { "type": [ "number" ] }, { "type": [ "string" ] }, { "type": [ "boolean" ] }, { "type": "null" } ], "description": "Value to seed the Faker generator for deterministic output: https://faker.readthedocs.io/en/master/#seeding-the-generator" }, "locale": { "oneOf": [ { "type": [ "string" ] }, { "type": "array", "items": { "type": [ "string" ] } }, { "type": "null" } ], "description": "One or more LCID locale strings to produce localized output for: https://faker.readthedocs.io/en/master/#localization" } }, "description": "Config for the [`Faker`](https://faker.readthedocs.io/en/master/) instance variable `fake` used within map expressions. Only applicable if the plugin specifies `faker` as an addtional dependency (through the `singer-sdk` `faker` extra or directly)." }, "flattening_enabled": { "type": [ "boolean", "null" ], "description": "'True' to enable schema flattening and automatically expand nested properties." }, "flattening_max_depth": { "type": [ "integer", "null" ], "description": "The max depth to flatten schemas." } }, "required": [ "aws_redshift_copy_role_arn", "s3_bucket" ] } } ```
github-actions[bot] commented 1 week ago

Testing plugin tap-totango (edsoncezar16 variant):

Starting test job... ... Job completed.

Version info ``` tap-totango v0.5.0, Meltano SDK v0.27.0 ```
Usage info ``` melty-bot % tap-totango --help Usage: tap-totango [OPTIONS] Execute the Singer tap. Options: --state PATH Use a bookmarks file for incremental replication. --catalog PATH Use a Singer catalog file with the tap. --test TEXT Use --test to sync a single record for each stream. Use --test=schema to test schema output without syncing records. --discover Run the tap in discovery mode. --config TEXT Configuration file location or 'ENV' to use environment variables. --format [json|markdown] Specify output style for --about --about Display package metadata and settings. --version Display the package version. --help Show this message and exit. ```
Detected capabilities > - ✅ 'discover' > - ✅ 'catalog' > - ✅ 'state' > - ✅ 'about'
JSON Metadata ```json { "name": "tap-totango", "description": "totango tap class.", "version": "0.5.0", "sdk_version": "0.27.0", "capabilities": [ "catalog", "state", "discover", "about", "stream-maps", "schema-flattening" ], "settings": { "type": "object", "properties": { "api_url": { "type": [ "string" ], "default": "https://api.totango.com", "description": "The url for the API services. https://api.totango.com is for US services, whereas https://api-eu1.totango.com is for EU services.", "enum": [ "https://api.totango.com", "https://api-eu1.totango.com " ] }, "auth_token": { "type": [ "string" ], "description": "The token to authenticate against the API service", "secret": true, "writeOnly": true }, "events_terms": { "type": "array", "items": { "type": "object", "properties": { "type": { "type": [ "string" ] } }, "required": [ "type" ], "additionalProperties": true }, "default": [], "description": "An array containing filter conditions to use for the events stream search.", "examples": [ [ { "type": "event_property", "name": "event_type", "eq": "note" } ], [ { "type": "or", "or": [ { "type": "event_property", "name": "event_type", "eq": "note" }, { "type": "event_property", "name": "event_type", "eq": "campaign_touch" } ] } ], [ { "type": "date", "term": "date", "joker": "yesterday" }, { "type": "or", "or": [ { "type": "event_property", "name": "event_type", "eq": "note" }, { "type": "event_property", "name": "event_type", "eq": "campaign_touch" } ] } ], [ { "type": "date", "term": "date", "gte": 1587859200000 }, { "type": "event_property", "name": "event_type", "eq": "note" } ] ] }, "events_count": { "type": [ "integer" ], "default": 1000, "description": "The maximum number of accounts to return in the events result set. The max. value for count is 1000." }, "events_offset": { "type": [ "integer" ], "default": 0, "description": "Page number (0 is the 1st-page)." }, "account_id": { "type": [ "string", "null" ], "description": "Filter the events stream results for a specific account." }, "accounts_terms": { "type": "array", "items": { "type": "object", "properties": { "type": { "type": [ "string" ] } }, "required": [ "type" ], "additionalProperties": true }, "default": [], "description": "An array containing filter conditions to use for the accounts stream search.", "examples": [ [ { "type": "string", "term": "status_group", "in_list": [ "paying" ] } ] ] }, "accounts_fields": { "type": "array", "items": { "type": "object", "properties": { "type": { "type": [ "string" ] } }, "required": [ "type" ], "additionalProperties": true }, "default": [], "description": "List of fields to return as results. Note that the account name and account-id are always returned as well.", "examples": [ [ { "type": "string", "term": "health", "field_display_name": "Health rank " }, { "type": "health_trend", "field_display_name": "Health last change " }, { "type": "string_attribute", "attribute": "Success Manager", "field_display_name": "Success Manager" } ] ] }, "accounts_count": { "type": [ "integer", "null" ], "default": 100, "description": "The maximum number of accounts to return in the accounts result set. The max. value for count is 1000." }, "accounts_offset": { "type": [ "integer", "null" ], "default": 0, "description": "Record number (0 states \"start at record 0\"). The record size can be defined using the count parameter (and limited to 1000). Tip: To page through results, ask for 1000 records (count: 1000). If you receive 1000 records, assume there\u2019s more, in which case you want to pull the next 1000 records (offset: 1000\u2026then 2000\u2026etc.). Repeat paging until the number of records returned is less than 1000." }, "accounts_sort_by": { "type": [ "string", "null" ], "default": "display_name", "description": "Field name to sort the accounts stream results set by." }, "accounts_sort_order": { "type": [ "string", "null" ], "enum": [ "ASC", "DESC" ], "default": "ASC", "description": "Order to sort the accounts stream results set by." }, "users_terms": { "type": "array", "items": { "type": "object", "properties": { "type": { "type": [ "string" ] } }, "required": [ "type" ], "additionalProperties": true }, "default": [], "description": "An array containing filter conditions to use for the users stream search.", "examples": [ [ { "type": "parent_account", "terms": [ { "type": "string", "term": "status_group", "in_list": [ "paying" ] } ] } ] ] }, "users_fields": { "type": "array", "items": { "type": "object", "properties": { "type": { "type": [ "string" ] } }, "required": [ "type" ], "additionalProperties": true }, "default": [], "description": "List of fields to return as results. Note that the user name and id along with account name and account-id are always returned as well.", "examples": [ [ { "type": "date", "term": "last_activity_time", "field_display_name": "Last activity", "desc": true }, { "type": "named_aggregation", "aggregation": "total_activities", "duration": 14, "field_display_name": "Activities (14d)" } ] ] }, "users_count": { "type": [ "integer", "null" ], "default": 1000, "description": "The maximum number of users to return in the users result set. The max. value for count is 1000." }, "users_offset": { "type": [ "integer", "null" ], "default": 0, "description": "Record number (0 states \"start at record 0\"). The record size can be defined using the count parameter (and limited to 1000). Tip: To page through results, ask for 1000 records (count: 1000). If you receive 1000 records, assume there\u2019s more, in which case you want to pull the next 1000 records (offset: 1000\u2026then 2000\u2026etc.). Repeat paging until the number of records returned is less than 1000." }, "users_sort_by": { "type": [ "string", "null" ], "default": "display_name", "description": "Field name to sort the users stream results set by." }, "users_sort_order": { "type": [ "string", "null" ], "enum": [ "ASC", "DESC" ], "default": "ASC", "description": "Order to sort the users stream results set by." }, "stream_maps": { "type": [ "object", "null" ], "properties": {}, "description": "Config object for stream maps capability. For more information check out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html)." }, "stream_map_config": { "type": [ "object", "null" ], "properties": {}, "description": "User-defined config values to be used within map expressions." }, "flattening_enabled": { "type": [ "boolean", "null" ], "description": "'True' to enable schema flattening and automatically expand nested properties." }, "flattening_max_depth": { "type": [ "integer", "null" ], "description": "The max depth to flatten schemas." } }, "required": [ "api_url", "auth_token", "events_terms", "events_count", "events_offset", "accounts_terms", "accounts_fields", "users_terms", "users_fields" ] } } ```
Discovered streams - `accounts` - `events` - `users`

Job completed.

Version info ``` tap-totango v0.5.0, Meltano SDK v0.27.0 ```
Usage info ``` melty-bot % tap-totango --help Usage: tap-totango [OPTIONS] Execute the Singer tap. Options: --state PATH Use a bookmarks file for incremental replication. --catalog PATH Use a Singer catalog file with the tap. --test TEXT Use --test to sync a single record for each stream. Use --test=schema to test schema output without syncing records. --discover Run the tap in discovery mode. --config TEXT Configuration file location or 'ENV' to use environment variables. --format [json|markdown] Specify output style for --about --about Display package metadata and settings. --version Display the package version. --help Show this message and exit. ```
Detected capabilities > - ✅ 'discover' > - ✅ 'catalog' > - ✅ 'state' > - ✅ 'about'
JSON Metadata ```json { "name": "tap-totango", "description": "totango tap class.", "version": "0.5.0", "sdk_version": "0.27.0", "capabilities": [ "catalog", "state", "discover", "about", "stream-maps", "schema-flattening" ], "settings": { "type": "object", "properties": { "api_url": { "type": [ "string" ], "default": "https://api.totango.com", "description": "The url for the API services. https://api.totango.com is for US services, whereas https://api-eu1.totango.com is for EU services.", "enum": [ "https://api.totango.com", "https://api-eu1.totango.com " ] }, "auth_token": { "type": [ "string" ], "description": "The token to authenticate against the API service", "secret": true, "writeOnly": true }, "events_terms": { "type": "array", "items": { "type": "object", "properties": { "type": { "type": [ "string" ] } }, "required": [ "type" ], "additionalProperties": true }, "default": [], "description": "An array containing filter conditions to use for the events stream search.", "examples": [ [ { "type": "event_property", "name": "event_type", "eq": "note" } ], [ { "type": "or", "or": [ { "type": "event_property", "name": "event_type", "eq": "note" }, { "type": "event_property", "name": "event_type", "eq": "campaign_touch" } ] } ], [ { "type": "date", "term": "date", "joker": "yesterday" }, { "type": "or", "or": [ { "type": "event_property", "name": "event_type", "eq": "note" }, { "type": "event_property", "name": "event_type", "eq": "campaign_touch" } ] } ], [ { "type": "date", "term": "date", "gte": 1587859200000 }, { "type": "event_property", "name": "event_type", "eq": "note" } ] ] }, "events_count": { "type": [ "integer" ], "default": 1000, "description": "The maximum number of accounts to return in the events result set. The max. value for count is 1000." }, "events_offset": { "type": [ "integer" ], "default": 0, "description": "Page number (0 is the 1st-page)." }, "account_id": { "type": [ "string", "null" ], "description": "Filter the events stream results for a specific account." }, "accounts_terms": { "type": "array", "items": { "type": "object", "properties": { "type": { "type": [ "string" ] } }, "required": [ "type" ], "additionalProperties": true }, "default": [], "description": "An array containing filter conditions to use for the accounts stream search.", "examples": [ [ { "type": "string", "term": "status_group", "in_list": [ "paying" ] } ] ] }, "accounts_fields": { "type": "array", "items": { "type": "object", "properties": { "type": { "type": [ "string" ] } }, "required": [ "type" ], "additionalProperties": true }, "default": [], "description": "List of fields to return as results. Note that the account name and account-id are always returned as well.", "examples": [ [ { "type": "string", "term": "health", "field_display_name": "Health rank " }, { "type": "health_trend", "field_display_name": "Health last change " }, { "type": "string_attribute", "attribute": "Success Manager", "field_display_name": "Success Manager" } ] ] }, "accounts_count": { "type": [ "integer", "null" ], "default": 100, "description": "The maximum number of accounts to return in the accounts result set. The max. value for count is 1000." }, "accounts_offset": { "type": [ "integer", "null" ], "default": 0, "description": "Record number (0 states \"start at record 0\"). The record size can be defined using the count parameter (and limited to 1000). Tip: To page through results, ask for 1000 records (count: 1000). If you receive 1000 records, assume there\u2019s more, in which case you want to pull the next 1000 records (offset: 1000\u2026then 2000\u2026etc.). Repeat paging until the number of records returned is less than 1000." }, "accounts_sort_by": { "type": [ "string", "null" ], "default": "display_name", "description": "Field name to sort the accounts stream results set by." }, "accounts_sort_order": { "type": [ "string", "null" ], "enum": [ "ASC", "DESC" ], "default": "ASC", "description": "Order to sort the accounts stream results set by." }, "users_terms": { "type": "array", "items": { "type": "object", "properties": { "type": { "type": [ "string" ] } }, "required": [ "type" ], "additionalProperties": true }, "default": [], "description": "An array containing filter conditions to use for the users stream search.", "examples": [ [ { "type": "parent_account", "terms": [ { "type": "string", "term": "status_group", "in_list": [ "paying" ] } ] } ] ] }, "users_fields": { "type": "array", "items": { "type": "object", "properties": { "type": { "type": [ "string" ] } }, "required": [ "type" ], "additionalProperties": true }, "default": [], "description": "List of fields to return as results. Note that the user name and id along with account name and account-id are always returned as well.", "examples": [ [ { "type": "date", "term": "last_activity_time", "field_display_name": "Last activity", "desc": true }, { "type": "named_aggregation", "aggregation": "total_activities", "duration": 14, "field_display_name": "Activities (14d)" } ] ] }, "users_count": { "type": [ "integer", "null" ], "default": 1000, "description": "The maximum number of users to return in the users result set. The max. value for count is 1000." }, "users_offset": { "type": [ "integer", "null" ], "default": 0, "description": "Record number (0 states \"start at record 0\"). The record size can be defined using the count parameter (and limited to 1000). Tip: To page through results, ask for 1000 records (count: 1000). If you receive 1000 records, assume there\u2019s more, in which case you want to pull the next 1000 records (offset: 1000\u2026then 2000\u2026etc.). Repeat paging until the number of records returned is less than 1000." }, "users_sort_by": { "type": [ "string", "null" ], "default": "display_name", "description": "Field name to sort the users stream results set by." }, "users_sort_order": { "type": [ "string", "null" ], "enum": [ "ASC", "DESC" ], "default": "ASC", "description": "Order to sort the users stream results set by." }, "stream_maps": { "type": [ "object", "null" ], "properties": {}, "description": "Config object for stream maps capability. For more information check out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html)." }, "stream_map_config": { "type": [ "object", "null" ], "properties": {}, "description": "User-defined config values to be used within map expressions." }, "flattening_enabled": { "type": [ "boolean", "null" ], "description": "'True' to enable schema flattening and automatically expand nested properties." }, "flattening_max_depth": { "type": [ "integer", "null" ], "description": "The max depth to flatten schemas." } }, "required": [ "api_url", "auth_token", "events_terms", "events_count", "events_offset", "accounts_terms", "accounts_fields", "users_terms", "users_fields" ] } } ```
Discovered streams - `accounts` - `events` - `users`
github-actions[bot] commented 1 week ago

Testing plugin tap-mailchimp (acarter24 variant):

Starting test job... ... Job completed.

Auto-generated README.md # `tap-mailchimp` Mailchimp tap class. Built with the [Meltano Singer SDK](https://sdk.meltano.com). ## Capabilities * `catalog` * `state` * `discover` * `about` * `stream-maps` * `schema-flattening` ## Settings | Setting | Required | Default | Description | |:--------------------|:--------:|:-------:|:------------| | api_key | True | None | The token to authenticate against the API service | | start_date | False | None | The earliest record date to sync | | dc | True | None | Your Mailchimp DC | | stream_maps | False | None | Config object for stream maps capability. For more information check out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html). | | stream_map_config | False | None | User-defined config values to be used within map expressions. | | flattening_enabled | False | None | 'True' to enable schema flattening and automatically expand nested properties. | | flattening_max_depth| False | None | The max depth to flatten schemas. | A full list of supported settings and capabilities is available by running: `tap-mailchimp --about`
Version info ``` tap-mailchimp v0.0.1, Meltano SDK v0.24.0 ```
Usage info ``` melty-bot % tap-mailchimp --help Usage: tap-mailchimp [OPTIONS] Execute the Singer tap. Options: --state PATH Use a bookmarks file for incremental replication. --catalog PATH Use a Singer catalog file with the tap. --test TEXT Use --test to sync a single record for each stream. Use --test=schema to test schema output without syncing records. --discover Run the tap in discovery mode. --config TEXT Configuration file location or 'ENV' to use environment variables. --format [json|markdown] Specify output style for --about --about Display package metadata and settings. --version Display the package version. --help Show this message and exit. ```
Detected capabilities > - ✅ 'discover' > - ✅ 'catalog' > - ✅ 'state' > - ✅ 'about'
JSON Metadata ```json { "name": "tap-mailchimp", "description": "Mailchimp tap class.", "version": "0.0.1", "sdk_version": "0.24.0", "capabilities": [ "catalog", "state", "discover", "about", "stream-maps", "schema-flattening" ], "settings": { "type": "object", "properties": { "api_key": { "type": [ "string" ], "description": "The token to authenticate against the API service", "secret": true, "writeOnly": true }, "start_date": { "type": [ "string", "null" ], "format": "date-time", "description": "The earliest record date to sync" }, "dc": { "type": [ "string" ], "description": "Your Mailchimp DC" }, "stream_maps": { "type": [ "object", "null" ], "properties": {}, "description": "Config object for stream maps capability. For more information check out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html)." }, "stream_map_config": { "type": [ "object", "null" ], "properties": {}, "description": "User-defined config values to be used within map expressions." }, "flattening_enabled": { "type": [ "boolean", "null" ], "description": "'True' to enable schema flattening and automatically expand nested properties." }, "flattening_max_depth": { "type": [ "integer", "null" ], "description": "The max depth to flatten schemas." } }, "required": [ "api_key", "dc" ] } } ```
Discovered streams - `campaigns` - `lists` - `lists_members` - `reports_email_activity` - `reports_sent_to` - `reports_unsubscribes`
github-actions[bot] commented 1 week ago

Testing plugin tap-decentraland-api (decentraland variant):

Starting test job... ... Job completed.

Auto-generated README.md # `tap-decentraland-api` DecentralandAPI tap class. Built with the [Meltano Singer SDK](https://sdk.meltano.com). ## Capabilities * `catalog` * `state` * `discover` * `about` * `stream-maps` * `schema-flattening` ## Settings | Setting | Required | Default | Description | |:---------------------------|:--------:|:-------:|:------------| | api_url | False | https://api.decentraland.org | | | coingecko_url | False | https://api.coingecko.com/api/v3 | | | coingecko_start_date | False | 2017-10-28 | | | catalysts_start_date | False | 2000-01-01 | | | events_api_url | False | https://events.decentraland.org/api | | | governance_snapshot_api_url| False | https://governance.decentraland.org/api | | | governance_aragon_api_url | False | https://api.thegraph.com/subgraphs/name/aragon/aragon-voting-mainnet | | | peer_api_url | False | https://peer-lb.decentraland.org | | | places_api_url | False | https://places.decentraland.org/api | | | scenes_per_run | False | 2000 | | | builder_api_url | False | https://builder-api.decentraland.org/v1 | | | badges_url | False | https://badges.decentraland.org | | | sync_content_after | False | 1680998400000 | Sync content after certain snapshot date in unix timestamp | | world_content_server_url | False | https://worlds-content-server.decentraland.org | World content server URL | | builder_assetpacks_url | False | https://builder-assetpacks-prd-bf9fae6.s3.amazonaws.com | Builder Asset Packs URL | | profile_stream_max_rows | False | None | Max rows to fetch from profile changes stream | | store_stream_max_rows | False | None | Max rows to fetch from store changes stream | | stream_maps | False | None | Config object for stream maps capability. For more information check out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html). | | stream_map_config | False | None | User-defined config values to be used within map expressions. | | flattening_enabled | False | None | 'True' to enable schema flattening and automatically expand nested properties. | | flattening_max_depth | False | None | The max depth to flatten schemas. | A full list of supported settings and capabilities is available by running: `tap-decentraland-api --about`
Version info ``` tap-decentraland-api v0.1.0, Meltano SDK v0.16.0 ```
Usage info ``` melty-bot % tap-decentraland-api --help Usage: tap-decentraland-api [OPTIONS] Execute the Singer tap. Options: --state PATH Use a bookmarks file for incremental replication. --catalog PATH Use a Singer catalog file with the tap. --test TEXT Use --test to sync a single record for each stream. Use --test=schema to test schema output without syncing records. --discover Run the tap in discovery mode. --config TEXT Configuration file location or 'ENV' to use environment variables. --format [json|markdown] Specify output style for --about --about Display package metadata and settings. --version Display the package version. --help Show this message and exit. ```
Detected capabilities > - ✅ 'discover' > - ✅ 'catalog' > - ✅ 'state' > - ✅ 'about'
JSON Metadata ```json { "name": "tap-decentraland-api", "description": "DecentralandAPI tap class.", "version": "0.1.0", "sdk_version": "0.16.0", "capabilities": [ "catalog", "state", "discover", "about", "stream-maps", "schema-flattening" ], "settings": { "type": "object", "properties": { "api_url": { "type": [ "string", "null" ], "default": "https://api.decentraland.org" }, "coingecko_url": { "type": [ "string", "null" ], "default": "https://api.coingecko.com/api/v3" }, "coingecko_start_date": { "type": [ "string", "null" ], "format": "date-time", "default": "2017-10-28" }, "catalysts_start_date": { "type": [ "string", "null" ], "format": "date-time", "default": "2000-01-01" }, "events_api_url": { "type": [ "string", "null" ], "default": "https://events.decentraland.org/api" }, "governance_snapshot_api_url": { "type": [ "string", "null" ], "default": "https://governance.decentraland.org/api" }, "governance_aragon_api_url": { "type": [ "string", "null" ], "default": "https://api.thegraph.com/subgraphs/name/aragon/aragon-voting-mainnet" }, "peer_api_url": { "type": [ "string", "null" ], "default": "https://peer-lb.decentraland.org" }, "places_api_url": { "type": [ "string", "null" ], "default": "https://places.decentraland.org/api" }, "scenes_per_run": { "type": [ "integer", "null" ], "default": 2000 }, "builder_api_url": { "type": [ "string", "null" ], "default": "https://builder-api.decentraland.org/v1" }, "badges_url": { "type": [ "string", "null" ], "default": "https://badges.decentraland.org" }, "sync_content_after": { "type": [ "integer", "null" ], "default": 1680998400000, "description": "Sync content after certain snapshot date in unix timestamp" }, "world_content_server_url": { "type": [ "string", "null" ], "default": "https://worlds-content-server.decentraland.org", "description": "World content server URL" }, "builder_assetpacks_url": { "type": [ "string", "null" ], "default": "https://builder-assetpacks-prd-bf9fae6.s3.amazonaws.com", "description": "Builder Asset Packs URL" }, "profile_stream_max_rows": { "type": [ "integer", "null" ], "description": "Max rows to fetch from profile changes stream" }, "store_stream_max_rows": { "type": [ "integer", "null" ], "description": "Max rows to fetch from store changes stream" }, "stream_maps": { "type": [ "object", "null" ], "properties": {}, "description": "Config object for stream maps capability. For more information check out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html)." }, "stream_map_config": { "type": [ "object", "null" ], "properties": {}, "description": "User-defined config values to be used within map expressions." }, "flattening_enabled": { "type": [ "boolean", "null" ], "description": "'True' to enable schema flattening and automatically expand nested properties." }, "flattening_max_depth": { "type": [ "integer", "null" ], "description": "The max depth to flatten schemas." } } } } ```
Discovered streams - `badges_metadata` - `coingecko_mana_token` - `content_snapshot` - `dao_aragon_proposals` - `dao_snapshot_proposals` - `dao_snapshot_votes` - `events` - `peers` - `places` - `profile_changes` - `scene` - `scene_changes` - `scene_changes_v2` - `scene_mapping` - `smart_items` - `store_changes` - `templates` - `tiles` - `world_index` - `world_permissions` - `world_scenes` - `worlds`

Job completed.

Auto-generated README.md # `tap-decentraland-api` DecentralandAPI tap class. Built with the [Meltano Singer SDK](https://sdk.meltano.com). ## Capabilities * `catalog` * `state` * `discover` * `about` * `stream-maps` * `schema-flattening` ## Settings | Setting | Required | Default | Description | |:---------------------------|:--------:|:-------:|:------------| | api_url | False | https://api.decentraland.org | | | coingecko_url | False | https://api.coingecko.com/api/v3 | | | coingecko_start_date | False | 2017-10-28 | | | catalysts_start_date | False | 2000-01-01 | | | events_api_url | False | https://events.decentraland.org/api | | | governance_snapshot_api_url| False | https://governance.decentraland.org/api | | | governance_aragon_api_url | False | https://api.thegraph.com/subgraphs/name/aragon/aragon-voting-mainnet | | | peer_api_url | False | https://peer-lb.decentraland.org | | | places_api_url | False | https://places.decentraland.org/api | | | scenes_per_run | False | 2000 | | | builder_api_url | False | https://builder-api.decentraland.org/v1 | | | badges_url | False | https://badges.decentraland.org | | | sync_content_after | False | 1680998400000 | Sync content after certain snapshot date in unix timestamp | | world_content_server_url | False | https://worlds-content-server.decentraland.org | World content server URL | | builder_assetpacks_url | False | https://builder-assetpacks-prd-bf9fae6.s3.amazonaws.com | Builder Asset Packs URL | | profile_stream_max_rows | False | None | Max rows to fetch from profile changes stream | | store_stream_max_rows | False | None | Max rows to fetch from store changes stream | | stream_maps | False | None | Config object for stream maps capability. For more information check out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html). | | stream_map_config | False | None | User-defined config values to be used within map expressions. | | flattening_enabled | False | None | 'True' to enable schema flattening and automatically expand nested properties. | | flattening_max_depth | False | None | The max depth to flatten schemas. | A full list of supported settings and capabilities is available by running: `tap-decentraland-api --about`
Version info ``` tap-decentraland-api v0.1.0, Meltano SDK v0.16.0 ```
Usage info ``` melty-bot % tap-decentraland-api --help Usage: tap-decentraland-api [OPTIONS] Execute the Singer tap. Options: --state PATH Use a bookmarks file for incremental replication. --catalog PATH Use a Singer catalog file with the tap. --test TEXT Use --test to sync a single record for each stream. Use --test=schema to test schema output without syncing records. --discover Run the tap in discovery mode. --config TEXT Configuration file location or 'ENV' to use environment variables. --format [json|markdown] Specify output style for --about --about Display package metadata and settings. --version Display the package version. --help Show this message and exit. ```
Detected capabilities > - ✅ 'discover' > - ✅ 'catalog' > - ✅ 'state' > - ✅ 'about'
JSON Metadata ```json { "name": "tap-decentraland-api", "description": "DecentralandAPI tap class.", "version": "0.1.0", "sdk_version": "0.16.0", "capabilities": [ "catalog", "state", "discover", "about", "stream-maps", "schema-flattening" ], "settings": { "type": "object", "properties": { "api_url": { "type": [ "string", "null" ], "default": "https://api.decentraland.org" }, "coingecko_url": { "type": [ "string", "null" ], "default": "https://api.coingecko.com/api/v3" }, "coingecko_start_date": { "type": [ "string", "null" ], "format": "date-time", "default": "2017-10-28" }, "catalysts_start_date": { "type": [ "string", "null" ], "format": "date-time", "default": "2000-01-01" }, "events_api_url": { "type": [ "string", "null" ], "default": "https://events.decentraland.org/api" }, "governance_snapshot_api_url": { "type": [ "string", "null" ], "default": "https://governance.decentraland.org/api" }, "governance_aragon_api_url": { "type": [ "string", "null" ], "default": "https://api.thegraph.com/subgraphs/name/aragon/aragon-voting-mainnet" }, "peer_api_url": { "type": [ "string", "null" ], "default": "https://peer-lb.decentraland.org" }, "places_api_url": { "type": [ "string", "null" ], "default": "https://places.decentraland.org/api" }, "scenes_per_run": { "type": [ "integer", "null" ], "default": 2000 }, "builder_api_url": { "type": [ "string", "null" ], "default": "https://builder-api.decentraland.org/v1" }, "badges_url": { "type": [ "string", "null" ], "default": "https://badges.decentraland.org" }, "sync_content_after": { "type": [ "integer", "null" ], "default": 1680998400000, "description": "Sync content after certain snapshot date in unix timestamp" }, "world_content_server_url": { "type": [ "string", "null" ], "default": "https://worlds-content-server.decentraland.org", "description": "World content server URL" }, "builder_assetpacks_url": { "type": [ "string", "null" ], "default": "https://builder-assetpacks-prd-bf9fae6.s3.amazonaws.com", "description": "Builder Asset Packs URL" }, "profile_stream_max_rows": { "type": [ "integer", "null" ], "description": "Max rows to fetch from profile changes stream" }, "store_stream_max_rows": { "type": [ "integer", "null" ], "description": "Max rows to fetch from store changes stream" }, "stream_maps": { "type": [ "object", "null" ], "properties": {}, "description": "Config object for stream maps capability. For more information check out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html)." }, "stream_map_config": { "type": [ "object", "null" ], "properties": {}, "description": "User-defined config values to be used within map expressions." }, "flattening_enabled": { "type": [ "boolean", "null" ], "description": "'True' to enable schema flattening and automatically expand nested properties." }, "flattening_max_depth": { "type": [ "integer", "null" ], "description": "The max depth to flatten schemas." } } } } ```
Discovered streams - `badges_metadata` - `coingecko_mana_token` - `content_snapshot` - `dao_aragon_proposals` - `dao_snapshot_proposals` - `dao_snapshot_votes` - `events` - `peers` - `places` - `profile_changes` - `scene` - `scene_changes` - `scene_changes_v2` - `scene_mapping` - `smart_items` - `store_changes` - `templates` - `tiles` - `world_index` - `world_permissions` - `world_scenes` - `worlds`