We are hiring! Apply here
Cloud Connectors

The fluvio cloud connector subcommands are used to manage Connectors in InfinyOn Cloud.

$  fluvio cloud connector -h
View Fluvio Connector information

Usage: fluvio-cloud connector <COMMAND>

Commands:
  logs    View connector logs
  create  Create a new Connector
  delete  Delete a Connector
  list    List all Connectors
  update  Update and restart a Connector
  config  Show the connector configuration details
  help    Print this message or the help of the given subcommand(s)

Options:
  -h, --help  Print help

 

fluvio cloud connector create

This command is used to provision a new connector.

$  fluvio cloud connector create -h
Create a new Connector

Usage: fluvio-cloud connector create [OPTIONS] --config <CONFIG>

Options:
  -c, --config <CONFIG>        Connector config
      --log-level <LOG_LEVEL>  Sets the log level [default: LogLevel::default()]
  -h, --help                   Print help

To create a connector, you need to create a YAML-based connector config file.

For more about the connector config file, see the Cloud connectors page.

When running fluvio cloud connector create, pass the path to this file using the --config option.

Example usage:

$ fluvio cloud connector create --config=./cats.yaml
connector "cat-facts" (http-source) created

 

fluvio cloud connector config

Command to show the configuration file used to create this connector.

$  fluvio cloud connector config -h
Show the connector configuration details

Usage: fluvio-cloud connector config <NAME>

Arguments:
  <NAME>  Name of connector

Options:
  -h, --help  Print help

Example usage:

apiVersion: 0.1.0
meta:
 version: 0.2.1
 name: cat-facts
 type: http-source
 topic: cat-facts
 create-topic: true
http:
 endpoint: "https://catfact.ninja/fact"
 interval: 10s

 

fluvio cloud connector list

This command show you all the existing Connectors in your cluster.

$  fluvio cloud connector list -h
List all Connectors

Usage: fluvio-cloud connector list

Options:
  -h, --help  Print help

 

fluvio cloud connector update

Command to update and restart an existing connector.

$  fluvio cloud connector update -h
Update and restart a Connector

Usage: fluvio-cloud connector update [OPTIONS] --config <CONFIG>

Options:
  -c, --config <CONFIG>        Name of connector
      --log-level <LOG_LEVEL>  Sets the log level [default: LogLevel::default()]
  -h, --help                   Print help

Example usage:

$ fluvio cloud connector update --config=./cats.yaml
connector "cat-facts" (http-source) updated

 

fluvio cloud connector logs

Command to view the logs written by the connector.

$  fluvio cloud connector logs -h
View connector logs

Usage: fluvio-cloud connector logs <NAME>

Arguments:
  <NAME>  Name of connector

Options:
  -h, --help  Print help

Example usage:

% fluvio cloud connector logs cat-facts
2022-10-21T14:55:13.508989Z  INFO http_source: Starting HTTP source connector connector_version="0.4.1" git_hash="0ad913c5ceb732881fd753874e5082777bbed91e"
2022-10-21T14:55:13.509096Z  INFO http_source: interval=10s method=GET topic=cat-facts output_parts=body output_type=text endpoint=https://catfact.ninja/fact
2022-10-21T14:55:13.510284Z  INFO fluvio::config::tls: Using verified TLS with certificates from paths domain="broad-union-b685e7fda03fefb3d5221d0a3b9c64c7.c.infinyon.cloud"
2022-10-21T14:55:13.515459Z  INFO fluvio::fluvio: Connecting to Fluvio cluster fluvio_crate_version="0.14.0" fluvio_git_hash="e96d8e2738ee39ddbb64fea37134f119f97e25bf"
2022-10-21T14:55:13.574584Z  INFO connect: fluvio::sockets: connect to socket add=fluvio-sc-public:9003
...
 

Configure Logging Levels

By default connectors will log using the info level. You can configure the log level for connectors running in the cloud using the --log-level option.

The --log-level option is available for both, fluvio cloud connector <create | update>.

Any of the following levels can be used:

  • error
  • warn
  • info
  • debug
  • trace

 

fluvio cloud connector delete

This command deletes an existing Connector.

$  fluvio cloud connector delete -h
Delete a Connector

Usage: fluvio-cloud connector delete <name>...

Arguments:
  <name>...  One or more name(s) of the connector(s) to be deleted

Options:
  -h, --help  Print help

Example usage:

$ fluvio cloud connector delete cat-facts
connector "cat-facts" deleted