KafkaConnection

Kafka connection using the default driver.

Implements: IMessageQueueConnection, IReferenceable, IConfigurable, IOpenable

Description

By defining a connection and sharing it through multiple message queues you can reduce the number of used database connections.

Configuration parameters

  • client_id: (optional) name of the client id
  • connection(s):
    • discovery_key: (optional) key to retrieve the connection from IDiscovery
    • host: host name or IP address
    • port: port number (default: 27017)
    • uri: resource URI or connection string with all parameters in it
  • credential(s):
    • store_key: (optional) key to retrieve the credentials from ICredentialStore
    • username: username
    • password: user’s password
  • options:
    • log_level: (optional) log level 0 - None, 1 - Error, 2 - Warn, 3 - Info, 4 - Debug (default: 1)
    • connect_timeout: (optional) number of milliseconds to connect to broker (default: 1000)
    • max_retries: (optional) maximum retry attempts (default: 5)
    • retry_timeout: (optional) number of milliseconds to wait on each reconnection attempt (default: 30000)
    • request_timeout: (optional) number of milliseconds to wait on flushing messages (default: 30000)

References

  • *:logger:*:*:1.0 - (optional) ILogger components to pass log messages
  • *:discovery:*:*:1.0 - (optional) IDiscovery services
  • *:credential-store:*:*:1.0 (optional) credential stores to resolve credentials

Constructors

Creates a new instance of the connection component.

public constructor()

Fields

_adminClient

Kafka admin client object;

protected _adminClient: any

_clientConfig

Kafka connection properties

protected _clientConfig: any

_clientId

Hostname as client id.

protected _clientId: string

_connectTimeout

Connection time out

protected _connectTimeout: number = 1000

_connection

Kafka connection pool object

protected _connection: any

_connectionResolver

Connection resolver

protected _connectionResolver: KafkaConnectionResolver

_logLevel

Log level

protected _logLevel: number = 1

_logger

Logger

protected _logger: CompositeLogger = new CompositeLogger()

_maxRetries

Maximum number of entries.

protected _maxRetries: number = 5

_options

Connection options

protected _options: ConfigParams = new ConfigParams()

_producer

Kafka message producer object

protected _producer: any

_requestTimeout

Number of milliseconds to wait on flushing messages (default: 30000)

protected _requestTimeout: number = 30000

_retryTimeout

Number of milliseconds to wait on each reconnection attempt (default: 30000)

protected _retryTimeout: number = 30000

_subscriptions

Topic subscriptions

protected _subscriptions: KafkaSubscription[] = []

Instance methods

checkOpen

Checks if the connection is open.
Raises an error is the connection is closed.

protected checkOpen(): void

close

Closes a component and frees used resources.

public close(context: IContext): Promise<void>

  • context: IContext - (optional) a context to trace execution through a call chain.

commit

Commit a message offset.

public commit(topic: string, groupId: string, partition: number, offset: number, listener: IKafkaMessageListener): Promise<void>

  • topic: string - topic name
  • groupId: string - (optional) consumer group id
  • partition: number - partition number
  • offset: number - message offset
  • listener: IKafkaMessageListener - message listener

configure

Configures the component by passing its configuration parameters.

public configure(config: ConfigParams): void

  • config: ConfigParams - configuration parameters to be set.

connectToAdmin

Connects an admin client on demand.

protected connectToAdmin(): Promise<void>

createQueue

Creates a message queue. If the connection doesn’t support this function, it exists without error.

public createQueue(name: string): Promise<void>

  • name: string - name of the queue to be created.

deleteQueue

Deletes a message queue. If the connection doesn’t support this function, it exists without error.

public deleteQueue(name: string): Promise<void>

  • name: string - name of the queue to be deleted.

getConnection

Gets the connection.

public getConnection(): any

  • returns: any - connection to a MySQL database

getProducer

Gets the Kafka message producer object

public getProducer(): any

  • returns: any - producer object

isOpen

Checks if the component is opened.

public isOpen(): boolean

  • returns: boolean - true if the component is open and false otherwise.

open

Opens the component.

public open(context: IContext): Promise<void>

  • context: IContext - (optional) a context to trace execution through a call chain.

publish

Publish a message to a specified topic.

public publish(topic: string, messages: any[], options: any): Promise<void>

  • topic: string - topic where the message will be placed.
  • messages: any[] - list of messages to be published.
  • options: any - publishing options.

readQueueNames

Reads a list of registered queue names. If the connection doesn’t support this function, it returns an empty list.

public readQueueNames(): Promise<string[]>

  • returns: Promise<string[]> - queue names.

seek

Seeks a message offset.

public seek(topic: string, groupId: string, partition: number, offset: number, listener: IKafkaMessageListener): Promise<void>

  • topic: string - topic name
  • groupId: string - (optional) consumer group id
  • partition: number - partition number
  • offset: number - message offset
  • listener: IKafkaMessageListener - message listener

setReferences

Sets references to dependent components.

public setReferences(references: IReferences): void

  • references: IReferences - references to locate the component dependencies.

subscribe

Subscribes to a topic

public subscribe(topic: string, groupId: string, options: any, listener: IKafkaMessageListener): Promise<void>

  • topic: string - subject(topic) name
  • groupId: string - (optional) consumer group id
  • options: any - subscription options
  • listener: IKafkaMessageListener - message listener

unsubscribe

Unsubscribes from a previously subscribed topic

public unsubscribe(topic: string, groupId: string, listener: IKafkaMessageListener): Promise<void>

  • topic: string - topic name
  • groupId: string - (optional) consumer group id
  • listener: IKafkaMessageListener - message listener