Key Default Type Description
minicluster.number-of-taskmanagers
1 Integer The number of task managers of MiniCluster.
task.cancellation.interval
30 s Duration Time interval between two successive task cancellation attempts.
task.cancellation.timeout
3 min Duration Timeout after which a task cancellation times out and leads to a fatal TaskManager error. A value of 0 deactivates the watch dog. Notice that a task cancellation is different from both a task failure and a clean shutdown. Task cancellation timeout only applies to task cancellation and does not apply to task closing/clean-up caused by a task failure or a clean shutdown.
task.cancellation.timers.timeout
7500 ms Duration Time we wait for the timers to finish all pending timer threads when the stream task is cancelled.
taskmanager.bind-host
(none) String The local address of the network interface that the task manager binds to. If not configured, '0.0.0.0' will be used.
taskmanager.collect-sink.port
0 Integer The port used for the client to retrieve query results from the TaskManager. The default value is 0, which corresponds to a random port assignment.
taskmanager.data.bind-port
(none) String The task manager's bind port used for data exchange operations. Also accepts a list of ports (“50100,50101”), ranges (“50100-50200”) or a combination of both. If not configured, 'taskmanager.data.port' will be used.
taskmanager.data.port
0 Integer The task manager’s external port used for data exchange operations.
taskmanager.data.ssl.enabled
true Boolean Enable SSL support for the taskmanager data transport. This is applicable only when the global flag for internal SSL (security.ssl.internal.enabled) is set to true
taskmanager.debug.memory.log
false Boolean Flag indicating whether to start a thread, which repeatedly logs the memory usage of the JVM.
taskmanager.debug.memory.log-interval
5 s Duration The interval for the log thread to log the current memory usage.
taskmanager.host
(none) String The external address of the network interface where the TaskManager is exposed. Because different TaskManagers need different values for this option, usually it is specified in an additional non-shared TaskManager-specific config file.
taskmanager.jvm-exit-on-oom
false Boolean Whether to kill the TaskManager when the task thread throws an OutOfMemoryError.
taskmanager.load-balance.mode
NONE

Enum

Mode for the load-balance allocation strategy across all available TaskManagers.
  • The SLOTS mode tries to spread out the slots evenly across all available TaskManagers.
  • The NONE mode is the default mode without any specified strategy.


Possible values:
  • "NONE"
  • "SLOTS"
taskmanager.log.path
System.getProperty("log.file") String The path to the log file of the task manager.
taskmanager.memory.min-segment-size
256 bytes MemorySize Minimum possible size of memory buffers used by the network stack and the memory manager. ex. can be used for automatic buffer size adjustment.
taskmanager.memory.segment-size
32 kb MemorySize Size of memory buffers used by the network stack and the memory manager.
taskmanager.network.bind-policy
"ip" String The automatic address binding policy used by the TaskManager if "taskmanager.host" is not set. The value should be one of the following:
  • "name" - uses hostname as binding address
  • "ip" - uses host's ip address as binding address
taskmanager.numberOfTaskSlots
1 Integer The number of parallel operator or user function instances that a single TaskManager can run. If this value is larger than 1, a single TaskManager takes multiple instances of a function or operator. That way, the TaskManager can utilize multiple CPU cores, but at the same time, the available memory is divided between the different operator or function instances. This value is typically proportional to the number of physical CPU cores that the TaskManager's machine has (e.g., equal to the number of cores, or half the number of cores).
taskmanager.registration.timeout
5 min Duration Defines the timeout for the TaskManager registration. If the duration is exceeded without a successful registration, then the TaskManager terminates.
taskmanager.resource-id
(none) String The TaskManager's ResourceID. If not configured, the ResourceID will be generated with the "RpcAddress:RpcPort" and a 6-character random string. Notice that this option is not valid in Yarn and Native Kubernetes mode.
taskmanager.rpc.bind-port
(none) Integer The local RPC port that the TaskManager binds to. If not configured, the external port (configured by 'taskmanager.rpc.port') will be used.
taskmanager.rpc.port
"0" String The external RPC port where the TaskManager is exposed. Accepts a list of ports (“50100,50101”), ranges (“50100-50200”) or a combination of both. It is recommended to set a range of ports to avoid collisions when multiple TaskManagers are running on the same machine.
taskmanager.runtime.fs-timeout
0 ms Duration The timeout for filesystem stream opening. A value of 0 indicates infinite waiting.
taskmanager.slot.timeout
10 s Duration Timeout used for identifying inactive slots. The TaskManager will free the slot if it does not become active within the given amount of time. Inactive slots can be caused by an out-dated slot request. If no value is configured, then it will fall back to pekko.ask.timeout.
taskmanager.system-out.log.cache-upper-size
100 kb MemorySize The cache upper size when Flink caches current line context of System.out or System.err when taskmanager.system-out.mode is LOG.
taskmanager.system-out.log.thread-name.enabled
false Boolean Whether to log the thread name when taskmanager.system-out.mode is LOG.
taskmanager.system-out.mode
DEFAULT

Enum

Redirection mode of System.out and System.err for all TaskManagers.
  • DEFAULT: TaskManagers don't redirect the System.out and System.err, it's the default value.
  • LOG: TaskManagers redirect System.out and System.err to LOG.info and LOG.error.
  • IGNORE: TaskManagers ignore System.out and System.err directly.


Possible values:
  • "DEFAULT"
  • "LOG"
  • "IGNORE"