Configuration: ETL Options
-
In this page:
- ETL.ExtractAndTransformTimeoutInSec
- ETL.MaxBatchSizeInMb
- ETL.MaxFallbackTimeInSec
- ETL.MaxNumberOfExtractedDocuments
- ETL.MaxNumberOfExtractedItems
- ETL.OLAP.MaxNumberOfExtractedDocuments
- ETL.Queue.AzureQueueStorage.TimeToLiveInSec
- ETL.Queue.AzureQueueStorage.VisibilityTimeoutInSec
- ETL.Queue.Kafka.InitTransactionsTimeoutInSec
- ETL.SQL.CommandTimeoutInSec
ETL.ExtractAndTransformTimeoutInSec
Number of seconds after which extraction and transformation will end and loading will start.
- Type:
int
- Default:
30
- Scope: Server-wide or per database
ETL.MaxNumberOfExtractedDocuments
- Max number of extracted documents in an ETL batch.
- If value is not set, or set to null, the number of extracted documents fallbacks to
ETL.MaxNumberOfExtractedItems
value.
- Type:
int
- Default:
8192
- Scope: Server-wide or per database
ETL.MaxBatchSizeInMb
- Maximum size in megabytes of a batch of data (documents and attachments) that will be sent to the destination as a single batch after transformation.
- If value is not set, or set to null, the size of the batch isn't limited in the processed ETL batch.
- Type:
Size
- Size Unit:
Megabytes
- Default:
64
- Scope: Server-wide or per database
ETL.MaxFallbackTimeInSec
- Maximum number of seconds the ETL process will be in a fallback mode after a load connection failure to a destination.
- The fallback mode means suspending the process.
- Type:
int
- Default:
900
- Scope: Server-wide or per database
ETL.MaxNumberOfExtractedItems
- Max number of extracted items (documents, counters, etc) in an ETL batch.
- If value is not set, or set to null, the number of extracted items isn't limited in the processed ETL batch.
- Type:
int
- Default:
8192
- Scope: Server-wide or per database
ETL.OLAP.MaxNumberOfExtractedDocuments
Max number of extracted documents in OLAP ETL batch.
- Type:
int
- Default:
64 * 1024
- Scope: Server-wide or per database
ETL.Queue.AzureQueueStorage.TimeToLiveInSec
Lifespan of a message in the queue.
- Type:
int
- Default:
604800
(7 days) - Scope: Server-wide or per database
ETL.Queue.AzureQueueStorage.VisibilityTimeoutInSec
How long a message is hidden after being retrieved but not deleted.
- Type:
int
- Default:
0
- Scope: Server-wide or per database
ETL.Queue.Kafka.InitTransactionsTimeoutInSec
Timeout to initialize transactions for the Kafka producer.
- Type:
int
- Default:
60
- Scope: Server-wide or per database
ETL.SQL.CommandTimeoutInSec
Number of seconds after which the SQL command will timeout.
- Type:
int
- Default:
null
(use provider default) - Scope: Server-wide or per database