Bulk Operations

Bulk operations are actions that are performed on a large scale. Example bulk operations tasks include importing or exporting items, changing prices on a mass scale, and assigning products to a warehouse.

For each indvidual task of a bulk operation, the system creates a message that is published in a message queue. A consumer runs in the background and processes the messages that it receives. Because tasks are processed in the background through the message queue system, when a merchant launches a bulk operation from the Admin panel, control is quickly returned to the merchant. In previous releases, the merchant could not use the Admin panel until all tasks were completed.

The primary Bulk Operation interface is OperationInterface. It defines the getter and setter methods the bulk operation uses to create and process messages. The following interfaces are also used:

Three clients call bulk operation APIs:

• A publisher, which pushes messages to the message queue
• A consumer, which handles each specific operation
• A client that gets the status of the bulk operation and shows the list of failed operations

Publish bulk operations

The BulkManagementInterface::scheduleBulk is responsible for publishing bulk operations. The following table describes its arguments.

See Create a publisher for a detailed example of a publisher.

Consume messages

When a consumer processes a message, it must notify the system of its status. The status can be OPEN, COMPLETE, RETRIABLY_FAILED, and NOT_RETRIABLY_FAILED.

To send this notification, use OperationManagementInterface::changeOperationStatus($operationId, $status, $message = null, $data = null).

Handling Recoverable Exceptions

Magento provides database exception classes to simplify the process of identifying recoverable database errors in client code. In most cases, such errors happen due to some environment issues and can be fixed. The full path to these classes is Magento\Framework\DB\Adapter\<class_name>. These exceptions extend generic \Zend_Db_Adapter_Exception.

The following pseudocode illustrates how to recover from database-related errors.

<?php
namespace example;
use Magento\Framework\DB\Adapter\LockWaitException;

// ...
try {
    // do something
} catch (LockWaitException $exception) {
    // try to recover from exception
}

See Create a publisher for a detailed example of a consumer.

Get the status of operations

Use getBulkStatus(UuidInterface $bulkId) to get the status of the overall bulk operation. Possible values are

Related Topic

• Message Queues Overview
• Example bulk operations implementation