Events and Lambdas

Events

MinIO notifications allow administrators to send notifications to external services such as Kafka or RabbitMQ for certain object or bucket events. MinIO supports bucket and object-level S3 events similar to the Amazon S3 Event Notifications.

These events can be operations like:

• Adding an object to a bucket
• Accessing an object in a bucket
• Deleting and removing an object
• Creating and deleting buckets

MinIO supports two modes of delivery of the messages, Asynchronous and Synchronous.

With asynchronous delivery, MinIO fires the event at the configured remote and does not wait for a response before continuing to the next event. Asynchronous bucket notification prioritizes sending events with the risk of some events being lost if the remote target has a transient issue during transit or processing.

With synchronous delivery, MinIO fires the event at the configured remote and then waits for the remote to confirm a successful receipt before continuing to the next event. Synchronous bucket notification prioritizes delivery of events with the risk of a slower event-send rate and queue fill.

The event notification is perfect for the following scenarios:

• ETL jobs that need to wait on a large CSV file to start processing.
• Fanning out objects to be processed by multiple applications.
• Processing workloads at different times such as cron jobs.

Lambdas

MinIO’s Object Lambda enables developers to programmatically transform objects on demand. You can transform objects as needed for your use case, such as redacting personally identifiable information (PII), enriching data with information from other sources, or converting between formats.

Like Amazon S3 Object Lambda functions, you trigger a MinIO Object Lambda handler function with a GET request from an application. The handler retrieves the requested object from MinIO, transforms it, and returns the modified data back to MinIO to send to the original application. The original object remains unchanged.

You can write a handler function in any language capable of sending and receiving HTTP requests. It must be able to:

• Listen for an HTTP POST request.
• Retrieve the original object using a URL.
• Return the transformed contents and authorization tokens.

Events and Lambdas

Learn more

Blog

AIHub: A Private Cloud Repository for Models and Datasets

Blog

MinIO’s S3 over RDMA Initiative: Setting New Standards in Object Storage for High-Speed AI Data Infrastructure

Blog

The most powerful S3 API ever? Introducing the Prompt API.