The Catalog feature enables administrators to query object namespace metadata, including prefixes,
creation times, sizes, and other vital metadata. It provides a streamlined GraphQL interface
integrated within the MinIO Enterprise Console for an efficient and user-friendly real-time metadata
querying experience.
The MinIO AIStor Catalog addresses the challenges of searching and
querying metadata in object storage at scale. Created for our largest
customers with exabytes of data under management, MinIO's AIStor Catalog
allows administrators to query the namespace of objects in real time. This
enables tasks such as data governance, audit, compliance checks, and other
operational analytics that require real-time information on the metadata
in object storage.
Query and navigate your entire object storage namespace with ease, even
at exabyte scale. MinIO’s AIStor Catalog was built for our largest
customers with performance top of mind. The AIStor Catalog empowers
you to find what you need in seconds, not hours.
The intuitive GraphQL interface makes querying and interacting with
object metadata a breeze, using a familiar and user-friendly syntax.
Administrators at most levels of technical expertise will be able to
query and generate actionable insights.
MinIO's AIStor Catalog integrates seamlessly with the MinIO
AIStor Console, eliminating context switching and streamlining your
workflow. Query, report and manage your metadata all from one location.
Forget about external services or databases. MinIO's AIStor Catalog
is a self-contained solution, simplifying setup and maintenance while
ensuring reliable metadata access. No longer do administrators have to
deal with faulty and imperfect homegrown solutions spread out across
many tools that have latency built-in to their product. With the
AIStor Catalog, you can find everything you need in one place.
Automatic indexing of uploaded data means there is no delay in accessing
the metadata of objects. Leveraging the AIStor Catalog for real-time
access to your metadata empowers crucial tasks like data governance,
compliance, and operational workflows.
Optimize space utilization — Quickly identify and manage space usage
based on specific object attributes, avoiding inefficient listing
processes and saving precious IOPS.
The MinIO AIStor Catalog provides a powerful and efficient solution
for managing your object metadata, focusing on functionality,
performance and user experience.
Ensure your data adheres to industry standards and internal policies
with real-time metadata checks. The MinIO AIStor Catalog simplifies
compliance management, saving you time and effort while helping to keep
your data and organization compliant.
MinIO's AIStor Catalog supercharges analytics on the metadata of objects
even at a very large scale.
Administrators no longer have to rely on home grown and inadequate
solutions, and instead can
query the namespace
of objects under their management directly in the MinIO AIStor Console.
Is GraphQL the same as SQL?
No, SQL is an older querying language created for relational databases.
GraphQL, on the other hand, is a data and platform agnostic querying
language.
Can I query the data inside objects using the AIStor Catalog?
No, the MinIO AIStor Catalog is a tool specifically designed for
querying the metadata of objects.
How do I turn the AIStor Catalog on?
You can turn the MinIO AIStor Catalog on using the MinIO AIStor Console.
Can I leverage the output of my GraphQL query to script some actions on
objects in MinIO, for example, mass tag objects meeting specific
criteria or removal of content that is older than a specific number of
days?
Yes, the AIStor Catalog can be used to gather all this information and
you can use other tools to mutate the objects.
Are there usable templates for commonly requested queries on GraphQL?
Not yet, but this feature is planned. However, the AIStor Catalog UI
does include an IDE with autocomplete to help users write queries.
Does the AIStor Catalog persist the index? How much storage do I need to
run and maintain the catalog?
Currently, the AIStor Catalog only backs up the index to object storage,
but the index is currently kept in memory to serve queries. We plan to
allow indexes larger than memory by using a disk-based index in a future
update.
What hardware do I need to run the AIStor Catalog?
MinIO’s AIStor Catalog requires enough RAM to store the index in memory
and this amount is proportional to the number of objects stored in
MinIO. Reach out to us for specific recommendations for your
installation.
What is the maximum amount of data the AIStor Catalog can index?
There is no technical limit, except for the RAM. The AIStor Catalog will
be even more scalable when we add support for disk based indexes.
How much does the AIStor Catalog cost?
The AIStor Catalog is a feature included in the MinIO Enterprise Plus
Subscription.
How can I control who has access to the AIStor Catalog?
The AIStor Catalog currently does not implement any authorization and is
only exposed through the MinIO AIStor Console. Authorization features
are in the roadmap.
Can I limit catalog access for specific users to a subset of objects,
buckets, or prefixes?
Not currently, authorization features are in the roadmap.
Replication
Versioning
Observability
Encryption
Key Management Server
S3 Compatibility
Object Immutability
Catalog
Object Prompt
Identity + Access Mgt
Firewall
AIHub
Lifecycle
Cache
Events and Lambdas
Console
Erasure Code Calculator
Reference Hardware
Integrations with MinIO
Download MinIO Object Store
Events
