Operations map

  • For scan operations, you need to use a keys as strings.

Operation

InMemoryStore

FilesystemStore

RedisStore

LmdbStore

PysosStore

ShelveStore

DynamoDBStore

FireStoreStore

CosmosDBStore

MongoDBStore

SafetensorsStore

ModalStore

UnQLite

Speedb

RocksDB

LevelDB

backend

python dict

fsspec (S3/gs,az,local,ftp, etc)

Redis

Lmdb

Pysos

Shelve

AWS DynamoDB

GCP Firestore

Azure Cosmos DB

MongoDB

safetensors

modal

unqlite-python

speedb

RocksDB

leveldb

set

+

+

+

+

+

+

+

+

+

+

-

+

+

+

+

+

get

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

pop

+

+

+

+

+

+

+

+

+

+

-

+

+

+

+

+

delete

+

+

+

+

+

+

+

+

+

+

-

+

+

+

+

+

len

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

eq

+

+

+

+

+

+

+

+

+

+

-

+

+

+

+

+

keys

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

values

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

items

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

iter

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

contains

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

+

update

+

+

+

+

+

+

+

+

+

+

-

+

+

+

+

+

persistence

-

+

+

+

+

+

+

+

+

+

+

-

+

+

+

+

save/load

+

Auto

Save (experimental)

+

+

+

Serverless

Serverless

Serverless

+ (strict)

+

-

+

(save/ingest)

(save/ingest)

-

key type (Not strict/strict)

Any

Any(local) / String(cloud)

Any/String

Any

Any

Any

String

Any/String

String

String

String

Any

Any

Any

Any

Any

value_type

Any

Any(local) / String(cloud)

Any/String

Any

Any

Any

Jsonable

Any

Any

Any/Dict[str,Any]

Tensors

Any

Any

Any

Any

Any

  • A strict=False mode is available to allow for more flexible data types - anything which is cloudpickle-able will work including classes and functions.