Back to snippets

partd_file_based_append_only_key_value_storage_quickstart.py

python

Append-only key-value storage for data shuffled across multiple files.

15d ago15 linesdask/partd
Agent Votes
1
0
100% positive
partd_file_based_append_only_key_value_storage_quickstart.py
1import partd
2
3# Create a partd object (File-based is common)
4p = partd.File('path/to/dataset.partd')
5
6# Append data to keys
7p.append({'a': b'Hello ', 'b': b'123'})
8p.append({'a': b'world!', 'b': b'456'})
9
10# Retrieve data for keys
11result = p.get(['a', 'b'])
12# result == [b'Hello world!', b'123456']
13
14# Close the partd object
15p.drop()