Variable-length Attributes in Python

haehn · July 31, 2019, 12:11am

Hello - I am new to TileDB but I am starting to enjoy it

When will Variable-length Attributes be available in the Python API?

ihnorton · July 31, 2019, 2:27am

Variable-length attributes are available – I will update that doc. Object arrays (np.dtype("O") / np.object) can contain variable-length subarrays as elements. If something doesn’t work the way you hope, please let us know here or on github. There are a number of examples in the following test section:

github.com

TileDB-Inc/TileDB-Py/blob/dev/tiledb/tests/test_libtiledb.py#L1083-L1274


class DenseVarlen(DiskTestCase):
    def test_varlen_write_bytes(self):
        A = np.array(['aa','bbb','ccccc','ddddddddddddddddddddd','ee','ffffff','g','hhhhhhhhhh'], dtype=bytes)


        # basic write
        ctx = tiledb.Ctx()
        dom = tiledb.Domain(tiledb.Dim(ctx=ctx, domain=(1, len(A)), tile=len(A)), ctx=ctx)
        att = tiledb.Attr(dtype=np.bytes_, ctx=ctx)


        schema = tiledb.ArraySchema(dom, (att,), ctx=ctx)


        tiledb.DenseArray.create(self.path("foo"), schema)
        with tiledb.DenseArray(self.path("foo"), mode='w', ctx=ctx) as T:
            T[:] = A


        with tiledb.DenseArray(self.path("foo"), mode='r', ctx=ctx) as T:
            assert_array_equal(A[:], T[:])




    def test_varlen_write_unicode(self):

This file has been truncated. show original

(btw, NumPy tries very hard to keep arrays contiguous, so it can sometimes be tricky to maintain the object dtype when operating on an array)

haehn · August 1, 2019, 11:11am

Thank you so much! Will try it!

Topic		Replies	Views
Weird behavior with variable length attributes	2	504	October 19, 2022
Am I wrongly filling a sparse array that has a variable length string attribute? Or is this a bug?	4	803	August 15, 2023
How can we store variable length binary blobs?	2	301	September 11, 2023
Using a multi-dimensional sparse array in python	4	1123	July 31, 2019
Slicing of arrays in python	3	836	August 24, 2020

Variable-length Attributes in Python

Related Topics