Comments (2)
hanxiao
commented on May 13, 2024
1
Thanks a lot for your interest!
Supporting zarr and xarray is definitely in the scope. The biggest challenge here is the wire format & serialization: while a naive implementation should be easily doable, I'm not really sure how to allow zero-copy serialization in zarr and xarray like in numpy.ndarray. I need to dig into their APIs and wire specification.
from docarray.
JoanFM
commented on May 13, 2024
Hello @NowanIlfideme ,
We have done a new release (0.30) that rewrites docarray completelly. There we provide TorchTensor object with semantics as you describe here in the ticket. I hope you like it and find it useful.
https://docs.docarray.org/API_reference/typing/tensor/tensor/
from docarray.
Related Issues (20)
- [pydantic v2] Push and pulling tests not passing with pydantic v2
- [pydantic v2] documentation test need to be trigger for pydantic v2
- Release Notes HOT 2
- Tensor not found in Tensorflow module HOT 4
- bug: deserializing from dataframe with numpy==1.26.1 HOT 15
- index.find() tries to reshape and fails HOT 10
- Integrate new Vector search library from Spotify HOT 3
- Release Notes HOT 4
- DocList raises exception for type object. HOT 3
- Error on subindice Embedding type for Torch Tensor moving from GPU to CPU. HOT 3
- TorchTensor deepcopy raises error when dtype is not float32 HOT 8
- Support Epsilla as a document store HOT 3
- Error type hints in Python3.12 (#1147) HOT 2
- Release Note
- [Docs Missing] docs.docarray.org -> There isn't a GitHub Pages site here. HOT 1
- Enhancement to the weaviate datatypes support (text[], object, object[]) with WeaviateDocumentIndex HOT 6
- HnswDocumentIndex treats document IDs as string, they can be str, int, ID HOT 4
- Class-typed fields are required when inserting a new document HOT 3
- HNSWLib Indexer cannot knn query in subindex HOT 8
- Loading audio tensors fails: ValueError: all input arrays must have the same shape HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from docarray.