Comments (2)
There is a note for the forward function:
"""
The forward expects a NestedTensor, which consists of:
- samples.tensor: batched images, of shape [batch_size x 3 x H x W]
- samples.mask: a binary mask of shape [batch_size x H x W], containing 1 on padded pixels
It returns a dict with the following elements:
- "pred_logits": the entity classification logits (including no-object) for all entity queries.
Shape= [batch_size x num_queries x (num_classes + 1)]
- "pred_boxes": the normalized entity boxes coordinates for all entity queries, represented as
(center_x, center_y, height, width). These values are normalized in [0, 1],
relative to the size of each individual image (disregarding possible padding).
See PostProcess for information on how to retrieve the unnormalized bounding box.
- "sub_logits": the subject classification logits
- "obj_logits": the object classification logits
- "sub_boxes": the normalized subject boxes coordinates
- "obj_boxes": the normalized object boxes coordinates
- "aux_outputs": Optional, only returned when auxilary losses are activated. It is a list of
dictionnaries containing the two above keys for each decoder layer.
"""
outputs_class is the entity prediction from DETR backbone, while
outputs_class_rel is the relationship prediction from RelTR.
from reltr.
Thank you!
from reltr.
Related Issues (20)
- About evaluate_rel_batch() function HOT 7
- name 'train_stats' is not defined HOT 2
- convert the reltr model to onnx forma
- about Predcls HOT 1
- Evaluation HOT 3
- checkpoint should be updated with enhanced version HOT 1
- Some misunderstanding about the heat map using to predict Relationship HOT 2
- Error during training in bbox.pyx : ValueError: Buffer dtype mismatch, expected 'DTYPE_t' but got 'double' HOT 1
- 请问如何将inference.py得到的场景图保存成一个json文件呢 HOT 1
- What happens when there are no relations in a sample? HOT 2
- When I was training data, I encountered an error HOT 1
- About OpenV6 HOT 3
- How to use the resulting weight file for evaluation HOT 1
- 1 HOT 5
- I can only get the relationships between entities, how can I get the scene graph? HOT 1
- Unable to train on a single GPU - ChildFailedError( torch.distributed.elastic.multiprocessing.errors.ChildFailedError HOT 1
- Incompatible tensor size when a running a batch size of 2 HOT 2
- demo HOT 3
- 关于openimages的数据处理问题 HOT 1
- Generated checkpoint files throwing error when trying to infere an image HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from reltr.