Comments (4)
- The text attention is meaningful when text input is given.
- For most experiments, training is done given by both image and text. w/o text and w/ text means the situation in the testing stage.
- No model difference, just do not send the text input (by setting the text feature matrix to zero).
from tandemnet.
@zizhaozhang
I am very interested in this paper. Hope you can provide some answers for my questions, thanks a lot!
-
so one of the idea this paper wants to tell us is that , using both image and text to train a model, and the image classification accuracy will increase? What reason can explain this accuracy increase?
-
it seems that your report can be summarized as 5 2-class or 3-class classification problems. So in the real medical report, I wonder that, does the doctor write sentences like "moderate crowding of the nuclei can be seen" , or write a crowding label(for example, 1 indicates mild crowding, 2 indicates moderate crowding, 3 indicates severe crowding)? If write labels, why not regard this a pure image classification problem?( I mean 5 classification problems , regarding the 5 cell appearances)
-
Besides, I observed that the descriptions are mainly about the cell appearance features, so why not directly using cell segmentation results to get the cell appearance features, since this seems more reasonable and reliable than learning from the report? (Because the cell segmentation results can not be integrated into a deep learning framework?)
from tandemnet.
Thanks !
- The introduced text knowledge
- Please note that we are not trying to solve the problem of this dataset. Our model is designed to input free text. For pathology images, it is true for pathologist to write this kind of report. They prefer to not change too much. You can find evidence from a pathology book.
- It is a fundamental logic question. Do you think image recognition is useful? Why we just do object detection?
Pls ask further paper question using email. This is for code issue :)
from tandemnet.
@zizhaozhang
I have already emailed you([email protected]) for further questions. Waiting for your answer. Thanks!
from tandemnet.
Related Issues (1)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tandemnet.