Comments (6)
Hello 👋
Thank you for taking the time to open this issue with recognize. I know it's frustrating when software
causes problems. You have made the right choice to come here and open an issue to make sure your problem gets looked at
and if possible solved.
I try to answer all issues and if possible fix all bugs here, but it sometimes takes a while until I get to it.
Until then, please be patient.
Note also that GitHub is a place where people meet to make software better together. Nobody here is under any obligation
to help you, solve your problems or deliver on any expectations or demands you may have, but if enough people come together we can
collaborate to make this software better. For everyone.
Thus, if you can, you could also look at other issues to see whether you can help other people with your knowledge
and experience. If you have coding experience it would also be awesome if you could step up to dive into the code and
try to fix the odd bug yourself. Everyone will be thankful for extra helping hands!
One last word: If you feel, at any point, like you need to vent, this is not the place for it; you can go to the forum,
to twitter or somewhere else. But this is a technical issue tracker, so please make sure to
focus on the tech and keep your opinions to yourself. (Also see our Code of Conduct. Really.)
I look forward to working with you on this issue
Cheers 💙
from recognize.
Recognize is classifying each photo 7 times
What leads you to this conclusion? Recognize should not process shared files multiple times per sharee. If this is the case then this is a bug. Otherwise this may likely be a duplicate of #948 (please check it out )
from recognize.
Well, thank you for your fast answer.
I'm struggling having the whole pics analyzed naturally, the "pending jobs" reported in the "Personnal Settings -> Recognize" tab are never triggered. This morning it was indicating 65000 files to be classified and 125000 files to be clustered.
This afternoon I could force the classify process by using the following command :
while true; do PHP_MEMORY_LIMIT=4096M php occ recognize:cluster-faces --batch-size=1000; done
By doing so, I could see in the console that the job kept cycling through each users by 500 item each time, during 9 hours, until the end.
Now the Recognize tab keep saying (translated) :
Classification :
66578 Files queued, Last classified: 2 days ago, Classification jobs scheduled: 1, Classification job last run: 10 hours ago
Clustering : nothing left
So I have just launched the "recognize:classify", it seems it scans the whole 200k files again, I don't really understand why the remaining job is not processing naturally, the log doesn't show any error.
EDIT : after 7h working it stopped. Now I have a remaining job of 66398 faces instead of the previous 66578.
Sorry for mixing several subjects, I'm not super pro at linux, nextcloud, and using Docker Nextcloud also brings additionnal minor problems.
from recognize.
So, there's background jobs and there's the command line commands. You can run the cluster-faces command to work on unclustered faces, but you cannot run the classify command to work on queued photos for classification. The queue is tied to background jobs. So either you setup background jobs in nextcloud correctly and then wait for background jobs to finish processing queued files or you clear all queues and run the classify command to take care of everything for you. As you are doing it currently you are doing the same work multiple times.
Generally, if the last background job ran not too long ago and the last classification was not too long ago, the system is working and you will simply have to wait for your 60000 photos to churn through it. Unless you don't have 60000 images at all, that would be a bug again.
from recognize.
@marcelklehr I followed your advice and added CRON jobs to trigger classify.
Now I have this "normal" notification :
Face recognition: 0 Queued files, Last classification: 2 hours ago, Scheduled background jobs: 0,
Face clustering: 0 faces left to cluster, Last clustering run: 2 hours ago, Scheduled background jobs: 0,
But there are still behaviours I don't understand.
Last 15 days uploaded photos were not visible in the assigned faces, nor in the unassigned faces. I just browsed back and forth between the "people" url, opened several people I was expecting to be recognized, and suddenly I could see the latest photos in the "unassigned faces" list from memories (as the same menu from the "photo" module is doing timeout).
What I don't understand, is that the face clustering batch still announces "0 faces left to cluster", while the unassigned recent faces show my main family members which I know Recognize is able to cluster. The weird thing is that there was 0 cluster action over the last 50 pics, which makes me think that the cluster process is faulty in some way.
from recognize.
Photos in "Unassigned faces" are all after clustering. That means clustering couldn't assign them to a cluster.
from recognize.
Related Issues (20)
- Error: Cannot find module 'fs/promises' HOT 3
- Support External Storage HOT 7
- Recognize results are lost when transferring files to other user HOT 8
- Recognize does not obey ignore files for external storage HOT 7
- Adjust "Platform" check for native TensorFlow support on Nextcloud Snap HOT 3
- JVM background processes cause server crashes HOT 2
- Movinet fails in GPU mode HOT 2
- Stuck at "Checking libtensorflow" in WASM mode HOT 6
- Add a way for user to judge: "This is not a person" HOT 4
- Error loading shared library ld-linux-x86-64.so.2: No such file or directory HOT 2
- Could not execute the Node.js binary. You may need to set the path to a working binary manually. HOT 8
- nextcloud recognize has recognized the face, but the thumbnail cannot be displayed when clicking on the face. HOT 4
- [Bug]: Label abbreviated without way to access its contents HOT 2
- Processing loop HOT 11
- Recrawl background jobs only working during the night (but exceeds maintenance window) HOT 5
- recrawl / classify - only not tagged files HOT 8
- Error in recognize file listener HOT 2
- Allowed memory size of xxx bytes exhausted (tried to allocate yyy bytes) at MrdBallTree.php on line 449 HOT 3
- NPU off-loading HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from recognize.