Question about Android audio only about streamassist HOT 11 CLOSED

I am working on a similar project but also with visual support. I have a demo .
I managed to replace the esp32 satellite that I used in this demo with Stream Assist integration together with the android application IP Webcam.
This application has the option to send only audio and thus I managed to use the camera on the fully kiosk browser for motion detection, at the same time, the IP Webcam application to send audio and it works very well together.
I hope that AlexxIT manages to find a solution to this problem and then integrate everything in the Stream Assist integration. I would also like to add the visual part in the Stream Assist integration as well.
I have replaced the video clips with gifs and there is no longer a need for two players, only the popup and media player from browser mod. I don't know if the camera from the browser mod also transmits audio, so that there would be no need for another application for audio.
And with what you did in this video, we can replace the nest audio speaker with nest hub display and have visual support. I am already working on this project.

from streamassist.

I added the tablet camera to the frigate and now I have a motion sensor, person detection and even facial detection and I can make an automation to turn on and off the tablet screen like the fully kiosk browser did. You can set to send the answers from Assist on the media player from the tablet via fully kiosk browser or browser mod.
On Google speakers, if a tts is sent or a response is played, if something is played on the speaker, the music does not resume. That's why it would be good to use google speakers for music and for Assist responses the media player on the tablet or other Home Assistant satellites.

from streamassist.

In Power management I checked "Stream on device boot", then in "Optional permissions" I checked "Allow streaming in background". I start the server only once and then let it run in the background. If the tablet is restarted, IP Webcam starts by itself and with the server running.

from streamassist.

This is software problem. StreamAssist requests only audio from RTSP source. It don't needs any video.
Maybe you should search another Android software. Or start to use only IPCAM as video source from Android.
Fully Kiosk streams video in the MJPEG format. It can't have audio inside.

from streamassist.

You can also disable motion/camera in FKB and use frigate on the rtsp stream. Frigate can also do VAD (and obviously motion/person detection) so you could trigger various automations to drive StreamAssist & Tablet screen/screensaver.

from streamassist.

I am working on a similar project but also with visual support. I have a demo . I managed to replace the esp32 satellite that I used in this demo with Stream Assist integration together with the android application IP Webcam. This application has the option to send only audio and thus I managed to use the camera on the fully kiosk browser for motion detection, at the same time, the IP Webcam application to send audio and it works very well together.

Thanks to you all for the responses. This gives me great encouragement that what I'm wanting to do is possible. I installed Web IPCAM and configured it. I can see and hear audio using the tablet's http server page at port 8080. I cannot, however, get StreamAssist to recognize the wake word so I'm not sure that the audio is getting into StreamAssist properly. @relust Could you possibly share any relevant settings in Web IPCAM that I should be setting and also what url you are using in the StreamAssist integration? I've tried http and the rtsp://192.168.0.152:8080/h264_ulaw.sdp urls without success.

EDIT So I tried the 'IP Camera' app on my phone and output to the media player being created by FK and things work great. I am guessing that 'IP Webcam' configuration on the tablet I'm using is incorrect and would still appreciate your configuration if possible.

I think I may not be understanding 100% but is it possible to run both FK and the 'IP Webcam' app on the same device? Won't there be a conflict between FK and IP Webcam both trying to access the audio device at the same time?

from streamassist.

It works for me with rtsp://192.168.0.247:8080/h264_pcm.sdp and with rtsp://192.168.0.247:8080/h264_ulaw.sdp with video and audio enabled. In version 1 of the stream assist integration, it worked very well with the Audio only option activated, but I just noticed that now, with version 2 of the Stream Assist integration, it no longer works. Maybe AlexxIT can tell us why it no longer works in version 2 of the integration with the Audio only option enabled.

from streamassist.

Thanks @relust I have it working now. I ended up having to get out of FK totally and got IP Webcam running then I fired up FK and things are working pretty well. I had been trying with audio only so turning video on seems to have done the trick. I did notice that if I have music playing via Music Assistant that the music does not resume after Assist answers. Other than that, fantastic! Thanks for the help.

I do notice a second or so of lag when saying the wake word before I get the notice it is listening. I'm wondering if this is because of the additional overhead of the video being streamed too. Would certainly think the audio only stream would be ideal.

from streamassist.

@relust I see what you mean but I am trying to have everything self contained if possible. I'm trying to replace my Alexa/Google devices :)

Do you have a way to auto start IP Webcam server? Is that a feature of pro?

from streamassist.

In Power management I checked "Stream on device boot", then in "Optional permissions" I checked "Allow streaming in background". I start the server only once and then let it run in the background. If the tablet is restarted, IP Webcam starts by itself and with the server running.

@relust Strange but I don't see that optional permissions option for Allowing to stream in the background.. On a reboot I now have it IP Webcam but it is displayed rather than FK. Guess I'll need to look for a solution that launches FK after or something.

from streamassist.

Media not resuming is because music assistant doesn't support announcements/tts yet.

from streamassist.