Code Monkey home page Code Monkey logo

Comments (18)

streetpea avatar streetpea commented on May 22, 2024 8

Update: I found the missing message sent over 9296 ... it works now on my computer! I'll push an update with mic support soon (I'll submit it upstream to chiaki and release it for chiaki4deck in the next week or so). Florian Grill was very helpful as well :)

from chiaki4deck.

streetpea avatar streetpea commented on May 22, 2024 5

I stopped working on it for a while but I will start working on it again.

from chiaki4deck.

chanksworld avatar chanksworld commented on May 22, 2024 4

I second this, microphone support is one of the pillars which is holding Chiaki back from being truly great . An added plus would be the abiliy to use regular non-mic headohones with the built-in steamdeck mic like on dualsense controllers.

from chiaki4deck.

streetpea avatar streetpea commented on May 22, 2024 4

added with 1.4.0 with commit 6fc4b8f

from chiaki4deck.

chanksworld avatar chanksworld commented on May 22, 2024 1

Yes it works in the official app. Through controller or any input on pc. Works with deck mic when running on windows

from chiaki4deck.

streetpea avatar streetpea commented on May 22, 2024 1

It’s in the takion.proto in several places such as:

message MicInfoPayload {
and here: https://github.com/streetpea/chiaki4deck/blob/main/lib/protobuf/takion.proto#L38 though the mic/micconnection doesn’t seem to be linked into Chiaki other than sending a default mute type. For example, there is no link to the micconnection in the stream connection code (or seemingly any other Chiaki code for that matter). In contrast, the controller connection from takion.proto is referenced here)

from chiaki4deck.

chanksworld avatar chanksworld commented on May 22, 2024

while this is being worked on (hopefully) any idea if using the pulse headset while in same room as ps5 could be a workaround? Considering buying one for this

from chiaki4deck.

jbaiter avatar jbaiter commented on May 22, 2024

Do you know if the microphone works in the official remote play app? I think I've tried it once with the Astro Controller Demo but could not get it to work.

from chiaki4deck.

jbaiter avatar jbaiter commented on May 22, 2024

Thanks, so that will probably require some more reverse engineering, currently there's nothing in Chiaki regarding mic support.

from chiaki4deck.

sdf86 avatar sdf86 commented on May 22, 2024

Is this still being worked on?

from chiaki4deck.

KarmaLeDemon avatar KarmaLeDemon commented on May 22, 2024

hello, sorry to disturb you. Are you still working on chiaki4deck? Because I wanted to use the microphone is I saw that it was not yet available. Thank you very much and again sorry

from chiaki4deck.

sdf86 avatar sdf86 commented on May 22, 2024

from chiaki4deck.

cetowne avatar cetowne commented on May 22, 2024

I stopped working on it for a while but I will start working on it again.

Thank you! This would be epic. Let me know if there’s a way to support or help!

from chiaki4deck.

danielkerwin avatar danielkerwin commented on May 22, 2024

I stopped working on it for a while but I will start working on it again.

If mic was working, I would never need to sit down at the actual PS5 again.

It’d be amazing if you can support this 😍

from chiaki4deck.

streetpea avatar streetpea commented on May 22, 2024

Mic is being worked on at https://github.com/streetpea/chiaki_mic. @jbaiter have you looked at mic support at all? I'm trying to add mic support and able to form audio messages via recorded audio that I send over takion (https://github.com/streetpea/chiaki_mic/blob/f3128a4ac6ee90906df8b7ee632ffcbad5218ead/lib/src/takion.c#L566) but right now nothing is happening. I tried piping these audio messages to the playback function for received audio in this branch (https://github.com/streetpea/chiaki_mic/tree/audio-test) as a test and that works (I can hear recorded audio played back via the speaker ... i.e., decrypted, opus decoded and then played back) so it seems that the audio packets are correctly formed and the encryption follows what's done for the controller feedback packets (https://github.com/streetpea/chiaki_mic/blob/4acaecf2652e278b792d5b0274bf156419445e83/lib/src/takion.c#L513). However, given the audio test shows no audio, clearly something is wrong. I have been talking to Florian Grill (he implemented mic in PS Play) and it seems to be very close to what he has so is at least close to being correct...do you have any insight into this?

Note: I'm implementing this in base Chiaki first and after submitting a pull request (i.e., git send-email) there will add to chiaki4deck so now it's just based off of the latest Chiaki code.

from chiaki4deck.

jbaiter avatar jbaiter commented on May 22, 2024

Sorry, I haven't look into it very closely :-( I was going to point you to Florian Grill as well 😅 Maybe he can send you some decrypted packet dumps and you can compare?

from chiaki4deck.

streetpea avatar streetpea commented on May 22, 2024

From my tests (playback of encrypted message) it seems like the audio message is being formed correctly but Florian Grill is going to send me a sample before encryption for a given audio input to check...if we get the same result then it must be something with the encryption/gmac but I'm hoping it's not that bc debugging that could prove challenging.

from chiaki4deck.

streetpea avatar streetpea commented on May 22, 2024

@jbaiter so Florian Grill helped me check the audio message and the encryption and it appears to be in order but it's still not working so there appears to be something missing but not sure what it is. Florian thinks that should be everything though so it's a bit of a mystery what's going wrong.

from chiaki4deck.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.