When importing audio, have an option to create a parameter curve to match the audio.

1. Ideas below, maybe you could call it AutoTrace/AutoDraw (horizontal wavy icon with arrow):
   a) as implied, auto-trace would prepare a continuous haptic curve fit to the audio profile. Hastily done below and you may consider allowing user to see the points or hide them and show smooth curve.Screen Shot 2020-11-14 at 07.37.13.png

   b) allow user the change the waveform after creation (sine, saw, triangle, square, etc).
   c) allow user to lock curve, then drag up/down to modify the intensity/sharpness.
   d) allow user to flip curve (button or double tap), offset curve (drag).

Drawing a parameter curve backwards gives a strange effect, instead we should update the time and duration in reverse to counter act a backward drawing event

Users with older devices without a Haptic Chip are not being alerted that their device can't play Core Haptics

It's really hard to edit the curve at a fine detail level because when you zoom in, their control points also get bigger and end up occupying the screen. See attached screenshot.

Steps to reproduce:

• Place a dynamic on the timeline
• Click on the 'Play on device' icon

(macOS)

We'd like to play haptics during our onboarding video which is around a minute long. We have code to sync an ahap file to the playback of the video but it's quite an ordeal trying to time everything with no visual reference. It would be amazing if Haptrix had support for importing a video file which plays back in the editor (and even better, the app) for synchronization purposes.

Being able to drag events in the lower frame to reorder them would help with visual organization. I am doing a workaround by cutting and pasting, which allows events to be sorted, but it's slow going.

Show error on iOS when Haptic fails to load

When a haptic fails to load on iOS there is no feedback to the user

• Show an error if there is an error

• Show a reason why the haptic may not play

• [x ] iOS

• macOS

• Other

When uploading from the website with an invalid AHAP file, the SVG's that are generated are broken

Any metadata should be optional. Notice that it is not required or even mentioned in Apple's documentation for AHAP files.

Just a note to myself, I'd like to open source the Haptrix iOS app

Thread 0 Crashed:: Dispatch queue: com.apple.main-thread 0 libsystem_platform.dylib 0x00007fff71d5e929 _platform_memmove$VARIANT$Haswell + 41

Right now, it's basically impossible to zoom out and work with more than 2 seconds of clip because everything becomes too small when you zoom. Zooming in and out should just stretch horizontally, not vertically -- this is how they do it in iMovie.

Hans wrote:

Apple has limitations on the size of audio file I believe. My testing shows it hits limit around 4.2MB but is not consistent. You could create an AutoTrim feature.
a) if you can allow creation of longer runs, that would be terrific. But allowing users to profile sound and create a sound “Block” would be helpful.
b) if Apple limits, another approach may be to modify the JSON/AHAP file to separate audio from haptic and sync/time (NSTimeInterval) audio properly, I know that will work as I’ve created files and timed. Apple may balk at vibrations that run too long or other in future. That said, I think the feature would be useful for a broader audience.
b) if Apple limits, it seems 30 second files often fall below the 4.2MB threshold. You could trim the audio file (AVAsset/CMTime). Base filename: Sound.ahap (Sound_30.ahap, Sound.60.ahap…).

Show Sharpness on a Transient item

Steps to reproduce

• Draw a haptic event in the canvas, but don't drag forward, drag it backwards

Note that in the event viewer at the bottom of the screen, the rendered fill is on the wrong side of the bars

I need to review the patterns I'm creating in Haptrix with a client group, which means I'm asking them to download the Haptrix iOS app and load files one at a time. If there was a way to audition multiple files at once, say in a list or with buttons, that would be incredible.

Create a parameter curve
Select it in the Timeline
Hit backspace on the keyboard
Note: Item should have been deleted, but it isn't

Add a GitHub Action to automatically read in the JSON source files and produce the Markdown files

julecom wrote: Being able to edit intensity and sharpness from the timeline (the same way than editing a continuous - when mouse over the top edge, edit length cursor appears and drag up or down to edit intensity)

Add an icon to show if a Haptic contains an Audio file

After debugging this, a single space turns the path to nil, and doesn't try to play the sound.

See WWDC 2021 https://developer.apple.com/videos/play/wwdc2021-10081 for more

I would love to be able to duplicate an element using the option + drag command (like any design softwares) / It would be way easier when trying to duplicate a pattern

Can't select a Transient Haptic bar from the graph after adding a Continuous Haptic "on top of it"
Steps to reproduce:

• place a transient haptic bar (ex. at 0.5s)
• draw a continuous haptic from 0 to 1s
• try to select and move the transient haptic

(macOs)

A window selection tool to select/copy/delete multiple events simultaneously would be hugely helpful
It would be ideal to have a way to select multiple files (window select, shift + select, a grouping function, etc) and be able to edit the same parameters for multiple files at once, e.g. changing the intensity of multiple haptic events simultaneously.

When editing a Haptic event with Audio, it would be useful to playback the audio file.

There should be a way to hide/view events at the bottom. With more complicated projects, my view gets way too cluttered.

Bonus points if these events can also be parented so we can hide/unhide groups of events

The event viewer in the lower frame of the app does not scroll with the timeline, so once events are off the screen they can't be seen. I'm finding it much easier to select events in the lower frame because it doesn't inadvertently move the event on selection. There also appears to be no way to zoom inside either frame.

I've neglected documentation for too long, I need to write some.

I've yet to create a README for this project

Julecom wrote: When the shift key is held down, you should be able to select multiple items

Sounds perfect !!
Also, would it be possible to Move a continuous item by clicking and dragging anywhere on it and edit the duration by clicking on the top of a bracket on either side to make it shorter or longer ?

Originally posted by @julecom in #33 (comment)

This seems to be related to Sandboxing

I would love to be able to play my haptics from the desktop app on the phone when the Haptrix app is in background, that way I can perform actions on my (own) app while playing haptics from the computer to better feel and imagine the work in progress without having to go through Xcode…

Stop invalid files from being able to be uploaded

Invalid files can be uploaded if an invalid file is created and uploaded straight away in the editor.

Detailed Description

We should run the validator on the file before we upload and point out issues to the user.

• Can we highlight which item has an error?

Platforms

• iOS
• macOS
• Wav

If a user has a large audio file, it may cause the haptic engine to run out of memory, show an alert/prompt somewhere saying that it may not work

NO-BREAK SPACE is incompatible with many JSON parsers including JSONSerialization.jsonObject.

I work around this by doing: replacingOccurrences(of: " ", with: " ") on the AHAP string data but this is technically an invalid parsing since NO-BREAK SPACE could appear within JSON strings.

Per, RFC 7159 The JavaScript Object Notation (JSON) Data Interchange Format:

Insignificant whitespace is allowed before or after any of the six structural characters.

  ws = *(
          %x20 /              ; Space
          %x09 /              ; Horizontal tab
          %x0A /              ; Line feed or New line
          %x0D )              ; Carriage return

It's useful to be able to feel a haptic on a PS5 Controller and an Xbox controller at the same time

Sometimes when you select an event, and drag it, the event somehow gets stuck, it's intermittent and I'm yet to get a full reproduction steps for it.

See image below

Add an audio file with a "[" square bracket in the file name and watch the encoder/decoder fail

julecom wrote: I would want to use the arrow icon to select and move elements (I don’t see the use of separating the arrow and the selection tool) and I would add a “hand” icon instead to move the canvas and use the Space bar + Drag command with any tool to move the canvas

Exporting *ahap files is great, sometimes a developer may want finer control, can we export the ahap as Swift code

julecom wrote: It would be cool and useful to add sounds on haptics (for visualisation purpose) on the desktop app.
You could play your haptics by pressing the Play button.

Apple does it well on its website:
ex: https://developer.apple.com/design/human-interface-guidelines/ios/user-interaction/haptics

MacOS app crashes every time I click on the Play button
I'm on macOS Big Sur 11.4 - Haptrix v 3.0.8 (30)

I'd like to be able to layout a Haptic experience, but then, with the constraints of the file, find unique ways of combining them together.

• Can I add a parametric design button?
• Can I generate random Haptic files? - Should we allow it?

On the UI/UX, would be great to also be able to zoom in/out of profile with a slider, and see entire sound as profile similar to Quicktime (Trim).