Text length calculation incorrect for non-English languages about py-tree-sitter HOT 3 CLOSED

Issue-Label Bot is automatically applying the label bug to this issue, with a confidence of 0.93. Please mark this comment with 👍 or 👎 to give our bot feedback!

Links: app homepage, dashboard and code for this bot.

from py-tree-sitter.

I agree that .text would be highly useful, though

        print(bytes.decode(code_bytes[child.start_byte:child.end_byte]))

gives the correct output per the playground, https://tree-sitter.github.io/tree-sitter/playground

from py-tree-sitter.

Yes, the code in your reproduction script is not correct. You are using the start_byte and end_byte to slice into a string, but that doesn't work: strings are sliced by character index, not byte index. As @andymass says, you would need to slice the code_bytes array.

from py-tree-sitter.