Thank you for your very interesting paper and for sharing the code base! I think there

A possible typo on line 44 of <a href="https://github.com/suzgunmirac/BIG-Bench-Hard/b

An typo on line 9 of <a href="https://github.com/suzgunmirac/BIG-Bench-Hard/blob/main/

Hi <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="

Potential typos in CoT prompts about big-bench-hard HOT 3 CLOSED

samar-khanna commented on June 26, 2024 1

Potential typos in CoT prompts

from big-bench-hard.

Comments (3)

samar-khanna commented on June 26, 2024 1

A possible typo on line 44 of navigate.txt

(4) Take 7 steps right: (0, 7), facing the positive y-axis.

should be

(4) Take 7 steps right: (0, 0), facing the positive y-axis.

from big-bench-hard.

samar-khanna commented on June 26, 2024 1

An typo on line 9 of web_of_lies.txt

(3) Vina says Jerry tells the truth. Since we know from (2) that Jerry tells the truth, if Vine says Jerry tells the truth, then Vina tells the truth.

should be

(3) Vina says Jerry tells the truth. Since we know from (2) that Jerry tells the truth, if Vina says Jerry tells the truth, then Vina tells the truth.

from big-bench-hard.

suzgunmirac commented on June 26, 2024 1

Hi @samar-khanna ,

Thank you so much for your meticulous examination of all our prompt files and for bringing to our attention these three minor typos. After reviewing your suggested corrections, I agree that they are all accurate. Thank you again for your help!

All the best,

MS.

from big-bench-hard.

Recommend Projects