Skip to content

Commit 25e4003

Browse files
committed
fixup: switch to ulp tolerance
tan(2.0h) is 2 ULPs off on AMD. We could arguably bump this all the way up to 4
1 parent a718c4e commit 25e4003

1 file changed

Lines changed: 3 additions & 2 deletions

File tree

test/Feature/HLSLLib/tan.16.test

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -46,8 +46,9 @@ Buffers:
4646
# 0, -sqrt(3), sqrt(3), tan(2.0) ~= -2.185
4747
Results:
4848
- Result: Test1
49-
Rule: BufferFloatEpsilon
50-
Epsilon: 0.003
49+
Rule: BufferFloatULP
50+
ULPT: 2
51+
ZeroTolerance: 0.001
5152
Actual: Out
5253
Expected: ExpectedOut
5354
DescriptorSets:

0 commit comments

Comments
 (0)