Benjamin Maxwell 89e7f4d31b [LV] Teach the vectorizer to cost and vectorize modf and sincospi intrinsics (#129064) ...

Follow on to #128035. It is a small extension to support vectorizing
`llvm.modf.*` and `llvm.sincospi.*` too.

This renames the test files from `sincos.ll` ->
`multiple-result-intrinsics.ll` to group together the similar tests
(which make up most of this PR).

2025-02-28 12:56:12 +00:00

..

aarch64-predication.ll

[LoopVectorize][NFC] Rewrite tests to check output of vplan cost model (#113697)

2024-11-19 08:55:39 +00:00

aarch64-unroll.ll

…

arbitrary-induction-step.ll

…

arith-fp-frem-costs.ll

[LoopVectorize][NFC] Fix arith-fp-frem-costs.ll test to use new vplan cost model (#120742)

2025-01-06 10:26:51 +00:00

arm64-unroll.ll

…

backedge-overflow.ll

…

blend-costs.ll

[VPlan] Handle some VPInstructions in may{Read,Write}FromMemory (#120058)

2025-01-08 15:17:26 +08:00

call-costs.ll

[VPlan] Remove loop region in optimizeForVFAndUF. (#108378)

2025-01-05 15:50:42 +00:00

clamped-trip-count.ll

[VPlan] Introduce explicit broadcasts for live-ins. (#124644)

2025-02-26 13:57:51 +00:00

conditional-branches-cost.ll

[LAA] Always require non-wrapping pointers for runtime checks. (#127543)

2025-02-20 19:00:23 +01:00

cost-no-valid-vplans-built.ll

…

deterministic-type-shrinkage.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

divs-with-scalable-vfs.ll

[VPlan] Introduce explicit broadcasts for live-ins. (#124644)

2025-02-26 13:57:51 +00:00

drop-poison-generating-flags.ll

[VPlan] Check VPWidenIntrinsicSC in VPRecipeWithIRFlags::classof.

2025-02-01 21:42:19 +00:00

eliminate-tail-predication.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

epilog-vectorization-factors.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

epilog-vectorization-widen-inductions.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

extend-vectorization-factor-for-unprofitable-memops.ll

…

extractvalue-no-scalarization-required.ll

[LV] Update checks to actually check VPlan for correct function.

2024-12-07 12:05:17 +00:00

first-order-recurrence-fold-tail.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

first-order-recurrence.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

fixed-order-recurrence.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

force-target-instruction-cost.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

fully-unrolled-cost.ll

[AArch64] Improve getPartialReductionCost for fixed-width VFs (#126538)

2025-02-11 15:10:39 +00:00

gather-cost.ll

…

gather-do-not-vectorize-addressing.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

i1-reg-usage.ll

…

induction-costs-sve.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

induction-costs.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

induction-trunc.ll

…

interleave_count_for_estimated_tc.ll

…

interleave_count_for_known_tc.ll

…

interleave-allocsize-not-equal-typesize.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

interleaved_cost.ll

[LoopVectorize] Make needsExtract notice scalarized instructions (#119720)

2025-01-02 14:31:36 +00:00

interleaved-store-of-first-order-recurrence.ll

…

interleaved-vs-scalar.ll

…

interleaving-load-store.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

interleaving-reduction.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

intrinsiccost.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

invalid-costs.ll

[VPlan] Return cost of PHI for scalar VFs in computeCost for FORs.

2024-11-21 21:11:21 +00:00

invariant-replicate-region.ll

[VPlan] Use State.get to extract lane mask for BranchOnMask.

2025-01-27 21:35:36 +00:00

lit.local.cfg

…

loop-vectorization-factors.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

loopvectorize_pr33804_double.ll

[LV] Bail out early if BTC+1 wraps.

2025-01-14 22:07:38 +00:00

low_trip_count_predicates.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

low_trip_memcheck_cost.ll

…

masked-call.ll

[VPlan] Simplify BLEND %a, %b, NOT(%m) -> BLEND %b, %a, %m. (#128375)

2025-02-27 17:43:24 +00:00

masked-op-cost.ll

[LoopVectorize][NFC] Rewrite tests to check output of vplan cost model (#113697)

2024-11-19 08:55:39 +00:00

max-vf-for-interleaved.ll

…

maximize-bandwidth-invalidate.ll

[LoopVectorize][NFC] Rewrite tests to check output of vplan cost model (#113697)

2024-11-19 08:55:39 +00:00

mul-simplification.ll

[VPlan] Only use SCEV for live-ins in tryToWiden. (#125436)

2025-02-03 17:01:02 +00:00

multiple-result-intrinsics.ll

[LV] Teach the vectorizer to cost and vectorize modf and sincospi intrinsics (#129064)

2025-02-28 12:56:12 +00:00

neon-gather-cost.ll

…

neoverse-epilogue-vect.ll

[AArch64][LV] Set MaxInterleaving to 4 for Neoverse V2 and V3 (#100385)

2024-11-20 09:33:39 +00:00

no_vector_instructions.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

nontemporal-load-store.ll

…

optsize_minsize.ll

[LV] Fix tests after 8150ab93f7.

2025-02-27 12:15:24 +00:00

outer_loop_prefer_scalable.ll

[VPlan] Omit zero add in VPWidenIntOrFpInductionRecipe (#119668)

2024-12-16 11:55:48 +08:00

outer_loop_test1_no_explicit_vect_width.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

Oz-and-forced-vectorize.ll

…

partial-reduce-chained.ll

[LoopVectorizer][AArch64] Add support for partial reduce subtraction (#123636)

2025-02-13 10:35:45 +00:00

partial-reduce-dot-product-epilogue.ll

[AArch64] Improve getPartialReductionCost for fixed-width VFs (#126538)

2025-02-11 15:10:39 +00:00

partial-reduce-dot-product-mixed.ll

[LV] Bail out early if BTC+1 wraps.

2025-01-14 22:07:38 +00:00

partial-reduce-dot-product-neon.ll

[LoopVectorizer] Allow partial reductions to be made in predicated loops (#124268)

2025-02-07 09:09:10 +00:00

partial-reduce-dot-product.ll

[AArch64] Improve getPartialReductionCost for fixed-width VFs (#126538)

2025-02-11 15:10:39 +00:00

partial-reduce-no-dotprod.ll

[LV] Bail out early if BTC+1 wraps.

2025-01-14 22:07:38 +00:00

partial-reduce-sub.ll

[LoopVectorizer][AArch64] Add support for partial reduce subtraction (#123636)

2025-02-13 10:35:45 +00:00

pr31900.ll

…

pr33053.ll

…

pr36032.ll

…

pr46950-load-cast-context-crash.ll

…

pr56627.ll

…

pr60831-sve-inv-store-crash.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

pr73894.ll

…

predication_costs.ll

…

prefer-fixed-if-equal-to-scalable.ll

[AArch64] Enable UseFixedOverScalableIfEqualCost for more Cortex-x cpus. (#122807)

2025-01-20 15:05:15 +00:00

reduction-recurrence-costs-sve.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

reduction-small-size.ll

…

reg-usage.ll

…

runtime-check-size-based-threshold.ll

…

runtime-check-trip-count-decisions.ll

…

scalable-alloca.ll

…

scalable-avoid-scalarization.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

scalable-call.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

scalable-fp-ext-trunc-illegal-type.ll

[VPlan] Propagate all GEP flags (#119899)

2024-12-17 13:48:50 +01:00

scalable-predicate-instruction.ll

…

scalable-reduction-inloop-cond.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

scalable-reductions-tf.ll

…

scalable-reductions.ll

…

scalable-strict-fadd.ll

[VPlan] Simplify BLEND %a, %b, NOT(%m) -> BLEND %b, %a, %m. (#128375)

2025-02-27 17:43:24 +00:00

scalable-struct-return.ll

[LV] Add initial support for vectorizing literal struct return values (#109833)

2025-02-17 09:51:35 +00:00

scalable-vectorization-cost-tuning.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

scalable-vectorization.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

scalable-vf-hint.ll

[AArch64] Change the default vscale-for-tuning to 1. (#117174)

2024-11-29 17:41:05 +00:00

scalar_interleave.ll

…

scalarize-store-with-predication.ll

…

sdiv-pow2.ll

…

select-costs.ll

Recommit "[LV][VPlan] Remove any-of reduction from precomputeCost. NFC (#117109)" (#117289)

2024-11-28 15:07:36 +08:00

simple_early_exit.ll

[VPlan] Create IR basic block for middle.block in VPlan.

2025-02-15 21:54:16 +01:00

smallest-and-widest-types.ll

…

sme-vectorize.ll

…

store-costs-sve.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

streaming-compatible-sve-no-maximize-bandwidth.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

streaming-vectorization.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

strict-fadd-cost.ll

…

strict-fadd-vf1.ll

…

strict-fadd.ll

[VPlan] Simplify BLEND %a, %b, NOT(%m) -> BLEND %b, %a, %m. (#128375)

2025-02-27 17:43:24 +00:00

struct-return-cost.ll

[LV] Add initial support for vectorizing literal struct return values (#109833)

2025-02-17 09:51:35 +00:00

sve2-histcnt-epilogue.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve2-histcnt-no-scalar-interleave.ll

[InstCombine] Infer nusw + nneg -> nuw for getelementptr (#111144)

2024-12-05 14:36:40 +01:00

sve2-histcnt-outerloop-scevaddrec.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

sve2-histcnt-too-many-deps.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve2-histcnt-vplan.ll

[LoopVectorize][NFC] Disable output for tests that don't need it (#124747)

2025-01-29 08:09:50 +00:00

sve2-histcnt.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-basic-vec.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

sve-cond-inv-loads.ll

[InstCombine] Infer nusw + nneg -> nuw for getelementptr (#111144)

2024-12-05 14:36:40 +01:00

sve-epilog-vect-inloop-reductions.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-epilog-vect-reductions.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-epilog-vect-strict-reductions.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-epilog-vect-vscale-tune.ll

[AArch64][LV] Set MaxInterleaving to 4 for Neoverse V2 and V3 (#100385)

2024-11-20 09:33:39 +00:00

sve-epilog-vect.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-extract-last-veclane.ll

…

sve-fneg.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-gather-scatter-cost.ll

[LAA] Don't require Stride == 1/-1 for inbounds pointer AddRecs nowrap. (#113126)

2024-11-05 22:45:56 +01:00

sve-gather-scatter.ll

[InstCombine] Infer nusw + nneg -> nuw for getelementptr (#111144)

2024-12-05 14:36:40 +01:00

sve-illegal-type.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

sve-inductions-unusual-types.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

sve-inductions.ll

…

sve-interleaved-accesses-cost.ll

[LV] Add test showing cost-model difference after 9491f75e1d.

2025-01-21 21:37:51 +00:00

sve-interleaved-accesses.ll

[VPlan] Introduce explicit broadcasts for live-ins. (#124644)

2025-02-26 13:57:51 +00:00

sve-interleaved-masked-accesses.ll

[VPlan] Introduce explicit broadcasts for live-ins. (#124644)

2025-02-26 13:57:51 +00:00

sve-inv-loads.ll

…

sve-inv-store.ll

…

sve-invalid-costs.ll

…

sve-large-strides.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

sve-live-out-pointer-induction.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

sve-low-trip-count.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

sve-masked-loadstore.ll

…

sve-multiexit.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-runtime-check-size-based-threshold.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-scalable-load-in-loop.ll

…

sve-select-cmp.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

sve-strict-fadd-cost.ll

[AArch64] Change the default vscale-for-tuning to 1. (#117174)

2024-11-29 17:41:05 +00:00

sve-tail-folding-cost.ll

…

sve-tail-folding-forced.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

sve-tail-folding-option.ll

…

sve-tail-folding-optsize.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

sve-tail-folding-overflow-checks.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

sve-tail-folding-reductions.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

sve-tail-folding-unroll.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00

sve-tail-folding.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

sve-type-conv.ll

…

sve-vector-reverse-mask4.ll

…

sve-vector-reverse.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

sve-vfabi.ll

…

sve-widen-extractvalue.ll

[LV] Bail out early if BTC+1 wraps.

2025-01-14 22:07:38 +00:00

sve-widen-gep.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

sve-widen-phi.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

synthesize-mask-for-call.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

tail-fold-uniform-memops.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

tail-folding-styles.ll

[VPlan] Introduce explicit broadcasts for live-ins. (#124644)

2025-02-26 13:57:51 +00:00

transform-narrow-interleave-to-widen-memory.ll

[LV] Add more tests for narrowing interleave groups for AArch64.

2025-01-26 13:52:18 +00:00

type-shrinkage-insertelt.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

type-shrinkage-zext-costs.ll

[IR] Convert from nocapture to captures(none) (#123181)

2025-01-29 16:56:47 +01:00

uniform-args-call-variants.ll

[InstCombine] Infer nusw + nneg -> nuw for getelementptr (#111144)

2024-12-05 14:36:40 +01:00

unsafe-vf-hint-remark.ll

…

veclib-calls-libsystem-darwin.ll

…

veclib-function-calls.ll

[AArch64] Change the default vscale-for-tuning to 1. (#117174)

2024-11-29 17:41:05 +00:00

veclib-intrinsic-calls.ll

…

vector-call-linear-args.ll

…

vector-reverse-mask4.ll

[LLVM][IR] Use splat syntax when printing Constant[Data]Vector. (#112548)

2024-11-06 11:53:33 +00:00

vector-reverse.ll

…

vplan-printing.ll

[VPlan] Create IR basic block for middle.block in VPlan.

2025-02-15 21:54:16 +01:00

widen-call-with-intrinsic-or-libfunc.ll

[VPlan] Compute induction end values in VPlan. (#112145)

2024-12-29 19:05:08 +00:00

wider-VF-for-callinst.ll

[LLVM][IR] Use splat syntax when printing ConstantExpr based splats. (#116856)

2024-11-21 11:21:12 +00:00