Florian Hahn b021464d35 [VPlan] Introduce scalar loop header in plan, remove VPLiveOut. (#109975) ...

Update VPlan to include the scalar loop header. This allows retiring
VPLiveOut, as the remaining live-outs can now be handled by adding
operands to the wrapped phis in the scalar loop header.

Note that the current version only includes the scalar loop header, no
other loop blocks and also does not wrap it in a region block.

PR: https://github.com/llvm/llvm-project/pull/109975

2024-10-31 21:36:44 +01:00

..

aarch64-predication.ll

…

aarch64-unroll.ll

…

arbitrary-induction-step.ll

[VPlan] Implement unrolling as VPlan-to-VPlan transform. (#95842)

2024-09-21 19:47:37 +01:00

arith-fp-frem-costs.ll

[CostModel][LoopVectorize] Move some loop vectoriser tests (#113702)

2024-10-30 13:50:02 +00:00

arm64-unroll.ll

…

backedge-overflow.ll

…

blend-costs.ll

[NFC] Migrate tests to use autoupdate for CHECK lines.

2024-10-22 12:55:15 +00:00

call-costs.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

clamped-trip-count.ll

[VPlan] Add VPValue for VF, use it for VPWidenIntOrFpInductionRecipe. (#95305)

2024-09-10 10:41:35 +01:00

conditional-branches-cost.ll

Revert "[AArch64][SVE] Enable max vector bandwidth for SVE" (#112873)

2024-10-18 11:05:55 +01:00

cost-no-valid-vplans-built.ll

[VPlan] Return std::nullopt early if plans are empty.

2024-06-27 12:25:59 +01:00

deterministic-type-shrinkage.ll

[VPlan] Implement unrolling as VPlan-to-VPlan transform. (#95842)

2024-09-21 19:47:37 +01:00

divs-with-scalable-vfs.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

eliminate-tail-predication.ll

[LV] Use SCEV to check if minimum iteration check is known. (#111310)

2024-10-18 15:22:59 -07:00

epilog-vectorization-widen-inductions.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

extend-vectorization-factor-for-unprofitable-memops.ll

…

extractvalue-no-scalarization-required.ll

[VPlan] Generalize VPValue::isDefinedOutsideLoopRegions.

2024-09-20 15:34:00 +01:00

first-order-recurrence-fold-tail.ll

[VPlan] Introduce ResumePhi VPInstruction, use to create phi for FOR. (#94760)

2024-07-11 16:08:04 +01:00

first-order-recurrence.ll

…

fixed-order-recurrence.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

force-target-instruction-cost.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

gather-cost.ll

…

gather-do-not-vectorize-addressing.ll

…

i1-reg-usage.ll

…

induction-costs-sve.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

induction-costs.ll

[VPlan] Introduce scalar loop header in plan, remove VPLiveOut. (#109975)

2024-10-31 21:36:44 +01:00

induction-trunc.ll

…

interleave_count_for_estimated_tc.ll

…

interleave_count_for_known_tc.ll

…

interleave-allocsize-not-equal-typesize.ll

[VPlan] Don't created GEP x, 0 for interleave group pointers.

2024-10-08 12:08:13 +01:00

interleaved_cost.ll

[LV] Assign cost to all interleave members when not interleaving.

2024-09-11 21:04:34 +01:00

interleaved-store-of-first-order-recurrence.ll

[VPlan] Don't created GEP x, 0 for interleave group pointers.

2024-10-08 12:08:13 +01:00

interleaved-vs-scalar.ll

[LV] Assign cost to all interleave members when not interleaving.

2024-09-11 21:04:34 +01:00

interleaving-load-store.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

interleaving-reduction.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

intrinsiccost.ll

TTI: Fix special casing vectorization costs of saturating add/sub (#97463)

2024-08-06 17:33:52 +04:00

invariant-replicate-region.ll

[LV] Move test requiring AArch64 to target subdir.

2024-09-21 12:54:59 +01:00

lit.local.cfg

…

loop-vectorization-factors.ll

[VPlan] Introduce scalar loop header in plan, remove VPLiveOut. (#109975)

2024-10-31 21:36:44 +01:00

loopvectorize_pr33804_double.ll

…

low_trip_count_predicates.ll

[LoopVectorize] Use predicated version of getSmallConstantMaxTripCount (#109928)

2024-10-11 10:10:15 +01:00

low_trip_memcheck_cost.ll

…

masked-call.ll

[LV] Use SCEV to check if minimum iteration check is known. (#111310)

2024-10-18 15:22:59 -07:00

masked-op-cost.ll

…

max-vf-for-interleaved.ll

…

maximize-bandwidth-invalidate.ll

…

mul-simplification.ll

[VPlan] Simplify MUL operands at recipe construction.

2024-09-02 21:25:31 +01:00

neon-gather-cost.ll

…

no_vector_instructions.ll

…

nontemporal-load-store.ll

…

outer_loop_prefer_scalable.ll

[VPlan] Add VPValue for VF, use it for VPWidenIntOrFpInductionRecipe. (#95305)

2024-09-10 10:41:35 +01:00

outer_loop_test1_no_explicit_vect_width.ll

…

Oz-and-forced-vectorize.ll

…

pr31900.ll

…

pr33053.ll

…

pr36032.ll

…

pr46950-load-cast-context-crash.ll

…

pr56627.ll

…

pr60831-sve-inv-store-crash.ll

[LV] Use SCEV to check if minimum iteration check is known. (#111310)

2024-10-18 15:22:59 -07:00

pr73894.ll

[VPlan] Remove VPPredInstPHIRecipes without users after region merging.

2024-07-20 13:21:32 +01:00

predication_costs.ll

…

prefer-fixed-if-equal-to-scalable.ll

[LV][AArch64] Prefer Fixed over Scalable if cost-model is equal (Neoverse V2) (#95819)

2024-07-17 10:46:28 +01:00

reduction-recurrence-costs-sve.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

reduction-small-size.ll

…

reg-usage.ll

…

runtime-check-size-based-threshold.ll

…

runtime-check-trip-count-decisions.ll

…

scalable-alloca.ll

[VPlan] Port invalid cost remarks to VPlan. (#99322)

2024-07-27 12:52:12 +01:00

scalable-avoid-scalarization.ll

[VPlan] Add VPValue for VF, use it for VPWidenIntOrFpInductionRecipe. (#95305)

2024-09-10 10:41:35 +01:00

scalable-call.ll

[VPlan] Introduce VPWidenIntrinsicRecipe to separate from libcall. (#110486)

2024-10-08 22:37:20 +01:00

scalable-fp-ext-trunc-illegal-type.ll

[LV][AArch64] Don't query registers for illegal scalable vector elts (#109411)

2024-09-23 13:35:23 +01:00

scalable-predicate-instruction.ll

…

scalable-reduction-inloop-cond.ll

[LV] Prefer FLT_MIN/MAX for fmin/fmax reductions with ninf (#107141)

2024-09-03 12:21:54 -07:00

scalable-reductions-tf.ll

…

scalable-reductions.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

scalable-strict-fadd.ll

[LV] Regenerate check-lines for some tests.

2024-10-23 04:34:13 +01:00

scalable-vectorization-cost-tuning.ll

Revert "[AArch64][SVE] Enable max vector bandwidth for SVE" (#112873)

2024-10-18 11:05:55 +01:00

scalable-vectorization.ll

Revert "[AArch64][SVE] Enable max vector bandwidth for SVE" (#112873)

2024-10-18 11:05:55 +01:00

scalable-vf-hint.ll

…

scalar_interleave.ll

…

scalarize-store-with-predication.ll

…

scatter-cost.ll

[AArch64] Increase scatter overhead on Neoverse-V2 (#101296)

2024-08-14 10:12:40 +05:30

sdiv-pow2.ll

…

select-costs.ll

[LoopVectorize] LLVM fails to vectorise loops with multi-bool varables (#89226)

2024-07-15 20:21:50 +01:00

simple_early_exit.ll

[NFC][LoopVectorize] Add more simple early exit tests (#112529)

2024-10-17 09:49:51 +01:00

smallest-and-widest-types.ll

…

sme-vectorize.ll

[AArch64] Consider streaming mode in TTI interfaces for vectorization. (#96305)

2024-06-24 11:06:16 +01:00

store-costs-sve.ll

Revert "[AArch64][SVE] Enable max vector bandwidth for SVE" (#112873)

2024-10-18 11:05:55 +01:00

streaming-compatible-sve-no-maximize-bandwidth.ll

[VPlan] Model branch cond to enter scalar epilogue in VPlan. (#92651)

2024-07-05 10:08:42 +01:00

streaming-vectorization.ll

[LLVM][TTI][SME] Allow optional auto-vectorisation for streaming functions. (#101679)

2024-08-05 11:25:44 +01:00

strict-fadd-cost.ll

…

strict-fadd-vf1.ll

…

strict-fadd.ll

[VPlan] Model branch cond to enter scalar epilogue in VPlan. (#92651)

2024-07-05 10:08:42 +01:00

sve2-histcnt-epilogue.ll

[LV] Vectorize histogram operations (#99851)

2024-09-27 13:08:55 +01:00

sve2-histcnt-no-scalar-interleave.ll

[LV] Vectorize histogram operations (#99851)

2024-09-27 13:08:55 +01:00

sve2-histcnt-outerloop-scevaddrec.ll

[LV] Vectorize histogram operations (#99851)

2024-09-27 13:08:55 +01:00

sve2-histcnt-too-many-deps.ll

[LV] Vectorize histogram operations (#99851)

2024-09-27 13:08:55 +01:00

sve2-histcnt-vplan.ll

[VPlan] Introduce scalar loop header in plan, remove VPLiveOut. (#109975)

2024-10-31 21:36:44 +01:00

sve2-histcnt.ll

Revert "[AArch64][SVE] Enable max vector bandwidth for SVE" (#112873)

2024-10-18 11:05:55 +01:00

sve-basic-vec.ll

…

sve-cond-inv-loads.ll

[VPlan] Add initial loop-invariant code motion transform. (#107894)

2024-09-20 11:22:03 +01:00

sve-epilog-vect-inloop-reductions.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

sve-epilog-vect-reductions.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

sve-epilog-vect-strict-reductions.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

sve-epilog-vect-vscale-tune.ll

…

sve-epilog-vect.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

sve-extract-last-veclane.ll

…

sve-fneg.ll

…

sve-gather-scatter-cost.ll

…

sve-gather-scatter.ll

[VPlan] Add VPValue for VF, use it for VPWidenIntOrFpInductionRecipe. (#95305)

2024-09-10 10:41:35 +01:00

sve-illegal-type.ll

[LoopVectorize][AArch64] Add limited support for scalable vectorisation of i1 types (#95920)

2024-06-25 15:04:24 +01:00

sve-inductions-unusual-types.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

sve-inductions.ll

[VPlan] Add VPValue for VF, use it for VPWidenIntOrFpInductionRecipe. (#95305)

2024-09-10 10:41:35 +01:00

sve-interleaved-accesses.ll

[InstCombine] Set samesign when converting signed predicates into unsigned (#112642)

2024-10-17 20:43:48 +08:00

sve-interleaved-masked-accesses.ll

[InstCombine] Set samesign when converting signed predicates into unsigned (#112642)

2024-10-17 20:43:48 +08:00

sve-inv-loads.ll

[VPlan] Add initial loop-invariant code motion transform. (#107894)

2024-09-20 11:22:03 +01:00

sve-inv-store.ll

…

sve-invalid-costs.ll

[LoopVectorize] Fix build issue caused by #95920 (#96647)

2024-06-25 15:51:32 +01:00

sve-large-strides.ll

…

sve-live-out-pointer-induction.ll

[LV] Compute value of escaped induction based on the computed end value. (#110576)

2024-10-10 20:04:46 +01:00

sve-low-trip-count.ll

…

sve-masked-loadstore.ll

…

sve-multiexit.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

sve-runtime-check-size-based-threshold.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

sve-scalable-load-in-loop.ll

…

sve-select-cmp.ll

[VPlan] Model branch cond to enter scalar epilogue in VPlan. (#92651)

2024-07-05 10:08:42 +01:00

sve-strict-fadd-cost.ll

…

sve-tail-folding-cost.ll

…

sve-tail-folding-forced.ll

[VPlan] Use VPInstruction::Name when assigning names (NFCI).

2024-10-18 05:52:35 +01:00

sve-tail-folding-option.ll

Prefer use of 0.0 over -0.0 for fadd reductions w/nsz (in IR) (#106770)

2024-09-03 09:16:37 -07:00

sve-tail-folding-optsize.ll

…

sve-tail-folding-overflow-checks.ll

…

sve-tail-folding-reductions.ll

[VPlan] Model branch cond to enter scalar epilogue in VPlan. (#92651)

2024-07-05 10:08:42 +01:00

sve-tail-folding-unroll.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

sve-tail-folding.ll

[LV] Use SCEV to check if minimum iteration check is known. (#111310)

2024-10-18 15:22:59 -07:00

sve-type-conv.ll

…

sve-vector-reverse-mask4.ll

…

sve-vector-reverse.ll

[LV][VPlan] Use VF VPValue in VPVectorPointerRecipe (#110974)

2024-10-26 23:18:50 +08:00

sve-vfabi.ll

…

sve-widen-extractvalue.ll

[VPlan] Generalize VPValue::isDefinedOutsideLoopRegions.

2024-09-20 15:34:00 +01:00

sve-widen-gep.ll

[VPlan][NFC] Fix the value name of VECTOR_GEP (#107544)

2024-09-18 19:22:36 +08:00

sve-widen-phi.ll

[InstCombine] Set samesign when converting signed predicates into unsigned (#112642)

2024-10-17 20:43:48 +08:00

synthesize-mask-for-call.ll

[VPlan] Introduce scalar loop header in plan, remove VPLiveOut. (#109975)

2024-10-31 21:36:44 +01:00

tail-fold-uniform-memops.ll

…

tail-folding-styles.ll

Move stepvector intrinsic out of experimental namespace (#98043)

2024-08-28 12:48:20 +01:00

type-shrinkage-insertelt.ll

…

type-shrinkage-zext-costs.ll

Revert "[AArch64][SVE] Enable max vector bandwidth for SVE" (#112873)

2024-10-18 11:05:55 +01:00

uniform-args-call-variants.ll

[InstCombine] Replace all dominated uses of condition with constants (#105510)

2024-09-01 09:49:23 +08:00

unsafe-vf-hint-remark.ll

…

veclib-calls-libsystem-darwin.ll

[aarch64] atan2 intrinsic lowering (p5) (#112611)

2024-10-24 17:53:12 -07:00

veclib-function-calls.ll

[AArch64][Test] Update test variable names (NFC) (#110667)

2024-10-03 16:14:21 +01:00

veclib-intrinsic-calls.ll

[aarch64] atan2 intrinsic lowering (p5) (#112611)

2024-10-24 17:53:12 -07:00

vector-call-linear-args.ll

[LAA] Don't assume libcalls with output/input pointers can be vectorized (#108980)

2024-09-23 16:05:55 +01:00

vector-reverse-mask4.ll

[InstCombine] Remove some of the complexity-based canonicalization (#91185)

2024-08-21 12:02:54 +02:00

vector-reverse.ll

…

widen-call-with-intrinsic-or-libfunc.ll

[VPlan] Introduce scalar loop header in plan, remove VPLiveOut. (#109975)

2024-10-31 21:36:44 +01:00

wider-VF-for-callinst.ll

[LV] Use SCEV to check if minimum iteration check is known. (#111310)

2024-10-18 15:22:59 -07:00