Florian Hahn b021464d35 [VPlan] Introduce scalar loop header in plan, remove VPLiveOut. (#109975) ...

Update VPlan to include the scalar loop header. This allows retiring
VPLiveOut, as the remaining live-outs can now be handled by adding
operands to the wrapped phis in the scalar loop header.

Note that the current version only includes the scalar loop header, no
other loop blocks and also does not wrap it in a region block.

PR: https://github.com/llvm/llvm-project/pull/109975

2024-10-31 21:36:44 +01:00

..

CostModel

[CostModel][LoopVectorize] Move some loop vectoriser tests (#113702)

2024-10-30 13:50:02 +00:00

already-vectorized.ll

[LV] Disable runtime unrolling for vectorized loops.

2023-01-06 10:56:17 +00:00

amdlibm-calls-finite.ll

Adding more vector calls for -fveclib=AMDLIBM (#109662)

2024-10-29 10:09:55 +00:00

amdlibm-calls.ll

Adding more vector calls for -fveclib=AMDLIBM (#109662)

2024-10-29 10:09:55 +00:00

avx1.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

avx512.ll

BlockFrequencyInfoImpl: Avoid big numbers, increase precision for small spreads

2023-10-24 20:27:39 -07:00

consecutive-ptr-cg-bug.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

consecutive-ptr-uniforms.ll

[LV] Check isPredInst instead of isScalarWithPred in uniform analysis. (#98892)

2024-07-19 12:02:25 +01:00

constant-fold.ll

[LV] Use IRBuilder to create and optimize middle-block compare.

2023-08-29 11:42:18 +01:00

constant-vector-operand.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

conversion-cost.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

cost-constant-known-via-scev.ll

[LV] Use SCEV to simplify wide binop operand to constant.

2024-10-02 13:45:49 +01:00

cost-model-assert.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:27:31 +01:00

cost-model.ll

[VPlan] Return cost of 0 for VPWidenCastRecipe without underlying value.

2024-10-25 21:25:44 +02:00

divs-with-tail-folding.ll

[VPlan] Only generate first lane for VPPredInstPHI if no others used.

2024-10-05 19:15:05 +01:00

drop-poison-generating-flags.ll

[VPlan] Only generate first lane for VPPredInstPHI if no others used.

2024-10-05 19:15:05 +01:00

ephemeral-recipes.ll

[VPlan] Don't add live-outs for IV phis.

2024-07-14 20:49:03 +01:00

epilog-vectorization-inductions.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

fixed-order-recurrence.ll

[VPlan] Try to hoist Previous (and operands), if sinking fails for FORs. (#108945)

2024-10-23 13:12:03 -07:00

float-induction-x86.ll

[LV] Compute value of escaped induction based on the computed end value. (#110576)

2024-10-10 20:04:46 +01:00

fneg-cost.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

fp32_to_uint32-cost-model.ll

…

fp64_to_uint32-cost-model.ll

…

fp80-widest-type.ll

…

fp_to_sint8-cost-model.ll

…

funclet.ll

[LV] Check for vector instruction in main vector loop.

2023-07-03 14:16:47 +01:00

gather_scatter.ll

[VPlan] Explicitly handle scalar pointer inductions. (#83068)

2024-03-26 16:01:57 +01:00

gather-cost.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

gather-vs-interleave.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

gcc-examples.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

gep-use-outside-loop.ll

[LV] Check pointer user are in loop when checking for uniform pointers.

2024-08-13 09:23:44 +01:00

i1-reg-usage.ll

[NFC] Port all runlines for LoopVectorize pass tests to -passes syntax

2022-12-05 22:17:30 +03:00

illegal-parallel-loop-uniform-write.ll

[LV] Optimize trip count SCEV.

2023-04-12 16:17:58 -07:00

imprecise-through-phis.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

induction-costs.ll

[VPlan] Introduce scalar loop header in plan, remove VPLiveOut. (#109975)

2024-10-31 21:36:44 +01:00

int128_no_gather.ll

…

interleave_short_tc.ll

…

interleave-cost.ll

[LV] Use type from InsertPos for cost computation of interleave groups.

2024-10-18 19:12:40 -07:00

interleave-opaque-pointers.ll

[VPlan] Don't created GEP x, 0 for interleave group pointers.

2024-10-08 12:08:13 +01:00

interleave-ptradd-with-replicated-operand.ll

[VPlan] Request lane 0 for pointer arg in PtrAdd.

2024-10-09 13:18:54 +01:00

interleaved-accesses-hoist-load-across-store.ll

[VPlan] Don't created GEP x, 0 for interleave group pointers.

2024-10-08 12:08:13 +01:00

interleaved-accesses-large-gap.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

interleaved-accesses-sink-store-across-load.ll

[VPlan] Don't created GEP x, 0 for interleave group pointers.

2024-10-08 12:08:13 +01:00

interleaved-accesses-use-after-free.ll

…

interleaved-accesses-waw-dependency.ll

…

interleaving.ll

[VPlan] Implement unrolling as VPlan-to-VPlan transform. (#95842)

2024-09-21 19:47:37 +01:00

intrinsiccost.ll

[InstCombine] Infer nsw/nuw for trunc (#87910)

2024-04-11 19:10:53 +08:00

invariant-load-gather.ll

[VPlan] Add initial loop-invariant code motion transform. (#107894)

2024-09-20 11:22:03 +01:00

invariant-store-vectorization.ll

[InstCombine] Remove some of the complexity-based canonicalization (#91185)

2024-08-21 12:02:54 +02:00

iv-live-outs.ll

[VPlan] Unify mayWriteToMemory and mayHaveSideEffects logic for VPInst.

2024-09-26 19:16:43 +01:00

libm-vector-calls-finite.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

libm-vector-calls-VF2-VF8.ll

[x86] Add tan intrinsic part 4 (#90503)

2024-06-05 15:01:33 -04:00

libm-vector-calls.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

limit-vf-by-tripcount.ll

[VPlan] Don't created GEP x, 0 for interleave group pointers.

2024-10-08 12:08:13 +01:00

lit.local.cfg

[NFC][Py Reformat] Reformat lit.local.cfg python files in llvm

2023-05-17 17:03:15 +02:00

load-deref-pred.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

masked_load_store.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

masked-store-cost.ll

[VPlan] Don't created GEP x, 0 for interleave group pointers.

2024-10-08 12:08:13 +01:00

max-mstore.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

metadata-enable.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

min-trip-count-switch.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

mul_slm_16bit.ll

…

multi-exit-cost.ll

[VPlan] Skip users outside loop in check for exit pre-compute candidates

2024-07-11 22:04:39 +01:00

no_fpmath_with_hotness.ll

…

no_fpmath.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

no-vector.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

nontemporal.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

optsize.ll

[LV] Add additional test coverage for cost modeling.

2024-06-26 10:18:01 +01:00

outer_loop_test1_no_explicit_vect_width.ll

…

parallel-loops-after-reg2mem.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

parallel-loops.ll

[InstCombine] Set disjoint flag when turning Add into Or. (#72702)

2023-11-27 12:54:11 -08:00

pointer-runtime-checks-unprofitable.ll

[LV] Add uses of result to pointer-runtime-checks-unprofitable.ll test.

2024-07-15 09:59:46 +01:00

powof2div.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

pr23997.ll

[InstCombine] Remove some of the complexity-based canonicalization (#91185)

2024-08-21 12:02:54 +02:00

pr34438.ll

[LV] Use IRBuilder to create and optimize middle-block compare.

2023-08-29 11:42:18 +01:00

pr35432.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

pr36524.ll

[VPlan] Preserve original induction order when creating scalar steps.

2024-01-31 13:31:28 +00:00

pr39160.ll

[VPlan] Don't create live-outs for induction increments.

2024-07-25 21:34:55 +01:00

pr42674.ll

[ConstantFolding] Canonicalize constexpr GEPs to i8 (#89872)

2024-05-20 11:47:30 +02:00

pr47437.ll

[VPlan] Don't created GEP x, 0 for interleave group pointers.

2024-10-08 12:08:13 +01:00

pr48340.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

pr51366-sunk-instruction-used-outside-of-loop.ll

…

pr54413-select-interleave-count-loop-with-cost-zero.ll

…

pr54634.ll

[CostModel][X86] Improve add/sub/mul overflow intrinsic costs

2024-07-25 16:01:05 +01:00

pr55096-scalarize-add.ll

LoopVectorize: guard appending InstsToScalarize; fix bug (#88720)

2024-04-18 10:03:07 +01:00

pr56319-vector-exit-cond-optimization-epilogue-vectorization.ll

[VPlan] Don't created GEP x, 0 for interleave group pointers.

2024-10-08 12:08:13 +01:00

pr72969.ll

[VPlan] Introduce ResumePhi VPInstruction, use to create phi for FOR. (#94760)

2024-07-11 16:08:04 +01:00

pr81872.ll

Recommit "[VPlan] Replace disjoint or with add instead of dropping disjoint. (#83821)"

2024-03-27 19:11:18 +00:00

pr109581-unused-blend.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

predicate-switch.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

predicated-instruction-cost.ll

[LV] Generalize predication checks from 2c8836c899 for operands.

2024-10-02 20:16:41 +01:00

propagate-metadata.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2023-01-04 17:25:42 +01:00

ptr-indvar-crash.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2023-01-04 17:25:42 +01:00

rauw-bug.ll

[NFC] Port all runlines for LoopVectorize pass tests to -passes syntax

2022-12-05 22:17:30 +03:00

reduction-crash.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

reduction-fastmath.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

reduction-small-size.ll

…

redundant-vf2-cost.ll

…

reg-usage-debug.ll

[LV] Reland "Update logic for calculating register usage due to invariants"

2023-02-28 17:32:39 +05:30

reg-usage.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

register-assumption.ll

…

replicate-recipe-with-only-first-lane-used.ll

[VPlan] Only generate first lane for VPPredInstPHI if no others used.

2024-10-05 19:15:05 +01:00

replicate-uniform-call.ll

[VPlan] Implement VPBlendRecipe::computeCost.

2024-10-08 21:33:42 +01:00

runtime-limit.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

scatter_crash.ll

Reland "[X86] Remove knl/knm specific ISAs supports (#92883)" (#93136)

2024-05-24 13:46:34 +08:00

slm-no-vectorize.ll

[LoopVectorize][X86] Regenerate slm-no-vectorize.ll

2023-06-13 14:15:37 +01:00

small-size.ll

[VPlan] Explicitly handle scalar pointer inductions. (#83068)

2024-03-26 16:01:57 +01:00

strided_load_cost.ll

[VPlan] Don't created GEP x, 0 for interleave group pointers.

2024-10-08 12:08:13 +01:00

struct-store.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

svml-calls-finite.ll

…

svml-calls.ll

[x86] Add tan intrinsic part 4 (#90503)

2024-06-05 15:01:33 -04:00

tail_folding_and_assume_safety.ll

…

tail_loop_folding.ll

[VPlan] Model branch cond to enter scalar epilogue in VPlan. (#92651)

2024-07-05 10:08:42 +01:00

tripcount.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

uint64_to_fp64-cost-model.ll

…

uniform_load.ll

…

uniform_mem_op.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

uniform-phi.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

uniformshift.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

unroll_selection.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

unroll-pm.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

unroll-small-loops.ll

[LV] Remove loop trip count threshold for deciding whether to interleave a loop (#67725)

2024-02-05 17:23:58 -08:00

veclib-calls.ll

[X86][LoopVectorize] Add support for arc and hyperbolic trig functions (#99383)

2024-07-28 20:57:43 -04:00

vect.omp.force.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

vect.omp.force.small-tc.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

vector_max_bandwidth.ll

…

vector_ptr_load_store.ll

…

vector-scalar-select-cost.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

vectorization-remarks-loopid-dbg.ll

[LV] Remove loop trip count threshold for deciding whether to interleave a loop (#67725)

2024-02-05 17:23:58 -08:00

vectorization-remarks-missed.ll

[LoopVectorize] Teach LoopVectorizationLegality about more early exits (#107004)

2024-09-19 09:41:25 +01:00

vectorization-remarks-profitable.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

vectorization-remarks.ll

[LV] Remove loop trip count threshold for deciding whether to interleave a loop (#67725)

2024-02-05 17:23:58 -08:00

vectorize-force-tail-with-evl.ll

[VPlan] Run DCE after unrolling.

2024-09-22 22:08:46 +01:00

vectorize-interleaved-accesses-gap.ll

[VPlan] Don't created GEP x, 0 for interleave group pointers.

2024-10-08 12:08:13 +01:00

vectorize-only-for-real.ll

…

vplan-native-inner-loop-only.ll

[VPlan] Don't created GEP x, 0 for interleave group pointers.

2024-10-08 12:08:13 +01:00

vplan-vp-intrinsics.ll

[VPlan] Use VPInstruction::Name when assigning names (NFCI).

2024-10-18 05:52:35 +01:00

widened-value-used-as-scalar-and-first-lane.ll

[VPlan] Unify mayWriteToMemory and mayHaveSideEffects logic for VPInst.

2024-09-26 19:16:43 +01:00

x86_fp80-interleaved-access.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

x86_fp80-vector-store.ll

…

x86-interleaved-accesses-masked-group.ll

[InstCombine] Set samesign when converting signed predicates into unsigned (#112642)

2024-10-17 20:43:48 +08:00

x86-interleaved-store-accesses-with-gaps.ll

[VPlan] Use pointer to member 0 as VPInterleaveRecipe's pointer arg. (#106431)

2024-10-06 22:53:13 +01:00

x86-pr39099.ll

[LoopVectorize] Convert some tests to opaque pointers (NFC)

2022-12-14 15:16:59 +01:00

x86-predication.ll

[VPlan] Remove VPPredInstPHIRecipes without users after region merging.

2024-07-20 13:21:32 +01:00