Florian Hahn 6108d50aed [VPlan] Add ReductionStartVector VPInstruction. (#142290) ...

Add a new VPInstruction::ReductionStartVector opcode to create the start
values for wide reductions. This more accurately models the start value
creation in VPlan and simplifies VPReductionPHIRecipe::execute. Down the
line it also allows removing VPReductionPHIRecipe::RdxDesc.

PR: https://github.com/llvm/llvm-project/pull/142290

2025-06-09 20:59:12 +01:00

..

CostModel

[LoopVectorizer] Prune VFs based on plan register pressure (#132190)

2025-05-19 13:27:17 +01:00

already-vectorized.ll

…

amdlibm-calls-finite.ll

…

amdlibm-calls.ll

…

avx1.ll

…

avx512.ll

…

consecutive-ptr-cg-bug.ll

…

consecutive-ptr-uniforms.ll

[LV] Optimize VPWidenIntOrFpInductionRecipe for known TC (#118828)

2025-03-28 14:47:40 +00:00

constant-fold.ll

[VPlan] Check captured operand when simplifying redundant OR.

2025-04-13 13:23:27 +01:00

constant-vector-operand.ll

…

conversion-cost.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

cost-constant-known-via-scev.ll

…

cost-model-assert.ll

…

cost-model-i386.ll

Reapply "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-04-28 20:01:37 +01:00

cost-model.ll

[VPlan] Add ReductionStartVector VPInstruction. (#142290)

2025-06-09 20:59:12 +01:00

divs-with-tail-folding.ll

[VPlan] Add initial CFG simplification, removing BranchOnCond true. (#106748)

2025-04-04 15:44:26 +01:00

drop-inbounds-flags-for-reverse-vector-pointer.ll

Reapply "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-04-28 20:01:37 +01:00

drop-poison-generating-flags.ll

[VPlan] Introduce constant folder in simplifyRecipe (#125365)

2025-05-20 14:16:01 +01:00

ephemeral-recipes.ll

…

epilog-vectorization-inductions.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

fixed-order-recurrence.ll

[LV] Don't consider FORs as profitable to scalarize.

2025-05-09 20:29:22 +01:00

float-induction-x86.ll

[InstCombine] Handle "add like" in ADD+GEP->GEP+GEP rewrites (#135156)

2025-04-14 17:11:13 +02:00

fminimumnum.ll

Vectorize: Support fminimumnum and fmaximumnum (#131781)

2025-04-15 08:08:45 +08:00

fneg-cost.ll

…

fp32_to_uint32-cost-model.ll

…

fp64_to_uint32-cost-model.ll

…

fp80-widest-type.ll

…

fp_to_sint8-cost-model.ll

…

funclet.ll

…

gather_scatter.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

gather-cost.ll

…

gather-vs-interleave.ll

…

gcc-examples.ll

…

gep-use-outside-loop.ll

Reapply "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-04-28 20:01:37 +01:00

i1-reg-usage.ll

[LV] Move VPlan-based calculateRegisterUsage to VPlanAnalysis (NFC). (#135673)

2025-06-02 17:40:50 +01:00

illegal-parallel-loop-uniform-write.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

imprecise-through-phis.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

induction-costs.ll

Reapply "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-04-28 20:01:37 +01:00

induction-step.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

int128_no_gather.ll

…

interleave_short_tc.ll

…

interleave-cost.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

interleave-opaque-pointers.ll

…

interleave-ptradd-with-replicated-operand.ll

…

interleaved-accesses-hoist-load-across-store.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

interleaved-accesses-large-gap.ll

…

interleaved-accesses-sink-store-across-load.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

interleaved-accesses-use-after-free.ll

…

interleaved-accesses-waw-dependency.ll

…

interleaving.ll

[InstCombine] Handle "add like" in ADD+GEP->GEP+GEP rewrites (#135156)

2025-04-14 17:11:13 +02:00

intrinsiccost.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

invariant-load-gather.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

invariant-store-vectorization.ll

[VPlan] Introduce explicit broadcasts for live-ins. (#124644)

2025-02-26 13:57:51 +00:00

iv-live-outs.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

libm-vector-calls-finite.ll

[LLVM][VecLib] Refactor LIBMVEC integration to be target neutral. (#138262)

2025-05-07 11:05:25 +01:00

libm-vector-calls-VF2-VF8.ll

[LLVM][VecLib] Refactor LIBMVEC integration to be target neutral. (#138262)

2025-05-07 11:05:25 +01:00

libm-vector-calls.ll

[LLVM][VecLib] Refactor LIBMVEC integration to be target neutral. (#138262)

2025-05-07 11:05:25 +01:00

limit-vf-by-tripcount.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

lit.local.cfg

…

load-deref-pred.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

masked_load_store.ll

Reapply "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-04-28 20:01:37 +01:00

masked-store-cost.ll

Reapply "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-04-28 20:01:37 +01:00

max-mstore.ll

…

metadata-enable.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

min-trip-count-switch.ll

…

mul_slm_16bit.ll

…

multi-exit-cost.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

no_fpmath_with_hotness.ll

…

no_fpmath.ll

…

no-vector.ll

…

nontemporal.ll

…

optsize.ll

[VPlan] Add initial CFG simplification, removing BranchOnCond true. (#106748)

2025-04-04 15:44:26 +01:00

outer_loop_test1_no_explicit_vect_width.ll

…

parallel-loops-after-reg2mem.ll

…

parallel-loops.ll

[InstCombine] Handle "add like" in ADD+GEP->GEP+GEP rewrites (#135156)

2025-04-14 17:11:13 +02:00

pointer-runtime-checks-unprofitable.ll

…

powof2div.ll

…

pr23997.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

pr34438.ll

[VPlan] Use InstSimplifyFolder instead of TargetFolder (#141222)

2025-05-28 11:00:14 +02:00

pr35432.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

pr36524.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

pr39160.ll

…

pr42674.ll

…

pr47437.ll

[LV] Reduce register usage for scaled reductions (#133090)

2025-04-11 14:31:08 +01:00

pr48340.ll

[VPlan] Don't access canonical IV in VPWidenPointerInduction::execute.

2025-03-15 21:32:48 +00:00

pr51366-sunk-instruction-used-outside-of-loop.ll

[VPlan] Remove ILV::sinkScalarOperands. (#136023)

2025-04-24 08:37:49 +01:00

pr54413-select-interleave-count-loop-with-cost-zero.ll

…

pr54634.ll

[VPlan] Introduce explicit broadcasts for live-ins. (#124644)

2025-02-26 13:57:51 +00:00

pr55096-scalarize-add.ll

Reapply "[VPlan] Fold NOT into predicate of wide compares." (#130347)

2025-04-28 20:01:37 +01:00

pr56319-vector-exit-cond-optimization-epilogue-vectorization.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00

pr72969.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

pr81872.ll

[VPlan] Add initial CFG simplification, removing BranchOnCond true. (#106748)

2025-04-04 15:44:26 +01:00

pr109581-unused-blend.ll

[VPlan] Also introduce broadcasts for live-ins used in vec preheader.

2025-03-11 21:19:14 +00:00

pr131359-dead-for-splice.ll

[VPlan] Account for dead FOR splice simplification in cost model (#131486)

2025-03-18 00:00:54 +08:00

pr141968-instsimplifyfolder.ll

[VPlan] Simplify PredPHI LiveIn -> LiveIn (#142271)

2025-06-02 14:56:35 +01:00

predicate-switch.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

predicated-instruction-cost.ll

…

propagate-metadata.ll

…

ptr-indvar-crash.ll

…

rauw-bug.ll

…

reduction-crash.ll

[LV] Improve a test, regen with UTC (#130092)

2025-04-01 14:11:20 +01:00

reduction-fastmath.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

reduction-small-size.ll

[VPlan] Add ReductionStartVector VPInstruction. (#142290)

2025-06-09 20:59:12 +01:00

redundant-vf2-cost.ll

…

reg-usage-debug.ll

[LV] Move VPlan-based calculateRegisterUsage to VPlanAnalysis (NFC). (#135673)

2025-06-02 17:40:50 +01:00

reg-usage.ll

[LV] Move VPlan-based calculateRegisterUsage to VPlanAnalysis (NFC). (#135673)

2025-06-02 17:40:50 +01:00

register-assumption.ll

…

replicate-recipe-with-only-first-lane-used.ll

[VPlan] Use InstSimplifyFolder instead of TargetFolder (#141222)

2025-05-28 11:00:14 +02:00

replicate-uniform-call.ll

[VPlan] Use InstSimplifyFolder instead of TargetFolder (#141222)

2025-05-28 11:00:14 +02:00

runtime-limit.ll

…

scatter_crash.ll

[LV] Move IV bypass value creation out of ILV (NFC)

2025-03-22 20:36:45 +00:00

scev-checks-unprofitable.ll

[VPlan] Use InstSimplifyFolder instead of TargetFolder (#141222)

2025-05-28 11:00:14 +02:00

slm-no-vectorize.ll

[IR] Convert from nocapture to captures(none) (#123181)

2025-01-29 16:56:47 +01:00

small-size.ll

[VPlan] Remove ILV::sinkScalarOperands. (#136023)

2025-04-24 08:37:49 +01:00

strided_load_cost.ll

[VPlan] Add incoming values for all predecessor to ResumePHI (NFCI).

2025-02-09 11:20:20 +00:00

struct-store.ll

…

svml-calls-finite.ll

…

svml-calls.ll

…

tail_folding_and_assume_safety.ll

…

tail_loop_folding.ll

[LoopVectorize] Don't replicate blocks with optsize (#129265)

2025-04-17 11:50:49 +01:00

transform-narrow-interleave-to-widen-memory-gaps.ll

[LV] Add additional tests for narrowing interleave groups.

2025-03-15 21:13:49 +00:00

transform-narrow-interleave-to-widen-memory.ll

Reapply "[VPlan] Add transformation to narrow interleave groups. (#106441)"

2025-03-25 20:57:10 +00:00

tripcount.ll

…

uint64_to_fp64-cost-model.ll

…

uniform_load.ll

[VPlan] Use InstSimplifyFolder instead of TargetFolder (#141222)

2025-05-28 11:00:14 +02:00

uniform_mem_op.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

uniform-phi.ll

…

uniformshift.ll

…

unroll_selection.ll

…

unroll-pm.ll

…

unroll-small-loops.ll

…

veclib-calls.ll

…

vect.omp.force.ll

…

vect.omp.force.small-tc.ll

[VPlan] Add initial CFG simplification, removing BranchOnCond true. (#106748)

2025-04-04 15:44:26 +01:00

vector_max_bandwidth.ll

…

vector_ptr_load_store.ll

…

vector-scalar-select-cost.ll

…

vectorization-remarks-loopid-dbg.ll

…

vectorization-remarks-missed.ll

…

vectorization-remarks-profitable.ll

…

vectorization-remarks.ll

…

vectorize-force-tail-with-evl.ll

[VPlan] Add initial CFG simplification, removing BranchOnCond true. (#106748)

2025-04-04 15:44:26 +01:00

vectorize-interleaved-accesses-gap.ll

[VPlan] Add initial CFG simplification, removing BranchOnCond true. (#106748)

2025-04-04 15:44:26 +01:00

vectorize-only-for-real.ll

…

vplan-native-inner-loop-only.ll

…

vplan-vp-intrinsics.ll

[VPlan] Add VF as operand to VPScalarIVStepsRecipe.

2025-03-28 21:48:59 +00:00

widened-value-used-as-scalar-and-first-lane.ll

[VPlan] Generalize SCALAR-STEPS removal to any unroll factor.

2025-03-26 21:03:50 +00:00

x86_fp80-interleaved-access.ll

…

x86_fp80-vector-store.ll

…

x86-interleaved-accesses-masked-group.ll

[VPlan] Also materialize broadcasts for backedge-taken-counts (NFC).

2025-03-18 22:35:18 +00:00

x86-interleaved-store-accesses-with-gaps.ll

…

x86-pr39099.ll

…

x86-predication.ll

[VPlan] Remove no-op SCALAR-STEPS after unrolling. (#123655)

2025-03-25 12:57:24 +00:00