caio/clang-p2996
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
2e080eb00ad76654313e0e119bb7fa0ffe2f9866
clang-p2996/llvm/test/Transforms/LoopVectorize
History
David Sherwood 2e080eb00a [SVE] Add support for scalable vectorization of loops with selects and cmps 
I have removed an unnecessary assert in LoopVectorizationCostModel::getInstructionCost
that prevented a cost being calculated for select instructions when using
scalable vectors. In addition, I have changed AArch64TTIImpl::getCmpSelInstrCost
to only do special cost calculations for fixed width vectors and fall
back to the base version for scalable vectors.

I have added a simple cost model test for cmps and selects:

  test/Analysis/CostModel/sve-cmpsel.ll

and some simple tests that show we vectorize loops with cmp and select:

  test/Transforms/LoopVectorize/AArch64/sve-basic-vec.ll

Differential Revision: https://reviews.llvm.org/D95039
2021-01-22 09:48:13 +00:00
..
AArch64
[SVE] Add support for scalable vectorization of loops with selects and cmps
2021-01-22 09:48:13 +00:00
AMDGPU
Use unary CreateShuffleVector if possible
2020-12-30 22:36:08 +09:00
ARM
[LV][ARM] Inloop reduction cost modelling
2021-01-21 21:03:41 +00:00
Hexagon
[LV] Fallback strategies if tail-folding fails
2020-08-26 16:55:25 +01:00
PowerPC
[NewPM][opt] Run the "default" AA pipeline by default
2021-01-21 21:08:54 -08:00
SystemZ
[SLP,LV] Use poison constant vector for shufflevector/initial insertelement
2021-01-06 11:22:50 +09:00
VE
[VE][TTI] don't advertise vregs/vops
2020-11-06 11:12:10 +01:00
X86
[VectorUtils] Do not try to add indices matching tombstone/empty values.
2021-01-18 11:18:28 +00:00
XCore
…
12-12-11-if-conv.ll
…
2012-10-20-infloop.ll
…
2012-10-22-isconsec.ll
…
2016-07-27-loop-vec.ll
…
alias-set-with-uncomputable-bounds.ll
[LAA] Do not set CanDoRT to false for AS that do not need RT checks.
2020-06-14 20:55:59 +01:00
align.ll
…
assume.ll
…
bsd_regex.ll
…
bzip_reverse_loops.ll
…
calloc.ll
[BasicAA] Rename deprecated -basicaa to -basic-aa
2020-06-26 20:41:37 -07:00
cast-induction.ll
…
check-prof-info.ll
Revert "Use uint64_t for branch weights instead of uint32_t"
2020-10-31 00:25:32 -07:00
conditional-assignment.ll
…
consec_no_gep.ll
…
consecutive-ptr-uniforms.ll
[SLP,LV] Use poison constant vector for shufflevector/initial insertelement
2021-01-06 11:22:50 +09:00
control-flow.ll
Reapply "[LV] Vectorize (some) early and multiple exit loops"" w/fix for builder
2020-12-28 10:13:28 -08:00
cpp-new-array.ll
…
dbg.value.ll
…
dead_instructions.ll
[LV] Keep Primary Induction alive when folding tail by masking
2020-11-24 15:12:54 +02:00
debugloc.ll
…
demanded-bits-of-pointer-instruction.ll
…
diag-missing-instr-debug-loc.ll
…
diag-with-hotness-info-2.ll
…
diag-with-hotness-info.ll
…
disable_nonforced_enable.ll
…
disable_nonforced.ll
…
discriminator.ll
…
dont-fold-tail-for-const-TC.ll
[IR] Let IRBuilder's CreateVectorSplat/CreateShuffleVector use poison as placeholder
2020-12-30 04:21:04 +09:00
dont-fold-tail-for-divisible-TC.ll
[LV] Merge tests into a single file (NFC)
2021-01-07 09:04:07 +02:00
ee-crash.ll
…
exact.ll
…
explicit_outer_detection.ll
…
explicit_outer_nonuniform_inner.ll
Require "target datalayout" to be at the beginning of an IR file.
2020-04-20 11:55:49 -07:00
explicit_outer_uniform_diverg_branch.ll
Require "target datalayout" to be at the beginning of an IR file.
2020-04-20 11:55:49 -07:00
fcmp-vectorize.ll
Recommit #2: "[LV] Induction Variable does not remain scalar under tail-folding."
2020-05-13 13:50:09 +01:00
first-order-recurrence-complex.ll
[LV] Relax assumption that LCSSA implies single entry
2021-01-12 12:34:52 -08:00
first-order-recurrence-multiply-recurrences.ll
…
first-order-recurrence.ll
[LV] Don't sink into replication regions
2021-01-08 09:50:10 +00:00
fix-reduction-dbg.ll
…
flags.ll
…
float-induction.ll
[IR] Let IRBuilder's CreateVectorSplat/CreateShuffleVector use poison as placeholder
2020-12-30 04:21:04 +09:00
float-minmax-instruction-flag.ll
Use unary CreateShuffleVector if possible
2020-12-30 22:36:08 +09:00
float-reduction.ll
Enable support for floating-point division reductions
2020-11-23 20:00:58 -05:00
fneg.ll
…
followup.ll
[LV] Collect dead induction truncates
2020-10-08 08:28:58 +01:00
funcall.ll
…
gcc-examples.ll
[BasicAA] Rename deprecated -basicaa to -basic-aa
2020-06-26 20:41:37 -07:00
gep_with_bitcast.ll
…
global_alias.ll
…
hints-trans.ll
[SimplifyCFG] TryToSimplifyUncondBranchFromEmptyBlock() already knows how to preserve DomTree
2020-12-17 01:03:49 +03:00
hoist-loads.ll
…
i8-induction.ll
…
icmp-uniforms.ll
[test] Fix Transforms/LoopVectorize under NPM
2020-12-07 21:48:21 -08:00
if-conv-crash.ll
…
if-conversion-edgemasks.ll
…
if-conversion-nest.ll
Revert "[InstCombine] add multi-use demanded bits fold for add with low-bit mask"
2020-11-16 14:48:09 -05:00
if-conversion-reduction.ll
…
if-conversion.ll
…
if-pred-non-void.ll
[SLP,LV] Use poison constant vector for shufflevector/initial insertelement
2021-01-06 11:22:50 +09:00
if-pred-not-when-safe.ll
[SimplifyCFG] TryToSimplifyUncondBranchFromEmptyBlock() already knows how to preserve DomTree
2020-12-17 01:03:49 +03:00
if-pred-stores.ll
[SimplifyCFG] Teach FoldCondBranchOnPHI() to preserve DomTree
2020-12-30 00:48:11 +03:00
if-reduction.ll
Recommit #2: "[LV] Induction Variable does not remain scalar under tail-folding."
2020-05-13 13:50:09 +01:00
incorrect-dom-info.ll
…
increment.ll
…
induction_plus.ll
…
induction-step.ll
[IR] Let IRBuilder's CreateVectorSplat/CreateShuffleVector use poison as placeholder
2020-12-30 04:21:04 +09:00
induction.ll
[SLP,LV] Use poison constant vector for shufflevector/initial insertelement
2021-01-06 11:22:50 +09:00
infiniteloop.ll
…
int_sideeffect.ll
…
interleaved-accesses-1.ll
[IR] Let IRBuilder's CreateVectorSplat/CreateShuffleVector use poison as placeholder
2020-12-30 04:21:04 +09:00
interleaved-accesses-2.ll
…
interleaved-accesses-3.ll
…
interleaved-accesses-alias.ll
…
interleaved-accesses-masked-group.ll
…
interleaved-accesses-pred-stores.ll
[IR] Let IRBuilder's CreateVectorSplat/CreateShuffleVector use poison as placeholder
2020-12-30 04:21:04 +09:00
interleaved-accesses-uniform-load.ll
…
interleaved-accesses.ll
[test] Autogen a loop vectorizer test to make future changes visible
2021-01-17 20:03:22 -08:00
interleaved-acess-with-remarks.ll
…
intrinsic.ll
[LV] Add abs/smin/smax/umin/umax intrinsics to isTriviallyVectorizable
2020-07-29 10:23:07 -07:00
invariant-store-vectorization.ll
Use unary CreateShuffleVector if possible
2020-12-30 22:36:08 +09:00
iv_outside_user.ll
…
lcssa-crash.ll
…
libcall-remark.ll
…
lifetime.ll
…
loop-form.ll
[test] pre commit a couple more tests for vectorizing multiple exit loops
2021-01-17 20:29:13 -08:00
loop-legality-checks.ll
Reapply "[LV] Vectorize (some) early and multiple exit loops"" w/fix for builder
2020-12-28 10:13:28 -08:00
loop-scalars.ll
[test] Fix Transforms/LoopVectorize under NPM
2020-12-07 21:48:21 -08:00
loop-vect-memdep.ll
…
loop-vect-option.ll
…
memdep-fold-tail.ll
[LV] Fallback strategies if tail-folding fails
2020-08-26 16:55:25 +01:00
memdep.ll
…
metadata-unroll.ll
…
metadata-width.ll
[LV] Legalize scalable VF hints
2021-01-08 10:49:44 +00:00
metadata.ll
…
middle-block-dbg.ll
…
miniters.ll
…
minmax_reduction.ll
[IR] Let IRBuilder's CreateVectorSplat/CreateShuffleVector use poison as placeholder
2020-12-30 04:21:04 +09:00
multi-use-reduction-bug.ll
…
multiple-address-spaces.ll
[BasicAA] Rename deprecated -basicaa to -basic-aa
2020-06-26 20:41:37 -07:00
multiple-exits-versioning.ll
[LV] Add test cases with multiple exits which require versioning.
2021-01-20 11:48:48 +00:00
multiple-strides-vectorization.ll
[IR] Let IRBuilder's CreateVectorSplat/CreateShuffleVector use poison as placeholder
2020-12-30 04:21:04 +09:00
no_array_bounds_scalable.ll
[SVE] Add support for scalable vectors with vectorize.scalable.enable loop attribute
2020-12-02 13:23:43 +00:00
no_array_bounds.ll
…
no_idiv_reduction.ll
…
no_int_induction.ll
…
no_outside_user.ll
…
no_switch_disable_vectorization.ll
…
no_switch.ll
…
no-interleave-up-front.ll
…
noalias-md-licm.ll
Rename scoped-noalias -> scoped-noalias-aa
2020-07-24 12:14:27 -07:00
noalias-md.ll
Rename scoped-noalias -> scoped-noalias-aa
2020-07-24 12:14:27 -07:00
noalias-scope-decl.ll
[noalias.decl] Look through llvm.experimental.noalias.scope.decl
2021-01-19 20:09:42 +01:00
nofloat-report.ll
…
nofloat.ll
…
non-const-n.ll
…
nontemporal.ll
…
novect-lcssa-cfg-invalidation.ll
[NewPM] Don't print 'Invalidating all non-preserved analyses'
2020-07-30 19:40:29 -07:00
nsw-crash.ll
…
nuw.ll
…
opt.ll
…
optimal-epilog-vectorization-limitations.ll
[LV] Legalize scalable VF hints
2021-01-08 10:49:44 +00:00
optimal-epilog-vectorization-liveout.ll
[LV] Epilogue Vectorization with Optimal Control Flow (Recommit)
2020-12-02 10:09:56 -05:00
optimal-epilog-vectorization-scalable.ll
[LV] Legalize scalable VF hints
2021-01-08 10:49:44 +00:00
optimal-epilog-vectorization.ll
[NewPM][opt] Run the "default" AA pipeline by default
2021-01-21 21:08:54 -08:00
optsize.ll
[IR] Let IRBuilder's CreateVectorSplat/CreateShuffleVector use poison as placeholder
2020-12-30 04:21:04 +09:00
outer_loop_test1.ll
[IR] Let IRBuilder's CreateVectorSplat/CreateShuffleVector use poison as placeholder
2020-12-30 04:21:04 +09:00
outer_loop_test2.ll
[IR] Let IRBuilder's CreateVectorSplat/CreateShuffleVector use poison as placeholder
2020-12-30 04:21:04 +09:00
partial-lcssa.ll
…
phi-cost.ll
[test] Fix Transforms/LoopVectorize under NPM
2020-12-07 21:48:21 -08:00
phi-hang.ll
…
pointer-induction.ll
[IR] Let IRBuilder's CreateVectorSplat/CreateShuffleVector use poison as placeholder
2020-12-30 04:21:04 +09:00
pr25281.ll
…
pr28541.ll
…
pr30654-phiscev-sext-trunc.ll
…
pr30806-phi-scev.ll
…
pr30806.ll
…
pr31098.ll
…
pr31190.ll
…
pr32859.ll
…
pr33706.ll
…
pr34681.ll
…
pr35743.ll
…
pr35773.ll
Recommit #2: "[LV] Induction Variable does not remain scalar under tail-folding."
2020-05-13 13:50:09 +01:00
pr36311.ll
…
pr36983.ll
…
pr37248.ll
…
pr37515.ll
…
pr38697.ll
…
pr38800.ll
…
pr39099.ll
…
pr39417-optsize-scevchecks.ll
[SLP,LV] Use poison constant vector for shufflevector/initial insertelement
2021-01-06 11:22:50 +09:00
pr43166-fold-tail-by-masking.ll
…
pr44488-predication.ll
[SLP,LV] Use poison constant vector for shufflevector/initial insertelement
2021-01-06 11:22:50 +09:00
pr45259.ll
…
pr45525.ll
[LV] Fix PR45525: Incorrect assert in blend recipe
2020-04-15 10:39:07 +03:00
pr45679-fold-tail-by-masking.ll
[NFC][LV][TEST]: extend pr45679-fold-tail-by-masking.ll with -force-vector-width=1 -force-vector-interleave=4
2020-06-09 18:30:56 +00:00
pr46525-expander-insertpoint.ll
[IR] Let IRBuilder's CreateVectorSplat/CreateShuffleVector use poison as placeholder
2020-12-30 04:21:04 +09:00
pr47343-expander-lcssa-after-cfg-update.ll
[LV] Update CFG before adding runtime checks.
2020-08-30 18:21:44 +01:00
preserve-dbg-loc-and-loop-metadata.ll
…
ptr_loops.ll
[BasicAA] Rename deprecated -basicaa to -basic-aa
2020-06-26 20:41:37 -07:00
ptr-induction.ll
…
read-only.ll
…
reduction-inloop-pred.ll
[SLP,LV] Use poison constant vector for shufflevector/initial insertelement
2021-01-06 11:22:50 +09:00
reduction-inloop-uf4.ll
[SLP,LV] Use poison constant vector for shufflevector/initial insertelement
2021-01-06 11:22:50 +09:00
reduction-inloop.ll
[InstCombine] use poison as placeholder for undemanded elems
2020-12-28 08:58:15 +09:00
reduction-order.ll
[LV] Tail folded inloop reductions.
2020-10-11 16:58:34 +01:00
reduction-predselect.ll
[LoopUtils] Fix neutral value for vector.reduce.fadd
2020-10-29 21:45:13 +01:00
reduction-small-size.ll
…
reduction.ll
Use unary CreateShuffleVector if possible
2020-12-30 22:36:08 +09:00
remarks-multi-exit-loops.ll
[LV] Fix crash when generating remarks with multi-exit loops.
2021-01-01 13:54:41 +00:00
remove_metadata.ll
…
reverse_induction.ll
…
reverse_iter.ll
…
runtime-check-address-space.ll
[BasicAA] Rename deprecated -basicaa to -basic-aa
2020-06-26 20:41:37 -07:00
runtime-check-needed-but-empty.ll
Recommit #2: "[LV] Induction Variable does not remain scalar under tail-folding."
2020-05-13 13:50:09 +01:00
runtime-check-pointer-element-type.ll
[LAA] Use DL to get element size for bound computation.
2020-10-07 18:57:07 +01:00
runtime-check-readonly-address-space.ll
…
runtime-check-readonly.ll
…
runtime-check.ll
Revert "[InstCombine] add multi-use demanded bits fold for add with low-bit mask"
2020-11-16 14:48:09 -05:00
runtime-limit.ll
…
safegep.ll
…
same-base-access.ll
…
scalable-loop-unpredicated-body-scalar-tail.ll
[LV] Legalize scalable VF hints
2021-01-08 10:49:44 +00:00
scalable-vf-hint.ll
[LV] Legalize scalable VF hints
2021-01-08 10:49:44 +00:00
scalar_after_vectorization.ll
…
scalar-select.ll
…
scev-exitlim-crash.ll
…
select-reduction.ll
Use unary CreateShuffleVector if possible
2020-12-30 22:36:08 +09:00
simple-unroll.ll
…
skeleton-lcssa-crash.ll
[LV] Set up branch from middle block earlier.
2020-12-27 18:21:12 +00:00
skip-iterations.ll
…
small-loop.ll
…
start-non-zero.ll
…
store-shuffle-bug.ll
[BasicAA] Rename deprecated -basicaa to -basic-aa
2020-06-26 20:41:37 -07:00
struct_access.ll
…
tail-folding-counting-down.ll
[LV] Fallback strategies if tail-folding fails
2020-08-26 16:55:25 +01:00
tail-folding-vectorization-factor-1.ll
[LoopVectorizer] Don't create unused block masks for reductions. NFC
2020-07-30 14:28:08 +01:00
tbaa-nodep.ll
[SimplifyCFG] TryToSimplifyUncondBranchFromEmptyBlock() already knows how to preserve DomTree
2020-12-17 01:03:49 +03:00
tripcount.ll
Revert "Use uint64_t for branch weights instead of uint32_t"
2020-10-31 00:25:32 -07:00
undef-inst-bug.ll
…
unroll_novec.ll
…
unroll-novec-memcheck-metadata.ll
…
unroll.ll
…
unsafe-dep-remark.ll
…
unsafe-vf-hint-remark.ll
[LV] Clamp VF hint when unsafe
2020-12-01 11:30:34 +00:00
unsized-pointee-crash.ll
…
use-scalar-epilogue-if-tp-fails.ll
[LV] Fallback strategies if tail-folding fails
2020-08-26 16:55:25 +01:00
value-ptr-bug.ll
…
vect-phiscev-sext-trunc.ll
…
vect.omp.persistence.ll
…
vect.stats.ll
…
vector-geps.ll
[IR] Let IRBuilder's CreateVectorSplat/CreateShuffleVector use poison as placeholder
2020-12-30 04:21:04 +09:00
vector-intrinsic-call-cost.ll
Recommit #2: "[LV] Induction Variable does not remain scalar under tail-folding."
2020-05-13 13:50:09 +01:00
vectorize-once.ll
[SimplifyCFG] TryToSimplifyUncondBranchFromEmptyBlock() already knows how to preserve DomTree
2020-12-17 01:03:49 +03:00
vectorizeVFone.ll
[VFDatabase] Testsuite for scalar functions are vector functions with VF =1
2020-04-30 15:47:21 -04:00
version-mem-access.ll
[BasicAA] Rename deprecated -basicaa to -basic-aa
2020-06-26 20:41:37 -07:00
vplan_hcfg_stress_test.ll
…
vplan-outer-loop-uncomputable-trip-count.ll
[VPlan] Reject loops without computable backedge taken counts
2020-06-12 10:31:18 +01:00
vplan-printing.ll
[VPlan] Unify value/recipe printing after VPDef transition.
2021-01-11 14:42:46 +00:00
vplan-stress-test-no-explict-vf.ll
…
vplan-vectorize-inner-loop-reduction.ll
[VPlan] Add vplan native path vectorization test case for inner loop reduction
2020-10-06 10:11:58 +01:00
write-only.ll
…
zero-sized-pointee-crash.ll
…