This patch upstreams some of the MLGO utilities, particularly the corpus extraction tooling, into LLVM proper. The motivation for this patch is available in the RFC. https://discourse.llvm.org/t/rfc-upstreaming-elements-of-the-mlgo-tooling/74939
522 B
522 B
MLGO Python Utilities
This folder contains MLGO Python utilities, particularly infrastructure to help enable ML applications within LLVM, especially tooling to extract corpora that can be used in downstream projects to train ML models and perform other tasks that benefit from having a large amount of data.
Python Versioning
Due to type annotations, the MLGO tooling currently only supports a Python version greater than 3.8, deviating from the current LLVM project-wide minimum supported version of Python 3.6.