caio/clice
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

refactor(server): extract Indexer and Compiler from MasterServer (#403)

Browse Source 
## Summary

- **Extract `Indexer` class** — owns all index state (ProjectIndex,
MergedIndex shards, OpenFileIndex) and query methods (definition,
references, call/type hierarchy, workspace symbol search)
- **Extract `Compiler` class** — owns document state, PCH/PCM cache,
compile argument resolution, header context, `ensure_compiled`, and
worker forwarding
- **MasterServer is now a pure LSP handler registration layer** (~700
lines, down from ~3200)
- **`MergedIndexShard`** wraps `index::MergedIndex` with a lazily-cached
PositionMapper; `OpenFileIndex` gains matching
`find_occurrence()`/`find_relations()` APIs — callers get pre-converted
LSP ranges directly
- **Indexer returns typed values** (`vector<Location>`,
`vector<CallHierarchyIncomingCall>`, etc.) instead of pre-serialized
JSON, fixing the references handler from JSON string surgery to simple
vector concatenation
- **Fix**: duplicate `workspace/symbol` loop in the original code

## Test plan

- [x] 465 unit tests pass
- [x] 113 integration tests pass
- [x] 2/2 smoke tests pass
- [x] `clang-format` applied

🤖 Generated with [Claude Code](https://claude.com/claude-code)

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

* **New Features**
* Server-side C++ compilation orchestration (module & precompiled header
builds) with LSP-integrated document handling.

* **Improvements**
* Deterministic, persistent, dependency-aware caching to avoid redundant
rebuilds and speed up incremental work.
* Better cross-file indexing and navigation, improved diagnostics and
more reliable include/import-aware completions.

* **Tests**
  * Unit tests updated to the unified worker query/build request shapes.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
ykiko
2026-04-07 13:30:12 +08:00
committed by GitHub
parent ada202e489
commit bb0b160a28
14 changed files with 3359 additions and 3612 deletions
Download Patch File Download Diff File Expand all files Collapse all files

54
tests/unit/server/stateful_worker_tests.cpp
View File

@@ -61,7 +61,8 @@ TEST_CASE(HoverWithoutCompile) {
w.run([&]() -> et::task<> {
// Hover on a file that hasn't been compiled should return null.
worker::HoverParams params;
worker::QueryParams params;
params.kind = worker::QueryKind::Hover;
params.path = "/tmp/nonexistent.cpp";
params.offset = 0;
@@ -101,7 +102,8 @@ TEST_CASE(CompileThenHover) {
// After successful compilation, hover should return info.
// "int foo() { return 42; }\n" is 25 chars, then char 22 on line 1 = offset 47
worker::HoverParams hp;
worker::QueryParams hp;
hp.kind = worker::QueryKind::Hover;
hp.path = src;
hp.offset = 47; // position of 'foo' in 'return foo();'
@@ -147,7 +149,8 @@ TEST_CASE(DocumentUpdate) {
w.peer->send_notification(up);
// After update, hover still returns stale AST results (not null).
worker::HoverParams hp;
worker::QueryParams hp;
hp.kind = worker::QueryKind::Hover;
hp.path = src;
hp.offset = 4;
@@ -168,7 +171,8 @@ TEST_CASE(CodeActionReturnsEmpty) {
bool test_done = false;
w.run([&]() -> et::task<> {
worker::CodeActionParams params;
worker::QueryParams params;
params.kind = worker::QueryKind::CodeAction;
params.path = "/tmp/test.cpp";
auto result = co_await w.peer->send_request(params);
@@ -189,7 +193,8 @@ TEST_CASE(GoToDefinitionReturnsEmpty) {
bool test_done = false;
w.run([&]() -> et::task<> {
worker::GoToDefinitionParams params;
worker::QueryParams params;
params.kind = worker::QueryKind::GoToDefinition;
params.path = "/tmp/test.cpp";
params.offset = 0;
@@ -211,7 +216,8 @@ TEST_CASE(SemanticTokensWithoutCompile) {
bool test_done = false;
w.run([&]() -> et::task<> {
worker::SemanticTokensParams params;
worker::QueryParams params;
params.kind = worker::QueryKind::SemanticTokens;
params.path = "/tmp/nonexistent.cpp";
auto result = co_await w.peer->send_request(params);
@@ -231,7 +237,8 @@ TEST_CASE(FoldingRangeWithoutCompile) {
bool test_done = false;
w.run([&]() -> et::task<> {
worker::FoldingRangeParams params;
worker::QueryParams params;
params.kind = worker::QueryKind::FoldingRange;
params.path = "/tmp/nonexistent.cpp";
auto result = co_await w.peer->send_request(params);
@@ -251,7 +258,8 @@ TEST_CASE(DocumentSymbolWithoutCompile) {
bool test_done = false;
w.run([&]() -> et::task<> {
worker::DocumentSymbolParams params;
worker::QueryParams params;
params.kind = worker::QueryKind::DocumentSymbol;
params.path = "/tmp/nonexistent.cpp";
auto result = co_await w.peer->send_request(params);
@@ -271,7 +279,8 @@ TEST_CASE(DocumentLinkWithoutCompile) {
bool test_done = false;
w.run([&]() -> et::task<> {
worker::DocumentLinkParams params;
worker::QueryParams params;
params.kind = worker::QueryKind::DocumentLink;
params.path = "/tmp/nonexistent.cpp";
auto result = co_await w.peer->send_request(params);
@@ -291,7 +300,8 @@ TEST_CASE(InlayHintsWithoutCompile) {
bool test_done = false;
w.run([&]() -> et::task<> {
worker::InlayHintsParams params;
worker::QueryParams params;
params.kind = worker::QueryKind::InlayHints;
params.path = "/tmp/nonexistent.cpp";
auto result = co_await w.peer->send_request(params);
@@ -333,13 +343,15 @@ TEST_CASE(MultipleSequentialRequests) {
CO_ASSERT_TRUE(cr.has_value());
// Now send multiple different feature requests sequentially.
worker::HoverParams hp;
worker::QueryParams hp;
hp.kind = worker::QueryKind::Hover;
hp.path = src;
hp.offset = 4; // 'foo' on line 0
auto r1 = co_await w.peer->send_request(hp);
EXPECT_TRUE(r1.has_value());
worker::CodeActionParams cap;
worker::QueryParams cap;
cap.kind = worker::QueryKind::CodeAction;
cap.path = src;
auto r2 = co_await w.peer->send_request(cap);
EXPECT_TRUE(r2.has_value());
@@ -347,18 +359,21 @@ TEST_CASE(MultipleSequentialRequests) {
// 'foo' in 'return foo(0);' at line 4, char 11
// lines: "int foo(int x) {\n"=17, " return x + 1;\n"=18, "}\n"=2, "int main() {\n"=14
// offset = 17+18+2+14+11 = 62
worker::GoToDefinitionParams gdp;
worker::QueryParams gdp;
gdp.kind = worker::QueryKind::GoToDefinition;
gdp.path = src;
gdp.offset = 62;
auto r3 = co_await w.peer->send_request(gdp);
EXPECT_TRUE(r3.has_value());
worker::SemanticTokensParams stp;
worker::QueryParams stp;
stp.kind = worker::QueryKind::SemanticTokens;
stp.path = src;
auto r4 = co_await w.peer->send_request(stp);
EXPECT_TRUE(r4.has_value());
worker::FoldingRangeParams frp;
worker::QueryParams frp;
frp.kind = worker::QueryKind::FoldingRange;
frp.path = src;
auto r5 = co_await w.peer->send_request(frp);
EXPECT_TRUE(r5.has_value());
@@ -403,7 +418,8 @@ TEST_CASE(MultipleDocuments) {
// Hover on each document after compilation.
for(int i = 0; i < 3; i++) {
worker::HoverParams hp;
worker::QueryParams hp;
hp.kind = worker::QueryKind::Hover;
hp.path = paths[i];
hp.offset = 4; // 'var_N'
@@ -431,7 +447,8 @@ TEST_CASE(EvictNotification) {
w.peer->send_notification(ep);
// Hover on the evicted document should return null (document doesn't exist).
worker::HoverParams hp;
worker::QueryParams hp;
hp.kind = worker::QueryKind::Hover;
hp.path = "/tmp/evict_test.cpp";
hp.offset = 0;
@@ -470,7 +487,8 @@ TEST_CASE(SpawnWithMemoryLimit) {
EXPECT_TRUE(cr.has_value());
// Feature request should work after compilation.
worker::HoverParams hp;
worker::QueryParams hp;
hp.kind = worker::QueryKind::Hover;
hp.path = src;
hp.offset = 4; // 'memlimit_var'