Paper results and original figures

Paper Reference Results

Browse the paper's complete historical tables and training curves under their original settings.

Explore Protocols Get Started Paper Reference Results

Paper results and original figures

Paper Reference Results

Browse the paper's complete historical tables and training curves under their original settings.

Paper reference results · snapshot 2026-10-21. Browse the original paper tables and figures below. Visit the protocol boards for current results.

126 Protocol A records

252 Protocol B records

120 Protocol C records

21 original loss curves

How to read these results

Paper cohort: three models, seven datasets and four federated methods, with Centralized and Local Only references. The paper uses AdamW, weight decay 0.01, learning rate 0.0002, sequence length 128 for BoolQ and 64 for other tasks, approximately equal client shards, and letter-token classification.

Accuracy is in percent; accuracy deltas are percentage points. Costs are reported in hours, MB and kJ. Historical ranks follow the original paper tables. OOM marks a memory-capacity failure and a dash marks an unavailable value.

Protocol A · Quality and reference baselines

All 126 records, including 28 OOM entries. Centralized and Local Only provide accuracy references.

Download complete original CSV

126 of 126 historical A records match the filters
Model	Dataset	Method	Pretrained accuracy (%)	Fine-tuned accuracy (%) [rank]	Pretrained loss	Fine-tuned loss [rank]	Status	Original note
Gemma 3-1B	HellaSwag	Centralized	25.03	31.65 [rank Upper Bound]	2.7088	2.0173 [rank Lower Bound]	reference	Centralized upper-bound reference.
Gemma 3-1B	HellaSwag	FedAvg+LoRA	25.03	—	2.7088	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	HellaSwag	FedProx+LoRA	25.03	—	2.7088	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	HellaSwag	HeteroLoRA	25.03	—	2.7088	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	HellaSwag	Local Only	25.03	—	2.7088	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	HellaSwag	SplitLoRA	25.03	25.33 [rank 1]	2.7088	2.6109 [rank 1]	ok	Only executable federated method at this model scale.
Gemma 3-1B	PIQA	Centralized	51.52	57.02 [rank Upper Bound]	1.1466	0.78 [rank Lower Bound]	reference	Centralized upper-bound reference.
Gemma 3-1B	PIQA	FedAvg+LoRA	51.52	—	1.1466	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	PIQA	FedProx+LoRA	51.52	—	1.1466	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	PIQA	HeteroLoRA	51.52	—	1.1466	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	PIQA	Local Only	51.52	—	1.1466	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	PIQA	SplitLoRA	51.52	53.81 [rank 1]	1.1466	0.9847 [rank 1]	ok	Only executable federated method at this model scale.
Gemma 3-1B	SocialIQA	Centralized	34.44	49.03 [rank Upper Bound]	1.8257	1.18 [rank Lower Bound]	reference	Centralized upper-bound reference.
Gemma 3-1B	SocialIQA	FedAvg+LoRA	34.44	—	1.8257	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	SocialIQA	FedProx+LoRA	34.44	—	1.8257	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	SocialIQA	HeteroLoRA	34.44	—	1.8257	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	SocialIQA	Local Only	34.44	—	1.8257	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	SocialIQA	SplitLoRA	34.44	45.7 [rank 1]	1.8257	1.2247 [rank 1]	ok	Only executable federated method at this model scale.
Gemma 3-1B	ARC-Easy	Centralized	26.14	33.71 [rank Upper Bound]	2.6107	1.9 [rank Lower Bound]	reference	Centralized upper-bound reference.
Gemma 3-1B	ARC-Easy	FedAvg+LoRA	26.14	—	2.6107	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	ARC-Easy	FedProx+LoRA	26.14	—	2.6107	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	ARC-Easy	HeteroLoRA	26.14	—	2.6107	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	ARC-Easy	Local Only	26.14	—	2.6107	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	ARC-Easy	SplitLoRA	26.14	28.07 [rank 1]	2.6107	2.2811 [rank 1]	ok	Only executable federated method at this model scale.
Gemma 3-1B	WinoGrande	Centralized	50.36	57.73 [rank Upper Bound]	1.4381	0.6427 [rank Lower Bound]	reference	Centralized upper-bound reference.
Gemma 3-1B	WinoGrande	FedAvg+LoRA	50.36	—	1.4381	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	WinoGrande	FedProx+LoRA	50.36	—	1.4381	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	WinoGrande	HeteroLoRA	50.36	—	1.4381	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	WinoGrande	Local Only	50.36	—	1.4381	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	WinoGrande	SplitLoRA	50.36	51.62 [rank 1]	1.4381	0.8169 [rank 1]	ok	Only executable federated method at this model scale.
Gemma 3-1B	BoolQ	Centralized	59.51	70.0 [rank Upper Bound]	1.0778	0.58 [rank Lower Bound]	reference	Centralized upper-bound reference.
Gemma 3-1B	BoolQ	FedAvg+LoRA	59.51	—	1.0778	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	BoolQ	FedProx+LoRA	59.51	—	1.0778	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	BoolQ	HeteroLoRA	59.51	—	1.0778	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	BoolQ	Local Only	59.51	—	1.0778	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	BoolQ	SplitLoRA	59.51	64.25 [rank 1]	1.0778	0.759 [rank 1]	ok	Only executable federated method at this model scale.
Gemma 3-1B	QNLI	Centralized	49.81	68.0 [rank Upper Bound]	1.4075	0.6451 [rank Lower Bound]	reference	Centralized upper-bound reference.
Gemma 3-1B	QNLI	FedAvg+LoRA	49.81	—	1.4075	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	QNLI	FedProx+LoRA	49.81	—	1.4075	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	QNLI	HeteroLoRA	49.81	—	1.4075	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	QNLI	Local Only	49.81	—	1.4075	—	oom	Out of memory on the evaluated edge client pool.
Gemma 3-1B	QNLI	SplitLoRA	49.81	64.52 [rank 1]	1.4075	0.7367 [rank 1]	ok	Only executable federated method at this model scale.
Gemma 3-270M	HellaSwag	Centralized	24.54	25.2 [rank Upper Bound]	2.9327	0.2513 [rank Lower Bound]	reference	Paper table reports this value; keep aligned with manuscript source.
Gemma 3-270M	HellaSwag	FedAvg+LoRA	24.54	24.84 [rank 3]	2.9327	2.6755 [rank 1]	ok	—
Gemma 3-270M	HellaSwag	FedProx+LoRA	24.54	24.84 [rank 3]	2.9327	2.6755 [rank 1]	ok	—
Gemma 3-270M	HellaSwag	HeteroLoRA	24.54	24.93 [rank 1]	2.9327	2.7378 [rank 3]	ok	—
Gemma 3-270M	HellaSwag	Local Only	24.54	24.73 [rank Lower Bound]	2.9327	2.6982 [rank Upper Bound]	reference	Local-only lower-bound reference.
Gemma 3-270M	HellaSwag	SplitLoRA	24.54	24.88 [rank 2]	2.9327	2.6765 [rank 2]	ok	—
Gemma 3-270M	PIQA	Centralized	51.47	51.87 [rank Upper Bound]	1.3732	1.2522 [rank Lower Bound]	reference	Centralized upper-bound reference.
Gemma 3-270M	PIQA	FedAvg+LoRA	51.47	50.47 [rank 2]	1.3732	1.3194 [rank 2]	ok	—
Gemma 3-270M	PIQA	FedProx+LoRA	51.47	51.47 [rank 1]	1.3732	1.3194 [rank 2]	ok	—
Gemma 3-270M	PIQA	HeteroLoRA	51.47	51.47 [rank 1]	1.3732	1.3443 [rank 3]	ok	—
Gemma 3-270M	PIQA	Local Only	51.47	50.24 [rank Lower Bound]	1.3732	1.3534 [rank Upper Bound]	reference	Local-only lower-bound reference.
Gemma 3-270M	PIQA	SplitLoRA	51.47	51.47 [rank 1]	1.3732	1.3188 [rank 1]	ok	—
Gemma 3-270M	SocialIQA	Centralized	34.34	44.98 [rank Upper Bound]	1.8536	1.2164 [rank Lower Bound]	reference	Centralized upper-bound reference.
Gemma 3-270M	SocialIQA	FedAvg+LoRA	34.34	40.94 [rank 1]	1.8536	1.3476 [rank 3]	ok	—
Gemma 3-270M	SocialIQA	FedProx+LoRA	34.34	40.38 [rank 3]	1.8536	1.3368 [rank 2]	ok	—
Gemma 3-270M	SocialIQA	HeteroLoRA	34.34	38.79 [rank 4]	1.8536	1.4414 [rank 4]	ok	—
Gemma 3-270M	SocialIQA	Local Only	34.34	37.86 [rank Lower Bound]	1.8536	1.7288 [rank Upper Bound]	reference	Local-only lower-bound reference.
Gemma 3-270M	SocialIQA	SplitLoRA	34.34	40.84 [rank 2]	1.8536	1.2748 [rank 1]	ok	—
Gemma 3-270M	ARC-Easy	Centralized	26.67	30.9 [rank Upper Bound]	2.967	2.3865 [rank Lower Bound]	reference	Centralized upper-bound reference.
Gemma 3-270M	ARC-Easy	FedAvg+LoRA	26.67	30.18 [rank 1]	2.967	2.4061 [rank 1]	ok	—
Gemma 3-270M	ARC-Easy	FedProx+LoRA	26.67	30.18 [rank 1]	2.967	2.4061 [rank 1]	ok	—
Gemma 3-270M	ARC-Easy	HeteroLoRA	26.67	30.0 [rank 2]	2.967	2.5769 [rank 3]	ok	—
Gemma 3-270M	ARC-Easy	Local Only	26.67	29.26 [rank Lower Bound]	2.967	2.5307 [rank Upper Bound]	reference	Local-only lower-bound reference.
Gemma 3-270M	ARC-Easy	SplitLoRA	26.67	29.3 [rank 3]	2.967	2.4278 [rank 2]	ok	—
Gemma 3-270M	WinoGrande	Centralized	49.88	50.59 [rank Upper Bound]	1.5455	1.3361 [rank Lower Bound]	reference	Centralized upper-bound reference.
Gemma 3-270M	WinoGrande	FedAvg+LoRA	49.88	50.51 [rank 2]	1.5455	1.4291 [rank 3]	ok	—
Gemma 3-270M	WinoGrande	FedProx+LoRA	49.88	51.3 [rank 1]	1.5455	1.3735 [rank 1]	ok	—
Gemma 3-270M	WinoGrande	HeteroLoRA	49.88	50.51 [rank 2]	1.5455	1.4621 [rank 4]	ok	—
Gemma 3-270M	WinoGrande	Local Only	49.88	50.43 [rank Lower Bound]	1.5455	1.4315 [rank Upper Bound]	reference	Local-only lower-bound reference.
Gemma 3-270M	WinoGrande	SplitLoRA	49.88	50.43 [rank 3]	1.5455	1.4263 [rank 2]	ok	—
Gemma 3-270M	BoolQ	Centralized	60.4	69.66 [rank Upper Bound]	0.8543	0.6199 [rank Lower Bound]	reference	Centralized upper-bound reference.
Gemma 3-270M	BoolQ	FedAvg+LoRA	60.4	62.94 [rank 2]	0.8543	0.7356 [rank 3]	ok	—
Gemma 3-270M	BoolQ	FedProx+LoRA	60.4	64.53 [rank 1]	0.8543	0.7271 [rank 2]	ok	—
Gemma 3-270M	BoolQ	HeteroLoRA	60.4	62.2 [rank 4]	0.8543	0.7441 [rank 4]	ok	—
Gemma 3-270M	BoolQ	Local Only	60.4	60.28 [rank Lower Bound]	0.8543	0.7396 [rank Upper Bound]	reference	Local-only lower-bound reference.
Gemma 3-270M	BoolQ	SplitLoRA	60.4	62.72 [rank 3]	0.8543	0.7017 [rank 1]	ok	—
Gemma 3-270M	QNLI	Centralized	51.51	78.29 [rank Upper Bound]	1.0986	0.5454 [rank Lower Bound]	reference	Centralized upper-bound reference.
Gemma 3-270M	QNLI	FedAvg+LoRA	51.51	68.26 [rank 2]	1.0986	0.672 [rank 2]	ok	—
Gemma 3-270M	QNLI	FedProx+LoRA	51.51	66.98 [rank 3]	1.0986	0.6741 [rank 3]	ok	—
Gemma 3-270M	QNLI	HeteroLoRA	51.51	63.87 [rank 4]	1.0986	0.7411 [rank 4]	ok	—
Gemma 3-270M	QNLI	Local Only	51.51	62.93 [rank Lower Bound]	1.0986	0.7056 [rank Upper Bound]	reference	Local-only lower-bound reference.
Gemma 3-270M	QNLI	SplitLoRA	51.51	71.46 [rank 1]	1.0986	0.5718 [rank 1]	ok	—
Qwen2.5-0.5B	HellaSwag	Centralized	26.87	35.13 [rank Upper Bound]	1.8658	1.7026 [rank Lower Bound]	reference	Centralized upper-bound reference.
Qwen2.5-0.5B	HellaSwag	FedAvg+LoRA	26.87	33.84 [rank 1]	1.8658	1.7446 [rank 1]	ok	—
Qwen2.5-0.5B	HellaSwag	FedProx+LoRA	26.87	33.84 [rank 1]	1.8658	1.7446 [rank 1]	ok	—
Qwen2.5-0.5B	HellaSwag	HeteroLoRA	26.87	33.18 [rank 3]	1.8658	1.7618 [rank 3]	ok	—
Qwen2.5-0.5B	HellaSwag	Local Only	26.87	26.06 [rank Lower Bound]	1.8658	2.0041 [rank Upper Bound]	reference	Local-only lower-bound reference.
Qwen2.5-0.5B	HellaSwag	SplitLoRA	26.87	33.67 [rank 2]	1.8658	1.7563 [rank 2]	ok	—
Qwen2.5-0.5B	PIQA	Centralized	59.36	65.45 [rank Upper Bound]	0.7382	0.6778 [rank Lower Bound]	reference	Centralized upper-bound reference.
Qwen2.5-0.5B	PIQA	FedAvg+LoRA	59.36	65.29 [rank 2]	0.7382	0.6781 [rank 2]	ok	—
Qwen2.5-0.5B	PIQA	FedProx+LoRA	59.36	65.29 [rank 2]	0.7382	0.6779 [rank 1]	ok	—
Qwen2.5-0.5B	PIQA	HeteroLoRA	59.36	65.34 [rank 1]	0.7382	0.6943 [rank 4]	ok	—
Qwen2.5-0.5B	PIQA	Local Only	59.36	61.22 [rank Lower Bound]	0.7382	0.7514 [rank Upper Bound]	reference	Local-only lower-bound reference.
Qwen2.5-0.5B	PIQA	SplitLoRA	59.36	64.47 [rank 3]	0.7382	0.6927 [rank 3]	ok	—
Qwen2.5-0.5B	SocialIQA	Centralized	55.99	68.07 [rank Upper Bound]	0.9644	0.7769 [rank Lower Bound]	reference	Centralized upper-bound reference.
Qwen2.5-0.5B	SocialIQA	FedAvg+LoRA	55.99	66.63 [rank 2]	0.9644	0.7993 [rank 2]	ok	—
Qwen2.5-0.5B	SocialIQA	FedProx+LoRA	55.99	67.35 [rank 1]	0.9644	0.7863 [rank 1]	ok	—
Qwen2.5-0.5B	SocialIQA	HeteroLoRA	55.99	66.07 [rank 4]	0.9644	0.825 [rank 4]	ok	—
Qwen2.5-0.5B	SocialIQA	Local Only	55.99	59.31 [rank Lower Bound]	0.9644	0.9981 [rank Upper Bound]	reference	Local-only lower-bound reference.
Qwen2.5-0.5B	SocialIQA	SplitLoRA	55.99	66.38 [rank 3]	0.9644	0.8044 [rank 3]	ok	—
Qwen2.5-0.5B	ARC-Easy	Centralized	71.05	79.47 [rank Upper Bound]	0.718	0.5913 [rank Lower Bound]	reference	Centralized upper-bound reference.
Qwen2.5-0.5B	ARC-Easy	FedAvg+LoRA	71.05	78.6 [rank 2]	0.718	0.6054 [rank 2]	ok	—
Qwen2.5-0.5B	ARC-Easy	FedProx+LoRA	71.05	78.77 [rank 1]	0.718	0.6013 [rank 1]	ok	—
Qwen2.5-0.5B	ARC-Easy	HeteroLoRA	71.05	76.67 [rank 4]	0.718	0.6274 [rank 4]	ok	—
Qwen2.5-0.5B	ARC-Easy	Local Only	71.05	74.53 [rank Lower Bound]	0.718	0.6693 [rank Upper Bound]	reference	Local-only lower-bound reference.
Qwen2.5-0.5B	ARC-Easy	SplitLoRA	71.05	77.02 [rank 3]	0.718	0.6102 [rank 3]	ok	—
Qwen2.5-0.5B	WinoGrande	Centralized	51.07	63.93 [rank Upper Bound]	0.7032	0.6156 [rank Lower Bound]	reference	Centralized upper-bound reference.
Qwen2.5-0.5B	WinoGrande	FedAvg+LoRA	51.07	63.46 [rank 2]	0.7032	0.6905 [rank 2]	ok	—
Qwen2.5-0.5B	WinoGrande	FedProx+LoRA	51.07	63.61 [rank 1]	0.7032	0.6906 [rank 3]	ok	—
Qwen2.5-0.5B	WinoGrande	HeteroLoRA	51.07	61.17 [rank 4]	0.7032	0.696 [rank 4]	ok	—
Qwen2.5-0.5B	WinoGrande	Local Only	51.07	56.69 [rank Lower Bound]	0.7032	0.7073 [rank Upper Bound]	reference	Local-only lower-bound reference.
Qwen2.5-0.5B	WinoGrande	SplitLoRA	51.07	62.43 [rank 3]	0.7032	0.6889 [rank 1]	ok	—
Qwen2.5-0.5B	BoolQ	Centralized	63.21	80.24 [rank Upper Bound]	0.6393	0.4788 [rank Lower Bound]	reference	Centralized upper-bound reference.
Qwen2.5-0.5B	BoolQ	FedAvg+LoRA	63.21	77.68 [rank 2]	0.6393	0.5051 [rank 2]	ok	—
Qwen2.5-0.5B	BoolQ	FedProx+LoRA	63.21	78.2 [rank 1]	0.6393	0.4939 [rank 1]	ok	—
Qwen2.5-0.5B	BoolQ	HeteroLoRA	63.21	76.73 [rank 4]	0.6393	0.5059 [rank 3]	ok	—
Qwen2.5-0.5B	BoolQ	Local Only	63.21	71.99 [rank Lower Bound]	0.6393	0.6127 [rank Upper Bound]	reference	Local-only lower-bound reference.
Qwen2.5-0.5B	BoolQ	SplitLoRA	63.21	76.79 [rank 3]	0.6393	0.5161 [rank 4]	ok	—
Qwen2.5-0.5B	QNLI	Centralized	58.17	85.76 [rank Upper Bound]	1.2153	0.4611 [rank Lower Bound]	reference	Centralized upper-bound reference.
Qwen2.5-0.5B	QNLI	FedAvg+LoRA	58.17	64.84 [rank 3]	1.2153	0.7994 [rank 2]	ok	—
Qwen2.5-0.5B	QNLI	FedProx+LoRA	58.17	64.96 [rank 2]	1.2153	0.7357 [rank 1]	ok	—
Qwen2.5-0.5B	QNLI	HeteroLoRA	58.17	64.29 [rank 4]	1.2153	0.949 [rank 4]	ok	—
Qwen2.5-0.5B	QNLI	Local Only	58.17	63.88 [rank Lower Bound]	1.2153	0.8657 [rank Upper Bound]	reference	Local-only lower-bound reference.
Qwen2.5-0.5B	QNLI	SplitLoRA	58.17	65.2 [rank 1]	1.2153	0.8051 [rank 3]	ok	—

Protocol B · Historical cost-to-target

All 252 records retain their original target accuracies and costs.

Download complete original CSV

252 of 252 historical B records match the filters
Model	Dataset	Method	Historical level	Historical target (%)	Time (h) [rank]	Communication (MB) [rank]	Energy (kJ) [rank]	Peak memory (MB) [rank]	Status
Gemma 3-1B	HellaSwag	FedAvg+LoRA	1	25.0	—	—	—	—	oom
Gemma 3-1B	HellaSwag	FedProx+LoRA	1	25.0	—	—	—	—	oom
Gemma 3-1B	HellaSwag	HeteroLoRA	1	25.0	—	—	—	—	oom
Gemma 3-1B	HellaSwag	SplitLoRA	1	25.0	0.13 [rank 1]	5535.09 [rank 1]	4.0 [rank 1]	1319.53 [rank 1]	ok
Gemma 3-1B	HellaSwag	FedAvg+LoRA	2	25.0	—	—	—	—	oom
Gemma 3-1B	HellaSwag	FedProx+LoRA	2	25.0	—	—	—	—	oom
Gemma 3-1B	HellaSwag	HeteroLoRA	2	25.0	—	—	—	—	oom
Gemma 3-1B	HellaSwag	SplitLoRA	2	25.0	0.13 [rank 1]	5535.09 [rank 1]	4.0 [rank 1]	1335.28 [rank 1]	ok
Gemma 3-1B	HellaSwag	FedAvg+LoRA	3	25.0	—	—	—	—	oom
Gemma 3-1B	HellaSwag	FedProx+LoRA	3	25.0	—	—	—	—	oom
Gemma 3-1B	HellaSwag	HeteroLoRA	3	25.0	—	—	—	—	oom
Gemma 3-1B	HellaSwag	SplitLoRA	3	25.0	1.31 [rank 1]	55854.1 [rank 1]	40.27 [rank 1]	1342.45 [rank 1]	ok
Gemma 3-1B	PIQA	FedAvg+LoRA	1	53.0	—	—	—	—	oom
Gemma 3-1B	PIQA	FedProx+LoRA	1	53.0	—	—	—	—	oom
Gemma 3-1B	PIQA	HeteroLoRA	1	53.0	—	—	—	—	oom
Gemma 3-1B	PIQA	SplitLoRA	1	53.0	0.87 [rank 1]	37236.07 [rank 1]	25.74 [rank 1]	1316.86 [rank 1]	ok
Gemma 3-1B	PIQA	FedAvg+LoRA	2	53.0	—	—	—	—	oom
Gemma 3-1B	PIQA	FedProx+LoRA	2	53.0	—	—	—	—	oom
Gemma 3-1B	PIQA	HeteroLoRA	2	53.0	—	—	—	—	oom
Gemma 3-1B	PIQA	SplitLoRA	2	53.0	0.87 [rank 1]	37236.07 [rank 1]	25.74 [rank 1]	1332.58 [rank 1]	ok
Gemma 3-1B	PIQA	FedAvg+LoRA	3	54.0	—	—	—	—	oom
Gemma 3-1B	PIQA	FedProx+LoRA	3	54.0	—	—	—	—	oom
Gemma 3-1B	PIQA	HeteroLoRA	3	54.0	—	—	—	—	oom
Gemma 3-1B	PIQA	SplitLoRA	3	54.0	1.15 [rank 1]	49312.63 [rank 1]	34.1 [rank 1]	1339.73 [rank 1]	ok
Gemma 3-1B	SocialIQA	FedAvg+LoRA	1	40.0	—	—	—	—	oom
Gemma 3-1B	SocialIQA	FedProx+LoRA	1	40.0	—	—	—	—	oom
Gemma 3-1B	SocialIQA	HeteroLoRA	1	40.0	—	—	—	—	oom
Gemma 3-1B	SocialIQA	SplitLoRA	1	40.0	0.84 [rank 1]	34216.93 [rank 1]	25.27 [rank 1]	1321.08 [rank 1]	ok
Gemma 3-1B	SocialIQA	FedAvg+LoRA	2	42.0	—	—	—	—	oom
Gemma 3-1B	SocialIQA	FedProx+LoRA	2	42.0	—	—	—	—	oom
Gemma 3-1B	SocialIQA	HeteroLoRA	2	42.0	—	—	—	—	oom
Gemma 3-1B	SocialIQA	SplitLoRA	2	42.0	0.98 [rank 1]	40255.21 [rank 1]	29.7 [rank 1]	1335.4 [rank 1]	ok
Gemma 3-1B	SocialIQA	FedAvg+LoRA	3	45.0	—	—	—	—	oom
Gemma 3-1B	SocialIQA	FedProx+LoRA	3	45.0	—	—	—	—	oom
Gemma 3-1B	SocialIQA	HeteroLoRA	3	45.0	—	—	—	—	oom
Gemma 3-1B	SocialIQA	SplitLoRA	3	45.0	1.36 [rank 1]	55854.1 [rank 1]	41.19 [rank 1]	1343.23 [rank 1]	ok
Gemma 3-1B	ARC-Easy	FedAvg+LoRA	1	27.0	—	—	—	—	oom
Gemma 3-1B	ARC-Easy	FedProx+LoRA	1	27.0	—	—	—	—	oom
Gemma 3-1B	ARC-Easy	HeteroLoRA	1	27.0	—	—	—	—	oom
Gemma 3-1B	ARC-Easy	SplitLoRA	1	27.0	0.15 [rank 1]	6541.47 [rank 1]	4.52 [rank 1]	1316.12 [rank 1]	ok
Gemma 3-1B	ARC-Easy	FedAvg+LoRA	2	27.0	—	—	—	—	oom
Gemma 3-1B	ARC-Easy	FedProx+LoRA	2	27.0	—	—	—	—	oom
Gemma 3-1B	ARC-Easy	HeteroLoRA	2	27.0	—	—	—	—	oom
Gemma 3-1B	ARC-Easy	SplitLoRA	2	27.0	0.15 [rank 1]	6541.47 [rank 1]	4.52 [rank 1]	1332.13 [rank 1]	ok
Gemma 3-1B	ARC-Easy	FedAvg+LoRA	3	28.0	—	—	—	—	oom
Gemma 3-1B	ARC-Easy	FedProx+LoRA	3	28.0	—	—	—	—	oom
Gemma 3-1B	ARC-Easy	HeteroLoRA	3	28.0	—	—	—	—	oom
Gemma 3-1B	ARC-Easy	SplitLoRA	3	28.0	0.19 [rank 1]	8051.04 [rank 1]	5.56 [rank 1]	1337.16 [rank 1]	ok
Gemma 3-1B	WinoGrande	FedAvg+LoRA	1	51.0	—	—	—	—	oom
Gemma 3-1B	WinoGrande	FedProx+LoRA	1	51.0	—	—	—	—	oom
Gemma 3-1B	WinoGrande	HeteroLoRA	1	51.0	—	—	—	—	oom
Gemma 3-1B	WinoGrande	SplitLoRA	1	51.0	1.58 [rank 1]	68433.85 [rank 1]	47.09 [rank 1]	1318.06 [rank 1]	ok
Gemma 3-1B	WinoGrande	FedAvg+LoRA	2	51.0	—	—	—	—	oom
Gemma 3-1B	WinoGrande	FedProx+LoRA	2	51.0	—	—	—	—	oom
Gemma 3-1B	WinoGrande	HeteroLoRA	2	51.0	—	—	—	—	oom
Gemma 3-1B	WinoGrande	SplitLoRA	2	51.0	1.68 [rank 1]	72962.56 [rank 1]	50.21 [rank 1]	1333.79 [rank 1]	ok
Gemma 3-1B	WinoGrande	FedAvg+LoRA	3	51.0	—	—	—	—	oom
Gemma 3-1B	WinoGrande	FedProx+LoRA	3	51.0	—	—	—	—	oom
Gemma 3-1B	WinoGrande	HeteroLoRA	3	51.0	—	—	—	—	oom
Gemma 3-1B	WinoGrande	SplitLoRA	3	51.0	1.73 [rank 1]	74975.32 [rank 1]	51.61 [rank 1]	1340.95 [rank 1]	ok
Gemma 3-1B	BoolQ	FedAvg+LoRA	1	62.0	—	—	—	—	oom
Gemma 3-1B	BoolQ	FedProx+LoRA	1	62.0	—	—	—	—	oom
Gemma 3-1B	BoolQ	HeteroLoRA	1	62.0	—	—	—	—	oom
Gemma 3-1B	BoolQ	SplitLoRA	1	62.0	0.09 [rank 1]	4025.52 [rank 1]	2.83 [rank 1]	1313.15 [rank 1]	ok
Gemma 3-1B	BoolQ	FedAvg+LoRA	2	63.0	—	—	—	—	oom
Gemma 3-1B	BoolQ	FedProx+LoRA	2	63.0	—	—	—	—	oom
Gemma 3-1B	BoolQ	HeteroLoRA	2	63.0	—	—	—	—	oom
Gemma 3-1B	BoolQ	SplitLoRA	2	63.0	1.42 [rank 1]	60382.81 [rank 1]	42.43 [rank 1]	1329.96 [rank 1]	ok
Gemma 3-1B	BoolQ	FedAvg+LoRA	3	64.0	—	—	—	—	oom
Gemma 3-1B	BoolQ	FedProx+LoRA	3	64.0	—	—	—	—	oom
Gemma 3-1B	BoolQ	HeteroLoRA	3	64.0	—	—	—	—	oom
Gemma 3-1B	BoolQ	SplitLoRA	3	64.0	1.49 [rank 1]	63401.95 [rank 1]	44.58 [rank 1]	1338.56 [rank 1]	ok
Gemma 3-1B	QNLI	FedAvg+LoRA	1	57.0	—	—	—	—	oom
Gemma 3-1B	QNLI	FedProx+LoRA	1	57.0	—	—	—	—	oom
Gemma 3-1B	QNLI	HeteroLoRA	1	57.0	—	—	—	—	oom
Gemma 3-1B	QNLI	SplitLoRA	1	57.0	0.15 [rank 1]	6038.28 [rank 1]	4.86 [rank 1]	1323.72 [rank 1]	ok
Gemma 3-1B	QNLI	FedAvg+LoRA	2	60.0	—	—	—	—	oom
Gemma 3-1B	QNLI	FedProx+LoRA	2	60.0	—	—	—	—	oom
Gemma 3-1B	QNLI	HeteroLoRA	2	60.0	—	—	—	—	oom
Gemma 3-1B	QNLI	SplitLoRA	2	60.0	0.18 [rank 1]	7044.66 [rank 1]	5.67 [rank 1]	1339.52 [rank 1]	ok
Gemma 3-1B	QNLI	FedAvg+LoRA	3	63.0	—	—	—	—	oom
Gemma 3-1B	QNLI	FedProx+LoRA	3	63.0	—	—	—	—	oom
Gemma 3-1B	QNLI	HeteroLoRA	3	63.0	—	—	—	—	oom
Gemma 3-1B	QNLI	SplitLoRA	3	63.0	0.2 [rank 1]	8051.04 [rank 1]	6.48 [rank 1]	1346.7 [rank 1]	ok
Gemma 3-270M	HellaSwag	FedAvg+LoRA	1	25.0	17.19 [rank 3]	20332.27 [rank 2]	794.6 [rank 3]	2323.27 [rank 3]	ok
Gemma 3-270M	HellaSwag	FedProx+LoRA	1	25.0	17.28 [rank 4]	20332.27 [rank 2]	798.81 [rank 4]	2336.17 [rank 4]	ok
Gemma 3-270M	HellaSwag	HeteroLoRA	1	25.0	7.9 [rank 2]	28842.89 [rank 3]	365.03 [rank 2]	1369.23 [rank 2]	ok
Gemma 3-270M	HellaSwag	SplitLoRA	1	25.0	2.43 [rank 1]	13351.67 [rank 1]	112.42 [rank 1]	940.64 [rank 1]	ok
Gemma 3-270M	HellaSwag	FedAvg+LoRA	2	25.0	21.02 [rank 3]	24850.55 [rank 1]	971.35 [rank 3]	2350.99 [rank 3]	ok
Gemma 3-270M	HellaSwag	FedProx+LoRA	2	25.0	21.13 [rank 4]	24850.55 [rank 1]	976.53 [rank 4]	2364.05 [rank 4]	ok
Gemma 3-270M	HellaSwag	HeteroLoRA	2	25.0	18.12 [rank 2]	66168.98 [rank 3]	837.6 [rank 2]	1385.57 [rank 2]	ok
Gemma 3-270M	HellaSwag	SplitLoRA	2	25.0	5.21 [rank 1]	28610.72 [rank 2]	240.86 [rank 1]	951.87 [rank 1]	ok
Gemma 3-270M	HellaSwag	FedAvg+LoRA	3	25.0	24.84 [rank 3]	29368.83 [rank 1]	1148.13 [rank 3]	2363.61 [rank 3]	ok
Gemma 3-270M	HellaSwag	FedProx+LoRA	3	25.0	24.93 [rank 4]	29368.83 [rank 1]	1152.17 [rank 4]	2376.74 [rank 4]	ok
Gemma 3-270M	HellaSwag	HeteroLoRA	3	25.0	18.82 [rank 2]	68713.95 [rank 3]	869.83 [rank 2]	1393.01 [rank 2]	ok
Gemma 3-270M	HellaSwag	SplitLoRA	3	25.0	10.36 [rank 1]	56839.96 [rank 2]	479.0 [rank 1]	956.98 [rank 1]	ok
Gemma 3-270M	PIQA	FedAvg+LoRA	1	52.0	54.78 [rank 4]	64851.75 [rank 4]	2536.17 [rank 4]	2340.37 [rank 4]	ok
Gemma 3-270M	PIQA	FedProx+LoRA	1	52.0	1.5 [rank 3]	1127.86 [rank 1]	69.32 [rank 3]	2313.91 [rank 3]	ok
Gemma 3-270M	PIQA	HeteroLoRA	1	52.0	1.17 [rank 2]	6004.91 [rank 3]	54.24 [rank 2]	1342.21 [rank 2]	ok
Gemma 3-270M	PIQA	SplitLoRA	1	52.0	0.18 [rank 1]	3814.76 [rank 2]	8.37 [rank 1]	1006.46 [rank 1]	ok
Gemma 3-270M	PIQA	FedAvg+LoRA	2	53.0	56.68 [rank 4]	67107.46 [rank 4]	2624.33 [rank 4]	2368.3 [rank 4]	ok
Gemma 3-270M	PIQA	FedProx+LoRA	2	53.0	1.5 [rank 2]	1127.86 [rank 1]	69.32 [rank 2]	2341.52 [rank 3]	ok
Gemma 3-270M	PIQA	HeteroLoRA	2	53.0	3.74 [rank 3]	19142.58 [rank 3]	173.16 [rank 3]	1358.23 [rank 2]	ok
Gemma 3-270M	PIQA	SplitLoRA	2	53.0	0.36 [rank 1]	7629.52 [rank 2]	16.71 [rank 1]	1018.47 [rank 1]	ok
Gemma 3-270M	PIQA	FedAvg+LoRA	3	53.0	57.64 [rank 3]	68235.31 [rank 2]	2668.47 [rank 3]	2381.01 [rank 4]	ok
Gemma 3-270M	PIQA	FedProx+LoRA	3	53.0	87.52 [rank 4]	68799.24 [rank 3]	4052.06 [rank 4]	2354.09 [rank 3]	ok
Gemma 3-270M	PIQA	HeteroLoRA	3	53.0	16.96 [rank 2]	89194.59 [rank 4]	785.27 [rank 2]	1365.52 [rank 2]	ok
Gemma 3-270M	PIQA	SplitLoRA	3	53.0	0.36 [rank 1]	7629.52 [rank 1]	16.71 [rank 1]	1023.94 [rank 1]	ok
Gemma 3-270M	SocialIQA	FedAvg+LoRA	1	38.0	47.18 [rank 4]	55348.95 [rank 4]	2091.23 [rank 4]	2317.0 [rank 4]	ok
Gemma 3-270M	SocialIQA	FedProx+LoRA	1	38.0	44.22 [rank 3]	51960.23 [rank 3]	1959.83 [rank 3]	2308.28 [rank 3]	ok
Gemma 3-270M	SocialIQA	HeteroLoRA	1	38.0	11.17 [rank 2]	40719.38 [rank 2]	494.95 [rank 2]	1336.75 [rank 2]	ok
Gemma 3-270M	SocialIQA	SplitLoRA	1	38.0	1.46 [rank 1]	20599.72 [rank 1]	64.8 [rank 1]	964.0 [rank 1]	ok
Gemma 3-270M	SocialIQA	FedAvg+LoRA	2	39.0	69.76 [rank 4]	81893.85 [rank 4]	3091.84 [rank 4]	2342.12 [rank 4]	ok
Gemma 3-270M	SocialIQA	FedProx+LoRA	2	39.0	53.82 [rank 3]	63255.94 [rank 3]	2385.6 [rank 3]	2333.29 [rank 3]	ok
Gemma 3-270M	SocialIQA	HeteroLoRA	2	39.0	13.38 [rank 2]	48778.42 [rank 2]	593.26 [rank 2]	1351.24 [rank 2]	ok
Gemma 3-270M	SocialIQA	SplitLoRA	2	39.0	2.03 [rank 1]	28610.72 [rank 1]	90.03 [rank 1]	974.45 [rank 1]	ok
Gemma 3-270M	SocialIQA	FedAvg+LoRA	3	40.0	86.13 [rank 4]	101096.54 [rank 4]	3817.46 [rank 4]	2355.84 [rank 4]	ok
Gemma 3-270M	SocialIQA	FedProx+LoRA	3	40.0	67.74 [rank 3]	79634.71 [rank 2]	3002.48 [rank 3]	2346.96 [rank 3]	ok
Gemma 3-270M	SocialIQA	HeteroLoRA	3	40.0	21.99 [rank 2]	80166.27 [rank 3]	974.85 [rank 2]	1359.15 [rank 2]	ok
Gemma 3-270M	SocialIQA	SplitLoRA	3	40.0	3.76 [rank 1]	53025.19 [rank 1]	166.86 [rank 1]	980.16 [rank 1]	ok
Gemma 3-270M	ARC-Easy	FedAvg+LoRA	1	28.0	29.95 [rank 3]	35581.46 [rank 2]	1331.65 [rank 3]	2238.33 [rank 3]	ok
Gemma 3-270M	ARC-Easy	FedProx+LoRA	1	28.0	30.15 [rank 4]	35581.46 [rank 2]	1340.68 [rank 4]	2274.42 [rank 4]	ok
Gemma 3-270M	ARC-Easy	HeteroLoRA	1	28.0	21.09 [rank 2]	37326.09 [rank 3]	938.0 [rank 2]	1363.6 [rank 2]	ok
Gemma 3-270M	ARC-Easy	SplitLoRA	1	28.0	1.78 [rank 1]	24795.95 [rank 1]	79.11 [rank 1]	957.83 [rank 1]	ok
Gemma 3-270M	ARC-Easy	FedAvg+LoRA	2	29.0	32.8 [rank 3]	38970.18 [rank 2]	1458.55 [rank 3]	2265.56 [rank 3]	ok
Gemma 3-270M	ARC-Easy	FedProx+LoRA	2	29.0	33.01 [rank 4]	38970.18 [rank 2]	1467.81 [rank 4]	2302.09 [rank 4]	ok
Gemma 3-270M	ARC-Easy	HeteroLoRA	2	29.0	26.35 [rank 2]	46657.62 [rank 3]	1171.86 [rank 2]	1380.19 [rank 2]	ok
Gemma 3-270M	ARC-Easy	SplitLoRA	2	29.0	1.86 [rank 1]	25940.38 [rank 1]	82.74 [rank 1]	969.48 [rank 1]	ok
Gemma 3-270M	ARC-Easy	FedAvg+LoRA	3	30.0	37.11 [rank 2]	44053.24 [rank 2]	1650.23 [rank 2]	2274.11 [rank 3]	ok
Gemma 3-270M	ARC-Easy	FedProx+LoRA	3	30.0	37.33 [rank 3]	44053.24 [rank 2]	1660.18 [rank 3]	2310.78 [rank 4]	ok
Gemma 3-270M	ARC-Easy	HeteroLoRA	3	30.0	39.01 [rank 4]	69138.11 [rank 3]	1734.87 [rank 4]	1385.4 [rank 2]	ok
Gemma 3-270M	ARC-Easy	SplitLoRA	3	30.0	1.97 [rank 1]	27466.29 [rank 1]	87.61 [rank 1]	973.14 [rank 1]	ok
Gemma 3-270M	WinoGrande	FedAvg+LoRA	1	51.0	4.3 [rank 3]	5083.07 [rank 2]	194.76 [rank 3]	2327.35 [rank 3]	ok
Gemma 3-270M	WinoGrande	FedProx+LoRA	1	51.0	21.11 [rank 4]	24850.55 [rank 4]	956.24 [rank 4]	2330.59 [rank 4]	ok
Gemma 3-270M	WinoGrande	HeteroLoRA	1	51.0	1.75 [rank 2]	6362.4 [rank 3]	79.4 [rank 2]	1365.71 [rank 2]	ok
Gemma 3-270M	WinoGrande	SplitLoRA	1	51.0	0.19 [rank 1]	3433.29 [rank 1]	8.73 [rank 1]	961.43 [rank 1]	ok
Gemma 3-270M	WinoGrande	FedAvg+LoRA	2	51.0	4.78 [rank 3]	5647.85 [rank 2]	216.42 [rank 3]	2355.12 [rank 3]	ok
Gemma 3-270M	WinoGrande	FedProx+LoRA	2	51.0	23.03 [rank 4]	27109.69 [rank 4]	1043.38 [rank 4]	2358.4 [rank 4]	ok
Gemma 3-270M	WinoGrande	HeteroLoRA	2	51.0	2.22 [rank 2]	8059.04 [rank 3]	100.49 [rank 2]	1382.01 [rank 2]	ok
Gemma 3-270M	WinoGrande	SplitLoRA	2	51.0	0.19 [rank 1]	3433.29 [rank 1]	8.73 [rank 1]	972.9 [rank 1]	ok
Gemma 3-270M	WinoGrande	FedAvg+LoRA	3	51.0	5.73 [rank 3]	6777.42 [rank 2]	259.77 [rank 3]	2367.76 [rank 3]	ok
Gemma 3-270M	WinoGrande	FedProx+LoRA	3	51.0	38.34 [rank 4]	45182.81 [rank 4]	1737.24 [rank 4]	2371.06 [rank 4]	ok
Gemma 3-270M	WinoGrande	HeteroLoRA	3	51.0	2.68 [rank 2]	9755.68 [rank 3]	121.5 [rank 2]	1389.43 [rank 2]	ok
Gemma 3-270M	WinoGrande	SplitLoRA	3	51.0	0.28 [rank 1]	4959.19 [rank 1]	12.62 [rank 1]	978.12 [rank 1]	ok
Gemma 3-270M	BoolQ	FedAvg+LoRA	1	62.0	21.88 [rank 3]	10166.13 [rank 1]	1137.31 [rank 3]	1339.46 [rank 2]	ok
Gemma 3-270M	BoolQ	FedProx+LoRA	1	62.0	35.02 [rank 4]	41229.32 [rank 3]	1819.79 [rank 4]	2324.8 [rank 4]	ok
Gemma 3-270M	BoolQ	HeteroLoRA	1	62.0	14.03 [rank 2]	50899.22 [rank 4]	729.35 [rank 2]	1403.02 [rank 3]	ok
Gemma 3-270M	BoolQ	SplitLoRA	1	62.0	0.62 [rank 1]	14977.36 [rank 2]	31.98 [rank 1]	1002.91 [rank 1]	ok
Gemma 3-270M	BoolQ	FedAvg+LoRA	2	63.0	89.88 [rank 4]	41794.1 [rank 2]	4671.2 [rank 4]	1356.61 [rank 2]	ok
Gemma 3-270M	BoolQ	FedProx+LoRA	2	63.0	50.36 [rank 3]	59302.44 [rank 3]	2617.11 [rank 3]	2354.56 [rank 4]	ok
Gemma 3-270M	BoolQ	HeteroLoRA	2	63.0	16.37 [rank 2]	59382.42 [rank 4]	850.83 [rank 2]	1420.98 [rank 3]	ok
Gemma 3-270M	BoolQ	SplitLoRA	2	63.0	0.71 [rank 1]	17223.96 [rank 1]	36.75 [rank 1]	1015.75 [rank 1]	ok
Gemma 3-270M	BoolQ	FedAvg+LoRA	3	64.0	104.47 [rank 4]	48571.52 [rank 2]	5429.43 [rank 4]	1365.38 [rank 2]	ok
Gemma 3-270M	BoolQ	FedProx+LoRA	3	64.0	70.98 [rank 3]	83588.2 [rank 4]	3688.79 [rank 3]	2369.79 [rank 4]	ok
Gemma 3-270M	BoolQ	HeteroLoRA	3	64.0	16.37 [rank 2]	59382.42 [rank 3]	850.83 [rank 2]	1430.17 [rank 3]	ok
Gemma 3-270M	BoolQ	SplitLoRA	3	64.0	0.71 [rank 1]	17223.96 [rank 1]	36.75 [rank 1]	1022.32 [rank 1]	ok
Gemma 3-270M	QNLI	FedAvg+LoRA	1	61.0	15.75 [rank 4]	18637.91 [rank 3]	822.83 [rank 4]	2365.36 [rank 3]	ok
Gemma 3-270M	QNLI	FedProx+LoRA	1	61.0	14.31 [rank 3]	16943.55 [rank 2]	747.48 [rank 3]	2382.52 [rank 4]	ok
Gemma 3-270M	QNLI	HeteroLoRA	1	61.0	4.09 [rank 2]	14845.61 [rank 1]	213.65 [rank 2]	1450.77 [rank 2]	ok
Gemma 3-270M	QNLI	SplitLoRA	1	61.0	1.15 [rank 1]	22507.1 [rank 4]	60.05 [rank 1]	1018.2 [rank 1]	ok
Gemma 3-270M	QNLI	FedAvg+LoRA	2	65.0	31.02 [rank 3]	36711.04 [rank 3]	1620.23 [rank 3]	2393.59 [rank 3]	ok
Gemma 3-270M	QNLI	FedProx+LoRA	2	65.0	32.43 [rank 4]	38405.39 [rank 4]	1693.7 [rank 4]	2410.95 [rank 4]	ok
Gemma 3-270M	QNLI	HeteroLoRA	2	65.0	6.42 [rank 2]	23328.81 [rank 1]	335.27 [rank 2]	1468.08 [rank 2]	ok
Gemma 3-270M	QNLI	SplitLoRA	2	65.0	1.81 [rank 1]	35477.29 [rank 2]	94.73 [rank 1]	1030.35 [rank 1]	ok
Gemma 3-270M	QNLI	FedAvg+LoRA	3	69.0	62.42 [rank 4]	73986.86 [rank 4]	3260.63 [rank 4]	2406.44 [rank 3]	ok
Gemma 3-270M	QNLI	FedProx+LoRA	3	69.0	45.35 [rank 3]	53654.59 [rank 2]	2368.79 [rank 3]	2423.89 [rank 4]	ok
Gemma 3-270M	QNLI	HeteroLoRA	3	69.0	17.72 [rank 2]	64472.34 [rank 3]	925.6 [rank 2]	1475.96 [rank 2]	ok
Gemma 3-270M	QNLI	SplitLoRA	3	69.0	2.07 [rank 1]	40436.48 [rank 1]	107.93 [rank 1]	1035.88 [rank 1]	ok
Qwen2.5-0.5B	HellaSwag	FedAvg+LoRA	1	30.0	15.84 [rank 3]	15732.89 [rank 2]	770.04 [rank 3]	3368.58 [rank 3]	ok
Qwen2.5-0.5B	HellaSwag	FedProx+LoRA	1	30.0	15.87 [rank 4]	15732.89 [rank 2]	771.13 [rank 4]	3539.18 [rank 4]	ok
Qwen2.5-0.5B	HellaSwag	HeteroLoRA	1	30.0	7.38 [rank 2]	22384.69 [rank 3]	358.58 [rank 2]	2587.7 [rank 2]	ok
Qwen2.5-0.5B	HellaSwag	SplitLoRA	1	30.0	0.45 [rank 1]	10142.58 [rank 1]	21.7 [rank 1]	1150.11 [rank 1]	ok
Qwen2.5-0.5B	HellaSwag	FedAvg+LoRA	2	32.0	30.03 [rank 4]	29809.69 [rank 2]	1459.38 [rank 4]	3408.78 [rank 3]	ok
Qwen2.5-0.5B	HellaSwag	FedProx+LoRA	2	32.0	30.02 [rank 3]	29809.69 [rank 2]	1458.96 [rank 3]	3581.42 [rank 4]	ok
Qwen2.5-0.5B	HellaSwag	HeteroLoRA	2	32.0	12.31 [rank 2]	37307.81 [rank 3]	598.08 [rank 2]	2618.58 [rank 2]	ok
Qwen2.5-0.5B	HellaSwag	SplitLoRA	2	32.0	0.85 [rank 1]	19217.52 [rank 1]	41.15 [rank 1]	1163.83 [rank 1]	ok
Qwen2.5-0.5B	HellaSwag	FedAvg+LoRA	3	33.0	73.99 [rank 3]	73696.17 [rank 2]	3596.01 [rank 3]	3427.08 [rank 3]	ok
Qwen2.5-0.5B	HellaSwag	FedProx+LoRA	3	33.0	74.1 [rank 4]	73696.17 [rank 2]	3601.39 [rank 4]	3600.64 [rank 4]	ok
Qwen2.5-0.5B	HellaSwag	HeteroLoRA	3	33.0	25.23 [rank 2]	76481.02 [rank 3]	1226.35 [rank 2]	2632.64 [rank 2]	ok
Qwen2.5-0.5B	HellaSwag	SplitLoRA	3	33.0	2.11 [rank 1]	48043.8 [rank 1]	102.63 [rank 1]	1170.08 [rank 1]	ok
Qwen2.5-0.5B	PIQA	FedAvg+LoRA	1	63.0	5.02 [rank 4]	4968.28 [rank 2]	232.97 [rank 4]	3432.59 [rank 4]	ok
Qwen2.5-0.5B	PIQA	FedProx+LoRA	1	63.0	5.01 [rank 3]	4968.28 [rank 2]	232.21 [rank 3]	3398.65 [rank 3]	ok
Qwen2.5-0.5B	PIQA	HeteroLoRA	1	63.0	2.05 [rank 2]	6217.97 [rank 3]	95.18 [rank 2]	2531.45 [rank 2]	ok
Qwen2.5-0.5B	PIQA	SplitLoRA	1	63.0	0.18 [rank 1]	4804.38 [rank 1]	8.47 [rank 1]	1137.96 [rank 1]	ok
Qwen2.5-0.5B	PIQA	FedAvg+LoRA	2	64.0	7.52 [rank 3]	7452.42 [rank 1]	349.03 [rank 3]	3473.55 [rank 4]	ok
Qwen2.5-0.5B	PIQA	FedProx+LoRA	2	64.0	8.33 [rank 4]	8280.47 [rank 3]	386.66 [rank 4]	3439.22 [rank 3]	ok
Qwen2.5-0.5B	PIQA	HeteroLoRA	2	64.0	5.94 [rank 2]	18032.11 [rank 4]	275.42 [rank 2]	2561.67 [rank 2]	ok
Qwen2.5-0.5B	PIQA	SplitLoRA	2	64.0	0.3 [rank 1]	8007.3 [rank 2]	14.12 [rank 1]	1151.54 [rank 1]	ok
Qwen2.5-0.5B	PIQA	FedAvg+LoRA	3	65.0	11.68 [rank 2]	11592.66 [rank 1]	541.71 [rank 2]	3492.19 [rank 4]	ok
Qwen2.5-0.5B	PIQA	FedProx+LoRA	3	65.0	17.58 [rank 4]	17388.98 [rank 2]	815.72 [rank 4]	3457.67 [rank 3]	ok
Qwen2.5-0.5B	PIQA	HeteroLoRA	3	65.0	12.7 [rank 3]	38551.41 [rank 4]	589.29 [rank 3]	2575.41 [rank 2]	ok
Qwen2.5-0.5B	PIQA	SplitLoRA	3	65.0	0.79 [rank 1]	20818.98 [rank 3]	36.72 [rank 1]	1157.72 [rank 1]	ok
Qwen2.5-0.5B	SocialIQA	FedAvg+LoRA	1	62.0	15.79 [rank 4]	15732.89 [rank 2]	772.17 [rank 4]	3418.89 [rank 3]	ok
Qwen2.5-0.5B	SocialIQA	FedProx+LoRA	1	62.0	15.71 [rank 3]	15732.89 [rank 2]	768.41 [rank 3]	3462.2 [rank 4]	ok
Qwen2.5-0.5B	SocialIQA	HeteroLoRA	1	62.0	5.32 [rank 2]	16166.72 [rank 3]	259.95 [rank 2]	2562.68 [rank 2]	ok
Qwen2.5-0.5B	SocialIQA	SplitLoRA	1	62.0	0.44 [rank 1]	10142.58 [rank 1]	21.54 [rank 1]	1147.95 [rank 1]	ok
Qwen2.5-0.5B	SocialIQA	FedAvg+LoRA	2	64.0	34.91 [rank 4]	34777.97 [rank 3]	1707.33 [rank 4]	3455.95 [rank 3]	ok
Qwen2.5-0.5B	SocialIQA	FedProx+LoRA	2	64.0	34.72 [rank 3]	34777.97 [rank 3]	1697.93 [rank 3]	3499.73 [rank 4]	ok
Qwen2.5-0.5B	SocialIQA	HeteroLoRA	2	64.0	9.98 [rank 2]	30468.05 [rank 2]	488.07 [rank 2]	2590.46 [rank 2]	ok
Qwen2.5-0.5B	SocialIQA	SplitLoRA	2	64.0	0.81 [rank 1]	18683.7 [rank 1]	39.61 [rank 1]	1160.39 [rank 1]	ok
Qwen2.5-0.5B	SocialIQA	FedAvg+LoRA	3	66.0	94.94 [rank 4]	94397.34 [rank 3]	4643.29 [rank 4]	3476.19 [rank 3]	ok
Qwen2.5-0.5B	SocialIQA	FedProx+LoRA	3	66.0	94.25 [rank 3]	94397.34 [rank 3]	4609.67 [rank 3]	3520.23 [rank 4]	ok
Qwen2.5-0.5B	SocialIQA	HeteroLoRA	3	66.0	29.94 [rank 2]	91404.14 [rank 2]	1464.33 [rank 2]	2605.63 [rank 2]	ok
Qwen2.5-0.5B	SocialIQA	SplitLoRA	3	66.0	1.34 [rank 1]	30961.56 [rank 1]	65.53 [rank 1]	1167.19 [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	FedAvg+LoRA	1	75.0	24.29 [rank 4]	24013.36 [rank 2]	1176.4 [rank 4]	3404.12 [rank 3]	ok
Qwen2.5-0.5B	ARC-Easy	FedProx+LoRA	1	75.0	24.13 [rank 3]	24013.36 [rank 2]	1168.56 [rank 3]	3441.75 [rank 4]	ok
Qwen2.5-0.5B	ARC-Easy	HeteroLoRA	1	75.0	4.0 [rank 2]	24250.08 [rank 3]	193.52 [rank 2]	2540.26 [rank 2]	ok
Qwen2.5-0.5B	ARC-Easy	SplitLoRA	1	75.0	0.48 [rank 1]	10676.4 [rank 1]	23.09 [rank 1]	1141.11 [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	FedAvg+LoRA	2	76.0	32.64 [rank 3]	32293.83 [rank 2]	1580.47 [rank 3]	3445.54 [rank 3]	ok
Qwen2.5-0.5B	ARC-Easy	FedProx+LoRA	2	76.0	33.31 [rank 4]	33121.88 [rank 3]	1612.96 [rank 4]	3483.62 [rank 4]	ok
Qwen2.5-0.5B	ARC-Easy	HeteroLoRA	2	76.0	7.89 [rank 2]	47878.36 [rank 4]	382.26 [rank 2]	2571.17 [rank 2]	ok
Qwen2.5-0.5B	ARC-Easy	SplitLoRA	2	76.0	0.95 [rank 1]	21352.8 [rank 1]	46.2 [rank 1]	1154.99 [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	FedAvg+LoRA	3	77.0	66.91 [rank 4]	66243.75 [rank 2]	3240.1 [rank 4]	3458.55 [rank 3]	ok
Qwen2.5-0.5B	ARC-Easy	FedProx+LoRA	3	77.0	66.58 [rank 3]	66243.75 [rank 2]	3223.88 [rank 3]	3496.77 [rank 4]	ok
Qwen2.5-0.5B	ARC-Easy	HeteroLoRA	3	77.0	11.17 [rank 2]	67775.86 [rank 3]	540.93 [rank 2]	2580.88 [rank 2]	ok
Qwen2.5-0.5B	ARC-Easy	SplitLoRA	3	77.0	1.53 [rank 1]	34164.48 [rank 1]	73.86 [rank 1]	1159.35 [rank 1]	ok
Qwen2.5-0.5B	WinoGrande	FedAvg+LoRA	1	57.0	10.8 [rank 3]	10764.61 [rank 3]	546.09 [rank 3]	3373.35 [rank 3]	ok
Qwen2.5-0.5B	WinoGrande	FedProx+LoRA	1	57.0	10.83 [rank 4]	10764.61 [rank 3]	547.75 [rank 4]	3437.81 [rank 4]	ok
Qwen2.5-0.5B	WinoGrande	HeteroLoRA	1	57.0	2.46 [rank 2]	7461.56 [rank 2]	124.64 [rank 2]	2520.73 [rank 2]	ok
Qwen2.5-0.5B	WinoGrande	SplitLoRA	1	57.0	0.18 [rank 1]	5338.2 [rank 1]	9.32 [rank 1]	1133.06 [rank 1]	ok
Qwen2.5-0.5B	WinoGrande	FedAvg+LoRA	2	60.0	39.91 [rank 3]	39746.25 [rank 3]	2018.83 [rank 3]	3413.61 [rank 3]	ok
Qwen2.5-0.5B	WinoGrande	FedProx+LoRA	2	60.0	46.43 [rank 4]	46370.62 [rank 4]	2348.84 [rank 4]	3478.84 [rank 4]	ok
Qwen2.5-0.5B	WinoGrande	HeteroLoRA	2	60.0	9.46 [rank 2]	28602.66 [rank 2]	478.32 [rank 2]	2550.81 [rank 2]	ok
Qwen2.5-0.5B	WinoGrande	SplitLoRA	2	60.0	0.74 [rank 1]	21352.8 [rank 1]	37.3 [rank 1]	1146.59 [rank 1]	ok
Qwen2.5-0.5B	WinoGrande	FedAvg+LoRA	3	62.0	99.43 [rank 4]	99365.62 [rank 2]	5029.8 [rank 4]	3431.93 [rank 3]	ok
Qwen2.5-0.5B	WinoGrande	FedProx+LoRA	3	62.0	99.39 [rank 3]	99365.62 [rank 2]	5027.48 [rank 3]	3497.51 [rank 4]	ok
Qwen2.5-0.5B	WinoGrande	HeteroLoRA	3	62.0	34.68 [rank 2]	105083.67 [rank 3]	1754.18 [rank 2]	2564.5 [rank 2]	ok
Qwen2.5-0.5B	WinoGrande	SplitLoRA	3	62.0	1.38 [rank 1]	40036.5 [rank 1]	69.84 [rank 1]	1152.74 [rank 1]	ok
Qwen2.5-0.5B	BoolQ	FedAvg+LoRA	1	71.0	6.65 [rank 3]	6624.38 [rank 1]	300.67 [rank 3]	3453.6 [rank 3]	ok
Qwen2.5-0.5B	BoolQ	FedProx+LoRA	1	71.0	6.67 [rank 4]	6624.38 [rank 1]	301.19 [rank 4]	3470.35 [rank 4]	ok
Qwen2.5-0.5B	BoolQ	HeteroLoRA	1	71.0	3.07 [rank 2]	9326.95 [rank 2]	138.66 [rank 2]	2499.21 [rank 2]	ok
Qwen2.5-0.5B	BoolQ	SplitLoRA	1	71.0	0.43 [rank 1]	11744.04 [rank 3]	19.42 [rank 1]	1142.87 [rank 1]	ok
Qwen2.5-0.5B	BoolQ	FedAvg+LoRA	2	75.0	12.48 [rank 3]	12420.7 [rank 1]	563.76 [rank 3]	3497.81 [rank 3]	ok
Qwen2.5-0.5B	BoolQ	FedProx+LoRA	2	75.0	12.5 [rank 4]	12420.7 [rank 1]	564.83 [rank 4]	3514.77 [rank 4]	ok
Qwen2.5-0.5B	BoolQ	HeteroLoRA	2	75.0	5.32 [rank 2]	16166.72 [rank 3]	240.57 [rank 2]	2531.2 [rank 2]	ok
Qwen2.5-0.5B	BoolQ	SplitLoRA	2	75.0	0.47 [rank 1]	12811.68 [rank 2]	21.18 [rank 1]	1157.5 [rank 1]	ok
Qwen2.5-0.5B	BoolQ	FedAvg+LoRA	3	78.0	32.46 [rank 3]	32293.83 [rank 2]	1466.74 [rank 3]	3520.44 [rank 3]	ok
Qwen2.5-0.5B	BoolQ	FedProx+LoRA	3	78.0	32.5 [rank 4]	32293.83 [rank 2]	1468.52 [rank 4]	3537.51 [rank 4]	ok
Qwen2.5-0.5B	BoolQ	HeteroLoRA	3	78.0	13.33 [rank 2]	40416.8 [rank 3]	602.2 [rank 2]	2547.57 [rank 2]	ok
Qwen2.5-0.5B	BoolQ	SplitLoRA	3	78.0	0.99 [rank 1]	27224.82 [rank 1]	44.94 [rank 1]	1164.99 [rank 1]	ok
Qwen2.5-0.5B	QNLI	FedAvg+LoRA	1	62.0	2.5 [rank 4]	2484.14 [rank 2]	116.24 [rank 4]	3375.58 [rank 3]	ok
Qwen2.5-0.5B	QNLI	FedProx+LoRA	1	62.0	2.49 [rank 3]	2484.14 [rank 2]	115.91 [rank 3]	3497.83 [rank 4]	ok
Qwen2.5-0.5B	QNLI	HeteroLoRA	1	62.0	1.03 [rank 2]	3108.98 [rank 3]	48.17 [rank 2]	2510.74 [rank 2]	ok
Qwen2.5-0.5B	QNLI	SplitLoRA	1	62.0	0.07 [rank 1]	1601.46 [rank 1]	3.43 [rank 1]	1152.89 [rank 1]	ok
Qwen2.5-0.5B	QNLI	FedAvg+LoRA	2	63.0	18.28 [rank 4]	18217.03 [rank 2]	851.18 [rank 4]	3415.86 [rank 3]	ok
Qwen2.5-0.5B	QNLI	FedProx+LoRA	2	63.0	18.22 [rank 3]	18217.03 [rank 2]	848.5 [rank 3]	3539.57 [rank 4]	ok
Qwen2.5-0.5B	QNLI	HeteroLoRA	2	63.0	3.71 [rank 2]	11192.34 [rank 1]	172.76 [rank 2]	2540.71 [rank 2]	ok
Qwen2.5-0.5B	QNLI	SplitLoRA	2	63.0	1.97 [rank 1]	42705.6 [rank 3]	91.54 [rank 1]	1166.65 [rank 1]	ok
Qwen2.5-0.5B	QNLI	FedAvg+LoRA	3	64.0	53.12 [rank 3]	52995.0 [rank 2]	2474.11 [rank 3]	3434.19 [rank 3]	ok
Qwen2.5-0.5B	QNLI	FedProx+LoRA	3	64.0	73.59 [rank 4]	73696.17 [rank 3]	3427.23 [rank 4]	3558.57 [rank 4]	ok
Qwen2.5-0.5B	QNLI	HeteroLoRA	3	64.0	16.29 [rank 2]	49121.95 [rank 1]	758.47 [rank 2]	2554.34 [rank 2]	ok
Qwen2.5-0.5B	QNLI	SplitLoRA	3	64.0	3.78 [rank 1]	82208.27 [rank 4]	176.19 [rank 1]	1172.91 [rank 1]	ok

Protocol C · Perturbations and nominal references

All 120 records, including the four nominal device-mix rows omitted from the perturbation board. Main-text and appendix communication tables report different values; each table keeps its source label.

Download complete original CSV

120 of 120 historical C records match the filters
Model	Dataset	Method	Scenario	Original condition	Accuracy (%) / delta (pp) [rank]	Time (h) / delta [rank]	Communication (MB) / delta [rank]	Energy (kJ) / delta [rank]	Memory (MB) / delta [rank]	Status
Gemma 3-1B	ARC-Easy	FedAvg+LoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	ARC-Easy	FedProx+LoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	ARC-Easy	HeteroLoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	ARC-Easy	SplitLoRA	communication	appendix communication fluctuation	28.07 (delta 0.0) [rank 1]	0.73 (delta 0.28) [rank 1]	19121.22 (delta 0.0) [rank 1]	21.46 (delta 8.27) [rank 1]	1323.4 (delta 0.0) [rank 1]	ok
Gemma 3-1B	BoolQ	FedAvg+LoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	BoolQ	FedProx+LoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	BoolQ	HeteroLoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	BoolQ	SplitLoRA	communication	appendix communication fluctuation	64.25 (delta 0.0) [rank 1]	2.32 (delta 0.83) [rank 1]	63401.95 (delta 0.0) [rank 1]	69.52 (delta 24.93) [rank 1]	1323.6 (delta 0.0) [rank 1]	ok
Gemma 3-1B	HellaSwag	FedAvg+LoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	HellaSwag	FedProx+LoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	HellaSwag	HeteroLoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	HellaSwag	SplitLoRA	communication	appendix communication fluctuation	25.33 (delta 0.0) [rank 1]	2.15 (delta 0.83) [rank 1]	55854.1 (delta 0.0) [rank 1]	65.81 (delta 25.54) [rank 1]	1327.05 (delta 0.0) [rank 1]	ok
Gemma 3-1B	PIQA	FedAvg+LoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	PIQA	FedProx+LoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	PIQA	HeteroLoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	PIQA	SplitLoRA	communication	appendix communication fluctuation	53.81 (delta 0.0) [rank 1]	3.8 (delta 1.57) [rank 1]	95606.11 (delta 0.0) [rank 1]	112.52 (delta 46.4) [rank 1]	1324.37 (delta 0.0) [rank 1]	ok
Gemma 3-1B	QNLI	FedAvg+LoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	QNLI	FedProx+LoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	QNLI	HeteroLoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	QNLI	SplitLoRA	communication	appendix communication fluctuation	64.52 (delta 0.0) [rank 1]	3.13 (delta 1.25) [rank 1]	75478.51 (delta 0.0) [rank 1]	100.92 (delta 40.28) [rank 1]	1331.26 (delta 0.0) [rank 1]	ok
Gemma 3-1B	SocialIQA	FedAvg+LoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	SocialIQA	FedProx+LoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	SocialIQA	HeteroLoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	SocialIQA	SplitLoRA	communication	appendix communication fluctuation	45.7 (delta 0.0) [rank 1]	2.81 (delta 1.16) [rank 1]	67930.66 (delta 0.0) [rank 1]	85.03 (delta 34.96) [rank 1]	1325.86 (delta 0.0) [rank 1]	ok
Gemma 3-1B	WinoGrande	FedAvg+LoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	WinoGrande	FedProx+LoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	WinoGrande	HeteroLoRA	communication	appendix communication fluctuation	—	—	—	—	—	oom
Gemma 3-1B	WinoGrande	SplitLoRA	communication	appendix communication fluctuation	51.62 (delta 0.0) [rank 1]	3.09 (delta 1.25) [rank 1]	80007.22 (delta 0.0) [rank 1]	92.4 (delta 37.32) [rank 1]	1325.58 (delta 0.0) [rank 1]	ok
Gemma 3-270M	ARC-Easy	FedAvg+LoRA	communication	appendix communication fluctuation	30.18 (delta 0.0) [rank 1]	63.44 (delta 26.33) [rank 2]	44053.24 (delta 0.0) [rank 1]	2821.07 (delta 1170.85) [rank 2]	2250.7 (delta 0.0) [rank 1]	ok
Gemma 3-270M	ARC-Easy	FedProx+LoRA	communication	appendix communication fluctuation	30.18 (delta 0.0) [rank 1]	64.0 (delta 26.67) [rank 3]	44053.24 (delta 0.0) [rank 1]	2846.01 (delta 1185.83) [rank 3]	2286.99 (delta 0.0) [rank 1]	ok
Gemma 3-270M	ARC-Easy	HeteroLoRA	communication	appendix communication fluctuation	30.0 (delta 0.0) [rank 1]	270.77 (delta 112.8) [rank 4]	69986.43 (delta 0.0) [rank 1]	12040.74 (delta 5016.12) [rank 4]	1371.14 (delta 0.0) [rank 1]	ok
Gemma 3-270M	ARC-Easy	SplitLoRA	communication	appendix communication fluctuation	29.3 (delta 0.0) [rank 1]	3.43 (delta 1.32) [rank 1]	29373.67 (delta 0.0) [rank 1]	152.54 (delta 58.82) [rank 1]	963.12 (delta 0.0) [rank 1]	ok
Gemma 3-270M	BoolQ	FedAvg+LoRA	communication	appendix communication fluctuation	62.94 (delta 0.0) [rank 1]	372.85 (delta 155.34) [rank 4]	101096.54 (delta 0.0) [rank 1]	19377.49 (delta 8073.3) [rank 4]	1350.13 (delta 0.0) [rank 1]	ok
Gemma 3-270M	BoolQ	FedProx+LoRA	communication	appendix communication fluctuation	64.53 (delta 0.0) [rank 1]	128.15 (delta 53.33) [rank 3]	88106.48 (delta 0.0) [rank 1]	6660.06 (delta 2771.8) [rank 3]	2343.31 (delta 0.0) [rank 1]	ok
Gemma 3-270M	BoolQ	HeteroLoRA	communication	appendix communication fluctuation	62.2 (delta 0.0) [rank 1]	112.15 (delta 46.67) [rank 2]	59382.42 (delta 0.0) [rank 1]	5828.63 (delta 2425.33) [rank 2]	1414.19 (delta 0.0) [rank 1]	ok
Gemma 3-270M	BoolQ	SplitLoRA	communication	appendix communication fluctuation	62.72 (delta 0.0) [rank 1]	4.19 (delta 1.67) [rank 1]	61407.17 (delta 0.0) [rank 1]	217.62 (delta 86.62) [rank 1]	1010.9 (delta 0.0) [rank 1]	ok
Gemma 3-270M	HellaSwag	FedAvg+LoRA	communication	appendix communication fluctuation	24.84 (delta 0.0) [rank 1]	61.26 (delta 25.42) [rank 2]	42358.89 (delta 0.0) [rank 1]	2831.3 (delta 1174.69) [rank 2]	2336.51 (delta 0.0) [rank 1]	ok
Gemma 3-270M	HellaSwag	FedProx+LoRA	communication	appendix communication fluctuation	24.84 (delta 0.0) [rank 1]	61.34 (delta 25.42) [rank 3]	42358.89 (delta 0.0) [rank 1]	2835.02 (delta 1174.96) [rank 3]	2349.48 (delta 0.0) [rank 1]	ok
Gemma 3-270M	HellaSwag	HeteroLoRA	communication	appendix communication fluctuation	24.93 (delta 0.0) [rank 1]	157.7 (delta 65.68) [rank 4]	83983.71 (delta 0.0) [rank 1]	7288.49 (delta 3035.72) [rank 4]	1377.03 (delta 0.0) [rank 1]	ok
Gemma 3-270M	HellaSwag	SplitLoRA	communication	appendix communication fluctuation	24.88 (delta 0.0) [rank 1]	22.1 (delta 9.17) [rank 1]	70954.58 (delta 0.0) [rank 1]	1021.62 (delta 423.66) [rank 1]	946.0 (delta 0.0) [rank 1]	ok
Gemma 3-270M	PIQA	FedAvg+LoRA	communication	appendix communication fluctuation	53.43 (delta 0.0) [rank 1]	98.77 (delta 41.14) [rank 2]	68235.31 (delta 0.0) [rank 1]	4573.02 (delta 1904.55) [rank 2]	2353.7 (delta 0.0) [rank 1]	ok
Gemma 3-270M	PIQA	FedProx+LoRA	communication	appendix communication fluctuation	51.69 (delta 0.0) [rank 1]	150.02 (delta 62.5) [rank 4]	68799.24 (delta 0.0) [rank 1]	6945.68 (delta 2893.62) [rank 4]	2327.1 (delta 0.0) [rank 1]	ok
Gemma 3-270M	PIQA	HeteroLoRA	communication	appendix communication fluctuation	52.18 (delta 0.0) [rank 1]	123.32 (delta 51.25) [rank 3]	95394.95 (delta 0.0) [rank 1]	5709.59 (delta 2372.77) [rank 3]	1349.86 (delta 0.0) [rank 1]	ok
Gemma 3-270M	PIQA	SplitLoRA	communication	appendix communication fluctuation	53.32 (delta 0.0) [rank 1]	0.44 (delta 0.08) [rank 1]	7629.52 (delta 0.0) [rank 1]	20.54 (delta 3.83) [rank 1]	1012.2 (delta 0.0) [rank 1]	ok
Gemma 3-270M	QNLI	FedAvg+LoRA	communication	appendix communication fluctuation	68.26 (delta 0.0) [rank 1]	126.44 (delta 52.58) [rank 2]	87541.7 (delta 0.0) [rank 1]	6604.48 (delta 2746.51) [rank 2]	2378.84 (delta 0.0) [rank 1]	ok
Gemma 3-270M	QNLI	FedProx+LoRA	communication	appendix communication fluctuation	66.98 (delta 0.0) [rank 1]	157.72 (delta 65.69) [rank 4]	109003.54 (delta 0.0) [rank 1]	8238.39 (delta 3431.46) [rank 4]	2396.1 (delta 0.0) [rank 1]	ok
Gemma 3-270M	QNLI	HeteroLoRA	communication	appendix communication fluctuation	63.87 (delta 0.0) [rank 1]	151.79 (delta 63.23) [rank 3]	80590.43 (delta 0.0) [rank 1]	7928.4 (delta 3302.58) [rank 3]	1459.04 (delta 0.0) [rank 1]	ok
Gemma 3-270M	QNLI	SplitLoRA	communication	appendix communication fluctuation	71.46 (delta 0.0) [rank 1]	3.34 (delta 1.26) [rank 1]	40817.95 (delta 0.0) [rank 1]	174.6 (delta 65.66) [rank 1]	1024.0 (delta 0.0) [rank 1]	ok
Gemma 3-270M	SocialIQA	FedAvg+LoRA	communication	appendix communication fluctuation	40.94 (delta 0.0) [rank 1]	155.04 (delta 64.58) [rank 3]	106179.61 (delta 0.0) [rank 1]	6871.89 (delta 2862.56) [rank 3]	2325.37 (delta 0.0) [rank 1]	ok
Gemma 3-270M	SocialIQA	FedProx+LoRA	communication	appendix communication fluctuation	40.38 (delta 0.0) [rank 1]	163.02 (delta 67.92) [rank 4]	111827.46 (delta 0.0) [rank 1]	7225.4 (delta 3010.3) [rank 4]	2316.62 (delta 0.0) [rank 1]	ok
Gemma 3-270M	SocialIQA	HeteroLoRA	communication	appendix communication fluctuation	38.79 (delta 0.0) [rank 1]	153.14 (delta 63.75) [rank 2]	81438.75 (delta 0.0) [rank 1]	6787.49 (delta 2825.62) [rank 2]	1341.58 (delta 0.0) [rank 1]	ok
Gemma 3-270M	SocialIQA	SplitLoRA	communication	appendix communication fluctuation	40.84 (delta 0.0) [rank 1]	9.14 (delta 3.75) [rank 1]	75913.77 (delta 0.0) [rank 1]	405.15 (delta 166.21) [rank 1]	967.49 (delta 0.0) [rank 1]	ok
Gemma 3-270M	WinoGrande	FedAvg+LoRA	communication	appendix communication fluctuation	50.51 (delta 0.0) [rank 1]	9.8 (delta 4.07) [rank 2]	6777.42 (delta 0.0) [rank 1]	444.02 (delta 184.26) [rank 2]	2340.61 (delta 0.0) [rank 1]	ok
Gemma 3-270M	WinoGrande	FedProx+LoRA	communication	appendix communication fluctuation	51.3 (delta 0.0) [rank 1]	65.69 (delta 27.34) [rank 4]	45182.81 (delta 0.0) [rank 1]	2976.11 (delta 1238.87) [rank 4]	2343.87 (delta 0.0) [rank 1]	ok
Gemma 3-270M	WinoGrande	HeteroLoRA	communication	appendix communication fluctuation	50.51 (delta 0.0) [rank 1]	18.23 (delta 7.5) [rank 3]	9755.68 (delta 0.0) [rank 1]	825.82 (delta 339.8) [rank 3]	1373.49 (delta 0.0) [rank 1]	ok
Gemma 3-270M	WinoGrande	SplitLoRA	communication	appendix communication fluctuation	50.43 (delta 0.0) [rank 1]	0.28 (delta 0.0) [rank 1]	4959.19 (delta 0.0) [rank 1]	12.62 (delta 0.0) [rank 1]	966.91 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	FedAvg+LoRA	communication	appendix communication fluctuation	79.47 (delta 0.0) [rank 1]	156.21 (delta 65.0) [rank 3]	90257.11 (delta 0.0) [rank 1]	7564.4 (delta 3147.51) [rank 3]	3422.95 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	FedProx+LoRA	communication	appendix communication fluctuation	79.47 (delta 0.0) [rank 1]	155.23 (delta 64.58) [rank 2]	90257.11 (delta 0.0) [rank 1]	7516.9 (delta 3127.34) [rank 2]	3460.78 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	HeteroLoRA	communication	appendix communication fluctuation	77.54 (delta 0.0) [rank 1]	198.11 (delta 82.5) [rank 4]	87673.36 (delta 0.0) [rank 1]	9592.96 (delta 3994.92) [rank 4]	2554.31 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	SplitLoRA	communication	appendix communication fluctuation	77.37 (delta 0.0) [rank 1]	3.72 (delta 1.52) [rank 1]	49111.44 (delta 0.0) [rank 1]	179.89 (delta 73.81) [rank 1]	1147.42 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	BoolQ	FedAvg+LoRA	communication	appendix communication fluctuation	79.39 (delta 0.0) [rank 1]	168.13 (delta 70.0) [rank 3]	97709.53 (delta 0.0) [rank 1]	7597.85 (delta 3163.24) [rank 3]	3481.1 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	BoolQ	FedProx+LoRA	communication	appendix communication fluctuation	79.33 (delta 0.0) [rank 1]	169.31 (delta 70.42) [rank 4]	98537.58 (delta 0.0) [rank 1]	7651.04 (delta 3182.07) [rank 4]	3497.98 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	BoolQ	HeteroLoRA	communication	appendix communication fluctuation	79.02 (delta 0.0) [rank 1]	141.91 (delta 59.12) [rank 2]	62801.48 (delta 0.0) [rank 1]	6412.58 (delta 2671.55) [rank 2]	2519.11 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	BoolQ	SplitLoRA	communication	appendix communication fluctuation	78.69 (delta 0.0) [rank 1]	6.14 (delta 2.5) [rank 1]	99824.33 (delta 0.0) [rank 1]	277.44 (delta 112.97) [rank 1]	1151.97 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	HellaSwag	FedAvg+LoRA	communication	appendix communication fluctuation	33.84 (delta 0.0) [rank 1]	271.04 (delta 112.92) [rank 2]	157328.91 (delta 0.0) [rank 1]	13172.27 (delta 5487.72) [rank 2]	3387.78 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	HellaSwag	FedProx+LoRA	communication	appendix communication fluctuation	33.84 (delta 0.0) [rank 1]	271.23 (delta 112.92) [rank 2]	157328.91 (delta 0.0) [rank 1]	13181.8 (delta 5487.72) [rank 2]	3559.35 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	HellaSwag	HeteroLoRA	communication	appendix communication fluctuation	33.18 (delta 0.0) [rank 1]	274.2 (delta 114.17) [rank 3]	121250.39 (delta 0.0) [rank 1]	13326.07 (delta 5548.47) [rank 3]	2602.45 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	HellaSwag	SplitLoRA	communication	appendix communication fluctuation	33.67 (delta 0.0) [rank 1]	8.03 (delta 3.33) [rank 1]	106763.99 (delta 0.0) [rank 1]	390.22 (delta 162.0) [rank 1]	1156.66 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	HellaSwag	FedAvg+LoRA	communication	fluctuating bandwidth	33.68 (delta 0.0) [rank 1]	1.08 (delta 0.02) [rank 3]	12006.68 (delta 0.0) [rank 1]	38.61 (delta 1.78) [rank 1]	3557.55 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	HellaSwag	FedProx+LoRA	communication	fluctuating bandwidth	33.68 (delta 0.0) [rank 1]	1.15 (delta 0.02) [rank 2]	12006.68 (delta 0.0) [rank 1]	44.39 (delta 2.08) [rank 2]	3548.12 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	HellaSwag	HeteroLoRA	communication	fluctuating bandwidth	33.12 (delta 0.0) [rank 1]	5.51 (delta 0.0) [rank 1]	11751.96 (delta 0.0) [rank 1]	233.79 (delta 8.47) [rank 3]	3552.89 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	HellaSwag	SplitLoRA	communication	fluctuating bandwidth	33.67 (delta 0.0) [rank 1]	12.08 (delta 4.46) [rank 4]	10676.4 (delta 0.0) [rank 1]	515.81 (delta 203.62) [rank 4]	3548.27 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	PIQA	FedAvg+LoRA	communication	appendix communication fluctuation	65.29 (delta 0.0) [rank 1]	93.03 (delta 38.75) [rank 3]	53823.05 (delta 0.0) [rank 1]	4316.03 (delta 1797.67) [rank 3]	3452.15 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	PIQA	FedProx+LoRA	communication	appendix communication fluctuation	65.29 (delta 0.0) [rank 1]	61.7 (delta 25.68) [rank 2]	35606.02 (delta 0.0) [rank 1]	2862.36 (delta 1191.49) [rank 2]	3418.02 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	PIQA	HeteroLoRA	communication	appendix communication fluctuation	66.05 (delta 0.0) [rank 1]	106.81 (delta 44.49) [rank 4]	47256.56 (delta 0.0) [rank 1]	4955.24 (delta 2063.96) [rank 4]	2545.88 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	PIQA	SplitLoRA	communication	appendix communication fluctuation	64.47 (delta 0.0) [rank 1]	1.25 (delta 0.42) [rank 1]	21886.62 (delta 0.0) [rank 1]	57.93 (delta 19.33) [rank 1]	1144.44 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	QNLI	FedAvg+LoRA	communication	appendix communication fluctuation	64.84 (delta 0.0) [rank 1]	225.03 (delta 93.75) [rank 2]	130831.41 (delta 0.0) [rank 1]	10480.39 (delta 4366.28) [rank 2]	3394.81 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	QNLI	FedProx+LoRA	communication	appendix communication fluctuation	64.96 (delta 0.0) [rank 1]	279.66 (delta 116.5) [rank 4]	163125.23 (delta 0.0) [rank 1]	13024.89 (delta 5425.68) [rank 4]	3517.76 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	QNLI	HeteroLoRA	communication	appendix communication fluctuation	64.29 (delta 0.0) [rank 1]	275.53 (delta 114.73) [rank 3]	121250.39 (delta 0.0) [rank 1]	12832.37 (delta 5343.39) [rank 3]	2525.05 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	QNLI	SplitLoRA	communication	appendix communication fluctuation	65.2 (delta 0.0) [rank 1]	6.28 (delta 2.5) [rank 1]	82208.27 (delta 0.0) [rank 1]	292.62 (delta 116.43) [rank 1]	1159.46 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	SocialIQA	FedAvg+LoRA	communication	appendix communication fluctuation	68.42 (delta 0.0) [rank 1]	274.18 (delta 114.17) [rank 3]	158985.0 (delta 0.0) [rank 1]	13409.35 (delta 5583.64) [rank 3]	3431.24 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	SocialIQA	FedProx+LoRA	communication	appendix communication fluctuation	68.42 (delta 0.0) [rank 1]	272.12 (delta 113.33) [rank 2]	158985.0 (delta 0.0) [rank 1]	13308.8 (delta 5542.88) [rank 2]	3474.71 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	SocialIQA	HeteroLoRA	communication	appendix communication fluctuation	67.45 (delta 0.0) [rank 1]	277.94 (delta 115.8) [rank 4]	123737.58 (delta 0.0) [rank 1]	13593.57 (delta 5663.76) [rank 4]	2571.94 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	SocialIQA	SplitLoRA	communication	appendix communication fluctuation	67.45 (delta 0.0) [rank 1]	5.17 (delta 2.08) [rank 1]	71531.87 (delta 0.0) [rank 1]	253.07 (delta 101.89) [rank 1]	1152.1 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	WinoGrande	FedAvg+LoRA	communication	appendix communication fluctuation	63.46 (delta 0.0) [rank 1]	224.22 (delta 93.33) [rank 2]	130831.41 (delta 0.0) [rank 1]	11342.17 (delta 4721.35) [rank 2]	3392.58 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	WinoGrande	FedProx+LoRA	communication	appendix communication fluctuation	63.61 (delta 0.0) [rank 1]	266.85 (delta 111.18) [rank 4]	155672.81 (delta 0.0) [rank 1]	13498.93 (delta 5623.93) [rank 4]	3457.41 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	WinoGrande	HeteroLoRA	communication	appendix communication fluctuation	61.17 (delta 0.0) [rank 1]	250.28 (delta 104.17) [rank 3]	110679.84 (delta 0.0) [rank 1]	12660.52 (delta 5269.37) [rank 3]	2535.09 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	WinoGrande	SplitLoRA	communication	appendix communication fluctuation	62.43 (delta 0.0) [rank 1]	2.21 (delta 0.83) [rank 1]	40036.5 (delta 0.0) [rank 1]	111.99 (delta 42.15) [rank 1]	1139.52 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	HellaSwag	FedAvg+LoRA	dropout	10% dropout	33.7 (delta -0.14) [rank 4]	184.96 (delta 26.84) [rank 3]	8250.0 (delta 412.5) [rank 3]	8956.4 (delta 1299.76) [rank 3]	4551.18 (delta -0.75) [rank 4]	ok
Qwen2.5-0.5B	HellaSwag	FedProx+LoRA	dropout	10% dropout	33.72 (delta -0.12) [rank 3]	185.16 (delta 26.85) [rank 4]	8250.0 (delta 412.5) [rank 3]	8966.19 (delta 1300.06) [rank 4]	4580.47 (delta -0.11) [rank 1]	ok
Qwen2.5-0.5B	HellaSwag	HeteroLoRA	dropout	10% dropout	33.13 (delta -0.05) [rank 1]	182.4 (delta 22.36) [rank 2]	8250.0 (delta 206.25) [rank 2]	8832.25 (delta 1082.9) [rank 2]	3927.04 (delta -0.57) [rank 2]	ok
Qwen2.5-0.5B	HellaSwag	SplitLoRA	dropout	10% dropout	33.59 (delta -0.08) [rank 2]	5.22 (delta 0.52) [rank 1]	8250.0 (delta 0.0) [rank 1]	252.66 (delta 25.27) [rank 1]	2023.79 (delta 0.58) [rank 3]	ok
Qwen2.5-0.5B	HellaSwag	FedAvg+LoRA	dropout	30% dropout	33.82 (delta -0.02) [rank 1]	237.81 (delta 79.69) [rank 3]	8250.0 (delta 412.5) [rank 3]	11515.38 (delta 3858.73) [rank 3]	4551.1 (delta -0.83) [rank 1]	ok
Qwen2.5-0.5B	HellaSwag	FedProx+LoRA	dropout	30% dropout	33.81 (delta -0.03) [rank 2]	238.07 (delta 79.75) [rank 4]	8250.0 (delta 412.5) [rank 3]	11527.95 (delta 3861.83) [rank 4]	4582.08 (delta 1.5) [rank 3]	ok
Qwen2.5-0.5B	HellaSwag	HeteroLoRA	dropout	30% dropout	33.09 (delta -0.09) [rank 3]	234.51 (delta 74.48) [rank 2]	8250.0 (delta 206.25) [rank 2]	11355.75 (delta 3606.4) [rank 2]	3928.49 (delta 0.88) [rank 2]	ok
Qwen2.5-0.5B	HellaSwag	SplitLoRA	dropout	30% dropout	33.57 (delta -0.1) [rank 4]	6.71 (delta 2.01) [rank 1]	8250.0 (delta 0.0) [rank 1]	324.85 (delta 97.45) [rank 1]	2024.71 (delta 1.5) [rank 3]	ok
Qwen2.5-0.5B	HellaSwag	FedAvg+LoRA	dropout	50% dropout	33.46 (delta -0.38) [rank 4]	289.47 (delta 131.35) [rank 3]	7177.5 (delta -660.0) [rank 2]	14017.18 (delta 6360.54) [rank 3]	4553.43 (delta 1.5) [rank 1]	ok
Qwen2.5-0.5B	HellaSwag	FedProx+LoRA	dropout	50% dropout	33.73 (delta -0.11) [rank 1]	271.62 (delta 113.31) [rank 2]	6723.75 (delta -1113.75) [rank 3]	13152.87 (delta 5486.74) [rank 2]	4582.08 (delta 1.5) [rank 1]	ok
Qwen2.5-0.5B	HellaSwag	HeteroLoRA	dropout	50% dropout	33.06 (delta -0.12) [rank 2]	328.31 (delta 168.28) [rank 4]	8250.0 (delta 206.25) [rank 1]	15898.05 (delta 8148.7) [rank 4]	3929.11 (delta 1.5) [rank 1]	ok
Qwen2.5-0.5B	HellaSwag	SplitLoRA	dropout	50% dropout	33.34 (delta -0.33) [rank 3]	7.56 (delta 2.87) [rank 1]	6641.25 (delta -1608.75) [rank 4]	366.23 (delta 138.84) [rank 1]	2024.71 (delta 1.5) [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	FedAvg+LoRA	heterogeneity	100J	78.6 (delta 0.0) [rank 1]	19.85 (delta -136.51) [rank 4]	6624.38 (delta 0.0) [rank 1]	960.95 (delta -6609.9) [rank 4]	4569.06 (delta 0.6) [rank 3]	ok
Qwen2.5-0.5B	ARC-Easy	FedProx+LoRA	heterogeneity	100J	78.77 (delta 0.0) [rank 1]	23.92 (delta -136.49) [rank 3]	6624.38 (delta 0.0) [rank 1]	1158.02 (delta -6608.81) [rank 3]	4569.57 (delta 0.5) [rank 2]	ok
Qwen2.5-0.5B	ARC-Easy	HeteroLoRA	heterogeneity	100J	76.84 (delta 0.17) [rank 2]	31.57 (delta -78.07) [rank 2]	3300.0 (delta -1608.75) [rank 2]	1528.42 (delta -3780.15) [rank 2]	3913.44 (delta 0.4) [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	SplitLoRA	heterogeneity	100J	77.02 (delta 0.0) [rank 1]	4.83 (delta 0.04) [rank 1]	3416.45 (delta 0.0) [rank 1]	233.71 (delta 1.78) [rank 1]	2018.8 (delta 0.4) [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	FedAvg+LoRA	heterogeneity	10I+10P+30M+50N	78.6 (delta 0.0) [rank 1]	168.82 (delta 12.47) [rank 4]	6624.38 (delta 0.0) [rank 1]	8174.42 (delta 603.56) [rank 4]	4567.86 (delta -0.6) [rank 3]	ok
Qwen2.5-0.5B	ARC-Easy	FedProx+LoRA	heterogeneity	10I+10P+30M+50N	78.77 (delta 0.0) [rank 1]	167.2 (delta 6.79) [rank 3]	6624.38 (delta 0.0) [rank 1]	8095.7 (delta 328.87) [rank 3]	4568.57 (delta -0.5) [rank 2]	ok
Qwen2.5-0.5B	ARC-Easy	HeteroLoRA	heterogeneity	10I+10P+30M+50N	76.32 (delta -0.35) [rank 2]	114.62 (delta 4.98) [rank 2]	4166.25 (delta -742.5) [rank 2]	5549.86 (delta 241.3) [rank 2]	3912.64 (delta -0.4) [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	SplitLoRA	heterogeneity	10I+10P+30M+50N	77.02 (delta 0.0) [rank 1]	4.84 (delta 0.05) [rank 1]	3416.45 (delta 0.0) [rank 1]	234.3 (delta 2.36) [rank 1]	2018.0 (delta -0.4) [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	FedAvg+LoRA	heterogeneity	10J+20I+20P+20M+30N	78.6 (delta 0.0) [rank 1]	166.01 (delta 9.65) [rank 4]	6624.38 (delta 0.0) [rank 1]	8038.0 (delta 467.14) [rank 4]	4568.16 (delta -0.3) [rank 3]	ok
Qwen2.5-0.5B	ARC-Easy	FedProx+LoRA	heterogeneity	10J+20I+20P+20M+30N	78.77 (delta 0.0) [rank 1]	165.21 (delta 4.81) [rank 3]	6624.38 (delta 0.0) [rank 1]	7999.56 (delta 232.73) [rank 3]	4568.82 (delta -0.25) [rank 2]	ok
Qwen2.5-0.5B	ARC-Easy	HeteroLoRA	heterogeneity	10J+20I+20P+20M+30N	76.4 (delta -0.27) [rank 2]	113.26 (delta 3.62) [rank 2]	4743.75 (delta -165.0) [rank 2]	5483.93 (delta 175.37) [rank 2]	3912.84 (delta -0.2) [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	SplitLoRA	heterogeneity	10J+20I+20P+20M+30N	77.02 (delta 0.0) [rank 1]	4.83 (delta 0.04) [rank 1]	3416.45 (delta 0.0) [rank 1]	233.79 (delta 1.85) [rank 1]	2018.2 (delta -0.2) [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	FedAvg+LoRA	heterogeneity	20J+20I+20P+20M+20N	78.6 (delta 0.0) [rank 1]	156.36 (delta 0.0) [rank 1]	6624.38 (delta 0.0) [rank 1]	7570.86 (delta 0.0) [rank 1]	4568.46 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	FedProx+LoRA	heterogeneity	20J+20I+20P+20M+20N	78.77 (delta 0.0) [rank 1]	160.41 (delta 0.0) [rank 1]	6624.38 (delta 0.0) [rank 1]	7766.83 (delta 0.0) [rank 1]	4569.07 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	HeteroLoRA	heterogeneity	20J+20I+20P+20M+20N	76.67 (delta 0.0) [rank 1]	109.64 (delta 0.0) [rank 1]	4908.75 (delta 0.0) [rank 1]	5308.56 (delta 0.0) [rank 1]	3913.04 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	SplitLoRA	heterogeneity	20J+20I+20P+20M+20N	77.02 (delta 0.0) [rank 1]	4.79 (delta 0.0) [rank 1]	3416.45 (delta 0.0) [rank 1]	231.94 (delta 0.0) [rank 1]	2018.4 (delta 0.0) [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	FedAvg+LoRA	heterogeneity	70J+20I+10P	78.6 (delta 0.0) [rank 1]	52.48 (delta -103.88) [rank 3]	6624.38 (delta 0.0) [rank 1]	2540.99 (delta -5029.87) [rank 3]	4568.76 (delta 0.3) [rank 3]	ok
Qwen2.5-0.5B	ARC-Easy	FedProx+LoRA	heterogeneity	70J+20I+10P	78.77 (delta 0.0) [rank 1]	52.34 (delta -108.07) [rank 4]	6624.38 (delta 0.0) [rank 1]	2534.2 (delta -5232.63) [rank 4]	4569.32 (delta 0.25) [rank 2]	ok
Qwen2.5-0.5B	ARC-Easy	HeteroLoRA	heterogeneity	70J+20I+10P	76.75 (delta 0.08) [rank 2]	51.46 (delta -58.17) [rank 2]	6063.75 (delta 1155.0) [rank 2]	2491.76 (delta -2816.8) [rank 2]	3913.24 (delta 0.2) [rank 1]	ok
Qwen2.5-0.5B	ARC-Easy	SplitLoRA	heterogeneity	70J+20I+10P	77.02 (delta 0.0) [rank 1]	4.82 (delta 0.03) [rank 1]	3416.45 (delta 0.0) [rank 1]	233.19 (delta 1.25) [rank 1]	2018.6 (delta 0.2) [rank 1]	ok

Original training loss curves

Appendix E · 21 original vector PDFs, one per model and dataset. Filters apply to model and dataset; each figure keeps its original method traces. Numerical curve samples are unavailable.

Historical aggregate rankings

36 archived per-model ranking records and four original paper figures. These retain the original aggregation and target settings. Only model/method filters apply to the table. Original figures are unfiltered.

Download original rankings CSV

36 of 36 historical aggregate records match model/method filters
Protocol	Model	Method	Position	Average rank	Status	Original note
A	Gemma 3-1B	SplitLoRA	1	1.0	ok	Only executable method under the memory budget.
A	Gemma 3-1B	FedAvg+LoRA	4	4.0	oom	Out of memory on the evaluated edge client pool.
A	Gemma 3-1B	FedProx+LoRA	4	4.0	oom	Out of memory on the evaluated edge client pool.
A	Gemma 3-1B	HeteroLoRA	4	4.0	oom	Out of memory on the evaluated edge client pool.
A	Gemma 3-270M	FedProx+LoRA	1	1.79	ok	—
A	Gemma 3-270M	SplitLoRA	1	1.79	ok	—
A	Gemma 3-270M	FedAvg+LoRA	3	2.0	ok	—
A	Gemma 3-270M	HeteroLoRA	4	3.07	ok	—
A	Qwen2.5-0.5B	FedProx+LoRA	1	1.29	ok	—
A	Qwen2.5-0.5B	FedAvg+LoRA	2	1.93	ok	—
A	Qwen2.5-0.5B	SplitLoRA	3	2.64	ok	—
A	Qwen2.5-0.5B	HeteroLoRA	4	3.57	ok	—
B	Gemma 3-1B	SplitLoRA	1	1.0	ok	Only executable method under the memory budget.
B	Gemma 3-1B	FedAvg+LoRA	4	4.0	oom	Out of memory on the evaluated edge client pool.
B	Gemma 3-1B	FedProx+LoRA	4	4.0	oom	Out of memory on the evaluated edge client pool.
B	Gemma 3-1B	HeteroLoRA	4	4.0	oom	Out of memory on the evaluated edge client pool.
B	Gemma 3-270M	SplitLoRA	1	1.11	ok	—
B	Gemma 3-270M	HeteroLoRA	2	2.32	ok	—
B	Gemma 3-270M	FedAvg+LoRA	3	3.11	ok	—
B	Gemma 3-270M	FedProx+LoRA	4	3.3	ok	—
B	Qwen2.5-0.5B	SplitLoRA	1	1.13	ok	—
B	Qwen2.5-0.5B	HeteroLoRA	2	2.2	ok	—
B	Qwen2.5-0.5B	FedAvg+LoRA	3	3.0	ok	—
B	Qwen2.5-0.5B	FedProx+LoRA	4	3.3	ok	—
C	Gemma 3-1B	SplitLoRA	1	1.0	ok	Only executable method under the memory budget.
C	Gemma 3-1B	FedAvg+LoRA	4	4.0	oom	Out of memory on the evaluated edge client pool.
C	Gemma 3-1B	FedProx+LoRA	4	4.0	oom	Out of memory on the evaluated edge client pool.
C	Gemma 3-1B	HeteroLoRA	4	4.0	oom	Out of memory on the evaluated edge client pool.
C	Gemma 3-270M	SplitLoRA	1	1.0	ok	—
C	Gemma 3-270M	FedAvg+LoRA	2	1.57	ok	—
C	Gemma 3-270M	HeteroLoRA	3	1.8	ok	—
C	Gemma 3-270M	FedProx+LoRA	4	2.03	ok	—
C	Qwen2.5-0.5B	SplitLoRA	1	1.0	ok	—
C	Qwen2.5-0.5B	FedAvg+LoRA	2	1.63	ok	—
C	Qwen2.5-0.5B	FedProx+LoRA	3	1.74	ok	—
C	Qwen2.5-0.5B	HeteroLoRA	4	1.91	ok	—

A · Original paper figure

Historical A ranking, original paper figure; original paper snapshot

Open full-resolution image

B · Original paper figure

Historical B ranking, original paper figure; original paper snapshot

Open full-resolution image

C · Original paper figure

Historical C ranking, original paper figure; original paper snapshot

Open full-resolution image

Overall · Original paper figure

Historical Overall ranking, original paper figure; original paper snapshot

Open full-resolution image

Source files and coverage

The three paper result CSVs and rankings CSV match the original local website exports byte-for-byte. Their source notes identify the main text and appendices. The loss and ranking figures are copied without alteration from the recovered paper source.

Protocol C includes communication results across the listed tasks, dropout on Qwen/HellaSwag, and device mixtures on Qwen/ARC-E.
Main-text and appendix communication tables retain their respective source labels.
Available artifacts include the aggregate result tables and original PDF/PNG figures. Some detailed run settings and numerical curve samples are unavailable.

Download catalog and source hashes

Complete machine-readable archive

Source file fingerprints
Source file	Records	SHA-256	Origin
protocol_a_results.csv	126	3067f4c9a0dc8a0cd5caa58c9806a191358bd8fba039328bee24baf810b29b2b	Archived paper-table export; preserved byte-for-byte
protocol_b_results.csv	252	186154e6bee59b67e30ade2c2af323851c9da9bcfd41537760dd271a1b93b8b8	Archived paper-table export; preserved byte-for-byte
protocol_c_results.csv	120	433bc0ec6bcfe774ec493045f4749383497f4dfe0d60fb33d5f16d8b757db243	Archived paper-table export; preserved byte-for-byte
protocol_rankings.csv	36	473a642ab1d1bfd463a5f4b001b740edbb98266f655c4390c181ca3ca86940d8	Archived paper-table export; preserved byte-for-byte
neurips_2026.tex	—	48c2fe8708406540399f0373bb3427483d036318513a76cb065d267e9c3d42d6	Local arXiv-2605.08636v1 source; Experimental Settings and Appendices A-E

Final score

Total Ranking

Higher score is better. Final score is the weighted average of Protocol A/B/C scores, with default protocol weights 1:1:1.

Rank	Method	Final Score	Protocol A	Protocol B	Protocol C	Weight Total

Score summary

Overall Ranking by Protocol

Higher scores reflect better task-level ranks.

Check out the Protocol Boards

Benchmark Pages

A Protocol A

Model Quality

Best evaluated checkpoint accuracy and loss, with calibrated system costs recorded separately.

B Protocol B

Cost to Target

Wall-clock time, communication, energy, and peak memory required to hit target accuracy.

C Protocol C

Robustness

Robustness across seven datasets and all three backbone models.

HW Platform

Real Devices

Heterogeneous Android and Jetson edge clients used by the benchmark.

Per-model scores

Score Details by Model

Protocol	Rank	Method	Base Model	Score	Feasibility	Note

Score summary

Overall Ranking

Compare the task-level results below.

Protocol A

Model Quality

Models: Qwen2.5-0.5B, Gemma 3-270M, Gemma 3-1B. Datasets: BoolQ, QNLI, PIQA, HellaSwag, SocialIQA, ARC-Easy, WinoGrande. Results are grouped by model and dataset.

Model	Task	Dataset	Method	Loss	Accuracy	Status

Protocol B

Cost to Target

Models: Qwen2.5-0.5B, Gemma 3-270M, Gemma 3-1B. Datasets: BoolQ, QNLI, PIQA, HellaSwag, SocialIQA, ARC-Easy, WinoGrande. Results are grouped by model and dataset.

Model	Task	Dataset	Target Acc	Method	Time h	Comm MB	Energy kJ	Memory MB	Status

Protocol C

Robustness

Models: Qwen2.5-0.5B, Gemma 3-270M, Gemma 3-1B. Datasets: BoolQ, QNLI, PIQA, HellaSwag, SocialIQA, ARC-Easy, WinoGrande. Results are grouped by model and dataset.

Δ = condition − nominal baseline. Accuracy changes use percentage points; cost changes use the displayed units.
Model	Scenario	Condition	Dataset	Method	Accuracy % / Δ pp	Time h / Δ h	Comm MB / Δ MB	Energy kJ / Δ kJ	Memory MB / Δ MB

Platform

Real Edge Devices

Wi-Fi 6 + Flower C++ SDK + MobileFineTuner

Order	Device	Processor	Memory

Submission pipeline

Submission

Checking the submission mode...

The upload form stays disabled until the server configuration is available.

Loading submission window...

Download participant tools · Setup guide

Need a token? Register with email or verify your email again to replace a lost token.

Submission token Protocol Model in package Method name Method description (one sentence, shown on the leaderboard) Submission artifact ZIP Quality metrics

Loading backend configuration...

Choose the evaluated protocol ZIP to upload.

Backend jobs

Recent Submissions

Submission	Protocol	Stage	Status	Updated	Result

Methods on the leaderboard

Submitted Methods

Protocol A: quality · B: cost to target · C: robustness. Scores use the leaderboard's 0–10 scale; farther from the center is better. Missing scores remain unfilled. Benchmark reference methods are labeled below.

Other Leaderboards

Explore More Pages

Protocol A

Paper Reference Results

Paper Reference Results

Protocol A · Quality and reference baselines

Protocol B · Historical cost-to-target

Protocol C · Perturbations and nominal references

Original training loss curves

Historical aggregate rankings

Source files and coverage

Total Ranking

Overall Ranking by Protocol

Benchmark Pages

Model Quality

Cost to Target

Robustness

Real Devices

Score Details by Model

Overall Ranking

Model Quality

Cost to Target

Robustness

Real Edge Devices

Submission

Recent Submissions

Submitted Methods

Explore More Pages

Quality

Efficiency

Robustness

Devices