Email registration
Get Your Submission Token
Verify your email, receive a private token, and submit your team's evaluated runs.
Email registration
Get Your Submission Token
Verify your email, receive a private token, and submit your team's evaluated runs.
Start submitting
A token for your team
- Enter your email.We send a six-digit verification code to your inbox.
- Verify your email.Your private submission token is shown once. Save it somewhere safe.
- Upload your run.Use the token on the Submit page or in the X-Submission-Token API header.
One verified email owns one team account. Your team / display name appears with your methods on the leaderboard; your email stays private. Share the token only with trusted teammates.
Lost your token? Verify the same email again. A new token replaces the old one while keeping your submissions and team identity.
Read the submission guideLoading email registration...
Email verified
Your submission token
The server cannot show this token again. Save it before leaving this page. “Use token” remembers it only for this browser tab's session.
Final score
Total Ranking
Higher score is better. Final score is the weighted average of Protocol A/B/C scores, with default protocol weights 1:1:1.
| Rank | Method | Final Score | Protocol A | Protocol B | Protocol C | Weight Total |
|---|
Score summary
Overall Ranking by Protocol
Higher scores reflect better task-level ranks.
Check out the Protocol Boards
Benchmark Pages
Model Quality
Best evaluated checkpoint accuracy and loss, with calibrated system costs recorded separately.
Protocol BCost to Target
Wall-clock time, communication, energy, and peak memory required to hit target accuracy.
Protocol CRobustness
Robustness across seven datasets and all three backbone models.
PlatformReal Devices
Heterogeneous Android and Jetson edge clients used by the benchmark.
Per-model scores
Score Details by Model
| Protocol | Rank | Method | Base Model | Score | Feasibility | Note |
|---|
Score summary
Overall Ranking
Compare the task-level results below.
Protocol A
Model Quality
Models: Qwen2.5-0.5B, Gemma 3-270M, Gemma 3-1B. Datasets: BoolQ, QNLI, PIQA, HellaSwag, SocialIQA, ARC-Easy, WinoGrande. Results are grouped by model and dataset.
| Model | Task | Dataset | Method | Loss | Accuracy | Status |
|---|
Protocol B
Cost to Target
Models: Qwen2.5-0.5B, Gemma 3-270M, Gemma 3-1B. Datasets: BoolQ, QNLI, PIQA, HellaSwag, SocialIQA, ARC-Easy, WinoGrande. Results are grouped by model and dataset.
| Model | Task | Dataset | Target Acc | Method | Time h | Comm MB | Energy kJ | Memory MB | Status |
|---|
Protocol C
Robustness
Models: Qwen2.5-0.5B, Gemma 3-270M, Gemma 3-1B. Datasets: BoolQ, QNLI, PIQA, HellaSwag, SocialIQA, ARC-Easy, WinoGrande. Results are grouped by model and dataset.
| Model | Scenario | Condition | Dataset | Method | Accuracy % / Δ pp | Time h / Δ h | Comm MB / Δ MB | Energy kJ / Δ kJ | Memory MB / Δ MB |
|---|
Platform
Real Edge Devices
| Order | Device | Processor | Memory |
|---|
Submission pipeline
Submission
Checking the submission mode...
The upload form stays disabled until the server configuration is available.
Backend jobs
Recent Submissions
| Submission | Protocol | Stage | Status | Updated | Result |
|---|
Methods on the leaderboard
Submitted Methods
Protocol A: quality · B: cost to target · C: robustness. Scores use the leaderboard's 0–10 scale; farther from the center is better. Missing scores remain unfilled. Benchmark reference methods are labeled below.
Other Leaderboards