question on "selected_layers", why[0~13]

[jianan86]

Appreciate your open-source contribution! Quick question on selected_layers:

1. Why does the action expert only utilize the first 14 KV layers? Is it just for runtime efficiency?
2. What’s the reasoning for selecting exactly layers [0~13]?