Questions about dense layers

[renlicheng]

What do you think about those layers being used as dense layers? How is this consideration made?

[dreaming-panda]

Through empirical study (actually, accidentally, we found this provides higher performance). This can also be a research problem.

I am unsure whether the placement is optimal or can be applied to other models.

[renlicheng]

这是来自QQ邮箱的假期自动回复邮件。您好，我最近正在休假中，无法亲自回复您的邮件。我将在假期结束后，尽快给您回复。