[fidl] Calculate max out-of-line payload size

Also write some unit tests for this and for max handle counting.

TEST=implement some fidl compiler tests

Change-Id: I6d6758100d432e0769bf18b0cd57925c9a56d9b8