Open csgura opened 2 years ago
It would help if you could provide a small single source file that produces a large output using
go tool compile -o x.a x.go
Here is a single file of about 1500 lines.
https://gotipplay.golang.org/p/kMBLHxigsDo
$ gotip clean -cache
$ gotip build
$ gotip tool compile -o x.a main.go
$ du -hs ~/Library/Caches/go-build/
105M /Users/gura/Library/Caches/go-build/
$ ls -al
total 142016
drwxr-xr-x 6 gura staff 192 Jan 6 11:34 .
drwxr-xr-x 15 gura staff 480 Jan 6 10:15 ..
-rwxr-xr-x 1 gura staff 2501872 Jan 6 11:34 main
-rw-r--r-- 1 gura staff 27 Jan 6 10:16 go.mod
-rw-r--r-- 1 gura staff 26695 Jan 6 11:31 main.go
-rw-r--r-- 1 gura staff 70173912 Jan 6 11:34 x.a
With the test case above, go tool compile foo.go
produces a file that is 70173802 bytes. go tool link foo.o
produces a file that is 2400985 bytes. So the final executable is about 3.5% of the size of the object file.
The largest symbol in the object file is
type..namedata.*main.Tuple2[go.shape.interface { Concat(main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]) main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; Drop(int) main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; DropWhile(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; Duplicate() main.Tuple2[main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0],main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]]; Exists(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) bool; Filter(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; FilterNot(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; Find(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) main.Option[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; ForAll(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) bool; Foreach(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0)); HasNext() bool; IsEmpty() bool; MakeString(string) string; Map(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) interface {}) main.Iterator[interface {}]; Next() go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0; NextOption() main.Option[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; NonEmpty() bool; Partition(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) main.Tuple2[main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0],main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]]; Reduce(main.Monoid[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]) go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0; Span(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) main.Tuple2[main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0],main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]]; Take(int) main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; TakeWhile(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; TapEach(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0)) main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; ToList() main.List[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; ToSeq() main.Seq[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0] }_0,go.shape.interface { Concat(main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]) main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; Drop(int) main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; DropWhile(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; Duplicate() main.Tuple2[main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0],main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]]; Exists(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) bool; Filter(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; FilterNot(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; Find(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) main.Option[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; ForAll(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) bool; Foreach(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0)); HasNext() bool; IsEmpty() bool; MakeString(string) string; Map(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) interface {}) main.Iterator[interface {}]; Next() go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0; NextOption() main.Option[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; NonEmpty() bool; Partition(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) main.Tuple2[main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0],main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]]; Reduce(main.Monoid[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]) go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0; Span(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) main.Tuple2[main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0],main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]]; Take(int) main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; TakeWhile(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0) bool) main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; TapEach(func(go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0)) main.Iterator[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; ToList() main.List[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0]; ToSeq() main.Seq[go.shape.interface { Failed() main.Try[error]; Foreach(func(int)); Get() int; IsFailure() bool; IsSuccess() bool; Iterator() main.Iterator[int]; Or(func() main.Try[int]) main.Try[int]; OrElse(int) int; OrElseGet(func() int) int; Recover(func(error) int) main.Try[int]; RecoverWith(func(error) main.Try[int]) main.Try[int]; String() string; ToOption() main.Option[int]; ToSeq() main.Seq[int]; Unapply() (int, error) }_0] }_1].
It's 30111 bytes (according to go tool nm
). It does not appear in the final executable. In fact, none of the 100 largest symbols in the object file appear in the executable.
This may be working as expected, but CC @randall77 @danscales in case it is not.
https://gotipplay.golang.org/p/8WZz12Ay6vz
It is almost the same code, but the Option, Try , HCons and Iterator types are changed to a struct type.
drwxr-xr-x 5 gura staff 160 Jan 6 14:46 .
drwxr-xr-x 7 gura staff 224 Jan 6 14:07 ..
-rwxr-xr-x 1 gura staff 2114816 Jan 6 14:42 opti
-rw-r--r-- 1 gura staff 23637 Jan 6 14:42 opti.go
-rw-r--r-- 1 gura staff 17436020 Jan 6 14:46 x.a
The object file size has been reduced to 17436020.
It seems that object files are created inefficiently when generic interfaces refer to each other. I know that it works as expected, but wouldn't it be better to output a warning message when an object file is created inefficiently like that?
Because I think It would be better not to use type parameters with interface types in the production to reduce compile time.
As Ian's symbol example shows, the symbols can be quite large for the names of instantiated functions/methods, when the type arguments are instantiated types that are nested and the descriptions of some of the underlying types (e.g. interfaces) are large. For the name of a shape type (the proxy type standing for all the types that a particular instantiation will handle), we use the standard printing (via LinkString) of the shared underlying type (e.g go.shape.int64_0
or go.shape.interface { M(); String() string }_0
or go.shape.struct { p.x int8; p.y float64 }_0
. Using the name of the underlying type is easiest so that we have a unique name across packages. For Go 1.19, we could try to use shorter, unique, but memo-ized names, but then we would probably need extra coordination across compilations (using the build cache?). Or, if a shape name gets really large (> 50 characters), maybe we could replace it with an MD5 hash?
wouldn't it be better to output a warning message when an object file is created inefficiently like that?
No. This is something for a release note, not a compiler warning. Everything works correctly, it just takes more space than expected. The compiler never issues warnings anyhow.
FWIW, I've written a few tests to show that while package archives are definitely larger (usually 2x), the resulting binary executable shows no real difference -- https://github.com/akutz/go-generics-the-hard-way/blob/main/06-benchmarks/03-file-sizes.md.
@danscales This is in the 1.18 milestone; time to move to 1.19? Thanks.
Yes, I'll move to 1.19. Thanks!
I spent some time digging into this as we've been having significant issues with the build cache growing much too large, even with the type hashing introduced with Go 1.22 to fix #65030. I've created a MWE based on my findings which generates a 50 MB object file from ~130 lines of code: https://github.com/arvidfm/go-cache-bloat.
The large object files seem to be a result of several factors compounding to make the issue even worse:
O(n²)
compilation times for long dependency chains with respect to the number of packages in the chainFor us this adds up to several ~300 MB package archives being generated as part of the compilation, totalling ~5 GB for a single compilation from a clean cache. Making a single change to a central package results in most other packages being recompiled, resulting in another 5 GB, which quickly adds up.
I suspect (5) is unavoidable (and if anything desirable performance wise were it not for the other issues), and (3) is probably a requirement for interfaces to work. Hopefully something can be done about (1), (2) and (4), however. Maybe someone more familiar with the compiler internals could chime in to note which of these might be easiest to tackle. (It seems to me like it should be possible to avoid instantiating a type if the same instance is already present in one of the imported package archives.)
To better explain what I mean by (4), consider the following example, where the object files for both the main
and a
packages will contain identical instantiations of GenericType[int].GenericFunc
(as seen with go tool compile -S
), even though main
doesn't reference GenericType[int]
directly:
// a/a.go
package a
type GenericType[T any] struct{}
func (GenericType[T]) GenericFunc() {}
type A struct{}
func (A) AFunc(GenericType[int]) {}
// main.go
package main
import "example.com/cache/a"
type B struct {
A a.A
}
func main() {}
This compounds for long dependency chains like main -> a.A -> b.B -> c.C -> d.D
where each package will contain instantiations for all methods of the generic types used by all its (indirect) dependencies.
To get a better idea of specifically where the bloat is coming from, I ran a test on a real-world codebase that makes heavy use of generics. I created a new package containing a single file which calls a single generic function, referencing a type from another package that in turn results in a chain of generic type instantiations. The package looked something like this:
package mytest
import (
"github.com/blah/blah/core"
"github.com/blah/blah/users"
)
func doThing() {
core.DoAction[users.User]()
}
Running go build -o mytest.a
on this resulted in a 50 MB archive. I added some code to go tool compile
to collect statistics on what parts of the object file were taking the most space and ended up with the following (line numbers are approximate as the files contain modifications):
I suspect the vast, vast majority of data here is from duplicate method instantiations already present in other package archives. Each individual entry in the reloc section is small, but there are just so many of them that they add up, presumably due to the duplicate method instantiations.
As for how to best mitigate the issue, this is the best I've managed to come up with in terms of practical advice for the end user:
switch any(p).(type) {
case Pair[A, int], Pair[A, int64], Pair[A, int32], Pair[A, int16], Pair[A, int8]:
case Pair[A, uint], Pair[A, uint8], Pair[A, uint16], Pair[A, uint32], Pair[A, uint64], Pair[A, uintptr]:
case Pair[A, float32], Pair[A, float64]:
}
go tool nm -size -sort size
to find potentially problematic functions//go:noinline
as needed to prevent inlining from blowing up the size of your generic functionsOf course, most of this is absolutely horrible advice from a maintainability, readability and runtime performance perspective, and not particularly helpful if you've already implemented a certain architecture and can't afford to break compatibility, so I do hope that the issue can be fixed on the compiler side.
Turns out that there is an open issue for the duplicate generic instantiation (or at least a specific case of it): #56718
https://github.com/golang/go/issues/50438#issuecomment-2295094735 thank you for the breakdown. I am not sure when I will have cycles to investigate this, but I would like to so I will optimistically assign this to myself.
What version of Go are you using (
go version
)?Does this issue reproduce with the latest release?
Yes
What operating system and processor architecture are you using (
go env
)?go env
OutputWhat did you do?
What did you expect to see?
A build cache directory of a reasonable size , or Warning about incorrectly used generic type.
What did you see instead?
Please excuse my poor English.
It seems to be related to this issue as well. https://github.com/golang/go/issues/50204
I have written some algebraic data types to test the generic of Go 1.18. ( https://github.com/csgura/fp.git ) After running the tests, I noticed that the build cache was using a very large amount of disk. I guess the cause lies in the some recursive type ( HList and curried Func ) and the interface type that uses the type parameter.
When I modified the code so that a generic interface type does not return other generic interface type, The size of the build cache has been significantly reduced. This fix is applied in the master branch.
It will not become a problem right now, but I think it will become a big problem as more and more projects use generics.