Fail to create tables with many columns

[pdimens]

Hello, I seem to be experiencing an issue where I cannot create an IndexedTable with n columns beyond some kind of threshold limit.

• I cannot instantiate a single-row table with 2213 columns, therefore I cannot push new rows to it
• I cannot instantiate a table with all the data available at once (212x2213)
• Instantiating a table by one column and using transform to add more columns would be incredibly inefficient since it returns a new table each time.

Is there some kind of internal limit as to what is possible? Here is a snapshot of the ridiculously long error message that table spits out:

Internal error: encountered unexpected error in runtime:
StackOverflowError()
jl_typemap_level_insert_ at /buildworker/worker/package_linux64/build/src/typemap.c:976
jl_typemap_insert_generic at /buildworker/worker/package_linux64/build/src/typemap.c:944
jl_typemap_array_insert_ at /buildworker/worker/package_linux64/build/src/typemap.c:969 [inlined]
jl_typemap_level_insert_ at /buildworker/worker/package_linux64/build/src/typemap.c:1010
jl_typemap_insert_generic at /buildworker/worker/package_linux64/build/src/typemap.c:944
jl_typemap_array_insert_ at /buildworker/worker/package_linux64/build/src/typemap.c:969 [inlined]
...
typeinf at ./compiler/typeinfer.jl:12
typeinf_edge at ./compiler/typeinfer.jl:488
abstract_call_method at ./compiler/abstractinterpretation.jl:396
abstract_call_gf_by_type at ./compiler/abstractinterpretation.jl:93
abstract_call at ./compiler/abstractinterpretation.jl:850
jfptr_abstract_call_606.clone_1 at /usr/lib/julia/sys.so (unknown line)
_jl_invoke at /buildworker/worker/package_linux64/build/src/gf.c:2135 [inlined]
jl_apply_generic at /buildworker/worker/package_linux64/build/src/gf.c:2305
abstract_apply at ./compiler/abstractinterpretation.jl:581
abstract_call at ./compiler/abstractinterpretation.jl:637
abstract_call at ./compiler/abstractinterpretation.jl:636
abstract_eval_call at ./compiler/abstractinterpretation.jl:879
abstract_eval at ./compiler/abstractinterpretation.jl:949
typeinf_local at ./compiler/abstractinterpretation.jl:1208
typeinf_nocycle at ./compiler/abstractinterpretation.jl:1264
typeinf at ./compiler/typeinfer.jl:12
typeinf_edge at ./compiler/typeinfer.jl:488
abstract_call_method at ./compiler/abstractinterpretation.jl:396
abstract_call_gf_by_type at ./compiler/abstractinterpretation.jl:93
abstract_call at ./compiler/abstractinterpretation.jl:850
jfptr_abstract_call_606.clone_1 at /usr/lib/julia/sys.so (unknown line)
_jl_invoke at /buildworker/worker/package_linux64/build/src/gf.c:2135 [inlined]
jl_apply_generic at /buildworker/worker/package_linux64/build/src/gf.c:2305
abstract_apply at ./compiler/abstractinterpretation.jl:581
abstract_call at ./compiler/abstractinterpretation.jl:637
abstract_call at ./compiler/abstractinterpretation.jl:636
abstract_eval_call at ./compiler/abstractinterpretation.jl:879
abstract_eval at ./compiler/abstractinterpretation.jl:949
typeinf_local at ./compiler/abstractinterpretation.jl:1208
typeinf_nocycle at ./compiler/abstractinterpretation.jl:1264
typeinf at ./compiler/typeinfer.jl:12
typeinf_edge at ./compiler/typeinfer.jl:488
abstract_call_method at ./compiler/abstractinterpretation.jl:396
abstract_call_gf_by_type at ./compiler/abstractinterpretation.jl:93
abstract_call at ./compiler/abstractinterpretation.jl:850
jfptr_abstract_call_606.clone_1 at /usr/lib/julia/sys.so (unknown line)
_jl_invoke at /buildworker/worker/package_linux64/build/src/gf.c:2135 [inlined]
jl_apply_generic at /buildworker/worker/package_linux64/build/src/gf.c:2305
abstract_apply at ./compiler/abstractinterpretation.jl:581
abstract_call at ./compiler/abstractinterpretation.jl:637
abstract_call at ./compiler/abstractinterpretation.jl:636
abstract_eval_call at ./compiler/abstractinterpretation.jl:879
abstract_eval at ./compiler/abstractinterpretation.jl:949
typeinf_local at ./compiler/abstractinterpretation.jl:1208
typeinf_nocycle at ./compiler/abstractinterpretation.jl:1264
typeinf at ./compiler/typeinfer.jl:12
typeinf_edge at ./compiler/typeinfer.jl:488
abstract_call_method at ./compiler/abstractinterpretation.jl:396
abstract_call_gf_by_type at ./compiler/abstractinterpretation.jl:93
abstract_call at ./compiler/abstractinterpretation.jl:850
jfptr_abstract_call_606.clone_1 at /usr/lib/julia/sys.so (unknown line)
_jl_invoke at /buildworker/worker/package_linux64/build/src/gf.c:2135 [inlined]
jl_apply_generic at /buildworker/worker/package_linux64/build/src/gf.c:2305
abstract_apply at ./compiler/abstractinterpretation.jl:581
abstract_call at ./compiler/abstractinterpretation.jl:637
abstract_call at ./compiler/abstractinterpretation.jl:636
abstract_eval_call at ./compiler/abstractinterpretation.jl:879
abstract_eval at ./compiler/abstractinterpretation.jl:949
typeinf_local at ./compiler/abstractinterpretation.jl:1208
typeinf_nocycle at ./compiler/abstractinterpretation.jl:1264

[pdimens]

Update: This didn't fix the issue, however my data is in the long-format ("tidy"), which circumvented this issue