search

pmp-p / python-wasm-plus

~~sandbox for making Pygame CPython apps on WebAssembly, and also run CPython testsuite in browser~~ use Pygbag instead on https://github.com/pygame-web
https://pmp-p.github.io/python-wasm-plus/python311.html?org.python3.11.0&all
MIT License
14 stars 3 forks source link

CPython failed tests #1

Open pmp-p opened 2 years ago

pmp-p commented 2 years ago

with --enable-test-modules (not browser default )

Those must be excluded because they crash the VM : test_code

those tests are just failing normally:

test_builtin test_argparse test_cgi test_code_module test_dbm_dumb test_distutils test_ensurepip test_fileio test_genericpath test_getpath test_importlib test_inspect test_io test_mailbox test_mailcap test_math test_mimetypes test_multibytecodec test_netrc test_ntpath test_numeric_tower test_os test_pathlib test_pickle test_plistlib test_posix test_posixpath test_profile test_pydoc test_random test_rlcompleter test_sax test_shelve test_shutil test_signal test_stat test_strftime test_strtod test_sunau test_support test_sys test_tarfile test_tempfile test_trace test_traceback test_tracemalloc test_unicode test_unicode_file_functions test_unittest test_univnewlines test_urllib test_wave test_zipapp test_zipfile

those subtests are just failing normally:

test.test_decimal.CWhitebox.test_from_tuple test.test_uu.UUFileTest.test_decode_mode test.test_float.HexFloatTestCase.test_from_hex test.test_capi.SubinterpreterTest.test_module_state_shared_in_global test.test_cmath.CMathTests.test_specific_values

those must be excluded because how the testsuite is run on browser: test.test_sys.SysModuleTest.test_exit test.test_exceptions.ExceptionTests.testRaising test.test_sysconfig.TestSysConfig.test_get_config_h_filename

Those subtests must be excluded because they crash the VM :

test.test_bytes.BytesTest.test_from_format

test.test_decimal.CWhitebox.test_maxcontext_exact_arith => OOM on browser

ctypes.test.test_as_parameter.AsParamPropertyWrapperTestCase.test_byval ctypes.test.test_as_parameter.AsParamPropertyWrapperTestCase.test_callbacks ctypes.test.test_as_parameter.AsParamPropertyWrapperTestCase.test_callbacks_2 ctypes.test.test_as_parameter.AsParamPropertyWrapperTestCase.test_longlong_callbacks ctypes.test.test_as_parameter.AsParamPropertyWrapperTestCase.test_shorts ctypes.test.test_as_parameter.AsParamWrapperTestCase.test_callbacks ctypes.test.test_as_parameter.AsParamWrapperTestCase.test_callbacks_2 ctypes.test.test_as_parameter.AsParamWrapperTestCase.test_longlong_callbacks ctypes.test.test_as_parameter.AsParamWrapperTestCase.test_shorts ctypes.test.test_as_parameter.BasicWrapTestCase.test_callbacks ctypes.test.test_as_parameter.BasicWrapTestCase.test_callbacks_2 ctypes.test.test_as_parameter.BasicWrapTestCase.test_longlong_callbacks ctypes.test.test_as_parameter.BasicWrapTestCase.test_shorts ctypes.test.test_callbacks.Callbacks.test_byte ctypes.test.test_callbacks.Callbacks.test_char ctypes.test.test_callbacks.Callbacks.test_double ctypes.test.test_callbacks.Callbacks.test_float ctypes.test.test_callbacks.Callbacks.test_int ctypes.test.test_callbacks.Callbacks.test_issue12483 ctypes.test.test_callbacks.Callbacks.test_issue_7959 ctypes.test.test_callbacks.Callbacks.test_long ctypes.test.test_callbacks.Callbacks.test_longdouble ctypes.test.test_callbacks.Callbacks.test_longlong ctypes.test.test_callbacks.Callbacks.test_pyobject ctypes.test.test_callbacks.Callbacks.test_short ctypes.test.test_callbacks.Callbacks.test_ubyte ctypes.test.test_callbacks.Callbacks.test_uint ctypes.test.test_callbacks.Callbacks.test_ulong ctypes.test.test_callbacks.Callbacks.test_ulonglong ctypes.test.test_callbacks.Callbacks.test_unsupported_restype_1 ctypes.test.test_callbacks.Callbacks.test_unsupported_restype_2 ctypes.test.test_callbacks.Callbacks.test_ushort ctypes.test.test_callbacks.SampleCallbacksTestCase.test_callback_large_struct ctypes.test.test_callbacks.SampleCallbacksTestCase.test_callback_register_double ctypes.test.test_callbacks.SampleCallbacksTestCase.test_callback_register_int ctypes.test.test_callbacks.SampleCallbacksTestCase.test_callback_too_many_args ctypes.test.test_callbacks.SampleCallbacksTestCase.test_convert_result_error ctypes.test.test_callbacks.SampleCallbacksTestCase.test_integrate ctypes.test.test_callbacks.SampleCallbacksTestCase.test_issue_8959_a ctypes.test.test_frombuffer.Test.test_fortran_contiguous ctypes.test.test_funcptr.CFuncPtrTestCase.test_basic ctypes.test.test_funcptr.CFuncPtrTestCase.test_first ctypes.test.test_funcptr.CFuncPtrTestCase.test_structures ctypes.test.test_functions.FunctionTestCase.test_callbacks ctypes.test.test_functions.FunctionTestCase.test_callbacks_2 ctypes.test.test_functions.FunctionTestCase.test_longlong_callbacks ctypes.test.test_functions.FunctionTestCase.test_sf1651235 ctypes.test.test_functions.FunctionTestCase.test_shorts ctypes.test.test_libc.LibTest.test_qsort ctypes.test.test_pickling.PickleTest_0.test_unpickable ctypes.test.test_pickling.PickleTest_1.test_unpickable ctypes.test.test_pickling.PickleTest_2.test_unpickable ctypes.test.test_pickling.PickleTest_3.test_unpickable ctypes.test.test_pickling.PickleTest_4.test_unpickable ctypes.test.test_pickling.PickleTest_5.test_unpickable ctypes.test.test_pointers.PointersTestCase.test_callbacks_with_pointers ctypes.test.test_prototypes.ArrayTest.test ctypes.test.test_python_api.PythonAPITestCase.test_PyOS_snprintf ctypes.test.test_random_things.CallbackTracbackTestCase.test_FloatDivisionError ctypes.test.test_random_things.CallbackTracbackTestCase.test_IntegerDivisionError ctypes.test.test_random_things.CallbackTracbackTestCase.test_TypeErrorDivisionError ctypes.test.test_random_things.CallbackTracbackTestCase.test_ValueError ctypes.test.test_refcounts.AnotherLeak.test_callback ctypes.test.test_refcounts.RefcountTestCase.test_1 ctypes.test.test_refcounts.RefcountTestCase.test_refcount ctypes.test.test_simplesubclasses.Test.test_ignore_retval ctypes.test.test_simplesubclasses.Test.test_int_callback

pmp-p commented 2 years ago

== Tests result: SUCCESS ==

283 tests OK.

95 tests skipped: test__xxsubinterpreters test_asdl_parser test_asyncgen test_asynchat test_asyncio test_asyncore test_check_c_globals test_clinic test_cmd_line test_concurrent_futures test_contextlib_async test_curses test_dbm_gnu test_dbm_ndbm test_devpoll test_doctest test_docxmlrpc test_embed test_epoll test_faulthandler test_fcntl test_file_eintr test_fork1 test_ftplib test_gdb test_grp test_httplib test_httpservers test_idle test_imaplib test_interpreters test_ioctl test_kqueue test_launcher test_lzma test_mmap test_msilib test_multiprocessing_fork test_multiprocessing_forkserver test_multiprocessing_main_handling test_multiprocessing_spawn test_nis test_openpty test_ossaudiodev test_pdb test_pipes test_poll test_poplib test_pty test_pwd test_readline test_regrtest test_repl test_resource test_select test_selectors test_smtplib test_smtpnet test_socket test_socketserver test_spwd test_ssl test_startfile test_subprocess test_sys_settrace test_syslog test_tcl test_telnetlib test_thread test_threadedtempfile test_threading test_threading_local test_tix test_tk test_tools test_ttk_guionly test_ttk_textonly test_turtle test_urllib2 test_urllib2_localnet test_urllib2net test_urllibnet test_venv test_wait3 test_wait4 test_webbrowser test_winconsoleio test_winreg test_winsound test_wsgiref test_xmlrpc test_xmlrpc_net test_zipfile64 test_zipimport_support test_zoneinfo

Total duration: 1 hour 39 min Tests result: SUCCESS ========== run_tests done ============ Tests total: 434 Failed total: 55 Recent failures: skipped known fails: test_code test_zipfile test_builtin test_argparse test_cgi test_code_module test_dbm_dumb test_distutils test_ensurepip test_fileio test_genericpath test_getpath test_importlib test_inspect test_io test_mailbox test_mailcap test_math test_mimetypes test_multibytecodec test_netrc test_ntpath test_numeric_tower test_os test_pathlib test_pickle test_plistlib test_posix test_posixpath test_profile test_pydoc test_random test_rlcompleter test_sax test_shelve test_shutil test_signal test_stat test_strftime test_strtod test_sunau test_support test_sys test_tarfile test_tempfile test_trace test_traceback test_tracemalloc test_unicode test_unicode_file_functions test_unittest test_univnewlines test_urllib test_wave test_zipapp

tiran commented 2 years ago

with --enable-test-modules (not wasm/wasi default )

FYI, the test modules are disabled only for Emscripten/browser platform. Emscripten/node and WASI have them enabled. I disabled the test modules for browsers to keep the binary as small as possible.

pmp-p commented 2 years ago

too slow test_pickle

too slow or problematic test.test_mimetypes.MimetypesCliTestCase.test_invalid_option test.test_fileio.PyAutoFileTests.testReadintoByteArray

total fail test_argparse test_code_module test_distutils test_ensurepip test_genericpath test_inspect test_mailbox test_mailcap test_posixpath test_pydoc test_shutil

failing test.test_zipapp.ZipAppCmdlineTest.test_info_command

test.test_stat.TestFilemodeCStat.test_directory test.test_stat.TestFilemodeCStat.test_mode test.test_stat.TestFilemodePyStat.test_directory test.test_stat.TestFilemodePyStat.test_mode

test.test_posix.PosixTester.test_dup test.test_posix.TestPosixDirFd.test_readlink_dir_fd test.test_posix.TestPosixDirFd.test_chmod_dir_fd

test.test_pathlib.PathTest.test_chmod_follow_symlinks_true test.test_pathlib.PosixPathTest.test_chmod_follow_symlinks_true test.test_pathlib.PathTest.test_chmod test.test_pathlib.PathTest.test_is_mount test.test_pathlib.PathTest.test_samefile test.test_pathlib.PathTest.test_stat test.test_pathlib.PosixPathTest.test_chmod test.test_pathlib.PosixPathTest.test_is_mount test.test_pathlib.PosixPathTest.test_samefile test.test_pathlib.PosixPathTest.test_stat

test.test_os.TestScandir.test_attributes test.test_os.UtimeTests.test_utime test.test_os.UtimeTests.test_utime_by_indexed test.test_os.UtimeTests.test_utime_by_times test.test_os.UtimeTests.test_utime_dir_fd test.test_os.UtimeTests.test_utime_directory test.test_os.UtimeTests.test_utime_fd

test.test_ntpath.NtCommonTest.test_samefile test.test_ntpath.NtCommonTest.test_samestat

test.test_netrc.NetrcTestCase.test_security

test.test_multibytecodec.Test_IncrementalEncoder.test_subinterp

test.test_io.CIOTest.test_buffered_file_io test.test_io.CIOTest.test_raw_file_io test.test_io.PyIOTest.test_buffered_file_io test.test_io.PyIOTest.test_raw_file_io test.test_io.CBufferedWriterTest.test_truncate test.test_io.PyBufferedWriterTest.test_truncate test.test_io.CBufferedRandomTest.test_truncate test.test_io.PyBufferedRandomTest.test_truncate

test.test_math.MathTests.testLog2Exact test.test_math.MathTests.testRemainder test.test_math.MathTests.test_mtestfile test.test_math.MathTests.test_nextafter test.test_math.MathTests.test_testfile

test.test_getpath.MockGetPathTests.test_registry_win32

test.test_dbm_dumb.DumbDBMTestCase.test_readonly_files test.test_dbm_dumb.DumbDBMTestCase.test_dumbdbm_creation_mode

test.test_cgi.CgiTests.test_log

builtins.float

test.test_numeric_tower.ComparisonTest.test_mixed_comparisons

test.test_tempfile.TestMkdtemp.test_non_directory test.test_tempfile.TestMkstempInner.test_non_directory

test.test_strtod.StrtodTests.test_bigcomp test.test_strtod.StrtodTests.test_boundaries test.test_strtod.StrtodTests.test_parsing test.test_strtod.StrtodTests.test_particular test.test_strtod.StrtodTests.test_underflow_boundary

test.test_random.MersenneTwister_TestBasicOps.test_choices_subnormal test.test_random.SystemRandom_TestBasicOps.test_choices_subnormal

test.test_tarfile.GNUReadTest.test_sparse_file_00 test.test_tarfile.GNUReadTest.test_sparse_file_01 test.test_tarfile.GNUReadTest.test_sparse_file_10 test.test_tarfile.GNUReadTest.test_sparse_file_old test.test_tarfile.MiscReadTest.test_extract_directory test.test_tarfile.MiscReadTest.test_extract_pathlike_name test.test_tarfile.MiscReadTest.test_extractall test.test_tarfile.MiscReadTest.test_extractall_pathlike_name

test.test_mimetypes.MimetypesCliTestCase.test_help_option

test.test_importlib.extension.test_loader.Frozen_LoaderTests.test_is_package test.test_importlib.extension.test_loader.Frozen_LoaderTests.test_load_module_API test.test_importlib.extension.test_loader.Frozen_LoaderTests.test_module test.test_importlib.extension.test_loader.Frozen_LoaderTests.test_module_reuse test.test_importlib.extension.test_loader.Source_LoaderTests.test_is_package test.test_importlib.extension.test_loader.Source_LoaderTests.test_load_module_API test.test_importlib.extension.test_loader.Source_LoaderTests.test_module test.test_importlib.extension.test_loader.Source_LoaderTests.test_module_reuse test.test_importlib.extension.test_finder.Frozen_FinderTests.test_module

unittest.test.test_discovery.TestDiscovery.test_command_line_handling_do_discovery_too_many_arguments unittest.test.test_program.Test_TestProgram.test_Exit unittest.test.test_program.Test_TestProgram.test_ExitAsDefault

test.test_strftime.StrftimeTest.test_strftime

test.test_decimal.CWhitebox.test_from_tuple

test.test_sys.SysModuleTest.test_exit

test.test_exceptions.ExceptionTests.testRaising

test.test_sysconfig.TestSysConfig.test_get_config_h_filename

test.test_uu.UUFileTest.test_decode_mode

test.test_float.HexFloatTestCase.test_from_hex

test.test_capi.SubinterpreterTest.test_module_state_shared_in_global

test.test_cmath.CMathTests.test_specific_values

test.test_zipfile.TestsWithMultipleOpens.test_many_opens test.test_zipfile.EncodedMetadataTests.test_cli_with_metadata_encoding test.test_zipfile.OtherTests.test_comments test.test_zipfile.StoredTestsWithSourceFile.test_add_file_before_1980

OOM 512 MiB ( mobile webiew ) test.test_decimal.CWhitebox.test_maxcontext_exact_arith

crashing!

ctypes.test.test_as_parameter.AsParamPropertyWrapperTestCase.test_byval ctypes.test.test_as_parameter.AsParamPropertyWrapperTestCase.test_callbacks ctypes.test.test_as_parameter.AsParamPropertyWrapperTestCase.test_callbacks_2 ctypes.test.test_as_parameter.AsParamPropertyWrapperTestCase.test_longlong_callbacks ctypes.test.test_as_parameter.AsParamPropertyWrapperTestCase.test_shorts ctypes.test.test_as_parameter.AsParamWrapperTestCase.test_callbacks ctypes.test.test_as_parameter.AsParamWrapperTestCase.test_callbacks_2 ctypes.test.test_as_parameter.AsParamWrapperTestCase.test_longlong_callbacks ctypes.test.test_as_parameter.AsParamWrapperTestCase.test_shorts ctypes.test.test_as_parameter.BasicWrapTestCase.test_callbacks ctypes.test.test_as_parameter.BasicWrapTestCase.test_callbacks_2 ctypes.test.test_as_parameter.BasicWrapTestCase.test_longlong_callbacks ctypes.test.test_as_parameter.BasicWrapTestCase.test_shorts ctypes.test.test_callbacks.Callbacks.test_byte ctypes.test.test_callbacks.Callbacks.test_char ctypes.test.test_callbacks.Callbacks.test_double ctypes.test.test_callbacks.Callbacks.test_float ctypes.test.test_callbacks.Callbacks.test_int ctypes.test.test_callbacks.Callbacks.test_issue12483 ctypes.test.test_callbacks.Callbacks.test_issue_7959 ctypes.test.test_callbacks.Callbacks.test_long ctypes.test.test_callbacks.Callbacks.test_longdouble ctypes.test.test_callbacks.Callbacks.test_longlong ctypes.test.test_callbacks.Callbacks.test_pyobject ctypes.test.test_callbacks.Callbacks.test_short ctypes.test.test_callbacks.Callbacks.test_ubyte ctypes.test.test_callbacks.Callbacks.test_uint ctypes.test.test_callbacks.Callbacks.test_ulong ctypes.test.test_callbacks.Callbacks.test_ulonglong ctypes.test.test_callbacks.Callbacks.test_unsupported_restype_1 ctypes.test.test_callbacks.Callbacks.test_unsupported_restype_2 ctypes.test.test_callbacks.Callbacks.test_ushort ctypes.test.test_callbacks.SampleCallbacksTestCase.test_callback_large_struct ctypes.test.test_callbacks.SampleCallbacksTestCase.test_callback_register_double ctypes.test.test_callbacks.SampleCallbacksTestCase.test_callback_register_int ctypes.test.test_callbacks.SampleCallbacksTestCase.test_callback_too_many_args ctypes.test.test_callbacks.SampleCallbacksTestCase.test_convert_result_error ctypes.test.test_callbacks.SampleCallbacksTestCase.test_integrate ctypes.test.test_callbacks.SampleCallbacksTestCase.test_issue_8959_a ctypes.test.test_frombuffer.Test.test_fortran_contiguous ctypes.test.test_funcptr.CFuncPtrTestCase.test_basic ctypes.test.test_funcptr.CFuncPtrTestCase.test_first ctypes.test.test_funcptr.CFuncPtrTestCase.test_structures ctypes.test.test_functions.FunctionTestCase.test_callbacks ctypes.test.test_functions.FunctionTestCase.test_callbacks_2 ctypes.test.test_functions.FunctionTestCase.test_longlong_callbacks ctypes.test.test_functions.FunctionTestCase.test_sf1651235 ctypes.test.test_functions.FunctionTestCase.test_shorts ctypes.test.test_libc.LibTest.test_qsort ctypes.test.test_pickling.PickleTest_0.test_unpickable ctypes.test.test_pickling.PickleTest_1.test_unpickable ctypes.test.test_pickling.PickleTest_2.test_unpickable ctypes.test.test_pickling.PickleTest_3.test_unpickable ctypes.test.test_pickling.PickleTest_4.test_unpickable ctypes.test.test_pickling.PickleTest_5.test_unpickable ctypes.test.test_pointers.PointersTestCase.test_callbacks_with_pointers ctypes.test.test_prototypes.ArrayTest.test ctypes.test.test_python_api.PythonAPITestCase.test_PyOS_snprintf ctypes.test.test_random_things.CallbackTracbackTestCase.test_FloatDivisionError ctypes.test.test_random_things.CallbackTracbackTestCase.test_IntegerDivisionError ctypes.test.test_random_things.CallbackTracbackTestCase.test_TypeErrorDivisionError ctypes.test.test_random_things.CallbackTracbackTestCase.test_ValueError ctypes.test.test_refcounts.AnotherLeak.test_callback ctypes.test.test_refcounts.RefcountTestCase.test_1 ctypes.test.test_refcounts.RefcountTestCase.test_refcount ctypes.test.test_simplesubclasses.Test.test_ignore_retval ctypes.test.test_simplesubclasses.Test.test_int_callback

pmp-p commented 2 years ago

3.11b1

1 test altered the execution environment: test_os

98 tests skipped: test__xxsubinterpreters test_asdl_parser test_asyncgen test_asynchat test_asyncio test_asyncore test_bz2 test_check_c_globals test_clinic test_cmd_line test_concurrent_futures test_contextlib_async test_curses test_dbm_gnu test_dbm_ndbm test_devpoll test_doctest test_docxmlrpc test_embed test_epoll test_faulthandler test_fcntl test_file_eintr test_fork1 test_ftplib test_gdb test_grp test_gzip test_httplib test_httpservers test_idle test_imaplib test_interpreters test_ioctl test_kqueue test_launcher test_lzma test_mmap test_msilib test_multiprocessing_fork test_multiprocessing_forkserver test_multiprocessing_main_handling test_multiprocessing_spawn test_nis test_openpty test_ossaudiodev test_pdb test_pipes test_poll test_poplib test_pty test_pwd test_readline test_regrtest test_repl test_resource test_select test_selectors test_smtplib test_smtpnet test_socket test_socketserver test_spwd test_ssl test_startfile test_subprocess test_sys_settrace test_syslog test_tcl test_telnetlib test_thread test_threadedtempfile test_threading test_threading_local test_tix test_tk test_tools test_ttk_guionly test_ttk_textonly test_turtle test_urllib2 test_urllib2_localnet test_urllib2net test_urllibnet test_venv test_wait3 test_wait4 test_webbrowser test_winconsoleio test_winreg test_winsound test_wsgiref test_xmlrpc test_xmlrpc_net test_zipfile64 test_zipimport_support test_zlib test_zoneinfo

2 tests run no tests: test_dtrace test_pickle

Total duration: 28 min 12 sec Tests result: SUCCESS ========== run_tests done ============ Tests total: 434 Skipped: 13 test_code test_zipfile test_argparse test_code_module test_distutils test_ensurepip test_genericpath test_inspect test_mailbox test_mailcap test_posixpath test_pydoc test_shutil Failed total: 6 test_builtin test_fileio test_importlib test_posix test_unittest test_urllib

pmp-p commented 2 years ago

3.11b4 ( on firefox)

302 tests OK.

1 test altered the execution environment: test_os

100 tests skipped: test__xxsubinterpreters test_asdl_parser test_asyncgen test_asynchat test_asyncio test_asyncore test_bz2 test_check_c_globals test_clinic test_cmd_line test_concurrent_futures test_contextlib_async test_ctypes test_curses test_dbm_gnu test_dbm_ndbm test_devpoll test_doctest test_docxmlrpc test_dtrace test_embed test_epoll test_faulthandler test_file_eintr test_fork1 test_ftplib test_gdb test_grp test_gzip test_httplib test_httpservers test_idle test_imaplib test_interpreters test_ioctl test_kqueue test_launcher test_lzma test_mmap test_msilib test_multiprocessing_fork test_multiprocessing_forkserver test_multiprocessing_main_handling test_multiprocessing_spawn test_nis test_openpty test_ossaudiodev test_pdb test_pipes test_poll test_poplib test_pty test_pwd test_queue test_readline test_regrtest test_repl test_resource test_select test_selectors test_smtplib test_smtpnet test_socketserver test_spwd test_ssl test_stable_abi_ctypes test_startfile test_subprocess test_sys_settrace test_syslog test_tcl test_telnetlib test_thread test_threadedtempfile test_threading test_tix test_tk test_tools test_ttk_guionly test_ttk_textonly test_turtle test_urllib2 test_urllib2_localnet test_urllib2net test_urllibnet test_venv test_wait3 test_wait4 test_webbrowser test_winconsoleio test_winreg test_winsound test_wsgiref test_xmlrpc test_xmlrpc_net test_xxlimited test_zipfile64 test_zipimport_support test_zlib test_zoneinfo

1 test run no tests: test_pickle

Total duration: 18 min 32 sec Tests result: SUCCESS ========== run_tests done ============ Tests total: 434 Skipped: 13 test_code test_zipfile test_argparse test_code_module test_distutils test_ensurepip test_genericpath test_inspect test_mailbox test_mailcap test_posixpath test_pydoc test_shutil Failed total: 17 test_all test_compileall test_contextlib test_fcntl test_fileio test_genericalias test_http_cookiejar test_imp test_importlib test_logging test_posix test_runpy test_sched test_socket test_threading_local test_unittest test_urllib

sys._emscripten_info(emscripten_version=(3, 1, 17), runtime='Mozilla/5.0 (X11; Linux x86_64; rv:101.0) Gecko/20100101 Firefox/101.0', pthreads=False, shared_memory=False)